-- Logs begin at Sat 2022-10-22 02:23:01 UTC, end at Sat 2022-10-22 04:55:13 UTC. -- Oct 22 02:53:51.010615 n-d-862416-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 22 02:53:51.020491 n-d-862416-2 devstack@n-api.service[104572]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 22 02:53:51 2022] *** Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: nodename: n-d-862416-2 Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: machine: x86_64 Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: clock source: unix Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: pcre jit disabled Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: detected number of CPU cores: 4 Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: current working directory: / Oct 22 02:53:51.022453 n-d-862416-2 devstack@n-api.service[104572]: detected binary path: /usr/bin/uwsgi-core Oct 22 02:53:51.023158 n-d-862416-2 devstack@n-api.service[104572]: your processes number limit is 47680 Oct 22 02:53:51.023158 n-d-862416-2 devstack@n-api.service[104572]: your memory page size is 4096 bytes Oct 22 02:53:51.023158 n-d-862416-2 devstack@n-api.service[104572]: detected max file descriptor number: 2048 Oct 22 02:53:51.023158 n-d-862416-2 devstack@n-api.service[104572]: lock engine: pthread robust mutexes Oct 22 02:53:51.023158 n-d-862416-2 devstack@n-api.service[104572]: thunder lock: enabled Oct 22 02:53:51.023158 n-d-862416-2 devstack@n-api.service[104572]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 22 02:53:51.023158 n-d-862416-2 devstack@n-api.service[104572]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 22 02:53:51.061312 n-d-862416-2 devstack@n-api.service[104572]: Python main interpreter initialized at 0x5649c3b6f9c0 Oct 22 02:53:51.061312 n-d-862416-2 devstack@n-api.service[104572]: python threads support enabled Oct 22 02:53:51.061312 n-d-862416-2 devstack@n-api.service[104572]: your server socket listen backlog is limited to 100 connections Oct 22 02:53:51.061312 n-d-862416-2 devstack@n-api.service[104572]: your mercy for graceful operations on workers is 90 seconds Oct 22 02:53:51.061637 n-d-862416-2 devstack@n-api.service[104572]: mapped 403077 bytes (393 KB) for 2 cores Oct 22 02:53:51.061714 n-d-862416-2 devstack@n-api.service[104572]: *** Operational MODE: preforking *** Oct 22 02:53:51.061968 n-d-862416-2 devstack@n-api.service[104572]: *** uWSGI is running in multiple interpreter mode *** Oct 22 02:53:51.061968 n-d-862416-2 devstack@n-api.service[104572]: spawned uWSGI master process (pid: 104572) Oct 22 02:53:51.062152 n-d-862416-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 22 02:53:51.068243 n-d-862416-2 devstack@n-api.service[104572]: spawned uWSGI worker 1 (pid: 104573, cores: 1) Oct 22 02:53:51.068243 n-d-862416-2 devstack@n-api.service[104572]: spawned uWSGI worker 2 (pid: 104574, cores: 1) Oct 22 02:53:51.068243 n-d-862416-2 devstack@n-api.service[104572]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 22 02:53:51.720453 n-d-862416-2 devstack@n-api.service[104573]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 02:53:51.739789 n-d-862416-2 devstack@n-api.service[104574]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 02:53:52.811443 n-d-862416-2 devstack@n-api.service[104573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 02:53:52.811443 n-d-862416-2 devstack@n-api.service[104573]: from cryptography.utils import int_from_bytes Oct 22 02:53:52.812016 n-d-862416-2 devstack@n-api.service[104573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 02:53:52.812016 n-d-862416-2 devstack@n-api.service[104573]: from cryptography.utils import int_from_bytes Oct 22 02:53:52.839045 n-d-862416-2 devstack@n-api.service[104574]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 02:53:52.839045 n-d-862416-2 devstack@n-api.service[104574]: from cryptography.utils import int_from_bytes Oct 22 02:53:52.839544 n-d-862416-2 devstack@n-api.service[104574]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 02:53:52.839544 n-d-862416-2 devstack@n-api.service[104574]: from cryptography.utils import int_from_bytes Oct 22 02:53:55.314053 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 02:53:55.314628 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 02:53:55.314814 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 02:53:55.315168 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 02:53:55.315420 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 02:53:55.315806 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.316111 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 02:53:55.316493 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.316576 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 02:53:55.316672 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.316763 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.316910 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 02:53:55.317070 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.317269 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 02:53:55.317371 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.317526 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 02:53:55.317681 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.317927 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.318029 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.318233 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.318332 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.318549 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.318642 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.318861 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.318949 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.319182 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862416-2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.319283 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.319489 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.319574 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.319789 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.319875 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.320096 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.320185 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.320438 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.320587 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.320719 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.320843 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.320977 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.321102 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.321302 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862416-2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.321431 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.321622 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.321806 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.321965 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.323116 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.323266 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.323395 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.323520 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.323654 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.323779 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.323903 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.324026 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.324158 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.324319 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.324319 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.324564 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.324701 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.324853 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.324980 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.325113 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.325248 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.325372 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.325501 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.325625 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.325777 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862416-2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.325891 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326013 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326136 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326250 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326383 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326497 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326619 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326619 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326857 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.326991 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.327116 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.327241 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.327362 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862416-2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.327551 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.327715 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.327872 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.327969 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.328178 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.328286 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.329516 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.329637 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.329724 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.329811 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.329907 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.329988 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.330067 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.330146 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.330342 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.330439 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.330649 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.330752 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.330961 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.331056 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.331276 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.331372 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.331578 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.331664 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.331883 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.331970 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.332132 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.332249 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.332466 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.332553 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.332791 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.332902 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.333106 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.333210 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.333412 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.333498 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.333661 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.333746 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.333912 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.334007 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.334230 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.334317 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.334549 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.334639 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.334854 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.334990 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.335160 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.335247 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.335418 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.335526 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.335674 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.335836 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.335992 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.336125 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.336335 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.336486 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.336645 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.336774 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.336948 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.337076 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.337251 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.337462 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.337612 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.337808 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.337945 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.338070 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.338214 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.338340 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.338463 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.338595 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.338720 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.338846 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.339018 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.339148 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.339331 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.339467 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.339653 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.339781 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.339959 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.340088 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.340300 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.340432 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.340619 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.340747 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.340935 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.341062 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.341238 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.341364 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.341542 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.341678 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.341845 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.341973 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.342162 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.342291 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.342728 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.342871 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.343042 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.343168 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.343291 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.343422 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.343577 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.343714 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.343878 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.344014 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.344440 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.344704 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.344849 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.344985 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.345111 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.345235 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.345358 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.345483 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.345635 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.345772 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.345907 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.346034 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.346159 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.346296 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.346431 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.346562 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.346688 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.346812 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.346936 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.347060 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.347198 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.347333 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.347464 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.347597 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.347728 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.347941 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.348085 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.348229 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.348355 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.348479 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.348615 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.348741 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.348928 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.349058 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.349228 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.349364 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.349530 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.349667 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.349831 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.349968 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.350133 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.350260 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.350447 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.350574 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.350749 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.350876 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.351052 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.351181 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.351354 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.351492 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.351658 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.351788 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.351958 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.352086 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.352295 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.352427 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.352600 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.352728 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.352906 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.353035 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.353220 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.353356 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.353518 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.353656 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.353820 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.353961 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.354132 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.354271 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.354435 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.354563 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.354735 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.354868 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.355038 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.355179 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.355340 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.355467 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.355638 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.355765 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.355940 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.356078 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.356262 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.356405 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.356567 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.356697 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.356865 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.356999 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.357180 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.357317 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.357500 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.357630 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.357803 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.357955 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.358145 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.358272 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.358396 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.358521 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.358684 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.358812 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.359001 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.359129 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.359324 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.359465 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.359634 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.359800 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.360083 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.360237 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.360390 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.360532 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.360714 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 02:53:55.360844 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.361049 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.361178 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.361381 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.361525 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.361702 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.361830 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.362030 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.362158 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.362342 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.362480 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.362662 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.362791 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.362977 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.363105 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.363286 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.363424 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.363600 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.363729 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.363928 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.364058 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.364298 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.364449 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.364589 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.364716 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.364867 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.364998 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.365178 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.365314 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.365492 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.365620 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.365815 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.365943 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.366129 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.366257 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.366436 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.366564 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.366750 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.366878 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.367061 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.367193 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.367379 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.367508 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.367703 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.367841 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.368019 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.368157 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.368377 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.368517 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.368644 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.368767 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.368953 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.369083 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.369294 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.369424 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.369607 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.369745 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.369918 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.370055 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.370225 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.370358 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.370534 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.370675 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.370841 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.370969 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.371152 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.371280 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.371461 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.371599 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.371770 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.371899 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.372080 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.372277 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.372417 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.372552 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.372720 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.372849 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.373031 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.373161 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.373341 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.373478 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.373651 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.373780 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.373960 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.374087 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.374266 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.374395 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.374575 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.374703 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.374886 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.375015 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.375196 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.375805 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.376024 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.376147 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.376359 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.376488 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.376676 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.376804 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.376990 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.377119 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.377304 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.377442 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.377618 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.377754 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.377924 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.378053 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.378229 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.378382 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.378573 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.378711 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.378837 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.378962 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.379121 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.379268 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.379441 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.379578 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.379773 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.379901 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.380081 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.380242 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.380431 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.380561 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.380745 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.380875 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.381051 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.381190 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.381375 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.381503 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.381688 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.381819 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.381996 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.382124 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.382310 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.382439 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.382615 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.382741 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.382918 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.383046 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.383237 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.383357 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.383545 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.383673 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.383853 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.383990 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.384163 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.384355 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.384483 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.384615 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.384786 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.384916 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.385108 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.385235 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.385418 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.385554 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.385730 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.385865 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.386046 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.386175 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.386359 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.386488 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.386683 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.386810 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.386994 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.387122 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.387307 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.387513 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.387641 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.387765 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.387889 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.388027 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.388196 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.388347 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.388523 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.388728 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.388857 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.388993 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.389129 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.389262 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.389413 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.389542 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.389719 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.389848 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.390024 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.390162 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.390328 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.390458 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.390632 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.390769 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.390973 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.391616 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.391795 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.391969 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.392090 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.392305 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.392438 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.392615 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.392744 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.392921 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.393050 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.393270 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.393409 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.393579 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.393708 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.393889 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.394016 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.394197 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.394319 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.394502 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.394603 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.394845 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.394942 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.395154 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.395250 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.395468 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.395565 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.395778 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.395884 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.396088 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.396184 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.396441 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.396552 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.396749 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.396848 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.397065 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.397151 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.397372 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.397457 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.397681 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.397781 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.397988 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.398086 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.398297 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.398382 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.398606 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.398701 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.398916 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.399009 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.399218 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.399311 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.399531 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.399625 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.399857 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.399939 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.400303 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.400405 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.400499 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.400592 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.400799 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.400887 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.401114 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.401211 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.401427 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.401513 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.401744 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.401923 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.402066 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.402204 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.402353 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.402493 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.402653 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.402845 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.402999 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.403138 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.403284 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.403424 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.403561 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.403697 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.403878 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.404024 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.404182 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.404350 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.404490 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.404628 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.404765 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.404959 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.405106 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.405244 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.405381 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.405546 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.405686 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.405851 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.405991 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.406137 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.406277 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.406414 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.406779 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.407022 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.407165 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.407303 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.407303 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.407566 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.407704 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.407861 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.408002 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.408139 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.408327 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.408479 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.408627 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.408767 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.408994 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.409142 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.409281 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.409420 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.409566 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.409706 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.409855 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.410001 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.410141 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.410280 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.410427 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.410566 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.410712 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.410850 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.410995 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.411141 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.411323 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.411467 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.411606 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.411755 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.411892 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.412039 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.412179 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.412340 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.412489 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.412628 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.412766 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.412912 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.413051 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.413188 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.413326 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.413463 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.413610 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.413757 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.413895 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.414040 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.414178 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.414316 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.414453 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.414600 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.414739 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.414895 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.415035 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.415173 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.415330 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.415471 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.415609 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.415745 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.415921 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.416068 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.416314 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.416465 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.416604 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.416741 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.416879 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.417024 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.417171 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.417328 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.417468 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.417605 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.417743 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.417880 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.418055 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.418196 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.418334 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.418473 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.418618 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.418766 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.418928 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.419167 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.419322 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.419461 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.419600 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.419746 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.419885 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.420023 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.420159 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.420338 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.420480 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.420632 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.420777 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.420915 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.421053 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.421201 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.421346 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.421493 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.421632 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.421779 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.422084 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.422250 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.422548 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.422696 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.422867 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.423055 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.423200 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.423388 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.423545 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.423738 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.424029 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.424186 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.424388 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.424530 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.424692 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.424848 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.425018 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.425165 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.425326 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.425471 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.425637 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.425785 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.425934 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.426085 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.426224 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.426371 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.426510 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.426648 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.426799 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.426949 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.427089 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.427239 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.427385 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.427534 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.427683 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.427823 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.427970 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.428109 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.428296 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.428445 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.428596 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.428745 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.428884 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.429023 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.429178 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.429395 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.429551 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.429691 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.429836 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.429975 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.430114 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.430261 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.430400 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.430538 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.430689 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.430830 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.430975 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.431125 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.431275 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.431415 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.431552 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.431698 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.431865 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.432019 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.432168 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.432370 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.432511 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.432664 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.432831 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.433015 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.433159 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.433308 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.433447 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.433593 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.433741 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.433880 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.434025 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.434164 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.434310 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.434457 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.434638 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.434790 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.434929 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.435067 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.435221 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.435361 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.435532 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.435679 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.435817 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.435962 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.436128 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.436320 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.436464 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.436611 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.436750 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.436905 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.437054 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.437201 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.437341 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.437479 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.437616 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.437755 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.438442 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.438599 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.438770 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.438938 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.439094 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.439243 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.439401 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.439632 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.439778 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.439915 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.440061 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.440249 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.440479 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.440623 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.440774 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.440913 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.441051 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.441190 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.441337 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.441477 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.441628 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.441767 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.441905 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.442044 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.442191 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.442330 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.442468 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.442608 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.442746 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.442884 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.443031 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.443177 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.443324 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.443483 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.443624 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.443773 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.443912 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.444051 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.444190 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.444353 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.444491 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.444641 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.444790 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.444937 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.445076 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.445215 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.445363 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.445512 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.445651 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.445790 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.445928 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.446066 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.446204 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.446351 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.446491 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.446636 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.446776 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.446950 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.447116 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.447267 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.447406 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.447551 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.447690 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.447829 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.447977 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.448117 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.448299 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.448446 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.448585 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.448730 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.448879 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.449029 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.449176 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.449314 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.449459 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.449616 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.449834 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.449981 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.450127 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.450265 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.450403 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.450549 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.450699 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.450838 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.450999 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.451147 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.451299 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.451446 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.451593 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.451733 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.451871 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.452010 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.452149 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.452323 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.452472 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.452640 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.452797 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.452946 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.453084 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.453259 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.453411 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.454176 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.454332 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.454496 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.454652 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.454799 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.454945 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.455110 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.455265 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.455405 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.455561 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.455707 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.455846 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.456015 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.456162 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.456356 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.456523 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.456673 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.456811 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.456977 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.457124 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.457278 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.457439 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.457592 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.457732 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.457872 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.458017 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.458156 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.458305 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.458468 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.458615 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.458792 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.458937 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.459085 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.459224 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.459374 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.459519 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.459689 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.459852 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.460071 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.460272 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.460420 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.460568 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.460707 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.460845 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.460991 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.461136 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.461275 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.461423 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.461569 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.461708 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.461854 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.461993 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.462131 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.462270 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.462414 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.462563 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.462708 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.462847 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.462984 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.463122 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.463269 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.463417 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.463556 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.463694 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.463832 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.463970 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.464150 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.464329 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.464471 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.464610 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.464755 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.464892 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.465077 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.465230 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.465370 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.465507 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.465683 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.465830 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.465978 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.466116 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.466345 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.466489 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.466653 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.466800 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.466947 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.467097 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.467266 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.467413 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.467824 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.467964 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.468111 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.468282 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.468435 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.468574 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.468754 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.468898 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.469140 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.469444 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.469444 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.470296 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.470441 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.470591 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.470732 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.470879 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.471019 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.471158 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.471296 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.471444 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.471737 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.471885 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.472125 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.472319 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.472456 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.472540 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.472628 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.472716 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.472797 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.472797 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473000 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473083 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473162 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473240 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473318 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473404 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473485 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473626 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.473787 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.474041 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.474131 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.474353 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.474443 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.474657 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.474747 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.475025 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.475122 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.475331 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.475419 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.475645 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.475734 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.475955 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.476042 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.476300 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.476404 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.476623 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.476757 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.476930 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.477026 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.477238 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.477324 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.477540 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.477637 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.477859 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.477952 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.478177 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.478310 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.478484 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.478570 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.478797 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.478885 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.479100 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.479267 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.479422 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.479510 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.479740 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.479828 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.480054 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.480149 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.480400 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.480489 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.480741 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.480899 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.481045 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.481245 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.481342 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.481541 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.481659 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.481853 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.481951 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.482179 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.482266 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.482483 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.482570 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.482788 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.482883 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.483097 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.483184 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.483401 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.483490 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.483700 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.483796 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.484007 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.484103 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.484332 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.484422 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.484645 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.485268 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.485522 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.485616 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.485886 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.485978 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.486194 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.486282 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.486501 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.486595 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.486825 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.486919 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.487132 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.487221 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.487455 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.487543 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.487765 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.487851 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.488068 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.488156 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.488397 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.488486 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.488709 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.488797 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.489028 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.489115 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.489337 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.489422 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.489644 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.489739 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.489948 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.490035 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.490251 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.490338 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.490585 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.490670 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.490888 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.490975 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.491207 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.491304 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.491513 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.491622 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.491833 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.491933 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.492147 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.492257 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.492475 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.492579 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.492776 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.492864 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.493082 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.493170 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.493384 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.493474 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.493685 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.493773 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.493987 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.494083 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.494293 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.494382 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.494600 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.494687 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.494900 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.494988 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.495200 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.495288 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.495504 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.495603 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.495805 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.495891 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.496115 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.496248 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.496441 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.496528 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.496744 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.496867 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.497045 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.497132 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.497343 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.497429 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.497652 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.497746 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.497974 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.498061 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.498284 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.498371 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.498589 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.498687 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.498888 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.498974 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.499191 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.499279 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.499505 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.499600 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.499821 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.499908 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.500133 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.500240 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.501051 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.501151 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.501387 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.501492 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.501701 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.501786 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.502022 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.502121 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.502337 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.502434 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.502649 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.502735 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.502964 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.503058 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.503280 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.503495 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.503582 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.503823 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.503920 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.504138 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.504246 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.504481 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.504569 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.504799 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.504889 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.505113 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.505342 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.505436 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.505672 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.505768 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.505997 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.506084 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.506310 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.506396 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.506615 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.506715 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.506926 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.507012 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.507239 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.507327 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.507553 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.507651 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.507865 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.507953 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.508175 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.508296 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.508511 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.508602 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.508823 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.508917 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.509138 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.509237 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.509463 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.509565 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.509792 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.509879 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.510097 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.510198 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.510408 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.510503 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.510720 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.510807 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.511031 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.511122 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.511342 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.511435 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.511651 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.511738 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.511963 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.512072 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.512298 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.512390 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.512607 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.512695 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.512915 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.513002 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.513223 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.513309 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.513531 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.513616 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.513841 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.513929 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.514154 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.514255 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.514464 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.514564 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.514773 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.514859 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.515080 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.515170 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.515389 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.515489 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.515711 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.515909 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.516136 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.516330 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.516483 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.516666 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.516796 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.516994 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.517111 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.517318 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.517415 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.517637 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.517929 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.518048 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.518244 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.518341 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.518558 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.518654 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.518862 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.518950 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.519172 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.519261 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.519479 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.519568 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.519783 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.519870 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.520103 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.520190 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.520437 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.520525 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.520737 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.520831 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.521049 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.521143 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.521353 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.521447 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.521656 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.521881 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.521968 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.522230 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.522319 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.522547 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.522628 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.522872 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.522958 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.523176 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.523263 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.523499 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.523707 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.523794 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.524054 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.524142 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.524396 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.524486 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.524724 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.524811 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.525039 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.525126 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.525352 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.525439 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.525656 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.525741 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.525957 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.526044 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.526264 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.526358 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.526567 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.526652 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.526868 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.526962 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.527176 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.527270 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.527478 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.527572 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.527782 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.527875 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.528090 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.528183 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.528420 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.528521 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.528722 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.528807 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.529029 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.529115 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.529330 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.529428 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.529631 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.529719 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.529936 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.530022 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.530238 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.530332 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.530541 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.530629 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.530842 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.530927 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.531143 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.531241 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.531443 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.531538 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.531787 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.531875 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.532135 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.532324 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.532479 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.532644 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.532781 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.532950 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.533103 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.533259 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.533406 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.533564 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.533708 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.533873 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.534022 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.534222 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.534333 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.534531 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.534653 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.534835 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.534962 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.535156 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.535271 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.535459 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.535614 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.535760 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.535929 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.536077 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.536415 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.536505 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.536737 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.536835 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.537051 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.537139 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.537360 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.537455 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.537705 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.537802 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.538021 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.538108 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.538329 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.538554 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.538641 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.538889 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.538979 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.539211 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.539306 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.539532 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.539627 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.539842 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.539929 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.540151 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.540253 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.540486 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.540584 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.540790 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.540876 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.541095 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.541181 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.541402 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.541497 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.541709 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.541796 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.542017 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.542102 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.542329 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.542423 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.542626 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.542721 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.542933 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.543022 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.543239 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.543322 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.543543 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.543627 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.543851 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.543939 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.544159 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.544297 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.544492 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.544580 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.544802 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.544901 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.545111 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.545199 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.545419 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.545504 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.545731 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.545824 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.546037 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.546123 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.546349 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.546436 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.546665 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.546764 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.546983 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.547081 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.547823 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.547940 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.548290 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.548383 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.548605 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.548914 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.548999 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.549224 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.549323 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.549544 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.549632 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.549875 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.549963 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.550190 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.550286 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.550495 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.550582 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.550841 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.551158 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.551252 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.551471 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.551563 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.551783 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.551869 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.552102 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.552196 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.552443 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.552532 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.552769 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.552865 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.553092 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.553190 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.553402 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.553487 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.553711 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.553798 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.554019 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.554115 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.554332 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.554419 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.554654 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.554741 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.554970 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.555064 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.555275 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.555369 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.555578 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.555665 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.555881 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.555969 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.556182 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.556286 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.556510 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.556598 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.556813 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.556902 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.557117 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.557204 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.557417 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.557510 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.557718 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.557811 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.558020 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.558105 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.558322 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.558416 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.558622 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.558708 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.558922 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.559014 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.559221 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.559315 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.559525 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.559620 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.559826 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.559911 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.560125 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.560242 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.560451 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.560537 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.560751 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.560836 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.561051 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.561139 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.561348 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.561434 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.561657 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.561744 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.561961 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.562050 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.562262 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.562358 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.562563 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.562650 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.562972 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.563064 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.563305 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.563392 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.563631 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.563730 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.563953 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.564042 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.564336 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.564432 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.564599 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.564695 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.564909 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.564996 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.565230 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.565320 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.565539 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.565635 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.565850 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.565944 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.566160 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.566247 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.566470 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.566564 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.566779 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.566865 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.567106 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.567202 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.567413 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.567513 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.567724 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.567810 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.568033 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.568129 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.568369 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.568462 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.568680 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.568775 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.568989 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.569078 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.569299 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.569386 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.569629 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.569717 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.569931 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.570016 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.570241 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.570367 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.570552 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.570641 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.570865 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.570962 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.571177 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.571265 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.571484 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.571576 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.571794 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.571893 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.572105 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.572192 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.572437 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.572524 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.572749 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.572849 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.573060 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.573142 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.573371 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.573465 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.573684 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.573782 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.573990 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.574076 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.574301 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.574391 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.574617 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.574706 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.574930 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.575017 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.575254 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.575342 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.575577 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.575673 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.575887 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.575982 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.576197 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.576348 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.576524 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.576612 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.576770 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 02:53:55.576884 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.577198 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.577540 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.577867 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.578179 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.579000 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.579303 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 02:53:55.579545 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 02:53:55.731185 n-d-862416-2 devstack@n-api.service[104573]: INFO dbcounter [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Registered counter for database nova_api Oct 22 02:53:55.733444 n-d-862416-2 devstack@n-api.service[104574]: INFO dbcounter [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Registered counter for database nova_api Oct 22 02:53:55.752884 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_db.sqlalchemy.engines [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 02:53:55.754571 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_db.sqlalchemy.engines [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 02:53:55.759529 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writer thread running {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 02:53:55.761105 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writer thread running {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 02:53:55.817333 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.context [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) {{(pid=104573) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 02:53:55.818083 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.context [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) {{(pid=104574) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 02:53:55.821146 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 02:53:55.821615 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 02:53:55.821948 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 02:53:55.822422 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 02:53:55.823199 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 02:53:55.823916 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 02:53:55.824058 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 02:53:55.824395 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 02:53:55.824738 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 02:53:55.825187 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 02:53:55.826370 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 02:53:55.827180 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 02:53:55.828369 n-d-862416-2 devstack@n-api.service[104573]: INFO dbcounter [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Registered counter for database nova_cell0 Oct 22 02:53:55.829709 n-d-862416-2 devstack@n-api.service[104574]: INFO dbcounter [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Registered counter for database nova_cell0 Oct 22 02:53:55.832948 n-d-862416-2 devstack@n-api.service[104573]: INFO dbcounter [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Registered counter for database nova_cell1 Oct 22 02:53:55.833896 n-d-862416-2 devstack@n-api.service[104574]: INFO dbcounter [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Registered counter for database nova_cell1 Oct 22 02:53:55.840099 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_db.sqlalchemy.engines [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 02:53:55.841759 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_db.sqlalchemy.engines [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 02:53:55.843927 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_db.sqlalchemy.engines [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 02:53:55.846299 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_db.sqlalchemy.engines [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 02:53:55.850280 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writer thread running {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 02:53:55.850486 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writer thread running {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 02:53:55.852762 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writer thread running {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 02:53:55.990972 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writer thread running {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 02:53:55.996953 n-d-862416-2 devstack@n-api.service[104574]: INFO dbcounter [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Registered counter for database nova_cell0 Oct 22 02:53:56.001588 n-d-862416-2 devstack@n-api.service[104573]: INFO dbcounter [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Registered counter for database nova_cell0 Oct 22 02:53:56.006276 n-d-862416-2 devstack@n-api.service[104574]: DEBUG oslo_db.sqlalchemy.engines [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 02:53:56.008202 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_db.sqlalchemy.engines [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 02:53:56.011004 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writer thread running {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 02:53:56.012903 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writer thread running {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 02:53:56.354065 n-d-862416-2 devstack@n-api.service[104574]: WARNING keystonemiddleware.auth_token [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 02:53:56.354616 n-d-862416-2 devstack@n-api.service[104573]: WARNING keystonemiddleware.auth_token [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 02:53:56.361947 n-d-862416-2 devstack@n-api.service[104574]: WARNING keystonemiddleware.auth_token [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 02:53:56.362311 n-d-862416-2 devstack@n-api.service[104573]: WARNING keystonemiddleware.auth_token [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 02:53:56.712568 n-d-862416-2 devstack@n-api.service[104574]: WARNING keystonemiddleware.auth_token [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 02:53:56.715486 n-d-862416-2 devstack@n-api.service[104573]: WARNING keystonemiddleware.auth_token [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 02:53:56.718752 n-d-862416-2 devstack@n-api.service[104574]: WARNING keystonemiddleware.auth_token [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 02:53:56.722345 n-d-862416-2 devstack@n-api.service[104573]: WARNING keystonemiddleware.auth_token [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 02:53:56.724991 n-d-862416-2 devstack@n-api.service[104574]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649c3b6f9c0 pid: 104574 (default app) Oct 22 02:53:56.727005 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:53:56.727562 n-d-862416-2 devstack@n-api.service[104573]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649c3b6f9c0 pid: 104573 (default app) Oct 22 02:53:56.728169 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-a04d82e3-6b3a-4225-9bdd-12e54b9e14ab None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001676 Oct 22 02:53:56.728586 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Sat Oct 22 02:53:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:18.031088 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:18.032232 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Oct 22 02:55:18.032718 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:18.043973 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:SELECT=3 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:18.045610 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_cell0:SELECT=3 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:18.046717 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_cell1:SELECT=3 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:18.047989 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:18.903597 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-444c70cd-4a56-4606-a13a-360437b26c94 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:18.938082 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-444c70cd-4a56-4606-a13a-360437b26c94 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.899268 Oct 22 02:55:18.938857 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 02:55:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:21.581718 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:21.582747 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-1515f3fb-8c77-4859-a85f-1daa737d1974 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 22 02:55:21.583436 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:22.010895 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-75c8b4ce-ddad-42fa-9bce-949dd8fbb4d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "vcpus": 1, "id": "c1", "ram": 256, "disk": 1, "rxtx_factor": 1.0}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:22.064235 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-75c8b4ce-ddad-42fa-9bce-949dd8fbb4d0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.474549 Oct 22 02:55:22.066883 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 02:55:22.079576 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:SELECT=3 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:22.080491 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_cell1:SELECT=3 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:22.082552 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_cell0:SELECT=3 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:22.083711 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:22.312733 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-c3a29f10-9026-4dd0-bc02-96d6b4ff3e8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:22.382408 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-c3a29f10-9026-4dd0-bc02-96d6b4ff3e8e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.308549 Oct 22 02:55:22.383009 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Oct 22 02:55:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:25.024463 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-75c8b4ce-ddad-42fa-9bce-949dd8fbb4d0 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:25.025963 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-75c8b4ce-ddad-42fa-9bce-949dd8fbb4d0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Oct 22 02:55:25.026531 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:25.787834 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-d55ff767-feff-419d-b5af-e823a724c0d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:25.833016 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-d55ff767-feff-419d-b5af-e823a724c0d2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.800203 Oct 22 02:55:25.833738 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:55:25.847677 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-5ad64284-1254-479e-93d8-afc1c1b93a99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:25.914119 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-5ad64284-1254-479e-93d8-afc1c1b93a99 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070306 Oct 22 02:55:25.916163 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Oct 22 02:55:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:28.712500 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-d55ff767-feff-419d-b5af-e823a724c0d2 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:28.714209 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-d55ff767-feff-419d-b5af-e823a724c0d2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002261 Oct 22 02:55:28.715118 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:29.258438 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-4d10e70e-97c5-449a-aff0-b6c80407bb50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "disk": 10}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:29.286538 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-4d10e70e-97c5-449a-aff0-b6c80407bb50 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.564356 Oct 22 02:55:29.300406 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 02:55:29.301355 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-b6e8bb2e-1a9c-4f21-be68-0fe7acfab5f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:29.346770 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-b6e8bb2e-1a9c-4f21-be68-0fe7acfab5f6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050236 Oct 22 02:55:29.358640 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Oct 22 02:55:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 02:55:32.144674 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-4d10e70e-97c5-449a-aff0-b6c80407bb50 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:32.145680 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-4d10e70e-97c5-449a-aff0-b6c80407bb50 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 22 02:55:32.146082 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:32.625658 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-ea001429-c074-45f4-bf10-a533356e897a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "ram": 2048, "id": "d3"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:32.662501 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-ea001429-c074-45f4-bf10-a533356e897a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510446 Oct 22 02:55:32.663541 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:55:32.677486 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-c64bcc55-ad06-4002-b3b6-3e94dac6d012 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:32.710507 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-c64bcc55-ad06-4002-b3b6-3e94dac6d012 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036605 Oct 22 02:55:32.711320 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Oct 22 02:55:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:35.430045 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-ea001429-c074-45f4-bf10-a533356e897a admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:35.431165 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-ea001429-c074-45f4-bf10-a533356e897a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 22 02:55:35.431845 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:35.890480 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-98e897a4-72a4-4285-8aaf-2871a44e17b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "name": "ds4G", "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:35.915155 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-98e897a4-72a4-4285-8aaf-2871a44e17b1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476105 Oct 22 02:55:35.916194 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:55:35.928940 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-399af7eb-cc94-4db4-8c8a-1d33322cb7a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:35.963595 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-399af7eb-cc94-4db4-8c8a-1d33322cb7a6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038203 Oct 22 02:55:35.982214 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Oct 22 02:55:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:38.619229 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-98e897a4-72a4-4285-8aaf-2871a44e17b1 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:38.620296 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-98e897a4-72a4-4285-8aaf-2871a44e17b1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 22 02:55:38.620673 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:39.099289 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-b192ae0b-1b7c-4eef-8b74-2b2c75a2dde2 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:39.124463 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-b192ae0b-1b7c-4eef-8b74-2b2c75a2dde2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.497305 Oct 22 02:55:39.125002 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 02:55:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 02:55:41.708944 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-98e897a4-72a4-4285-8aaf-2871a44e17b1 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:41.709954 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-98e897a4-72a4-4285-8aaf-2871a44e17b1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 22 02:55:41.710362 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:42.163027 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-1fe294bc-7045-4081-8988-6531823a04ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:42.186409 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-1fe294bc-7045-4081-8988-6531823a04ab admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468095 Oct 22 02:55:42.186409 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 02:55:42.200100 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-f1180ed7-bf9f-4063-93f3-386722b8d89e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:42.234887 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-f1180ed7-bf9f-4063-93f3-386722b8d89e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039620 Oct 22 02:55:42.235673 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Oct 22 02:55:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:45.036738 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-1fe294bc-7045-4081-8988-6531823a04ab admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:45.037648 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-1fe294bc-7045-4081-8988-6531823a04ab admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Oct 22 02:55:45.038052 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:45.445241 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-c7ab7ab4-e963-4814-9c8c-66b489c18456 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:45.465274 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-c7ab7ab4-e963-4814-9c8c-66b489c18456 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419430 Oct 22 02:55:45.465948 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:55:45.478456 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-4a803891-b01b-4a3d-bf1d-66965d5737b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:45.511099 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-4a803891-b01b-4a3d-bf1d-66965d5737b3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036302 Oct 22 02:55:45.511832 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Oct 22 02:55:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:48.098623 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-c7ab7ab4-e963-4814-9c8c-66b489c18456 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:48.099626 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-c7ab7ab4-e963-4814-9c8c-66b489c18456 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 22 02:55:48.100036 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 02:55:48.529396 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-cc845014-51e4-4ca1-aa6d-2b692e6fef0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "disk": 40, "name": "m1.medium"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:48.551648 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-cc845014-51e4-4ca1-aa6d-2b692e6fef0d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.445639 Oct 22 02:55:48.552198 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:55:48.563984 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-4826f42a-e61f-4c01-a0c0-f25d70ce45e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:48.569757 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:48.592418 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-4826f42a-e61f-4c01-a0c0-f25d70ce45e3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032009 Oct 22 02:55:48.593087 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Oct 22 02:55:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:51.274365 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-cc845014-51e4-4ca1-aa6d-2b692e6fef0d admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:51.276007 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-cc845014-51e4-4ca1-aa6d-2b692e6fef0d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 Oct 22 02:55:51.277631 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:51.744975 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-8624d4a4-402e-49ff-9c60-e35cb7a3cdf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "vcpus": 4, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:51.764726 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-8624d4a4-402e-49ff-9c60-e35cb7a3cdf8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.481745 Oct 22 02:55:51.772230 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:55:51.777177 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-b42eb935-72e9-4e84-806b-708aad28c5a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:51.803622 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-b42eb935-72e9-4e84-806b-708aad28c5a3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030068 Oct 22 02:55:51.804237 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Oct 22 02:55:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:55:54.439333 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-8624d4a4-402e-49ff-9c60-e35cb7a3cdf8 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:55:54.440497 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-8624d4a4-402e-49ff-9c60-e35cb7a3cdf8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Oct 22 02:55:54.441064 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:55:54.890677 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-c4b8daa6-8530-4bcf-9a65-efe0e6fbf328 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:54.899882 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:55:54.916333 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-c4b8daa6-8530-4bcf-9a65-efe0e6fbf328 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.468842 Oct 22 02:55:54.917302 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Oct 22 02:55:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:55:54.929633 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-8b00c440-39de-4d18-9b4f-c5c54b115e22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:55:54.964681 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-8b00c440-39de-4d18-9b4f-c5c54b115e22 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038608 Oct 22 02:55:54.965265 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Oct 22 02:55:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:56:16.206500 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-c4b8daa6-8530-4bcf-9a65-efe0e6fbf328 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:16.207550 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-c4b8daa6-8530-4bcf-9a65-efe0e6fbf328 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 22 02:56:16.207955 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:56:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:16.219251 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:56:16.595307 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-6621d205-b0b6-492a-b8be-eeddca39f273 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:16.613753 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-6621d205-b0b6-492a-b8be-eeddca39f273 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399788 Oct 22 02:56:16.614278 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 02:56:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 02:56:17.917441 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-c4b8daa6-8530-4bcf-9a65-efe0e6fbf328 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:17.918579 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-c4b8daa6-8530-4bcf-9a65-efe0e6fbf328 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Oct 22 02:56:17.918976 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 02:56:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:18.446821 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-6ce3322a-f0fb-4e16-b66c-0cad7f797e7a admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:18.452453 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.wsgi [None req-6ce3322a-f0fb-4e16-b66c-0cad7f797e7a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-6ce3322a-f0fb-4e16-b66c-0cad7f797e7a admin admin] Request method failure captured: Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: Accept: application/json Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: Accept-Encoding: gzip, deflate Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: Connection: keep-alive Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: Content-Length: 0 Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: Host: 10.222.0.25 Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: Openstack-Api-Version: compute 2.92 Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: Openstack-System-Scope: None Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: User-Agent: python-novaclient Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Auth-Token: gAAAAABjU1vRfxRhb7R7nK3uZW8GR9cfJJMdLAdu_MDq6Yp_k7XHJn-OvqjOiPCtgJjKDlgDJ5AH5Ln_HD2P9pujnBOCws4uYObJm_kTduvlUP7jvlnoqQeyUu6VvjWxvHL-dqZdIJyRYd5dZlgThZFdCduw0tFPpUUpNok01Jw74CsH_O2VVaQ Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Domain-Id: None Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Domain-Name: None Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Identity-Status: Confirmed Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Is-Admin-Project: True Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Domain-Id: default Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Domain-Name: Default Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Name: admin Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Role: admin,member,reader Oct 22 02:56:18.455630 n-d-862416-2 devstack@n-api.service[104574]: X-Roles: admin,member,reader Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f105d331924ccd82d940842bb35759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f105d331924ccd82d940842bb35759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}] Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant: admin Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant-Name: admin Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-User: admin Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-User-Domain-Id: default Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-User-Domain-Name: Default Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-User-Id: afba9fa4b0424d44a4a81ddca24bbfb7 Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: X-User-Name: admin Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: method: > Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: exception: Flavor 42 could not be found. Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: action_args: {'id': '42'} Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 02:56:18.457378 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:18.458389 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.459797 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-6ce3322a-f0fb-4e16-b66c-0cad7f797e7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 02:56:18.461116 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-6ce3322a-f0fb-4e16-b66c-0cad7f797e7a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391207 Oct 22 02:56:18.461116 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Sat Oct 22 02:56:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 02:56:18.467428 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-6645bd49-3508-4a44-b1a1-67bf25946379 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:18.491373 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-6645bd49-3508-4a44-b1a1-67bf25946379 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028039 Oct 22 02:56:18.491922 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Oct 22 02:56:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 02:56:18.512365 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-756e5a8a-3ab6-41e7-b5c0-b0dcaab5e3dc admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:18.534772 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-756e5a8a-3ab6-41e7-b5c0-b0dcaab5e3dc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026929 Oct 22 02:56:18.535317 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Oct 22 02:56:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 02:56:18.545301 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-2cc9b771-30f3-40a4-8c70-38f3e34b8004 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:18.550752 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.wsgi [None req-2cc9b771-30f3-40a4-8c70-38f3e34b8004 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-2cc9b771-30f3-40a4-8c70-38f3e34b8004 admin admin] Request method failure captured: Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: Accept: application/json Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: Accept-Encoding: gzip, deflate Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: Connection: keep-alive Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: Content-Length: 0 Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: Host: 10.222.0.25 Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: Openstack-Api-Version: compute 2.92 Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: Openstack-System-Scope: None Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: User-Agent: python-novaclient Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Auth-Token: gAAAAABjU1vRfxRhb7R7nK3uZW8GR9cfJJMdLAdu_MDq6Yp_k7XHJn-OvqjOiPCtgJjKDlgDJ5AH5Ln_HD2P9pujnBOCws4uYObJm_kTduvlUP7jvlnoqQeyUu6VvjWxvHL-dqZdIJyRYd5dZlgThZFdCduw0tFPpUUpNok01Jw74CsH_O2VVaQ Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Domain-Id: None Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Domain-Name: None Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Identity-Status: Confirmed Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Is-Admin-Project: True Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Domain-Id: default Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Domain-Name: Default Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Name: admin Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Role: admin,member,reader Oct 22 02:56:18.554024 n-d-862416-2 devstack@n-api.service[104573]: X-Roles: admin,member,reader Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f105d331924ccd82d940842bb35759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f105d331924ccd82d940842bb35759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}] Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant: admin Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant-Name: admin Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-User: admin Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-User-Domain-Id: default Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-User-Domain-Name: Default Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-User-Id: afba9fa4b0424d44a4a81ddca24bbfb7 Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: X-User-Name: admin Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: method: > Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: exception: Flavor 42 could not be found. Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: action_args: {'id': '42'} Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 02:56:18.555603 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:18.556647 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:18.557931 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-2cc9b771-30f3-40a4-8c70-38f3e34b8004 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 02:56:18.559274 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-2cc9b771-30f3-40a4-8c70-38f3e34b8004 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014369 Oct 22 02:56:18.559274 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Sat Oct 22 02:56:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 02:56:19.767715 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-756e5a8a-3ab6-41e7-b5c0-b0dcaab5e3dc admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:19.768739 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-756e5a8a-3ab6-41e7-b5c0-b0dcaab5e3dc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 22 02:56:19.769132 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 02:56:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:20.288073 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-a879a968-f2a9-4732-916d-de057904cd6d admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:20.293068 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.wsgi [None req-a879a968-f2a9-4732-916d-de057904cd6d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-a879a968-f2a9-4732-916d-de057904cd6d admin admin] Request method failure captured: Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: Accept: application/json Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: Accept-Encoding: gzip, deflate Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: Connection: keep-alive Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: Content-Length: 0 Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: Host: 10.222.0.25 Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: Openstack-Api-Version: compute 2.92 Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: Openstack-System-Scope: None Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: User-Agent: python-novaclient Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Auth-Token: gAAAAABjU1vTwlHnnH-7EGdc2lbYG6YOK26gGNT-omB_K1q10nnSNdAyOF-nOx0equBHMi8Ystl_aqVl58_ajpnNsPazzuDau0Aos6fIA7RfC4pkOPx15FtE1onK-eGpEltovbKSfcwgJAO3GvxXGBY-5IllRHGDyKKXUV8o49eLIREaTLNH4GA Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Domain-Id: None Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Domain-Name: None Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Identity-Status: Confirmed Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Is-Admin-Project: True Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Domain-Id: default Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Domain-Name: Default Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Name: admin Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Role: admin,member,reader Oct 22 02:56:20.294587 n-d-862416-2 devstack@n-api.service[104573]: X-Roles: admin,member,reader Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f105d331924ccd82d940842bb35759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f105d331924ccd82d940842bb35759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}] Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant: admin Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant-Name: admin Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-User: admin Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-User-Domain-Id: default Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-User-Domain-Name: Default Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-User-Id: afba9fa4b0424d44a4a81ddca24bbfb7 Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: X-User-Name: admin Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: method: > Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: exception: Flavor 84 could not be found. Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: action_args: {'id': '84'} Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 02:56:20.296241 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:20.297149 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.298522 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-a879a968-f2a9-4732-916d-de057904cd6d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 02:56:20.299922 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-a879a968-f2a9-4732-916d-de057904cd6d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391816 Oct 22 02:56:20.299922 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Sat Oct 22 02:56:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 02:56:20.305703 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-7ba2ba0f-0f81-4739-ab67-84ff79e0fc56 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:20.321151 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-7ba2ba0f-0f81-4739-ab67-84ff79e0fc56 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018964 Oct 22 02:56:20.321667 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Oct 22 02:56:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 02:56:20.331586 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-080196ea-e07f-4505-8301-6f26928fcca3 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:20.347828 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-080196ea-e07f-4505-8301-6f26928fcca3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019717 Oct 22 02:56:20.348411 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Oct 22 02:56:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 02:56:20.358613 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-89c18918-705f-48ec-912c-afae5d804724 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:20.363693 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.wsgi [None req-89c18918-705f-48ec-912c-afae5d804724 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-89c18918-705f-48ec-912c-afae5d804724 admin admin] Request method failure captured: Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: Accept: application/json Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: Accept-Encoding: gzip, deflate Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: Connection: keep-alive Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: Content-Length: 0 Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: Host: 10.222.0.25 Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: Openstack-Api-Version: compute 2.92 Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: Openstack-System-Scope: None Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: User-Agent: python-novaclient Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Auth-Token: gAAAAABjU1vTwlHnnH-7EGdc2lbYG6YOK26gGNT-omB_K1q10nnSNdAyOF-nOx0equBHMi8Ystl_aqVl58_ajpnNsPazzuDau0Aos6fIA7RfC4pkOPx15FtE1onK-eGpEltovbKSfcwgJAO3GvxXGBY-5IllRHGDyKKXUV8o49eLIREaTLNH4GA Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Domain-Id: None Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Domain-Name: None Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Identity-Status: Confirmed Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Is-Admin-Project: True Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Domain-Id: default Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Domain-Name: Default Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Name: admin Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Role: admin,member,reader Oct 22 02:56:20.365213 n-d-862416-2 devstack@n-api.service[104574]: X-Roles: admin,member,reader Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f105d331924ccd82d940842bb35759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f105d331924ccd82d940842bb35759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}] Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant: admin Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant-Name: admin Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-User: admin Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-User-Domain-Id: default Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-User-Domain-Name: Default Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-User-Id: afba9fa4b0424d44a4a81ddca24bbfb7 Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: X-User-Name: admin Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: method: > Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: exception: Flavor 84 could not be found. Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: action_args: {'id': '84'} Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 02:56:20.366829 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:20.367721 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:20.368885 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-89c18918-705f-48ec-912c-afae5d804724 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 02:56:20.369907 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-89c18918-705f-48ec-912c-afae5d804724 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012619 Oct 22 02:56:20.369907 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Sat Oct 22 02:56:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 02:56:21.574268 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-080196ea-e07f-4505-8301-6f26928fcca3 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:21.575277 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-080196ea-e07f-4505-8301-6f26928fcca3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 22 02:56:21.575673 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 02:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:22.093908 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-07d6d769-b838-4ad2-9185-55259940dd7d admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:22.099587 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.wsgi [None req-07d6d769-b838-4ad2-9185-55259940dd7d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-07d6d769-b838-4ad2-9185-55259940dd7d admin admin] Request method failure captured: Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: Accept: application/json Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: Accept-Encoding: gzip, deflate Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: Connection: keep-alive Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: Content-Length: 0 Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: Host: 10.222.0.25 Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: Openstack-Api-Version: compute 2.92 Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: Openstack-System-Scope: None Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: User-Agent: python-novaclient Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Auth-Token: gAAAAABjU1vVZCf1ugCPa6VXaV-ALw2z9sT1ODDodhhnPViaN0jbq9py71iL8dBkrzwjx5WYYeN4sqg0p8-QPKgXnaujtFCmPJ4vcZoh16d7t8fsh6CNfIiczw3EW0P-PtJpbYakzX6DTHFF68hJoztTWjpL6QqBj6iIiI02LOtjzJ74UP8nhX0 Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Domain-Id: None Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Domain-Name: None Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Identity-Status: Confirmed Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Is-Admin-Project: True Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Domain-Id: default Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Domain-Name: Default Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Project-Name: admin Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Role: admin,member,reader Oct 22 02:56:22.101108 n-d-862416-2 devstack@n-api.service[104574]: X-Roles: admin,member,reader Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f105d331924ccd82d940842bb35759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f105d331924ccd82d940842bb35759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}] Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant: admin Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-Tenant-Name: admin Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-User: admin Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-User-Domain-Id: default Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-User-Domain-Name: Default Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-User-Id: afba9fa4b0424d44a4a81ddca24bbfb7 Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: X-User-Name: admin Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: method: > Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: exception: Flavor 451 could not be found. Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: action_args: {'id': '451'} Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 02:56:22.102700 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:22.103680 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.105083 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-07d6d769-b838-4ad2-9185-55259940dd7d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 02:56:22.106400 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-07d6d769-b838-4ad2-9185-55259940dd7d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389462 Oct 22 02:56:22.106400 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Oct 22 02:56:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 02:56:22.113022 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-5b47a4ec-306a-43ff-9d9b-c44574645aa8 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:22.127881 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-5b47a4ec-306a-43ff-9d9b-c44574645aa8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018413 Oct 22 02:56:22.128467 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Oct 22 02:56:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 02:56:22.137806 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:22.152564 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018248 Oct 22 02:56:22.153081 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Oct 22 02:56:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 02:56:22.162543 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-46863ec2-bd0c-4398-a9f6-2b867f7784eb admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:22.167456 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.wsgi [None req-46863ec2-bd0c-4398-a9f6-2b867f7784eb admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-46863ec2-bd0c-4398-a9f6-2b867f7784eb admin admin] Request method failure captured: Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: Accept: application/json Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: Accept-Encoding: gzip, deflate Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: Connection: keep-alive Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: Content-Length: 0 Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: Host: 10.222.0.25 Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: Openstack-Api-Version: compute 2.92 Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: Openstack-System-Scope: None Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: User-Agent: python-novaclient Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Auth-Token: gAAAAABjU1vVZCf1ugCPa6VXaV-ALw2z9sT1ODDodhhnPViaN0jbq9py71iL8dBkrzwjx5WYYeN4sqg0p8-QPKgXnaujtFCmPJ4vcZoh16d7t8fsh6CNfIiczw3EW0P-PtJpbYakzX6DTHFF68hJoztTWjpL6QqBj6iIiI02LOtjzJ74UP8nhX0 Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Domain-Id: None Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Domain-Name: None Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Identity-Status: Confirmed Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Is-Admin-Project: True Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Openstack-Nova-Api-Version: 2.92 Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Domain-Id: default Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Domain-Name: Default Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Project-Name: admin Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Role: admin,member,reader Oct 22 02:56:22.168999 n-d-862416-2 devstack@n-api.service[104573]: X-Roles: admin,member,reader Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f105d331924ccd82d940842bb35759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f105d331924ccd82d940842bb35759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f105d331924ccd82d940842bb35759"}]}] Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant: admin Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant-Id: 83f105d331924ccd82d940842bb35759 Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-Tenant-Name: admin Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-User: admin Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-User-Domain-Id: default Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-User-Domain-Name: Default Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-User-Id: afba9fa4b0424d44a4a81ddca24bbfb7 Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: X-User-Name: admin Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: method: > Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: exception: Flavor 451 could not be found. Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: action_args: {'id': '451'} Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 02:56:22.171291 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:22.173006 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 22 02:56:22.174438 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-46863ec2-bd0c-4398-a9f6-2b867f7784eb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 02:56:22.176011 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-46863ec2-bd0c-4398-a9f6-2b867f7784eb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011816 Oct 22 02:56:22.176011 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Oct 22 02:56:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 22 02:56:23.412956 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:23.413955 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 22 02:56:23.414344 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 02:56:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:23.930325 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-921b4817-6c46-4b10-ae9a-134adcb5e6eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:56:23.949999 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-921b4817-6c46-4b10-ae9a-134adcb5e6eb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398264 Oct 22 02:56:23.950539 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Sat Oct 22 02:56:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:56:25.177838 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:25.178828 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 22 02:56:25.179218 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 02:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:25.699750 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-a183310b-5391-4915-b17f-b093f686bc7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:56:25.718245 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-a183310b-5391-4915-b17f-b093f686bc7e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.402538 Oct 22 02:56:25.718791 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Sat Oct 22 02:56:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:56:26.931018 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:26.932091 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Oct 22 02:56:26.932532 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 02:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:27.457314 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-577e92f6-7379-44a3-8727-6e32cb694e0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:56:27.476922 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-577e92f6-7379-44a3-8727-6e32cb694e0d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.403948 Oct 22 02:56:27.477467 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Sat Oct 22 02:56:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 02:56:28.688898 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:28.689922 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 22 02:56:28.690309 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 02:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:29.207710 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-53f7f6c2-25f5-4985-a4b0-0ea82869c9f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 02:56:29.226291 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-53f7f6c2-25f5-4985-a4b0-0ea82869c9f8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398634 Oct 22 02:56:29.226842 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Sat Oct 22 02:56:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 02:56:30.440958 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:30.441963 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 22 02:56:30.442364 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 02:56:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:56:30.960023 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-b6e9dda7-75be-4d11-a965-d82f1a626416 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:56:30.981345 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-b6e9dda7-75be-4d11-a965-d82f1a626416 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402364 Oct 22 02:56:30.981932 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Sat Oct 22 02:56:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 02:57:27.624477 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:57:27.625430 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-955b17a7-446d-4e09-8dbc-9b33d7a3631c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Oct 22 02:57:27.625827 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Sat Oct 22 02:57:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 02:57:27.636443 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:57:28.018722 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-eb333e8f-7aa9-4613-a2dd-081b7c530849 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:57:28.039243 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-eb333e8f-7aa9-4613-a2dd-081b7c530849 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407370 Oct 22 02:57:28.039774 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 02:57:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 02:57:28.062155 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:SELECT=14 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 02:57:28.065970 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-c730e5a8-0740-496c-ad2a-a74eb7f433c6 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:57:28.073298 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-c730e5a8-0740-496c-ad2a-a74eb7f433c6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013199 Oct 22 02:57:28.073820 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Sat Oct 22 02:57:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:57:28.085296 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-8eac61e1-65f5-45cb-9ead-471454064c91 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:57:28.092991 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-8eac61e1-65f5-45cb-9ead-471454064c91 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011328 Oct 22 02:57:28.093507 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Sat Oct 22 02:57:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:57:28.104773 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-e4cf7151-6e36-49b7-bb53-791ac988b1ae admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:57:28.112512 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-e4cf7151-6e36-49b7-bb53-791ac988b1ae admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011178 Oct 22 02:57:28.113056 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Sat Oct 22 02:57:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 02:57:28.124651 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-6830f503-8f1f-4821-b36a-682a120b8c7f admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 02:57:28.131756 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-6830f503-8f1f-4821-b36a-682a120b8c7f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011292 Oct 22 02:57:28.132301 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Sat Oct 22 02:57:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:02:55.102659 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-e4cf7151-6e36-49b7-bb53-791ac988b1ae admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:02:55.103649 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-e4cf7151-6e36-49b7-bb53-791ac988b1ae admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 22 03:02:55.104037 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 03:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:02:55.241631 n-d-862416-2 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:SELECT=6 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:02:55.383686 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-76b51fed-5849-4b70-9d16-d2d57d961457 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:02:55.388424 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-76b51fed-5849-4b70-9d16-d2d57d961457 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:02:55.388899 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-76b51fed-5849-4b70-9d16-d2d57d961457 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:02:55.389326 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-76b51fed-5849-4b70-9d16-d2d57d961457 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:02:55.390044 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-76b51fed-5849-4b70-9d16-d2d57d961457 admin admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:02:55.390487 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-76b51fed-5849-4b70-9d16-d2d57d961457 admin admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:02:55.390901 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-76b51fed-5849-4b70-9d16-d2d57d961457 admin admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:02:55.430425 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-76b51fed-5849-4b70-9d16-d2d57d961457 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.190055 Oct 22 03:02:55.430980 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Oct 22 03:02:55 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:02:56.506956 n-d-862416-2 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-e4cf7151-6e36-49b7-bb53-791ac988b1ae admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:02:56.507978 n-d-862416-2 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-e4cf7151-6e36-49b7-bb53-791ac988b1ae admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 22 03:02:56.508386 n-d-862416-2 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Oct 22 03:02:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:02:56.698810 n-d-862416-2 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-de3fbaef-c48a-46d6-9660-f2e7a8091b7d admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:02:56.702282 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-de3fbaef-c48a-46d6-9660-f2e7a8091b7d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:02:56.702787 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-de3fbaef-c48a-46d6-9660-f2e7a8091b7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:02:56.703212 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-de3fbaef-c48a-46d6-9660-f2e7a8091b7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:02:56.705124 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-de3fbaef-c48a-46d6-9660-f2e7a8091b7d admin admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:02:56.705599 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-de3fbaef-c48a-46d6-9660-f2e7a8091b7d admin admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:02:56.706012 n-d-862416-2 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-de3fbaef-c48a-46d6-9660-f2e7a8091b7d admin admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:02:56.728883 n-d-862416-2 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-de3fbaef-c48a-46d6-9660-f2e7a8091b7d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.081043 Oct 22 03:02:56.729417 n-d-862416-2 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Oct 22 03:02:56 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:03:41.207184 n-d-862416-2 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 22 03:03:41.207759 n-d-862416-2 devstack@n-api.service[104572]: Sat Oct 22 03:03:41 2022 - graceful shutdown triggered... Oct 22 03:03:41.208239 n-d-862416-2 devstack@n-api.service[104573]: Gracefully killing worker 1 (pid: 104573)... Oct 22 03:03:41.209083 n-d-862416-2 devstack@n-api.service[104574]: Gracefully killing worker 2 (pid: 104574)... Oct 22 03:03:41.335775 n-d-862416-2 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:SELECT=4 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:03:42.207844 n-d-862416-2 devstack@n-api.service[104572]: worker 1 buried after 1 seconds Oct 22 03:03:42.208317 n-d-862416-2 devstack@n-api.service[104572]: worker 2 buried after 1 seconds Oct 22 03:03:42.208317 n-d-862416-2 devstack@n-api.service[104572]: goodbye to uWSGI. Oct 22 03:03:42.209434 n-d-862416-2 systemd[1]: devstack@n-api.service: Succeeded. Oct 22 03:03:42.209995 n-d-862416-2 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 22 03:03:42.212784 n-d-862416-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 22 03:03:42.234244 n-d-862416-2 devstack@n-api.service[120568]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 22 03:03:42 2022] *** Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: nodename: n-d-862416-2 Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: machine: x86_64 Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: clock source: unix Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: pcre jit disabled Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: detected number of CPU cores: 4 Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: current working directory: / Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: detected binary path: /usr/bin/uwsgi-core Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: your processes number limit is 47680 Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: your memory page size is 4096 bytes Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: detected max file descriptor number: 2048 Oct 22 03:03:42.255614 n-d-862416-2 devstack@n-api.service[120568]: lock engine: pthread robust mutexes Oct 22 03:03:42.256910 n-d-862416-2 devstack@n-api.service[120568]: thunder lock: enabled Oct 22 03:03:42.256910 n-d-862416-2 devstack@n-api.service[120568]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 22 03:03:42.256910 n-d-862416-2 devstack@n-api.service[120568]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 22 03:03:42.295072 n-d-862416-2 devstack@n-api.service[120568]: Python main interpreter initialized at 0x5570d9f419c0 Oct 22 03:03:42.295072 n-d-862416-2 devstack@n-api.service[120568]: python threads support enabled Oct 22 03:03:42.295072 n-d-862416-2 devstack@n-api.service[120568]: your server socket listen backlog is limited to 100 connections Oct 22 03:03:42.295072 n-d-862416-2 devstack@n-api.service[120568]: your mercy for graceful operations on workers is 90 seconds Oct 22 03:03:42.295472 n-d-862416-2 devstack@n-api.service[120568]: mapped 403077 bytes (393 KB) for 2 cores Oct 22 03:03:42.295472 n-d-862416-2 devstack@n-api.service[120568]: *** Operational MODE: preforking *** Oct 22 03:03:42.295734 n-d-862416-2 devstack@n-api.service[120568]: *** uWSGI is running in multiple interpreter mode *** Oct 22 03:03:42.295734 n-d-862416-2 devstack@n-api.service[120568]: spawned uWSGI master process (pid: 120568) Oct 22 03:03:42.295944 n-d-862416-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 22 03:03:42.296662 n-d-862416-2 devstack@n-api.service[120568]: spawned uWSGI worker 1 (pid: 120581, cores: 1) Oct 22 03:03:42.298792 n-d-862416-2 devstack@n-api.service[120568]: spawned uWSGI worker 2 (pid: 120582, cores: 1) Oct 22 03:03:42.298792 n-d-862416-2 devstack@n-api.service[120568]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 22 03:03:42.963568 n-d-862416-2 devstack@n-api.service[120582]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 03:03:42.965355 n-d-862416-2 devstack@n-api.service[120581]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 22 03:03:44.132785 n-d-862416-2 devstack@n-api.service[120582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 03:03:44.132785 n-d-862416-2 devstack@n-api.service[120582]: from cryptography.utils import int_from_bytes Oct 22 03:03:44.133472 n-d-862416-2 devstack@n-api.service[120582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 03:03:44.133472 n-d-862416-2 devstack@n-api.service[120582]: from cryptography.utils import int_from_bytes Oct 22 03:03:44.133847 n-d-862416-2 devstack@n-api.service[120581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 03:03:44.133847 n-d-862416-2 devstack@n-api.service[120581]: from cryptography.utils import int_from_bytes Oct 22 03:03:44.134283 n-d-862416-2 devstack@n-api.service[120581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 03:03:44.134283 n-d-862416-2 devstack@n-api.service[120581]: from cryptography.utils import int_from_bytes Oct 22 03:03:46.567048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 03:03:46.567609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 03:03:46.567766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 03:03:46.568130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 03:03:46.568412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 03:03:46.568803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.569127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.569616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.569939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.570271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.570587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.570915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.571240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.571566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.571828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.572145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.572499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862416-2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.572822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.573129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.573444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.573764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.574069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.574395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.574702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.575204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.575661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.575971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.576474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.576668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.576981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.577305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.577639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.577956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.578274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.578583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.578994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862416-2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.579314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.579628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.579936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.580388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.580704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.581013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.581336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.581669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.581975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.582299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.582617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.582933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.583250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.583551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.583859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.584163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.584525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.584845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.585133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.585384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.585691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.586011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.586328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.586649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.586905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.587152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.587468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.587785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.588095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.588430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.588738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.589042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.589343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.589646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.589950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.590255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.590571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.590886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.591205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.591510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.591824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.592255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.592509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.592816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.593180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.593520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.593899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.594218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.594540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.594845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.595150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.595453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.595768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.596111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.596442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.596695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.596995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.597300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.597616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.597921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.598226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.598546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.598829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.599134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.599438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.599740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.600335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.600641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.600945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.601248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.601552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.601859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.602160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.602477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.602797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.603103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.603408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.603714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.604020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.604368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.604675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.604980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.605301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.605608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.605911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.606228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.606531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.606836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.607151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.607448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.607752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.608066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.608409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.608713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.609571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.609876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.610178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.610484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.610783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.611083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.611381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.611700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.612020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.612352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.612659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.612963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.613279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.613618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.613952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.614299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.614613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.614944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.615272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.615588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.615898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.616250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.616555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.616866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.617175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.617484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.617800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.618117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.618444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.618758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.619072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.619388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.619698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.620013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.620370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.620697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.621006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.621345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.621687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.621998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.622319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.622643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.622953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.623264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.623573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.623913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.624247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.625155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.625684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.626006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.626239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 03:03:46.626677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.626769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 03:03:46.626854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.626954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.627036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 03:03:46.627275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.627372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 03:03:46.627569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.627682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 03:03:46.627885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.627975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.628266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.628377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.628590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.628784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.628912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.629114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.629228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.629449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.629542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.629809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.629915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.630092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.630187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.630415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.630508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.630742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.630838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.631003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.631086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.631323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.631415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.631624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.631705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862416-2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.631933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.632025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.632343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.632461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.632582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.633711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.633791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.633874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.633963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.634047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.634121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.634198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.634295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.634395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.634395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.634580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.634699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.634795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.634882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.634954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.635053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.635181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.635351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.635518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.635662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.635834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.635969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.636146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.636317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.636495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.636630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.636808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.636935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.637132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.637257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.637447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.637605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.637850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862416-2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.637965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.638160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.638273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.638470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.638593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.638780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.638894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.639089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.639193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.639399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.639511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.639720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.639825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.640056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.640165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.640439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.640533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.640799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.640892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.641034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.641166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.641340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.641437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.641661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.641764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.641986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.642087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.642300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.642519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.642612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.642696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.642895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.643006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.643199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.643301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.643500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.643603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.643802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.643906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.644052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.644154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.644390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.644499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.644716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.644825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.645016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.645108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.645317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.645418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.645592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.645696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.645844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.645940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.646166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.646268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.646489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.646592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.646791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.646892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.647094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.647207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.647400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.647523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.647711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.647818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.648017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.648121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.648363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.648594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.648701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.648867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.648971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.649060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.649257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.649354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.649578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.649755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.650040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.650192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.650340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.650484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.650617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.650758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.650979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.651119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.651262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.651393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.651533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.651673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.651813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.651949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.652091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.652253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.652399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.652649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.652784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.652917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.653059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.653191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.653331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.653464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.653595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.653741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.653884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.654028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.654169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.654308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.654493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.654629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.654795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.654940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.655072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.655204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.655330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.655457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.656134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.656310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.656495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.656644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.656878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.657011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.657190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.657310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.657503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.657631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.657845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.657981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.658103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.658215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.658412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.658540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.658721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.658842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.659028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.659155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.659334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.659453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.659638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.659765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.659949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.660276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.660497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.660735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.660887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.661106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.661256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.661398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.661530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.661662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.661808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.661903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.662043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.662145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.662354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.662464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.662677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.662770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.662957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.663053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.663262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.663357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.663574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.663677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.663880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.663982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.664188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.664313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.664531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.664708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.664851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.665148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.665323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.665482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.665650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.665754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.665947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.666063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.666256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.666361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.666564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.666680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.666879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.666991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.667202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.667314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.667514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.667634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.667837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.667948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.668140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.668264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.668472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.668868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.668949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.669023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.669134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.669324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.669489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.669648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.669800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.669898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.669985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.670363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.670567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.670746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.670917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.671103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.671200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.671994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.672158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.672329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.672476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 03:03:46.672647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.672743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.672845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.672945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.673035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.673239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.673347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.673560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.673673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.673899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.673999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.674234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.674344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.674557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.674720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.674858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.674989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.675167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.675303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.675479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.675590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.675789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.675894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.676103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.676197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.676450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.676557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.676759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.676862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.677071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.677166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.677385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.677491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.677690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.677794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.678078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.678228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.678425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.678562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.678705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.678892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.678997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.679226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.679336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.679547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.679643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.679871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.679979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.680231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.680545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.680545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.680786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.680889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.680979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.681199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.681339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.681514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.681619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.681824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.681921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.682137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.682242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.682443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.682537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.682750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.682846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.683062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.683158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.683371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.683488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.683676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.683773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.683981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.684092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.684325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.684444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.684638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.684733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.684943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.685053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.685249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.685361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.685555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.685651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.685869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.685962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.686173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.686279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.686483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.686586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.686787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.686890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.687138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.687261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.687445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.687553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.687748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.687852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.688052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.688170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.688396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.688504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.688708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.688802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.689019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.689116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.689327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.689431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.689637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.689740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.689957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.690054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.690267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.690370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.690654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.690756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.690913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.691013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.691183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.691288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.691487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.691648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.691791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.691893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.692099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.692198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.692434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.692551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.692738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.692878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.693047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.693150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.693355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.693526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.693664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.693761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.693972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.694073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.694272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.694379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.694585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.694680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.694887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.694982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.695203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.695309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.695510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.695604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.695811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.695912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.696113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.696228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.696447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.696555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.696761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.696866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.697068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.697163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.697379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.697510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.697689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.697824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.698004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.698142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.698309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.698456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.698647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.698779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.698900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.699019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.699220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.699342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.699529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.699664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.699831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.699953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.700152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.700297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.700554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.700843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.700967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.701081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.701192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.701304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.701415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.701536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.701656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.701776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.701954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.702078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.702260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.702400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.702636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.702837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.702991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.703120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.703249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.703363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.703568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.703710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.703832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.703945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.704142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.704350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.704485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.704619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.704804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.704995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.705108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.705206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.705408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.705513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.705716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.705951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.706048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.706145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.706446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.706603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.706695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.706793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.707016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.707126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.707320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.707425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.707626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.707732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.707930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.708026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.708263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.708376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.708582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.708756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.708891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.709013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.709203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.709310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.709522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.709619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.709852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.709948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.710170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.710276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.710498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.710648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.711219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.711320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.711408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.711496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.711599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.711689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.711783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.711876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.712027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.712122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.712363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.712463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.712689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.712788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.713010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.713156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.713340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.713453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.713660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.713793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.713998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.714149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.714294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.714448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.714612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.714753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.714929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.715293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.715424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.715524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.715613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.715751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.715981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.716090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.716221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.716325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.716514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.716677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.716823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.716934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.717144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.717256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.717453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.717585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.717775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.717891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.718084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.718873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.718953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.719034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.719251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.719395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.719569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.719710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.719898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.720008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.720266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.720380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.720550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.720689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.720867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.720996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.721181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.721308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.721488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.721614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.721804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.721914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.722126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.722224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.722442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.722639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.722742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.722955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.723052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.723269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.723373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.723577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.723669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.723892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.723995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.724220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.724349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.724596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.724716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.724863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.725243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.725471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.725568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.725773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.725883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.726099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.726209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.726408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.726511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.726717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.726824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.727028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.727129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.727334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.727430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.727640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.727743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.727948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.728052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.728277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.728376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.728586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.728696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.728891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.729033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.729215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.729310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.729521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.729624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.729842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.729944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.730154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.730254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.730478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.730574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.730794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.730889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.731107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.731237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.731431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.731538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.731747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.731851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.732061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.732166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.732402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.732500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.732718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.732834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.733035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.733150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.733349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.733445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.733675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.733970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.734093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.734201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.734411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.734576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.734729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.734896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.735089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.735243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.735394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.735629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.735727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.735815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.736133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.736271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.736475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.736571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.736801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.736898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.737163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.737266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.737512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.737616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.737822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.737926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.738146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.738251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.738472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.738567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.738778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.738882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.739081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.739312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.739413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.739509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.739692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.739873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.739987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.740097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.740353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.740665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.740979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.741108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.741291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.741411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.741601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.741730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.741904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.742025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.742207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.742332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.742532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.742724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.742839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.742959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.743140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.743272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.743434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.743563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.743755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.743877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.744074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.744281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.744390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.744553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.744713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.744885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.745026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.745190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.745477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.745576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.745688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.745810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.745943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.746122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.746237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.746426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.746525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.746773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.746879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.747082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.747189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.747425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.747532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.747745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.747855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.748078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.748175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.748437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.748616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.748765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.748923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.749075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.749218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.749855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.750110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.750264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.750451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.750581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.750761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.750887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.751071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.751177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.751416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.751516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.751729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.751833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.752035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.752145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.752367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.752466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.752681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.752784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.752986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.753099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.753289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.753384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.753607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.753770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.753923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.754072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.754227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.754324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.754533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.754638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.754842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.754962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.755146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.755251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.755447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.755621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.755754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.755892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.756071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.756176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.756406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.756515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.756727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.756825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.757036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.757139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.757343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.757437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.757652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.757758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.757963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.758064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.758275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.758379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.758583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.758705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.758896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.759000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.759209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.759319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.759517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.759611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.759821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.759923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.760130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.760256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.760473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.760579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.760788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.760899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.761100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.761330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.761439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.761661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.761810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.761974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.762078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.762285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.762388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.762597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.762693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.762910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.763006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.763214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.763308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.763522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.763616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.763828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.763977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.764134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.764257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.764467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.764579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.764776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.764880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.765160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.765310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.765488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.765595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.765830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.766012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.766149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.766290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.766462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.766569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.766771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.766874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.767085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.767187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.767422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.767518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.767745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.767848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.768053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.768157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.768403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.768500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.768720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.768824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.769035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.769148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.769349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.769453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.769665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.769812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.769976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.770080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.770288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.770422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.770605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.770733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.770919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.771055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.771927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.772102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.772339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.772497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.772663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.772820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.772974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.773132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.773278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.773431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.773609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.773866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.773866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.774175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.774329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.774476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.774476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.774779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.774925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.775031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.775121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.775216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.775313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.775313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.775491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.775662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.775979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.780238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.780387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.780483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.780564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.781189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.781339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.781432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.781432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.781588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.781662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.781802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.781920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.782967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.783920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.784002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.784089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.784164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.785943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.786025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.786100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.786203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.786280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.786363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.786955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.787967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.788048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.788123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.788222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.788309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.788612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.788722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.788800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.788883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.789055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.789180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.789401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.789567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.789725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.789882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.790030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.790184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.790333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.790480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.790635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.790791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.790937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.791091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.791239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.791402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.791550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.791706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.791863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.792010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.792156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.792397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.792561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.792709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.792864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.793020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.793175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.793323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.793489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.793649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.793805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.793952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.794108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.794301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.794550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.794706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.794905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.795334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.795501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.795659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.795824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.795984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.796132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.797282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.797450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.797616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.797773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.797930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.798078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.798226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.798381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.798545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.798703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.798851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.799011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.799159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.799307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.799554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.799721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.799879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.800028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.800182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.800374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.800534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.800692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.800848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.801006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.801162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.801324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.801479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.801627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.801776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.801923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.802071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.802227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.802382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.802530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.802684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.802832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.802989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.803146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.803302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.803450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.803597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.803759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.803915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.804073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.804247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.804414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.804590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.804820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.805046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.805482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.805648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.805798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.805954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.806103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.806260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.806409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.806555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.806710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.806866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.807034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.807505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.807675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.807823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.807971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.808118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.808296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.808451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.808607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.808762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.808910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.809066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.809223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.809371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.809545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.809790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.809954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.810104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.810267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.810415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.810415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.810703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.810858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.811012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.811174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.811330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.811479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.811636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.811783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.812051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.812222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.812379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.812526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.812684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.812833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.812990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.813138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.813286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.813432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.813578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.813736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.813897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.814046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.814200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.814356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.814512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.814673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.814673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.815121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.815297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.815717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.815717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.816026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.816177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.816399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.816709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.816912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.817128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.817629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.817801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.817958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.818109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.818256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.818411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.818571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.818740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.818889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.819035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.819181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.819344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.819500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.819666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.820437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.820599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.820761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.820922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.821078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.821232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.821392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.821540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.821688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.822014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.822184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.822334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.822334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.822629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.822786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.822948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.823097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.823251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.823411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.823559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.823720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.823869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.824016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.824163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.824369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.824528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.824687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.824836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.824995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.825297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.825487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.825936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.826107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.826262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.826416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.826569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.826721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.826884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.827040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.827193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.827346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.827769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.827945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.828263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.828464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.828710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.828871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.829026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.829189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.829364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.829520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.829680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.829838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.830087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.830260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.830427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.830591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.830746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.830926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.831213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.831389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.831560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.831725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.831880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.832034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.832187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.832383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.832383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.832705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.832867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.833021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.833191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.833354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.833508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.833661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.833821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.833974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.834141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.834296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.834458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.834623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.834786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.834952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.834952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.835385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.835557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.836009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.836173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.836399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.836573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.836729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.836729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.837040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.837202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.837368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.837531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.838094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.838094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.838421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.838584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.838768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.839012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.839183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.839344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.839508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.839689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.839845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.840006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.840267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.840444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.840611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.840779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.840779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.841119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.841361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.841524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.841716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.841890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.842069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.842224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.842385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.842540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.842732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.842901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.843055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.843731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.843731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 03:03:46.844224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.844224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.844224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.844224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.844224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.844224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.844224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.844224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.845536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.845536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.845536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.845536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.845536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.845536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.845536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.845536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.847128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.847128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.847128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.847128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.847128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.847128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.847128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.847128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.848569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.848569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.848569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.848569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.848569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.848569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.848569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.848569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.850815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.850815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.850815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.850815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.850815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.850815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.850815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.850815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.852068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.852068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.852068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.852068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.852702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.852702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.853157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.853494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.853819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.854163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.854499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.854811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.855123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.855549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.855750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.856323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.856502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.856707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.857022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.857337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.857651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.857965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.858306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.858591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.859075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.859392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.859712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.860030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.860386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.860858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.861043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.861373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.861699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.862017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.862339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.862702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.862967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.863278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.863593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.863913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.864266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.864588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.864899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.865330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.865653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.865975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.866421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.866677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.866997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.867326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.867643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.867967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.868306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.868640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.868986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.869319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.869647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.869956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.870268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.870580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.870896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.871226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.871540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.871851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.872183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.872492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.872803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.873113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.873422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.873732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.874046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.874853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.875181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.875492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.875802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.876110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.876556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.876820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.877037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.877346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.877654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.877962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.878271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.878608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.878945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.879314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.879589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.879908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.880310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.880566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.880894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.881217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.881540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.881901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.882195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.882925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.882925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.883260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.883439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.883751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.884067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.884528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.885195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.885195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.885528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.885684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.885980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.886290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.886721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.886986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.887228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.887546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.887857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.888171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.888579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.888826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.889153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.889457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.889777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.890195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.890532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.891089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.891369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.891705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.892047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.892430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.892752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.893106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.893441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.893761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.894076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.894386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 03:03:46.894634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 03:03:46.904692 n-d-862416-2 devstack@n-api.service[120582]: INFO dbcounter [None req-4847245d-6505-448e-b544-17282760f937 None None] Registered counter for database nova_api Oct 22 03:03:46.926849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_db.sqlalchemy.engines [None req-4847245d-6505-448e-b544-17282760f937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 03:03:46.933795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writer thread running {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 03:03:46.957896 n-d-862416-2 devstack@n-api.service[120581]: INFO dbcounter [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Registered counter for database nova_api Oct 22 03:03:46.979997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_db.sqlalchemy.engines [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 03:03:46.987553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writer thread running {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 03:03:46.992897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.context [None req-4847245d-6505-448e-b544-17282760f937 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) {{(pid=120582) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 03:03:46.996972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4847245d-6505-448e-b544-17282760f937 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:03:46.997464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4847245d-6505-448e-b544-17282760f937 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:03:46.999106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4847245d-6505-448e-b544-17282760f937 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:03:46.999966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4847245d-6505-448e-b544-17282760f937 None None] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:03:47.000441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4847245d-6505-448e-b544-17282760f937 None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:03:47.002840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4847245d-6505-448e-b544-17282760f937 None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:03:47.004983 n-d-862416-2 devstack@n-api.service[120582]: INFO dbcounter [None req-4847245d-6505-448e-b544-17282760f937 None None] Registered counter for database nova_cell0 Oct 22 03:03:47.009391 n-d-862416-2 devstack@n-api.service[120582]: INFO dbcounter [None req-4847245d-6505-448e-b544-17282760f937 None None] Registered counter for database nova_cell1 Oct 22 03:03:47.017446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_db.sqlalchemy.engines [None req-4847245d-6505-448e-b544-17282760f937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 03:03:47.020052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_db.sqlalchemy.engines [None req-4847245d-6505-448e-b544-17282760f937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 03:03:47.024770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writer thread running {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 03:03:47.027210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writer thread running {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 03:03:47.044775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.context [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) {{(pid=120581) load_cells /opt/stack/nova/nova/context.py:464}} Oct 22 03:03:47.048865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:03:47.049358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:03:47.051287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:03:47.051663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:03:47.052108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:03:47.054151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:03:47.056177 n-d-862416-2 devstack@n-api.service[120581]: INFO dbcounter [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Registered counter for database nova_cell0 Oct 22 03:03:47.060960 n-d-862416-2 devstack@n-api.service[120581]: INFO dbcounter [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Registered counter for database nova_cell1 Oct 22 03:03:47.068788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_db.sqlalchemy.engines [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 03:03:47.072172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_db.sqlalchemy.engines [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 03:03:47.075188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writer thread running {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 03:03:47.184569 n-d-862416-2 devstack@n-api.service[120582]: INFO dbcounter [None req-4847245d-6505-448e-b544-17282760f937 None None] Registered counter for database nova_cell0 Oct 22 03:03:47.193313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_db.sqlalchemy.engines [None req-4847245d-6505-448e-b544-17282760f937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 03:03:47.198078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writer thread running {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 03:03:47.220770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writer thread running {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 03:03:47.230251 n-d-862416-2 devstack@n-api.service[120581]: INFO dbcounter [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Registered counter for database nova_cell0 Oct 22 03:03:47.239916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_db.sqlalchemy.engines [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 03:03:47.244625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writer thread running {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 03:03:47.529892 n-d-862416-2 devstack@n-api.service[120582]: WARNING keystonemiddleware.auth_token [None req-4847245d-6505-448e-b544-17282760f937 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 03:03:47.537897 n-d-862416-2 devstack@n-api.service[120582]: WARNING keystonemiddleware.auth_token [None req-4847245d-6505-448e-b544-17282760f937 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 03:03:47.569554 n-d-862416-2 devstack@n-api.service[120581]: WARNING keystonemiddleware.auth_token [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 03:03:47.576982 n-d-862416-2 devstack@n-api.service[120581]: WARNING keystonemiddleware.auth_token [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 03:03:47.892190 n-d-862416-2 devstack@n-api.service[120582]: WARNING keystonemiddleware.auth_token [None req-4847245d-6505-448e-b544-17282760f937 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 03:03:47.899009 n-d-862416-2 devstack@n-api.service[120582]: WARNING keystonemiddleware.auth_token [None req-4847245d-6505-448e-b544-17282760f937 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 03:03:47.904519 n-d-862416-2 devstack@n-api.service[120582]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5570d9f419c0 pid: 120582 (default app) Oct 22 03:03:47.928586 n-d-862416-2 devstack@n-api.service[120581]: WARNING keystonemiddleware.auth_token [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 22 03:03:47.934558 n-d-862416-2 devstack@n-api.service[120581]: WARNING keystonemiddleware.auth_token [None req-907c51b6-37ad-406e-ba8b-1ebb79dc22b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 22 03:03:47.940628 n-d-862416-2 devstack@n-api.service[120581]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5570d9f419c0 pid: 120581 (default app) Oct 22 03:04:29.073420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:29.074584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:29.075315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:29.076237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:29.803225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:29.804036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:29.805036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:29.805791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:30.246056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b1a1f71-d912-4877-a69b-fe7d0c67481d tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2135234681", "id": 2007770012, "os-flavor-access:is_public": "False"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:30.302410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b1a1f71-d912-4877-a69b-fe7d0c67481d tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 1.234270 Oct 22 03:04:30.303197 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:29 2022] POST /compute/v2.1/flavors => generated 431 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:30.534976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a232d58-4808-4b7e-86b5-ef08a3e63d36 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1935259882", "id": 205296404, "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:30.558147 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a232d58-4808-4b7e-86b5-ef08a3e63d36 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.252669 Oct 22 03:04:30.559007 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2/2] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:30 2022] POST /compute/v2.1/flavors => generated 427 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:30.644354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef0c8ed6-42c1-4d6d-bad7-2561a9591a21 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:30.649068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef0c8ed6-42c1-4d6d-bad7-2561a9591a21 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:30.649555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef0c8ed6-42c1-4d6d-bad7-2561a9591a21 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:30.650271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef0c8ed6-42c1-4d6d-bad7-2561a9591a21 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:30.650704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef0c8ed6-42c1-4d6d-bad7-2561a9591a21 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:30.651145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef0c8ed6-42c1-4d6d-bad7-2561a9591a21 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:30.651752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef0c8ed6-42c1-4d6d-bad7-2561a9591a21 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:30.702944 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef0c8ed6-42c1-4d6d-bad7-2561a9591a21 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.904493 Oct 22 03:04:30.702944 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:04:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:04:30.856861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef6d5efa-9edf-47e7-a4e4-930c5fd8b43f tempest-NetworksTest-1563908486 tempest-NetworksTest-1563908486-project-admin] Calling method '.version_select at 0x7f0d1bc181f0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:30.928108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '.version_select at 0x7f0d1bbfbb80>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:30.937993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) {{(pid=120581) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 22 03:04:30.938755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:30.939468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:30.939978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:30.971796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:30.972431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:30.973036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:30.987079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:30.987553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:30.988172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:30.996299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-652b56e5-5f75-47aa-b799-69351cd9cb1e tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.296520 Oct 22 03:04:31.009978 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1167 bytes} [Sat Oct 22 03:04:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:31.130197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65b66e55-d5c8-44bb-a6be-dc921d0b39b3 tempest-AZAdminNegativeTestJSON-231247793 tempest-AZAdminNegativeTestJSON-231247793-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:31.131968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-65b66e55-d5c8-44bb-a6be-dc921d0b39b3 tempest-AZAdminNegativeTestJSON-231247793 tempest-AZAdminNegativeTestJSON-231247793-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '35e4720012234c8bb04ba84b2f83798c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9402ab19df344175b6a8b665b7f30db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65b66e55-d5c8-44bb-a6be-dc921d0b39b3 tempest-AZAdminNegativeTestJSON-231247793 tempest-AZAdminNegativeTestJSON-231247793-project] Request method failure captured: Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU128wM3GVK8APq7LODI65b47BbQBvia_id00ksZvu_2qF81NxqVcyxB4fWc-abLV4TSiS_V_fNyVjDAwCKiCnQqJ6Ocw6h4Rhi5qWGz_YyPKfJR2oH_ieyKuvlIRhV52Bv-wZZZ86I11G_zgl1gVkjuoneLRvr0OzOwkCrAxTU7NQ_g Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9402ab19df344175b6a8b665b7f30db9 Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AZAdminNegativeTestJSON-231247793 Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:04:31.135892 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9402ab19df344175b6a8b665b7f30db9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9402ab19df344175b6a8b665b7f30db9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9402ab19df344175b6a8b665b7f30db9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9402ab19df344175b6a8b665b7f30db9"}]}] Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AZAdminNegativeTestJSON-231247793 Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9402ab19df344175b6a8b665b7f30db9 Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-231247793 Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AZAdminNegativeTestJSON-231247793-project Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 35e4720012234c8bb04ba84b2f83798c Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AZAdminNegativeTestJSON-231247793-project Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 22 03:04:31.137106 n-d-862416-2 devstack@n-api.service[120581]: action_args: {} Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:31.137806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 22 03:04:31.138872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:31.140590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65b66e55-d5c8-44bb-a6be-dc921d0b39b3 tempest-AZAdminNegativeTestJSON-231247793 tempest-AZAdminNegativeTestJSON-231247793-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:31.141599 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65b66e55-d5c8-44bb-a6be-dc921d0b39b3 tempest-AZAdminNegativeTestJSON-231247793 tempest-AZAdminNegativeTestJSON-231247793-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.143445 Oct 22 03:04:31.142137 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1185 bytes} [Sat Oct 22 03:04:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 144 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:31.147394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6882947d-da51-4027-8176-23deeef1eee6 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "dfdb0b29418141acba4f442c0055c3be"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:31.391420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6882947d-da51-4027-8176-23deeef1eee6 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2007770012/action" status: 200 len: 97 microversion: 2.1 time: 0.248041 Oct 22 03:04:31.392104 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4/6] 10.222.0.25 () {60 vars in 1200 bytes} [Sat Oct 22 03:04:31 2022] POST /compute/v2.1/flavors/2007770012/action => generated 97 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:31.396581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac7af00e-b38c-4ee2-b206-b385be080339 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:31.407185 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef6d5efa-9edf-47e7-a4e4-930c5fd8b43f tempest-NetworksTest-1563908486 tempest-NetworksTest-1563908486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.846852 Oct 22 03:04:31.411047 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:04:30 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:31.413549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e141a1e-601f-4c16-b858-ade49b9930c8 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-693344985"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:31.417031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-0e141a1e-601f-4c16-b858-ade49b9930c8 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid e08a073d-0d3c-47ec-ada0-4e8d886b6915 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:04:31.433892 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac7af00e-b38c-4ee2-b206-b385be080339 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/205296404" status: 202 len: 0 microversion: 2.1 time: 0.040341 Oct 22 03:04:31.434625 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:04:31 2022] DELETE /compute/v2.1/flavors/205296404 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:31.505079 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e141a1e-601f-4c16-b858-ade49b9930c8 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.094984 Oct 22 03:04:31.505878 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 4/9] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:31 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:31.628694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-226ec649-7b53-4bdb-a8d9-f2675f836376 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1413457541", "id": 1056586544, "os-flavor-access:is_public": "False"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:31.660421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0313497-63cf-4e90-8fb6-e42ff53a29ea tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:31.662467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0313497-63cf-4e90-8fb6-e42ff53a29ea tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:31.663034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0313497-63cf-4e90-8fb6-e42ff53a29ea tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:31.665852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0313497-63cf-4e90-8fb6-e42ff53a29ea tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:31.666556 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-226ec649-7b53-4bdb-a8d9-f2675f836376 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.230599 Oct 22 03:04:31.666798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0313497-63cf-4e90-8fb6-e42ff53a29ea tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:31.667638 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 6/10] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:31 2022] POST /compute/v2.1/flavors => generated 439 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:31.672346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0313497-63cf-4e90-8fb6-e42ff53a29ea tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:31.673475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0313497-63cf-4e90-8fb6-e42ff53a29ea tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:31.715943 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0313497-63cf-4e90-8fb6-e42ff53a29ea tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.208833 Oct 22 03:04:31.716698 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 5/11] 10.222.0.25 () {58 vars in 1164 bytes} [Sat Oct 22 03:04:31 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:31.721929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ce653cd-8ee2-42e1-b4ad-814a29063019 tempest-NetworksTest-1563908486 tempest-NetworksTest-1563908486-project-admin] Calling method '.version_select at 0x7f0d1b32ea60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:31.785002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27df5396-cf47-423b-a08f-042f33a4a74f tempest-FlavorsAccessTestJSON-1048365655 tempest-FlavorsAccessTestJSON-1048365655-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:31.815887 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27df5396-cf47-423b-a08f-042f33a4a74f tempest-FlavorsAccessTestJSON-1048365655 tempest-FlavorsAccessTestJSON-1048365655-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.147093 Oct 22 03:04:31.816512 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:31 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:31.820811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5757f70-6ff2-4ef0-968c-2c7d4d7046c1 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:31.848934 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5757f70-6ff2-4ef0-968c-2c7d4d7046c1 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031353 Oct 22 03:04:31.849522 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:31.855011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7e4cafcd-d481-48ce-902e-fc3f0c9b90f4 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:31.856861 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ce653cd-8ee2-42e1-b4ad-814a29063019 tempest-NetworksTest-1563908486 tempest-NetworksTest-1563908486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/55370f84-6f6d-40f1-8b4b-a7511a9ada23" status: 200 len: 652 microversion: 2.1 time: 0.138798 Oct 22 03:04:31.857437 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 6/14] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:04:31 2022] GET /compute/v2.1/os-networks/55370f84-6f6d-40f1-8b4b-a7511a9ada23 => generated 652 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:31.871560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0336412-45f1-4c34-a1a5-45538b81dfcf tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:31.899294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e4cafcd-d481-48ce-902e-fc3f0c9b90f4 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:31.899775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e4cafcd-d481-48ce-902e-fc3f0c9b90f4 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:31.900233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e4cafcd-d481-48ce-902e-fc3f0c9b90f4 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:31.985977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0336412-45f1-4c34-a1a5-45538b81dfcf tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1056586544/action" status: 200 len: 97 microversion: 2.1 time: 0.127484 Oct 22 03:04:31.986749 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 7/15] 10.222.0.25 () {60 vars in 1200 bytes} [Sat Oct 22 03:04:31 2022] POST /compute/v2.1/flavors/1056586544/action => generated 97 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:31.991865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4df69e08-9452-402f-97db-991a60e80439 tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:31.994174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4df69e08-9452-402f-97db-991a60e80439 tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:31.994689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4df69e08-9452-402f-97db-991a60e80439 tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:31.995125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4df69e08-9452-402f-97db-991a60e80439 tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:31.995863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4df69e08-9452-402f-97db-991a60e80439 tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:31.996416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4df69e08-9452-402f-97db-991a60e80439 tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:31.996843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4df69e08-9452-402f-97db-991a60e80439 tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:32.023345 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4df69e08-9452-402f-97db-991a60e80439 tempest-AZAdminV2TestJSON-337741729 tempest-AZAdminV2TestJSON-337741729-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.035428 Oct 22 03:04:32.023938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1185 bytes} [Sat Oct 22 03:04:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:32.028502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a7bf239-5d3f-47b5-bf5e-642f7e71f36c tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dfdb0b29418141acba4f442c0055c3be"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:32.438562 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7e4cafcd-d481-48ce-902e-fc3f0c9b90f4 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.586983 Oct 22 03:04:32.440034 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 9/17] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:04:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:32.450766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc509737-ede1-4388-b122-14bd41b32342 tempest-NetworksTest-1563908486 tempest-NetworksTest-1563908486-project-admin] Calling method '.version_select at 0x7f0d1ba6aee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:32.455461 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a7bf239-5d3f-47b5-bf5e-642f7e71f36c tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2007770012/action" status: 200 len: 21 microversion: 2.1 time: 0.430071 Oct 22 03:04:32.456129 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 9/18] 10.222.0.25 () {60 vars in 1200 bytes} [Sat Oct 22 03:04:32 2022] POST /compute/v2.1/flavors/2007770012/action => generated 21 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:32.462738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3bd666d-1db8-4965-bf7d-d4f4f1abd865 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1744215576", "id": 18721348, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:32.486492 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3bd666d-1db8-4965-bf7d-d4f4f1abd865 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.028796 Oct 22 03:04:32.487270 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 10/19] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:32 2022] POST /compute/v2.1/flavors => generated 411 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:32.492181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f195b6fb-5fbd-42f0-8f10-dbc45b220707 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:32.864896 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-f195b6fb-5fbd-42f0-8f10-dbc45b220707 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project ecb0d8e7fbf34237ac356b91e4881c17 combination. Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f195b6fb-5fbd-42f0-8f10-dbc45b220707 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Request method failure captured: Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/flavors/1056586544/action HTTP/1.1 Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 67 Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU129tQwcrLk2DzUwynBpNuEfe9N3QS6SzM8qePYS6iDh_i0XwD2SyR1qqyRcMfQ4IFdlROQto61tCMCUjb62SnNo5dwsdwBB48mZUYYzBPA3BARHLWJpOclfgSGINW8lC6Z7D5dIepdmj10Ufct2ovLbQWJ3ipvfVuR-YkyhOdDsJbo Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e10dc9d918f949b5ab3acf46747b8766 Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:32.882455 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e10dc9d918f949b5ab3acf46747b8766"}]}] Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e10dc9d918f949b5ab3acf46747b8766 Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 40a1b28e10d84dd586f95ff4925fd6ae Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: {"addTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} Oct 22 03:04:32.883853 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: exception: Flavor access already exists for flavor 17 and project ecb0d8e7fbf34237ac356b91e4881c17 combination. Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1056586544', 'body': {'addTenantAccess': {'tenant': 'ecb0d8e7fbf34237ac356b91e4881c17'}}} Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result.read() Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 03:04:32.884621 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-ecb0d8e7fbf34237ac356b91e4881c17' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi session.flush() Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 03:04:32.885681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 03:04:32.886810 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 03:04:32.888814 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result.read() Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-ecb0d8e7fbf34237ac356b91e4881c17' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 22, 3, 4, 32, 858233), 'updated_at': None, 'flavor_id': 17, 'project_id': 'ecb0d8e7fbf34237ac356b91e4881c17'}] Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:32.890519 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project ecb0d8e7fbf34237ac356b91e4881c17 combination. Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:32.891598 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project ecb0d8e7fbf34237ac356b91e4881c17 combination. Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:32.892988 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:32.893898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project ecb0d8e7fbf34237ac356b91e4881c17 combination. Oct 22 03:04:32.893898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.897111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f195b6fb-5fbd-42f0-8f10-dbc45b220707 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project ecb0d8e7fbf34237ac356b91e4881c17 combination. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:32.898135 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f195b6fb-5fbd-42f0-8f10-dbc45b220707 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1056586544/action" status: 409 len: 152 microversion: 2.1 time: 0.409803 Oct 22 03:04:32.898823 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1200 bytes} [Sat Oct 22 03:04:32 2022] POST /compute/v2.1/flavors/1056586544/action => generated 152 bytes in 411 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:04:32.904187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cfad3375-d9b2-4248-8042-263235217e88 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:32.924662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfad3375-d9b2-4248-8042-263235217e88 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:32.925450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfad3375-d9b2-4248-8042-263235217e88 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:32.925962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfad3375-d9b2-4248-8042-263235217e88 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:32.944247 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc509737-ede1-4388-b122-14bd41b32342 tempest-NetworksTest-1563908486 tempest-NetworksTest-1563908486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.501312 Oct 22 03:04:32.945540 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 10/21] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:04:32 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:32.955456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6db9730-0289-4481-85f6-50e1f6ce17c9 tempest-FlavorsAccessTestJSON-1048365655 tempest-FlavorsAccessTestJSON-1048365655-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:32.982360 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-cfad3375-d9b2-4248-8042-263235217e88 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-862416-2. Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cfad3375-d9b2-4248-8042-263235217e88 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Request method failure captured: Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 39 Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU129bqZ1BmGSKpvVa9ry6bigUUgGdtCPxaBiLr5fU4ScuLzU8SzNzE45jCWOwl2ww93ISXk08WfiSrper_OyCHgB3vmn_3BNqd96ITHWvXx6u2evU83dcJ2JZCmgtjttSUn-QGWpTdAGfLDByeQlcw-fxX7CTaxCYqBaovC_wV7prrg Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:32.989796 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f48255d03ca14a7983348f809f853256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f48255d03ca14a7983348f809f853256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}] Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f2bc147c69c54292a059b5d7054d7c96 Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: {"add_host": {"host": "n-h1-862416-2"}} Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:32.991192 n-d-862416-2 devstack@n-api.service[120582]: exception: Aggregate 1 already has host n-h1-862416-2. Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-862416-2'}}} Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result.read() Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 03:04:32.992423 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-862416-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi session.flush() Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 03:04:32.993548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 03:04:32.995487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 03:04:32.996874 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result.read() Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-862416-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 22, 3, 4, 32, 962835), 'updated_at': None, 'host': 'n-h1-862416-2', 'aggregate_id': 1}] Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:32.998113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-862416-2. Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:32.999976 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-862416-2. Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:33.001155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:33.002276 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-862416-2. Oct 22 03:04:33.002276 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:33.004259 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6db9730-0289-4481-85f6-50e1f6ce17c9 tempest-FlavorsAccessTestJSON-1048365655 tempest-FlavorsAccessTestJSON-1048365655-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.054966 Oct 22 03:04:33.004410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cfad3375-d9b2-4248-8042-263235217e88 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-862416-2. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:33.006155 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cfad3375-d9b2-4248-8042-263235217e88 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.105319 Oct 22 03:04:33.006556 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 12/22] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:04:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 22 03:04:33.020314 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:32 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:33.024056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5348722-15d1-4652-953a-48d33055bd22 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:33.044799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c9eca04-2c74-4252-85b3-381160cfcb3f tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:33.080787 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5348722-15d1-4652-953a-48d33055bd22 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.072042 Oct 22 03:04:33.087198 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 13/24] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:33 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:33.107163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9848838a-9280-4be2-83b1-eb2b356bffcd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:33.119851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9848838a-9280-4be2-83b1-eb2b356bffcd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:33.120559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9848838a-9280-4be2-83b1-eb2b356bffcd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:33.121086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9848838a-9280-4be2-83b1-eb2b356bffcd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:33.620353 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1c9eca04-2c74-4252-85b3-381160cfcb3f tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1056586544/action" status: 200 len: 21 microversion: 2.1 time: 0.598770 Oct 22 03:04:33.622151 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 12/25] 10.222.0.25 () {60 vars in 1200 bytes} [Sat Oct 22 03:04:33 2022] POST /compute/v2.1/flavors/1056586544/action => generated 21 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:33.628002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8329237-f437-4184-9191-cba64a9b2e4d tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:33.648589 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8329237-f437-4184-9191-cba64a9b2e4d tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2007770012" status: 202 len: 0 microversion: 2.1 time: 0.025001 Oct 22 03:04:33.649707 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:33 2022] DELETE /compute/v2.1/flavors/2007770012 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:33.656782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d5c468d-92fd-459e-a39f-8992db9a22ce tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:33.682995 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d5c468d-92fd-459e-a39f-8992db9a22ce tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/18721348" status: 202 len: 0 microversion: 2.1 time: 0.029980 Oct 22 03:04:33.685579 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:04:33 2022] DELETE /compute/v2.1/flavors/18721348 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:33.691413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c276469e-a4e7-4703-92dd-749e9acffbc8 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:33.711047 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c276469e-a4e7-4703-92dd-749e9acffbc8 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1056586544" status: 202 len: 0 microversion: 2.1 time: 0.023377 Oct 22 03:04:33.711989 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:33 2022] DELETE /compute/v2.1/flavors/1056586544 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:33.720086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13c010ab-f241-40b6-a24a-487d1c38afd8 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:33.755771 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13c010ab-f241-40b6-a24a-487d1c38afd8 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042502 Oct 22 03:04:33.756690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:33.761400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01c549cd-c35b-4adc-8db5-1327b318596d tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:33.782690 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01c549cd-c35b-4adc-8db5-1327b318596d tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024848 Oct 22 03:04:33.783660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 17/30] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:33.788496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5aa1952-46ab-4cbb-8aa3-3f564a284c62 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:33.812079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5aa1952-46ab-4cbb-8aa3-3f564a284c62 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027061 Oct 22 03:04:33.824359 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 18/31] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:33.838086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be8ba038-38ea-4cc4-98f7-1bf8a90f3f69 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1832143297", "id": 758483148, "os-flavor-access:is_public": "False"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:33.862648 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be8ba038-38ea-4cc4-98f7-1bf8a90f3f69 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.037123 Oct 22 03:04:33.863387 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 19/32] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:33 2022] POST /compute/v2.1/flavors => generated 428 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:33.878635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e17202c9-6fbd-4b9b-8d0d-133ff0adac92 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-377723672", "id": 1849853559, "os-flavor-access:is_public": "True"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:33.900679 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e17202c9-6fbd-4b9b-8d0d-133ff0adac92 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.027285 Oct 22 03:04:33.901545 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 20/33] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:33 2022] POST /compute/v2.1/flavors => generated 428 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:33.918635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75631cd5-1c3e-4c8a-a7a2-adf883b69911 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1271331879", "id": 1012198735, "os-flavor-access:is_public": "True"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:33.946490 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9848838a-9280-4be2-83b1-eb2b356bffcd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.843768 Oct 22 03:04:33.948033 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 14/34] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:04:33 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:33.963422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b4b035b-6491-4600-8fdf-874bc016dd67 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:33.984479 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75631cd5-1c3e-4c8a-a7a2-adf883b69911 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.081446 Oct 22 03:04:33.992269 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b4b035b-6491-4600-8fdf-874bc016dd67 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/758483148/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.041067 Oct 22 03:04:33.993123 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 15/35] 10.222.0.25 () {58 vars in 1206 bytes} [Sat Oct 22 03:04:33 2022] GET /compute/v2.1/flavors/758483148/os-flavor-access => generated 21 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:33.996710 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 21/36] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:33 2022] POST /compute/v2.1/flavors => generated 438 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.004086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b03e6f5-ccce-446f-9cd7-1ce91b915d87 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.007210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-53270fec-bf9f-4377-b880-5e0a959bccf7 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.038134 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-53270fec-bf9f-4377-b880-5e0a959bccf7 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1849853559" status: 202 len: 0 microversion: 2.1 time: 0.043722 Oct 22 03:04:34.042938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 16/37] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:33 2022] DELETE /compute/v2.1/flavors/1849853559 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:34.062312 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b03e6f5-ccce-446f-9cd7-1ce91b915d87 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.062664 Oct 22 03:04:34.063883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 22/38] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:33 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:04:34.064683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7864bae9-6af5-4df7-b2f3-b3867d8780da tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.079591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b72e645-b32d-4fe7-b8c9-edcfb2c727eb tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.084538 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-7864bae9-6af5-4df7-b2f3-b3867d8780da tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7864bae9-6af5-4df7-b2f3-b3867d8780da tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Request method failure captured: Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/flavors/1012198735/os-flavor-access HTTP/1.1 Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU129tQwcrLk2DzUwynBpNuEfe9N3QS6SzM8qePYS6iDh_i0XwD2SyR1qqyRcMfQ4IFdlROQto61tCMCUjb62SnNo5dwsdwBB48mZUYYzBPA3BARHLWJpOclfgSGINW8lC6Z7D5dIepdmj10Ufct2ovLbQWJ3ipvfVuR-YkyhOdDsJbo Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e10dc9d918f949b5ab3acf46747b8766 Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:34.086535 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e10dc9d918f949b5ab3acf46747b8766"}]}] Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e10dc9d918f949b5ab3acf46747b8766 Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 40a1b28e10d84dd586f95ff4925fd6ae Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: exception: Access list not available for public flavors. Oct 22 03:04:34.087599 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'flavor_id': '1012198735'} Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 22 03:04:34.088241 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.089255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7864bae9-6af5-4df7-b2f3-b3867d8780da tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:34.089255 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7864bae9-6af5-4df7-b2f3-b3867d8780da tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1012198735/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.042756 Oct 22 03:04:34.094851 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 17/39] 10.222.0.25 () {58 vars in 1209 bytes} [Sat Oct 22 03:04:34 2022] GET /compute/v2.1/flavors/1012198735/os-flavor-access => generated 91 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:04:34.106891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f985cdf3-0d79-49fd-aebb-2cef5e595333 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.128197 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b72e645-b32d-4fe7-b8c9-edcfb2c727eb tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/758483148" status: 202 len: 0 microversion: 2.1 time: 0.061836 Oct 22 03:04:34.129847 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 23/40] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:04:34 2022] DELETE /compute/v2.1/flavors/758483148 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:34.139183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d4fb835-6392-457e-868a-ffbc524e0758 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-648381063"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.145253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.aggregate [None req-5d4fb835-6392-457e-868a-ffbc524e0758 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid f3328974-f779-46e9-871c-ca7ee0e1da22 for aggregate {{(pid=120581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:04:34.148538 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f985cdf3-0d79-49fd-aebb-2cef5e595333 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5419 microversion: 2.1 time: 0.052357 Oct 22 03:04:34.152666 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 18/41] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:34 2022] GET /compute/v2.1/flavors/detail => generated 5419 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:34.156564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7,nova_api:DELETE=18 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:34.158806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c02cdcc9-febf-4364-af57-8ef1f3237a70 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-393460360", "name": "tempest-test_aggregate-1614949872"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.184664 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5d4fb835-6392-457e-868a-ffbc524e0758 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053447 Oct 22 03:04:34.186349 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 24/42] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.191816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b470a20-42b4-4267-a8cb-c78fb4f0fb92 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.208287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-c02cdcc9-febf-4364-af57-8ef1f3237a70 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid 11744e3c-213e-480f-aa16-2cafe7209838 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:04:34.216189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b470a20-42b4-4267-a8cb-c78fb4f0fb92 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1012198735" status: 202 len: 0 microversion: 2.1 time: 0.028232 Oct 22 03:04:34.217646 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 25/43] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:34 2022] DELETE /compute/v2.1/flavors/1012198735 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:34.224460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a19a1d58-c2c0-4b63-85f2-d56e9c5747c7 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.252233 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c02cdcc9-febf-4364-af57-8ef1f3237a70 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.100534 Oct 22 03:04:34.253293 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 19/44] 10.222.0.25 () {60 vars in 1165 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.253652 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a19a1d58-c2c0-4b63-85f2-d56e9c5747c7 tempest-FlavorsAccessTestJSON-449508660 tempest-FlavorsAccessTestJSON-449508660-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033657 Oct 22 03:04:34.255177 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 26/45] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:34.276158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63281b42-acd6-483b-a34b-25059cd46773 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-301313153", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.326591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63281b42-acd6-483b-a34b-25059cd46773 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.071799 Oct 22 03:04:34.328461 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 20/46] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/flavors => generated 506 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.339498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62c5754e-5472-4c2e-b740-a0c72710d06c tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.363336 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62c5754e-5472-4c2e-b740-a0c72710d06c tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5487 microversion: 2.1 time: 0.033692 Oct 22 03:04:34.363912 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 21/47] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:34 2022] GET /compute/v2.1/flavors/detail => generated 5487 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:34.370579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0cd1d595-96d8-43a9-ac00-70b964ddce12 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.386571 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0cd1d595-96d8-43a9-ac00-70b964ddce12 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.019513 Oct 22 03:04:34.392494 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 22/48] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:04:34 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.397582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-742e1ba4-a322-4e35-9213-995f4e010388 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.416949 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-742e1ba4-a322-4e35-9213-995f4e010388 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/836bc256-4f5b-48be-bb62-fd848f2e9735" status: 202 len: 0 microversion: 2.1 time: 0.023082 Oct 22 03:04:34.417946 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 23/49] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:04:34 2022] DELETE /compute/v2.1/flavors/836bc256-4f5b-48be-bb62-fd848f2e9735 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:34.422678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b752863-e7da-4b06-a4cc-d681da0e3ed1 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1882320838", "id": 893241962, "os-flavor-access:is_public": "False"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.444904 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b752863-e7da-4b06-a4cc-d681da0e3ed1 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.025764 Oct 22 03:04:34.445506 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 24/50] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/flavors => generated 436 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.452868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30af0c0b-cef9-4087-9cc1-f9534867861f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.463672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:DELETE=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:34.465928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30af0c0b-cef9-4087-9cc1-f9534867861f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:34.466384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30af0c0b-cef9-4087-9cc1-f9534867861f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:34.466817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30af0c0b-cef9-4087-9cc1-f9534867861f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:34.628810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef083616-e67b-435b-894d-d0d1dcf04fd5 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.630304 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30af0c0b-cef9-4087-9cc1-f9534867861f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.1 time: 0.183785 Oct 22 03:04:34.631076 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.632627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ef083616-e67b-435b-894d-d0d1dcf04fd5 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9f34301104ab4b72a4c37bd7138e4560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b9859d98054eae94ebb07fbe62a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef083616-e67b-435b-894d-d0d1dcf04fd5 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Request method failure captured: Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 39 Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU127WfAd9VgQuiVdWrHp-ACP003TKFAfhAqTyfGbvvuAwW9F5WdmD1XpVkWtgfhjG-CZg4ycpC7BtuIBZ7BbnvSe_Hqd_CRh8K8YbJogsRmFOpPBEHxZ60Q2JRLgUIb2wY0netyBIhdwqpBk3A2VsZ4gGygWmwifvHzHOYfe89374tU Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:04:34.634751 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}] Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 9f34301104ab4b72a4c37bd7138e4560 Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: {"add_host": {"host": "n-h1-862416-2"}} Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:04:34.636063 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-862416-2'}}} Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:34.636999 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 22 03:04:34.638240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.639479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef083616-e67b-435b-894d-d0d1dcf04fd5 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:34.639479 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef083616-e67b-435b-894d-d0d1dcf04fd5 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.379903 Oct 22 03:04:34.639479 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 381 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:34.649802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97de5fc3-a909-472d-8349-850c652032f1 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.671223 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97de5fc3-a909-472d-8349-850c652032f1 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038937 Oct 22 03:04:34.671980 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 26/53] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:34.690045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9f0bd10-8808-41c8-8ad6-ebfad66672e0 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.714267 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9f0bd10-8808-41c8-8ad6-ebfad66672e0 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.040881 Oct 22 03:04:34.715153 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 27/54] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:34 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:04:34.720317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0530a089-864c-4a9d-87cb-efcbd60b77f1 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1980921032", "id": "fc794bbe-6dc5-462f-8cae-9c09102a66a8", "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.740719 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0530a089-864c-4a9d-87cb-efcbd60b77f1 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.024414 Oct 22 03:04:34.741306 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 28/55] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/flavors => generated 507 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.745753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df5cab5a-2b05-4337-81bf-877d662ec4b6 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2038760199"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.749426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-df5cab5a-2b05-4337-81bf-877d662ec4b6 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid 05672828-242c-45e1-8ecc-857aa0ee58d7 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:04:34.773859 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-df5cab5a-2b05-4337-81bf-877d662ec4b6 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.031294 Oct 22 03:04:34.774472 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 29/56] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:34.782308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3b57beb-7a37-4157-b1e0-4dfb734cd01b tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.801310 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3b57beb-7a37-4157-b1e0-4dfb734cd01b tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/fc794bbe-6dc5-462f-8cae-9c09102a66a8" status: 202 len: 0 microversion: 2.1 time: 0.023724 Oct 22 03:04:34.802007 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 30/57] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:04:34 2022] DELETE /compute/v2.1/flavors/fc794bbe-6dc5-462f-8cae-9c09102a66a8 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:34.807310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-213614018"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.823632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) {{(pid=120582) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 22 03:04:34.824485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:34.825035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:34.825543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:34.833374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:34.833940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:34.834448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:34.841849 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-213614018 could not be found. Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Request method failure captured: Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 57 Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU129bqZ1BmGSKpvVa9ry6bigUUgGdtCPxaBiLr5fU4ScuLzU8SzNzE45jCWOwl2ww93ISXk08WfiSrper_OyCHgB3vmn_3BNqd96ITHWvXx6u2evU83dcJ2JZCmgtjttSUn-QGWpTdAGfLDByeQlcw-fxX7CTaxCYqBaovC_wV7prrg Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:34.845056 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f48255d03ca14a7983348f809f853256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f48255d03ca14a7983348f809f853256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}] Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f2bc147c69c54292a059b5d7054d7c96 Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: {"add_host": {"host": "tempest-nonexist_host-213614018"}} Oct 22 03:04:34.846390 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: exception: Compute host tempest-nonexist_host-213614018 could not be found. Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-213614018'}}} Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-213614018' is not mapped to any cell Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.847230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 22 03:04:34.848474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-213614018 could not be found. Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-213614018 could not be found. Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:34.849645 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-213614018 could not be found. Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-213614018 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:34.851124 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-91e3cbc5-be47-4779-b3db-952b065bc3e2 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.044618 Oct 22 03:04:34.855189 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 31/58] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:34.856606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-10ae78bc-9516-443a-8aae-6ae80439ae73 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.876974 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-10ae78bc-9516-443a-8aae-6ae80439ae73 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023997 Oct 22 03:04:34.880574 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:34.884405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ab44461-1b82-4f8d-8ee0-d58551b3544b tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:34.907205 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ab44461-1b82-4f8d-8ee0-d58551b3544b tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.028377 Oct 22 03:04:34.907964 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 33/60] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:34 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:04:34.994280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-564816f6-acdb-4b1e-99b2-41098f8bea6c tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:34.998321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-564816f6-acdb-4b1e-99b2-41098f8bea6c tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f456020c38ba4264a825ac23e4489f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb0d8e7fbf34237ac356b91e4881c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-564816f6-acdb-4b1e-99b2-41098f8bea6c tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] Request method failure captured: Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/flavors/893241962/action HTTP/1.1 Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 67 Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU127GLivWQ9vWnpehYe83OzAb0Uj2vs5vCNxPpRUhUvretNgastnttCquFJYuwl01QGfK4YDENXd-SpEUEs91RvZpS9fppRwI5APt_SMMAih7NH97hvppFaW3cwSZ-q4Np8ape4yOL9OBCNR1CBRYqMWzf-EDWK_C68QjhU5xkpc5jk Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: ecb0d8e7fbf34237ac356b91e4881c17 Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-568765774 Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:04:35.000895 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ecb0d8e7fbf34237ac356b91e4881c17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ecb0d8e7fbf34237ac356b91e4881c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ecb0d8e7fbf34237ac356b91e4881c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ecb0d8e7fbf34237ac356b91e4881c17"}]}] Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-568765774 Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: ecb0d8e7fbf34237ac356b91e4881c17 Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-568765774 Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FlavorsAccessNegativeTestJSON-568765774-project Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f456020c38ba4264a825ac23e4489f0f Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-568765774-project Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: {"addTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} Oct 22 03:04:35.002154 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '893241962', 'body': {'addTenantAccess': {'tenant': 'ecb0d8e7fbf34237ac356b91e4881c17'}}} Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:35.002939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 22 03:04:35.004039 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.005940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-564816f6-acdb-4b1e-99b2-41098f8bea6c tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:35.006776 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-564816f6-acdb-4b1e-99b2-41098f8bea6c tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] 10.222.0.25 "POST /compute/v2.1/flavors/893241962/action" status: 403 len: 130 microversion: 2.1 time: 0.369235 Oct 22 03:04:35.007459 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 28/61] 10.222.0.25 () {60 vars in 1197 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/flavors/893241962/action => generated 130 bytes in 370 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:35.014031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-09640409-1ae9-4413-b4ab-8ac69d916c97 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1394188046", "id": 1698553378, "os-flavor-access:is_public": "True"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:35.035539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-09640409-1ae9-4413-b4ab-8ac69d916c97 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026863 Oct 22 03:04:35.036132 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 29/62] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:35.040925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b06821f0-be88-4877-be35-5c8afcef4d51 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b06821f0-be88-4877-be35-5c8afcef4d51 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Request method failure captured: Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 283 Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU129bqZ1BmGSKpvVa9ry6bigUUgGdtCPxaBiLr5fU4ScuLzU8SzNzE45jCWOwl2ww93ISXk08WfiSrper_OyCHgB3vmn_3BNqd96ITHWvXx6u2evU83dcJ2JZCmgtjttSUn-QGWpTdAGfLDByeQlcw-fxX7CTaxCYqBaovC_wV7prrg Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:04:35.046155 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f48255d03ca14a7983348f809f853256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f48255d03ca14a7983348f809f853256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}] Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f2bc147c69c54292a059b5d7054d7c96 Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:35.048123 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:04:35.054482 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:35.055131 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:35.056132 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:35.057053 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:04:35.057053 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:04:35.057053 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:04:35.057053 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.057053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b06821f0-be88-4877-be35-5c8afcef4d51 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:35.057387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b06821f0-be88-4877-be35-5c8afcef4d51 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.010623 Oct 22 03:04:35.057387 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 30/63] 10.222.0.25 () {60 vars in 1165 bytes} [Sat Oct 22 03:04:35 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:04:35.057387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd76cd92-01c3-4626-a742-33d59d3fb9a8 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:35.072849 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd76cd92-01c3-4626-a742-33d59d3fb9a8 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/893241962" status: 202 len: 0 microversion: 2.1 time: 0.022602 Oct 22 03:04:35.074263 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 31/64] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:04:35 2022] DELETE /compute/v2.1/flavors/893241962 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:35.080682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-942d11e4-155b-4092-ad36-766059ebab54 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:35.088380 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-942d11e4-155b-4092-ad36-766059ebab54 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1698553378" status: 200 len: 414 microversion: 2.1 time: 0.012582 Oct 22 03:04:35.089317 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:04:35 2022] GET /compute/v2.1/flavors/1698553378 => generated 414 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:35.094381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39385a28-35bb-42cb-b7a9-34ff7bac04ca tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39385a28-35bb-42cb-b7a9-34ff7bac04ca tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Request method failure captured: Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 27 Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU129bqZ1BmGSKpvVa9ry6bigUUgGdtCPxaBiLr5fU4ScuLzU8SzNzE45jCWOwl2ww93ISXk08WfiSrper_OyCHgB3vmn_3BNqd96ITHWvXx6u2evU83dcJ2JZCmgtjttSUn-QGWpTdAGfLDByeQlcw-fxX7CTaxCYqBaovC_wV7prrg Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:04:35.098505 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f48255d03ca14a7983348f809f853256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f48255d03ca14a7983348f809f853256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}] Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f2bc147c69c54292a059b5d7054d7c96 Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: {"aggregate": {"name": ""}} Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:04:35.099596 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '' Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:35.101368 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:04:35.102497 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.103498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39385a28-35bb-42cb-b7a9-34ff7bac04ca tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:35.103498 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39385a28-35bb-42cb-b7a9-34ff7bac04ca tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009413 Oct 22 03:04:35.103498 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:35 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:04:35.105407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67fadd22-aa84-4209-b3e4-82da41539f6b tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:35.128902 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67fadd22-aa84-4209-b3e4-82da41539f6b tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.026916 Oct 22 03:04:35.130004 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 34/67] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:35 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:35.506221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-569826741", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "availability_zone": "tempest-test_az-393460360"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:35.526726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:35.527427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:35.528048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:35.529034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:35.529717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:35.530149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:35.544176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa52e707-65d3-467d-ade7-6b518480c650 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:35.583766 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa52e707-65d3-467d-ade7-6b518480c650 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.452451 Oct 22 03:04:35.588320 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 35/68] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:35 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:35.598068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-453259fb-edab-4f5b-bef2-356456605ffa tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-116053505"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:35.612402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-453259fb-edab-4f5b-bef2-356456605ffa tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9f34301104ab4b72a4c37bd7138e4560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b9859d98054eae94ebb07fbe62a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-453259fb-edab-4f5b-bef2-356456605ffa tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Request method failure captured: Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 59 Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU127WfAd9VgQuiVdWrHp-ACP003TKFAfhAqTyfGbvvuAwW9F5WdmD1XpVkWtgfhjG-CZg4ycpC7BtuIBZ7BbnvSe_Hqd_CRh8K8YbJogsRmFOpPBEHxZ60Q2JRLgUIb2wY0netyBIhdwqpBk3A2VsZ4gGygWmwifvHzHOYfe89374tU Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:04:35.614528 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}] Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 9f34301104ab4b72a4c37bd7138e4560 Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: {"aggregate": {"name": "tempest-test_aggregate-116053505"}} Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:04:35.615595 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-116053505'}}} Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:35.616685 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:35.617806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 22 03:04:35.618935 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:35.619929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-453259fb-edab-4f5b-bef2-356456605ffa tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:35.620993 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-453259fb-edab-4f5b-bef2-356456605ffa tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.031595 Oct 22 03:04:35.627487 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 36/69] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:35 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:35.634067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d461a94d-ccdd-4e71-b395-326476b6d69d tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1678964595", "id": 787943463, "os-flavor-access:is_public": "False"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:35.651971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:04:35.663357 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d461a94d-ccdd-4e71-b395-326476b6d69d tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.034289 Oct 22 03:04:35.664650 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 37/70] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:35 2022] POST /compute/v2.1/flavors => generated 436 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:35.669724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aefcc645-09d3-48f7-87a3-88c2dadb2520 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:35.695909 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aefcc645-09d3-48f7-87a3-88c2dadb2520 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1698553378" status: 202 len: 0 microversion: 2.1 time: 0.029910 Oct 22 03:04:35.696485 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 38/71] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:35 2022] DELETE /compute/v2.1/flavors/1698553378 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:35.701618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9f13e2e-ecd2-462e-9269-43fb6ba944c3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-508708260"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:35.707190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.aggregate [None req-f9f13e2e-ecd2-462e-9269-43fb6ba944c3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid 859fe710-7435-4437-bfb2-e4112f65478f for aggregate {{(pid=120581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:04:35.737810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9f13e2e-ecd2-462e-9269-43fb6ba944c3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040099 Oct 22 03:04:35.738548 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 39/72] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:35 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:35.743163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3288251-084f-449d-b8f9-889bee050d4b tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:35.913898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:04:35.914339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:04:35.914814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:04:35.915235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:04:35.915649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:04:35.933085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:35.934380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:35.934831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:35.935574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:35.936034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:35.936562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:35.971340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Getting quotas for project 8f8e2401cc2342a1b556d18dc00e1ec1. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:04:35.979060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Getting quotas for user d8e2c4b21fee46a5862d8610e5abe7be and project 8f8e2401cc2342a1b556d18dc00e1ec1. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:04:35.991890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:04:35.994752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:04:36.064042 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee3264a9-dfb2-46b2-b2c8-471cc7ff496d tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155075 Oct 22 03:04:36.064753 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 34/73] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:04:36.069317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-26baea88-d327-4349-afa8-cc2fdbb81c03 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.092900 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-26baea88-d327-4349-afa8-cc2fdbb81c03 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027038 Oct 22 03:04:36.093966 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 35/74] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:36.114687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82efc219-5ac6-4fdf-a21f-0561a56a4467 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-508708260"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.119497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-82efc219-5ac6-4fdf-a21f-0561a56a4467 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid 370b1976-e4b3-49a0-a7f7-e75a85e14116 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:04:36.133985 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-82efc219-5ac6-4fdf-a21f-0561a56a4467 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-508708260 already exists. Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82efc219-5ac6-4fdf-a21f-0561a56a4467 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Request method failure captured: Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 59 Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU129bqZ1BmGSKpvVa9ry6bigUUgGdtCPxaBiLr5fU4ScuLzU8SzNzE45jCWOwl2ww93ISXk08WfiSrper_OyCHgB3vmn_3BNqd96ITHWvXx6u2evU83dcJ2JZCmgtjttSUn-QGWpTdAGfLDByeQlcw-fxX7CTaxCYqBaovC_wV7prrg Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:36.136374 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f48255d03ca14a7983348f809f853256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f48255d03ca14a7983348f809f853256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}] Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f2bc147c69c54292a059b5d7054d7c96 Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: {"aggregate": {"name": "tempest-test_aggregate-508708260"}} Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:36.137448 n-d-862416-2 devstack@n-api.service[120582]: exception: Aggregate tempest-test_aggregate-508708260 already exists. Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-508708260'}}} Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 22 03:04:36.138087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-508708260 already exists. Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:36.139000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-508708260 already exists. Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-508708260 already exists. Oct 22 03:04:36.140198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.142255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82efc219-5ac6-4fdf-a21f-0561a56a4467 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-508708260 already exists. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:36.143593 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82efc219-5ac6-4fdf-a21f-0561a56a4467 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.048416 Oct 22 03:04:36.144669 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 36/75] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:04:36.151713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fa5c08ef-1aee-4381-97d3-c65bce0a6e57 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.152725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fa5c08ef-1aee-4381-97d3-c65bce0a6e57 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:36.244300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fa5c08ef-1aee-4381-97d3-c65bce0a6e57 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:36.263461 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fa5c08ef-1aee-4381-97d3-c65bce0a6e57 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1241 microversion: 2.1 time: 0.116318 Oct 22 03:04:36.265430 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 37/76] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:36.272262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46d070e4-227d-465f-aa4a-d81c369f4a1f tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2836846", "id": 1539288493, "os-flavor-access:is_public": "False"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.292505 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46d070e4-227d-465f-aa4a-d81c369f4a1f tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.025715 Oct 22 03:04:36.293730 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 38/77] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/flavors => generated 427 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.299261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2e4a03d4-6c4e-48f0-b1aa-3f1659fbecea tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.330620 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2e4a03d4-6c4e-48f0-b1aa-3f1659fbecea tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.035399 Oct 22 03:04:36.331316 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:36 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:04:36.338233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cda98668-00eb-4143-a0b9-f2fc671a7834 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "1539288493"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.355909 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-cda98668-00eb-4143-a0b9-f2fc671a7834 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] HTTP exception thrown: Flavor 1539288493 could not be found. Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cda98668-00eb-4143-a0b9-f2fc671a7834 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] Request method failure captured: Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 107 Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127EeBrlHbW5MvWOTseucj_jiMDUs2hr0ml5eH_UpqTX2zhrqBCm5xb-ASW3tQRLJK071vGmsHdGnO8rN6inJqZ0me85fBqbA0_wszUityn7EvvcXR4pXOFNp5Qvh7BZv8_ekjnwOIK3IKc8D3cu-rRmRiV_PWrJe-l2yz6VzuvwUM Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: d6a1d4989d744d0cb329033c2c4a9e8e Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsAdminTestJSON-282019787 Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:36.362782 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d6a1d4989d744d0cb329033c2c4a9e8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6a1d4989d744d0cb329033c2c4a9e8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d6a1d4989d744d0cb329033c2c4a9e8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d6a1d4989d744d0cb329033c2c4a9e8e"}]}] Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsAdminTestJSON-282019787 Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: d6a1d4989d744d0cb329033c2c4a9e8e Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-282019787 Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsAdminTestJSON-282019787-project Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8727d1245e5a426e95c4939715f57b48 Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsAdminTestJSON-282019787-project Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "test", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "1539288493"}} Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:36.364061 n-d-862416-2 devstack@n-api.service[120582]: exception: Flavor 1539288493 could not be found. Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '1539288493'}}} Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1539288493 could not be found. Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.364790 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1539288493 could not be found. Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.365777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.366817 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.366817 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:36.366817 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:36.366817 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1539288493 could not be found. Oct 22 03:04:36.366817 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.366817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cda98668-00eb-4143-a0b9-f2fc671a7834 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] Returning 400 to user: Flavor 1539288493 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:36.366817 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cda98668-00eb-4143-a0b9-f2fc671a7834 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.032069 Oct 22 03:04:36.366817 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 40/79] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/servers => generated 81 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:04:36.371856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a715ba18-cb3d-41cd-96bb-e48de11c5b54 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2050520793"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.376852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-a715ba18-cb3d-41cd-96bb-e48de11c5b54 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid 16e657ad-9b00-4054-a41b-0a0fc829d8ab for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:04:36.404109 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a715ba18-cb3d-41cd-96bb-e48de11c5b54 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037119 Oct 22 03:04:36.406020 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 41/80] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.411373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d6a0d394-476c-4d00-8678-efab88acd8ea tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.436271 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d6a0d394-476c-4d00-8678-efab88acd8ea tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1539288493" status: 202 len: 0 microversion: 2.1 time: 0.028382 Oct 22 03:04:36.441523 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 42/81] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:36 2022] DELETE /compute/v2.1/flavors/1539288493 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:36.447592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d79218bc-1d3f-4b86-afa1-ca2069acf7ab tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.449222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d79218bc-1d3f-4b86-afa1-ca2069acf7ab tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9f34301104ab4b72a4c37bd7138e4560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b9859d98054eae94ebb07fbe62a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d79218bc-1d3f-4b86-afa1-ca2069acf7ab tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Request method failure captured: Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127WfAd9VgQuiVdWrHp-ACP003TKFAfhAqTyfGbvvuAwW9F5WdmD1XpVkWtgfhjG-CZg4ycpC7BtuIBZ7BbnvSe_Hqd_CRh8K8YbJogsRmFOpPBEHxZ60Q2JRLgUIb2wY0netyBIhdwqpBk3A2VsZ4gGygWmwifvHzHOYfe89374tU Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:36.453064 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}] Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 9f34301104ab4b72a4c37bd7138e4560 Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 22 03:04:36.454478 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '6'} Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:36.455162 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 22 03:04:36.456313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.457106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d79218bc-1d3f-4b86-afa1-ca2069acf7ab tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:36.457992 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d79218bc-1d3f-4b86-afa1-ca2069acf7ab tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.014731 Oct 22 03:04:36.458880 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 43/82] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:36 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:36.463820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-779a767d-3b9a-4829-95f2-0324aa966c37 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.493313 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-779a767d-3b9a-4829-95f2-0324aa966c37 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033225 Oct 22 03:04:36.494578 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 44/83] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:36.511907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-33e7e3a3-2868-4242-8e66-4d581caa78a7 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.526639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=8,nova_api:DELETE=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:36.549293 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-33e7e3a3-2868-4242-8e66-4d581caa78a7 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.053353 Oct 22 03:04:36.550796 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 45/84] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:36 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:04:36.556176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20d1dbd1-b273-4a8a-8b65-47bc49a11f8c tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-999722463", "id": 718863656, "os-flavor-access:is_public": "False"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.593728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3288251-084f-449d-b8f9-889bee050d4b tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/787943463/action" status: 200 len: 96 microversion: 2.1 time: 0.854048 Oct 22 03:04:36.596052 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20d1dbd1-b273-4a8a-8b65-47bc49a11f8c tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.043900 Oct 22 03:04:36.596809 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 40/85] 10.222.0.25 () {60 vars in 1197 bytes} [Sat Oct 22 03:04:35 2022] POST /compute/v2.1/flavors/787943463/action => generated 96 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:36.604936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 46/86] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/flavors => generated 411 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.616168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-133a0494-944f-476d-b000-4d99533662c3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.617869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5597978e-457c-449a-a19e-741ab0cec736 tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.624651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5597978e-457c-449a-a19e-741ab0cec736 tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f456020c38ba4264a825ac23e4489f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb0d8e7fbf34237ac356b91e4881c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5597978e-457c-449a-a19e-741ab0cec736 tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] Request method failure captured: Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/flavors/787943463/action HTTP/1.1 Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 70 Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127GLivWQ9vWnpehYe83OzAb0Uj2vs5vCNxPpRUhUvretNgastnttCquFJYuwl01QGfK4YDENXd-SpEUEs91RvZpS9fppRwI5APt_SMMAih7NH97hvppFaW3cwSZ-q4Np8ape4yOL9OBCNR1CBRYqMWzf-EDWK_C68QjhU5xkpc5jk Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: ecb0d8e7fbf34237ac356b91e4881c17 Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-568765774 Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:36.630597 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ecb0d8e7fbf34237ac356b91e4881c17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ecb0d8e7fbf34237ac356b91e4881c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ecb0d8e7fbf34237ac356b91e4881c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ecb0d8e7fbf34237ac356b91e4881c17"}]}] Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-568765774 Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: ecb0d8e7fbf34237ac356b91e4881c17 Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-568765774 Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsAccessNegativeTestJSON-568765774-project Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f456020c38ba4264a825ac23e4489f0f Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-568765774-project Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: {"removeTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} Oct 22 03:04:36.631770 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '787943463', 'body': {'removeTenantAccess': {'tenant': 'ecb0d8e7fbf34237ac356b91e4881c17'}}} Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can( Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:36.632463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 22 03:04:36.633434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.634392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5597978e-457c-449a-a19e-741ab0cec736 tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:36.635484 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5597978e-457c-449a-a19e-741ab0cec736 tempest-FlavorsAccessNegativeTestJSON-568765774 tempest-FlavorsAccessNegativeTestJSON-568765774-project] 10.222.0.25 "POST /compute/v2.1/flavors/787943463/action" status: 403 len: 133 microversion: 2.1 time: 0.027374 Oct 22 03:04:36.639447 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 47/87] 10.222.0.25 () {60 vars in 1197 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/flavors/787943463/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:36.650132 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-133a0494-944f-476d-b000-4d99533662c3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 22 03:04:36.655867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-853ff8ac-6990-4045-a2c2-8a4765755ed2 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1094044905", "id": 1783510818, "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-133a0494-944f-476d-b000-4d99533662c3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Request method failure captured: Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU129bqZ1BmGSKpvVa9ry6bigUUgGdtCPxaBiLr5fU4ScuLzU8SzNzE45jCWOwl2ww93ISXk08WfiSrper_OyCHgB3vmn_3BNqd96ITHWvXx6u2evU83dcJ2JZCmgtjttSUn-QGWpTdAGfLDByeQlcw-fxX7CTaxCYqBaovC_wV7prrg Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:04:36.660868 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f48255d03ca14a7983348f809f853256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f48255d03ca14a7983348f809f853256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}] Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f2bc147c69c54292a059b5d7054d7c96 Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: exception: Aggregate -1 could not be found. Oct 22 03:04:36.662014 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '-1'} Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 03:04:36.662624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.663541 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-133a0494-944f-476d-b000-4d99533662c3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-133a0494-944f-476d-b000-4d99533662c3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.064579 Oct 22 03:04:36.664805 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 41/88] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:04:36 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:04:36.678890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa2ffbed-634b-4a15-ba2d-4fefcdef0c76 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ecb0d8e7fbf34237ac356b91e4881c17"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.700673 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-853ff8ac-6990-4045-a2c2-8a4765755ed2 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.057986 Oct 22 03:04:36.701446 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 48/89] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/flavors => generated 414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.720194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a8efbfa9-d80d-4ba0-85ae-d400141708d7 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1010254936"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:36.724030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-a8efbfa9-d80d-4ba0-85ae-d400141708d7 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid 25a13383-a419-4105-8059-8b005b7f93ca for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:04:36.759524 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a8efbfa9-d80d-4ba0-85ae-d400141708d7 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055483 Oct 22 03:04:36.761581 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 49/90] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.769286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67878d2f-b8f8-432e-a89f-ae456a719145 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.813174 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-67878d2f-b8f8-432e-a89f-ae456a719145 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 840 microversion: 2.1 time: 0.049766 Oct 22 03:04:36.816897 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 50/91] 10.222.0.25 () {58 vars in 1169 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 840 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.828848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1c3d825-a8a4-4221-96f1-e533d70ac496 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.831814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a1c3d825-a8a4-4221-96f1-e533d70ac496 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9f34301104ab4b72a4c37bd7138e4560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b9859d98054eae94ebb07fbe62a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1c3d825-a8a4-4221-96f1-e533d70ac496 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Request method failure captured: Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127WfAd9VgQuiVdWrHp-ACP003TKFAfhAqTyfGbvvuAwW9F5WdmD1XpVkWtgfhjG-CZg4ycpC7BtuIBZ7BbnvSe_Hqd_CRh8K8YbJogsRmFOpPBEHxZ60Q2JRLgUIb2wY0netyBIhdwqpBk3A2VsZ4gGygWmwifvHzHOYfe89374tU Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:36.834176 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}] Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 9f34301104ab4b72a4c37bd7138e4560 Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 22 03:04:36.835319 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '7'} Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:36.835935 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.837355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1c3d825-a8a4-4221-96f1-e533d70ac496 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:36.838182 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1c3d825-a8a4-4221-96f1-e533d70ac496 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.016118 Oct 22 03:04:36.838182 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 51/92] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:36.840822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c76ad2f-2cbd-4ba5-9931-0a6c16243020 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.852816 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c76ad2f-2cbd-4ba5-9931-0a6c16243020 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 840 microversion: 2.1 time: 0.015239 Oct 22 03:04:36.853828 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 52/93] 10.222.0.25 () {58 vars in 1177 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 840 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.858242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f77115dd-71dd-4974-a634-8469400c6dca tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.897291 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f77115dd-71dd-4974-a634-8469400c6dca tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.036459 Oct 22 03:04:36.897291 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 53/94] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:36 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:04:36.899413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e82f26b5-c5e0-4dcb-b9ff-7d587fb9ed08 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.916044 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e82f26b5-c5e0-4dcb-b9ff-7d587fb9ed08 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 840 microversion: 2.1 time: 0.022428 Oct 22 03:04:36.917410 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 54/95] 10.222.0.25 () {58 vars in 1171 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 840 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.923583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c2b394f-c0b0-411a-adaf-8c11f05f7ccd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.932288 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3c2b394f-c0b0-411a-adaf-8c11f05f7ccd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c2b394f-c0b0-411a-adaf-8c11f05f7ccd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Request method failure captured: Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU129bqZ1BmGSKpvVa9ry6bigUUgGdtCPxaBiLr5fU4ScuLzU8SzNzE45jCWOwl2ww93ISXk08WfiSrper_OyCHgB3vmn_3BNqd96ITHWvXx6u2evU83dcJ2JZCmgtjttSUn-QGWpTdAGfLDByeQlcw-fxX7CTaxCYqBaovC_wV7prrg Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:36.934056 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f48255d03ca14a7983348f809f853256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f48255d03ca14a7983348f809f853256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}] Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f2bc147c69c54292a059b5d7054d7c96 Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: exception: Aggregate -1 could not be found. Oct 22 03:04:36.935178 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '-1'} Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.936102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 22 03:04:36.937899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.938826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c2b394f-c0b0-411a-adaf-8c11f05f7ccd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:36.938826 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c2b394f-c0b0-411a-adaf-8c11f05f7ccd tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.017049 Oct 22 03:04:36.938826 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 55/96] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:04:36.942088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77a89429-258f-4831-8889-f7e246fbaab6 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.954363 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77a89429-258f-4831-8889-f7e246fbaab6 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 840 microversion: 2.1 time: 0.016742 Oct 22 03:04:36.955243 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 56/97] 10.222.0.25 () {58 vars in 1169 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 840 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:36.959569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-883c3a5a-b9e8-47d4-92cc-d5dac25a14e4 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.961184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-883c3a5a-b9e8-47d4-92cc-d5dac25a14e4 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9f34301104ab4b72a4c37bd7138e4560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b9859d98054eae94ebb07fbe62a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-883c3a5a-b9e8-47d4-92cc-d5dac25a14e4 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Request method failure captured: Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127WfAd9VgQuiVdWrHp-ACP003TKFAfhAqTyfGbvvuAwW9F5WdmD1XpVkWtgfhjG-CZg4ycpC7BtuIBZ7BbnvSe_Hqd_CRh8K8YbJogsRmFOpPBEHxZ60Q2JRLgUIb2wY0netyBIhdwqpBk3A2VsZ4gGygWmwifvHzHOYfe89374tU Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:36.962753 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}] Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 9f34301104ab4b72a4c37bd7138e4560 Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 22 03:04:36.963840 n-d-862416-2 devstack@n-api.service[120582]: action_args: {} Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:36.965096 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:36.966363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-883c3a5a-b9e8-47d4-92cc-d5dac25a14e4 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:36.969045 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-883c3a5a-b9e8-47d4-92cc-d5dac25a14e4 tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.008053 Oct 22 03:04:36.969045 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 57/98] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:36.971301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3cb8d5c-d75f-4f03-84c0-b1483b2d2260 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:36.993865 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3cb8d5c-d75f-4f03-84c0-b1483b2d2260 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.027989 Oct 22 03:04:36.994776 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 58/99] 10.222.0.25 () {58 vars in 1169 bytes} [Sat Oct 22 03:04:36 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:37.015443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-371e1438-1b57-4486-b45f-b5e9d03b0d97 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.039318 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-371e1438-1b57-4486-b45f-b5e9d03b0d97 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.027637 Oct 22 03:04:37.044830 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 59/100] 10.222.0.25 () {58 vars in 1175 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:37.058536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0340a068-aae5-483b-9c6e-aa98d8526cf5 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.086386 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0340a068-aae5-483b-9c6e-aa98d8526cf5 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.030640 Oct 22 03:04:37.088021 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 60/101] 10.222.0.25 () {58 vars in 1173 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:37.110140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9e9709a6-36d0-4c8d-b9c3-19d4cef63a48 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.139048 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9e9709a6-36d0-4c8d-b9c3-19d4cef63a48 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.035203 Oct 22 03:04:37.140968 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 61/102] 10.222.0.25 () {58 vars in 1169 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:37.161746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4d80ef9a-9b44-458d-8e4e-56389507919c tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.189485 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4d80ef9a-9b44-458d-8e4e-56389507919c tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1783510818" status: 202 len: 0 microversion: 2.1 time: 0.031528 Oct 22 03:04:37.193477 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 62/103] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:37 2022] DELETE /compute/v2.1/flavors/1783510818 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:37.198461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-78a5f270-eda9-400f-b57d-91c579bd7e75 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.220647 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-78a5f270-eda9-400f-b57d-91c579bd7e75 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026030 Oct 22 03:04:37.221598 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 63/104] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:37.239955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72f45750-af8a-440e-bf64-cc898173dbf9 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.259236 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72f45750-af8a-440e-bf64-cc898173dbf9 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/718863656" status: 202 len: 0 microversion: 2.1 time: 0.023061 Oct 22 03:04:37.263139 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 64/105] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:04:37 2022] DELETE /compute/v2.1/flavors/718863656 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:37.268512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e68a0cf9-df2a-4203-8422-bd4149393edc tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.297601 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e68a0cf9-df2a-4203-8422-bd4149393edc tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033149 Oct 22 03:04:37.299040 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 65/106] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:37.305123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2aded19-1412-4fd3-b118-70f3caeda357 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.306074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2aded19-1412-4fd3-b118-70f3caeda357 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:37.380127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e2aded19-1412-4fd3-b118-70f3caeda357 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:37.388450 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2aded19-1412-4fd3-b118-70f3caeda357 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1241 microversion: 2.1 time: 0.087149 Oct 22 03:04:37.389325 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 66/107] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:37.394625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-388ebd59-42d9-4544-a083-9cce3431ef8b tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-125754886", "id": 357908811, "os-flavor-access:is_public": "False"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:37.419977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-388ebd59-42d9-4544-a083-9cce3431ef8b tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.029013 Oct 22 03:04:37.420648 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 67/108] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:37 2022] POST /compute/v2.1/flavors => generated 411 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:37.433561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3e72810-8daa-48c9-87bc-a11662a139a2 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.446658 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa2ffbed-634b-4a15-ba2d-4fefcdef0c76 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/787943463/action" status: 200 len: 21 microversion: 2.1 time: 0.781103 Oct 22 03:04:37.447995 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 42/109] 10.222.0.25 () {60 vars in 1197 bytes} [Sat Oct 22 03:04:36 2022] POST /compute/v2.1/flavors/787943463/action => generated 21 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:37.459747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab6d996b-e93d-4029-9d9c-7b1d96cf9977 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.480599 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3e72810-8daa-48c9-87bc-a11662a139a2 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049072 Oct 22 03:04:37.481332 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 68/110] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:37.501720 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab6d996b-e93d-4029-9d9c-7b1d96cf9977 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/787943463" status: 202 len: 0 microversion: 2.1 time: 0.047398 Oct 22 03:04:37.502373 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 43/111] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:04:37 2022] DELETE /compute/v2.1/flavors/787943463 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:37.508613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-683da3b7-744e-4932-a58d-08dcced9db5a tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.510832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-041b30e6-8ac0-45b4-a13d-4591e9322b18 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.550472 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-683da3b7-744e-4932-a58d-08dcced9db5a tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053302 Oct 22 03:04:37.550983 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-041b30e6-8ac0-45b4-a13d-4591e9322b18 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042909 Oct 22 03:04:37.565002 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 69/112] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:37.565161 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 44/113] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:37.580034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef59c89e-0cee-42ca-96e2-a0fbd7d7ea16 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.584827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5103286-cc9f-4fab-a5a8-51cca96bb5f3 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1283593132", "id": 1995241312, "os-flavor-access:is_public": "False"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:37.618064 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef59c89e-0cee-42ca-96e2-a0fbd7d7ea16 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/357908811" status: 202 len: 0 microversion: 2.1 time: 0.047463 Oct 22 03:04:37.619025 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 70/114] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:04:37 2022] DELETE /compute/v2.1/flavors/357908811 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:37.619566 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5103286-cc9f-4fab-a5a8-51cca96bb5f3 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.043844 Oct 22 03:04:37.631670 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 45/115] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:37 2022] POST /compute/v2.1/flavors => generated 439 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:37.632002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d621ba59-9694-41ba-8e16-69a10e55d36c tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.637121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-355af8b6-ef38-40ad-aaba-f543562fc6b3 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "54970e22740d48179ad8ddb54b2018bf"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:37.664581 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d621ba59-9694-41ba-8e16-69a10e55d36c tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039879 Oct 22 03:04:37.664581 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 71/116] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:37.682366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3bcd4b7-f601-4a3b-9e91-133a5f70b51a tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-195254972", "id": 1717656919, "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:37.707251 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3bcd4b7-f601-4a3b-9e91-133a5f70b51a tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.028447 Oct 22 03:04:37.708019 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 72/117] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:37 2022] POST /compute/v2.1/flavors => generated 413 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:37.721815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e38b3e8b-76d8-48d5-b324-090d1eef4a77 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.749709 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e38b3e8b-76d8-48d5-b324-090d1eef4a77 tempest-FlavorsAdminTestJSON-282019787 tempest-FlavorsAdminTestJSON-282019787-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.032804 Oct 22 03:04:37.751092 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 73/118] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:37.770996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fccab91d-2c06-4ed2-b42c-f922f0bc4c5c tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.791790 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fccab91d-2c06-4ed2-b42c-f922f0bc4c5c tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1717656919" status: 202 len: 0 microversion: 2.1 time: 0.024782 Oct 22 03:04:37.793390 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 74/119] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:37 2022] DELETE /compute/v2.1/flavors/1717656919 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:37.801338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7fdb0a4-8c15-4b46-83b2-83ace61e0747 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:37.825067 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e7fdb0a4-8c15-4b46-83b2-83ace61e0747 tempest-FlavorsAdminTestJSON-1825103529 tempest-FlavorsAdminTestJSON-1825103529-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027431 Oct 22 03:04:37.826358 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 75/120] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:38.130399 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-355af8b6-ef38-40ad-aaba-f543562fc6b3 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] HTTP exception thrown: Flavor access not found for 31 / 54970e22740d48179ad8ddb54b2018bf combination. Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-355af8b6-ef38-40ad-aaba-f543562fc6b3 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Request method failure captured: Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/flavors/1995241312/action HTTP/1.1 Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 70 Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU129tQwcrLk2DzUwynBpNuEfe9N3QS6SzM8qePYS6iDh_i0XwD2SyR1qqyRcMfQ4IFdlROQto61tCMCUjb62SnNo5dwsdwBB48mZUYYzBPA3BARHLWJpOclfgSGINW8lC6Z7D5dIepdmj10Ufct2ovLbQWJ3ipvfVuR-YkyhOdDsJbo Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e10dc9d918f949b5ab3acf46747b8766 Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:04:38.132498 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e10dc9d918f949b5ab3acf46747b8766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e10dc9d918f949b5ab3acf46747b8766"}]}] Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e10dc9d918f949b5ab3acf46747b8766 Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-102298224 Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 40a1b28e10d84dd586f95ff4925fd6ae Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: {"removeTenantAccess": {"tenant": "54970e22740d48179ad8ddb54b2018bf"}} Oct 22 03:04:38.133627 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: exception: Flavor access not found for 31 / 54970e22740d48179ad8ddb54b2018bf combination. Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1995241312', 'body': {'removeTenantAccess': {'tenant': '54970e22740d48179ad8ddb54b2018bf'}}} Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 22 03:04:38.134263 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / 54970e22740d48179ad8ddb54b2018bf combination. Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / 54970e22740d48179ad8ddb54b2018bf combination. Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:38.135228 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:38.138023 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:38.138023 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:38.138023 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:38.138023 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:38.138023 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / 54970e22740d48179ad8ddb54b2018bf combination. Oct 22 03:04:38.138023 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:38.140575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-355af8b6-ef38-40ad-aaba-f543562fc6b3 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Returning 404 to user: Flavor access not found for 31 / 54970e22740d48179ad8ddb54b2018bf combination. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:38.142351 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-355af8b6-ef38-40ad-aaba-f543562fc6b3 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1995241312/action" status: 404 len: 124 microversion: 2.1 time: 0.508969 Oct 22 03:04:38.143482 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 46/121] 10.222.0.25 () {60 vars in 1200 bytes} [Sat Oct 22 03:04:37 2022] POST /compute/v2.1/flavors/1995241312/action => generated 124 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:38.152382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65f6afac-a616-44b9-80f8-b530ef884d7d tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:38.172943 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65f6afac-a616-44b9-80f8-b530ef884d7d tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1995241312" status: 202 len: 0 microversion: 2.1 time: 0.024528 Oct 22 03:04:38.173475 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 76/122] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:04:38 2022] DELETE /compute/v2.1/flavors/1995241312 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:04:38.183004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94074271-75ad-4162-85d0-0a06c1008977 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:38.207469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-94074271-75ad-4162-85d0-0a06c1008977 tempest-FlavorsAccessNegativeTestJSON-102298224 tempest-FlavorsAccessNegativeTestJSON-102298224-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029962 Oct 22 03:04:38.208857 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 47/123] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:38.412933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:38.413972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:38.429401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:38.430045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:38.430645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:38.431531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:38.432222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:38.432722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:38.676939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:38.692959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-958bf044-31de-4eef-a42c-c2a58b989570 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1289 microversion: 2.1 time: 0.283884 Oct 22 03:04:38.693937 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 48/124] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:38 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1289 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:38.865491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1788578397", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:38.872544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:DELETE=19,nova_api:SELECT=76,nova_api:INSERT=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:38.938350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:04:39.440943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:04:39.441590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:04:39.442072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:04:39.443051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:04:39.443480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:04:39.465647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:39.466139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:39.466579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:39.468386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:39.476153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:39.476788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:39.528783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Getting quotas for project fb48d5632707444191801ef0a8940ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:04:39.541221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Getting quotas for user f0cf56d422d54c14a43abdc352756ada and project fb48d5632707444191801ef0a8940ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:04:39.579345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:04:39.584518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:04:39.669031 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68544e4f-941c-48a6-827b-0cd002cef731 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348336 Oct 22 03:04:39.681753 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 77/125] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:04:39.691247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9dfb9155-6816-4285-8b12-71534a593e56 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:39.691862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9dfb9155-6816-4285-8b12-71534a593e56 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:39.833972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f8a8d098-9b48-4adb-92e8-05f90027c570 tempest-FlavorMetadataValidation-47572318 tempest-FlavorMetadataValidation-47572318-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-931214272", "id": 1025703469, "os-flavor-access:is_public": "True"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:39.876497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9dfb9155-6816-4285-8b12-71534a593e56 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:39.882094 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f8a8d098-9b48-4adb-92e8-05f90027c570 tempest-FlavorMetadataValidation-47572318 tempest-FlavorMetadataValidation-47572318-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.633551 Oct 22 03:04:39.893125 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 49/126] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:04:39 2022] POST /compute/v2.1/flavors => generated 470 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:04:39.895247 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9dfb9155-6816-4285-8b12-71534a593e56 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1220 microversion: 2.1 time: 0.212265 Oct 22 03:04:39.895866 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 78/127] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:39 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1220 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:39.911821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:39.911821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:39.912091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd7f516f-72c3-432a-86ea-1cbc8052ea1d tempest-FlavorMetadataValidation-47572318 tempest-FlavorMetadataValidation-47572318-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:39.914158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:39.916474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:39.917234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:39.920760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:39.923281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:39.924003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:40.100618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:40.111831 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf72f3da-bf80-426e-ab86-26f10b01dcab tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1295 microversion: 2.1 time: 0.225309 Oct 22 03:04:40.112477 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 50/128] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:39 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1295 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:40.602992 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd7f516f-72c3-432a-86ea-1cbc8052ea1d tempest-FlavorMetadataValidation-47572318 tempest-FlavorMetadataValidation-47572318-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1025703469/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.702055 Oct 22 03:04:40.603895 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 79/129] 10.222.0.25 () {62 vars in 1265 bytes} [Sat Oct 22 03:04:39 2022] POST /compute/v2.1/flavors/1025703469/os-extra_specs => generated 62 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:40.621585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7edfb6f-8d7e-4941-8b88-07a816127fc9 tempest-FlavorMetadataValidation-47572318 tempest-FlavorMetadataValidation-47572318-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:40.681454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:40.696940 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a7edfb6f-8d7e-4941-8b88-07a816127fc9 tempest-FlavorMetadataValidation-47572318 tempest-FlavorMetadataValidation-47572318-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1025703469" status: 202 len: 0 microversion: 2.86 time: 0.082967 Oct 22 03:04:40.697558 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 51/130] 10.222.0.25 () {60 vars in 1202 bytes} [Sat Oct 22 03:04:40 2022] DELETE /compute/v2.1/flavors/1025703469 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:04:40.707783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-def9c69c-4fd4-493f-a3a4-613cd90fa7ce tempest-FlavorMetadataValidation-47572318 tempest-FlavorMetadataValidation-47572318-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:40.777904 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-def9c69c-4fd4-493f-a3a4-613cd90fa7ce tempest-FlavorMetadataValidation-47572318 tempest-FlavorMetadataValidation-47572318-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.073478 Oct 22 03:04:40.799267 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 80/131] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:04:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:04:40.919046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-945e6039-c72f-4e2e-a3a8-ea5ae9033f36 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:40.920629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-945e6039-c72f-4e2e-a3a8-ea5ae9033f36 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:41.082251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-945e6039-c72f-4e2e-a3a8-ea5ae9033f36 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:41.101512 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-945e6039-c72f-4e2e-a3a8-ea5ae9033f36 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1220 microversion: 2.1 time: 0.186251 Oct 22 03:04:41.111499 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 52/132] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:40 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1220 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:41.141921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:41.144674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:41.156356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:41.156886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:41.157357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:41.159499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:41.159799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:41.160305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:41.511377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:41.521635 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0996c1e1-2e38-40a1-96da-79220611a61b tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.386307 Oct 22 03:04:41.523752 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 53/133] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:41 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:42.150954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:42.151577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:42.155764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=17,nova_api:INSERT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:42.167812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:42.170429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:42.172756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:42.174078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:42.174785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:42.175609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:42.291282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:42.303257 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab1b57ce-80e8-405c-9de8-a624bd39d11d tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1272 microversion: 2.1 time: 0.160230 Oct 22 03:04:42.306581 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 54/134] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:42 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:42.551805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:42.552648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:42.560999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:42.563285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:42.564519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:42.565919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:42.567386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:42.572116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:42.829688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-550134d9-595b-494d-9aef-24401e048651 tempest-QuotaClassesAdminTestJSON-703900470 tempest-QuotaClassesAdminTestJSON-703900470-project-admin] Calling method '.version_select at 0x7f0d1ae7c550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:42.866409 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-550134d9-595b-494d-9aef-24401e048651 tempest-QuotaClassesAdminTestJSON-703900470 tempest-QuotaClassesAdminTestJSON-703900470-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 1.891943 Oct 22 03:04:42.868669 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 81/135] 10.222.0.25 () {58 vars in 1185 bytes} [Sat Oct 22 03:04:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:42.884608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-505de850-82bb-4b83-9960-b2f30600f3d4 tempest-QuotaClassesAdminTestJSON-703900470 tempest-QuotaClassesAdminTestJSON-703900470-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1ade03a0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:42.974479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:42.997532 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1f2fc30-3781-4218-853e-99e4cd419797 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.448641 Oct 22 03:04:43.001212 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 55/136] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:42 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:43.336704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:43.339061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:43.357201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:43.357989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:43.358735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:43.360073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:43.362590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:43.363379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:43.516459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:43.529490 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b81a99d6-3d5f-4d00-8587-7d13cbfd3fd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1278 microversion: 2.1 time: 0.198266 Oct 22 03:04:43.531179 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 56/137] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:43 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:43.555932 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-505de850-82bb-4b83-9960-b2f30600f3d4 tempest-QuotaClassesAdminTestJSON-703900470 tempest-QuotaClassesAdminTestJSON-703900470-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.676019 Oct 22 03:04:43.557330 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 82/138] 10.222.0.25 () {60 vars in 1206 bytes} [Sat Oct 22 03:04:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:43.593573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-88ba4c66-331e-49cd-a844-a36772752255 tempest-QuotaClassesAdminTestJSON-703900470 tempest-QuotaClassesAdminTestJSON-703900470-project-admin] Calling method '.version_select at 0x7f0d1b037550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:43.694757 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-88ba4c66-331e-49cd-a844-a36772752255 tempest-QuotaClassesAdminTestJSON-703900470 tempest-QuotaClassesAdminTestJSON-703900470-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.126958 Oct 22 03:04:43.696463 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 57/139] 10.222.0.25 () {58 vars in 1185 bytes} [Sat Oct 22 03:04:43 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:43.709426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8246aa58-8b01-4b4e-97e1-947c175ee70e tempest-QuotaClassesAdminTestJSON-703900470 tempest-QuotaClassesAdminTestJSON-703900470-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1ad75310>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:43.734816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=13 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:43.892795 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8246aa58-8b01-4b4e-97e1-947c175ee70e tempest-QuotaClassesAdminTestJSON-703900470 tempest-QuotaClassesAdminTestJSON-703900470-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.185900 Oct 22 03:04:43.904564 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 83/140] 10.222.0.25 () {60 vars in 1206 bytes} [Sat Oct 22 03:04:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:44.027210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:44.028165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:44.037068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:44.037639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:44.044699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:44.046188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:44.046889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:44.047334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:44.522537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:44.540547 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-66703306-85f4-495d-84d4-0781dd9c2d40 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.517091 Oct 22 03:04:44.544654 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 58/141] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:44 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:44.558688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:44.559470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:44.572805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:44.573573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:44.574679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:44.576064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:44.577913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:44.580105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:44.789700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:44.804390 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-178a7098-14a1-4ada-9c4e-498504ef6460 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1278 microversion: 2.1 time: 0.250153 Oct 22 03:04:44.835968 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 59/142] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:44 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:45.282646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aeb1d0e7-318a-47eb-ad3f-80634c3c4372 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Calling method '.version_select at 0x7f0d1ad8cee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:45.292219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeb1d0e7-318a-47eb-ad3f-80634c3c4372 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.294309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeb1d0e7-318a-47eb-ad3f-80634c3c4372 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.296396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeb1d0e7-318a-47eb-ad3f-80634c3c4372 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.301043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeb1d0e7-318a-47eb-ad3f-80634c3c4372 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.305713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeb1d0e7-318a-47eb-ad3f-80634c3c4372 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.307556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeb1d0e7-318a-47eb-ad3f-80634c3c4372 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.399818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aeb1d0e7-318a-47eb-ad3f-80634c3c4372 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 1.013489 Oct 22 03:04:45.402793 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 84/143] 10.222.0.25 () {58 vars in 1128 bytes} [Sat Oct 22 03:04:44 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:04:45.413128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-039a0ef0-5302-492e-a065-cca26461b239 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Calling method '.version_select at 0x7f0d1b037820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:45.430182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-039a0ef0-5302-492e-a065-cca26461b239 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.430679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-039a0ef0-5302-492e-a065-cca26461b239 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.431120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-039a0ef0-5302-492e-a065-cca26461b239 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.431857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-039a0ef0-5302-492e-a065-cca26461b239 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.432375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-039a0ef0-5302-492e-a065-cca26461b239 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.432778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-039a0ef0-5302-492e-a065-cca26461b239 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.502414 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-039a0ef0-5302-492e-a065-cca26461b239 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.092864 Oct 22 03:04:45.503853 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 60/144] 10.222.0.25 () {58 vars in 1139 bytes} [Sat Oct 22 03:04:45 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:45.515255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43cc1c75-2d89-4a04-9f9b-9db4b83ae432 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Calling method '.version_select at 0x7f0d1ad75160>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:45.519843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43cc1c75-2d89-4a04-9f9b-9db4b83ae432 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.524144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43cc1c75-2d89-4a04-9f9b-9db4b83ae432 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.524794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43cc1c75-2d89-4a04-9f9b-9db4b83ae432 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.527739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43cc1c75-2d89-4a04-9f9b-9db4b83ae432 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.528536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43cc1c75-2d89-4a04-9f9b-9db4b83ae432 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.529046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43cc1c75-2d89-4a04-9f9b-9db4b83ae432 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.569285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:45.570755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:45.584263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.588784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.589469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.593998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.594766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.595420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.614447 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43cc1c75-2d89-4a04-9f9b-9db4b83ae432 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.102962 Oct 22 03:04:45.626095 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 85/145] 10.222.0.25 () {58 vars in 1145 bytes} [Sat Oct 22 03:04:45 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:04:45.853410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:45.854555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:45.895525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.896161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.896518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.897257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:45.899366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:45.899734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:45.914294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:45.933613 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb8eb7d4-35e1-45f4-b04e-62df0e4bc6c8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.362422 Oct 22 03:04:45.938674 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 61/146] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:45 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:46.918966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:46.943600 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2b55abea-7892-4444-92d0-02fcf9fbfdef tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 1.098334 Oct 22 03:04:46.944614 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 86/147] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:45 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:46.971710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:46.977294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:46.998887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:47.000913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:47.002730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:47.004891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:47.006430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:47.007356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:47.430491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:47.453839 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-62e9d84f-b270-40df-a3eb-76058edd07e6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.489133 Oct 22 03:04:47.455650 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 62/148] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:46 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:47.969005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:47.969761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:47.980932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:47.981436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:47.981883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:47.982613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:47.993674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:47.994149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:48.725670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6d6862c0-0a6b-4128-89ff-753026f38581 req-6d407b56-4f3f-4730-acdb-2d62b2baf0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fb7988-2331-4539-bc11-7f0e337f1a8c", "tag": "65019e24-b881-4ea6-ab0f-f7ef34f2d814"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:48.785327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6d6862c0-0a6b-4128-89ff-753026f38581 req-6d407b56-4f3f-4730-acdb-2d62b2baf0a1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:48.790253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6d6862c0-0a6b-4128-89ff-753026f38581 req-6d407b56-4f3f-4730-acdb-2d62b2baf0a1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:48.791299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6d6862c0-0a6b-4128-89ff-753026f38581 req-6d407b56-4f3f-4730-acdb-2d62b2baf0a1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:48.850655 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6d6862c0-0a6b-4128-89ff-753026f38581 req-6d407b56-4f3f-4730-acdb-2d62b2baf0a1 service nova] Creating event network-changed:65019e24-b881-4ea6-ab0f-f7ef34f2d814 for instance 40fb7988-2331-4539-bc11-7f0e337f1a8c on n-h1-862416-2 Oct 22 03:04:48.852162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6d6862c0-0a6b-4128-89ff-753026f38581 req-6d407b56-4f3f-4730-acdb-2d62b2baf0a1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:04:48.854054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6d6862c0-0a6b-4128-89ff-753026f38581 req-6d407b56-4f3f-4730-acdb-2d62b2baf0a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:04:48.859688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:48.860971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:48.862970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:48.865477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:48.866113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:48.866759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:48.868884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:48.877715 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-438dc9c7-7a10-4518-91e1-f751cea94bd5 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.913430 Oct 22 03:04:48.897103 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 87/149] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:47 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:48.898123 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.compute.rpcapi [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 22 03:04:48.903695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:48.904951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] Releasing lock "compute-rpcapi-router" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:04:48.905088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:48.918778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:48.919662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:48.920298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:48.922259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:48.923164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:48.923975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:48.953988 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc0ab9b2-5d8b-407b-b111-5ed8aafaf97b None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.516728 Oct 22 03:04:48.955862 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 63/150] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:49.606194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:49.632494 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb25b08b-f785-4af9-827d-303474805b60 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.733863 Oct 22 03:04:49.651088 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 88/151] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:48 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:49.745547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95c56a7d-dfa6-45ea-a9f0-bc62515d9418 tempest-FlavorsV255TestJSON-1771183574 tempest-FlavorsV255TestJSON-1771183574-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-611507216", "id": 1207230851, "os-flavor-access:is_public": "True"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:49.781964 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95c56a7d-dfa6-45ea-a9f0-bc62515d9418 tempest-FlavorsV255TestJSON-1771183574 tempest-FlavorsV255TestJSON-1771183574-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.597577 Oct 22 03:04:49.782800 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 64/152] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:04:49 2022] POST /compute/v2.1/flavors => generated 448 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:04:49.907600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:49.908541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:49.929734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:49.931741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:49.932668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:49.934464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:49.935853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:49.937037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:50.166271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:50.180124 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aea74280-8731-43e3-b533-ff7d885887ce tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.276357 Oct 22 03:04:50.181082 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 65/153] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:49 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:50.286326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-21081e11-55eb-44d0-8280-ad651c4db473 tempest-FlavorsV255TestJSON-1220081923 tempest-FlavorsV255TestJSON-1220081923-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.299264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-21081e11-55eb-44d0-8280-ad651c4db473 tempest-FlavorsV255TestJSON-1220081923 tempest-FlavorsV255TestJSON-1220081923-project] 10.222.0.25 "GET /compute/v2.1/flavors/1207230851" status: 200 len: 448 microversion: 2.55 time: 0.505917 Oct 22 03:04:50.310286 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 89/154] 10.222.0.25 () {60 vars in 1199 bytes} [Sat Oct 22 03:04:49 2022] GET /compute/v2.1/flavors/1207230851 => generated 448 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:04:50.320625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1073686a-9db2-45ad-8b0a-0b3c69e8c927 tempest-FlavorsV255TestJSON-1771183574 tempest-FlavorsV255TestJSON-1771183574-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1c106550>, body: {"flavor": {"description": "new"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:50.416081 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1073686a-9db2-45ad-8b0a-0b3c69e8c927 tempest-FlavorsV255TestJSON-1771183574 tempest-FlavorsV255TestJSON-1771183574-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1207230851" status: 200 len: 449 microversion: 2.55 time: 0.101302 Oct 22 03:04:50.427241 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 90/155] 10.222.0.25 () {62 vars in 1219 bytes} [Sat Oct 22 03:04:50 2022] PUT /compute/v2.1/flavors/1207230851 => generated 449 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:04:50.434004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6bd77ad3-16e5-49ef-b9db-91ad9c04a613 tempest-FlavorsV255TestJSON-1220081923 tempest-FlavorsV255TestJSON-1220081923-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.505914 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6bd77ad3-16e5-49ef-b9db-91ad9c04a613 tempest-FlavorsV255TestJSON-1220081923 tempest-FlavorsV255TestJSON-1220081923-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.077196 Oct 22 03:04:50.507248 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 91/156] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:04:50 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:04:50.533737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9e47955e-c068-4557-a255-9b26e34a1bb4 tempest-FlavorsV255TestJSON-1220081923 tempest-FlavorsV255TestJSON-1220081923-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.585028 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9e47955e-c068-4557-a255-9b26e34a1bb4 tempest-FlavorsV255TestJSON-1220081923 tempest-FlavorsV255TestJSON-1220081923-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.056694 Oct 22 03:04:50.587449 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 92/157] 10.222.0.25 () {60 vars in 1166 bytes} [Sat Oct 22 03:04:50 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:04:50.596030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f70a7973-234c-4baf-8328-c9e0637e376e tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Calling method '.version_select at 0x7f0d1b037670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.598806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f70a7973-234c-4baf-8328-c9e0637e376e tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '2203898fe1ca4f6199866eae06cf7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede85425a5a342f7bb3ac738dd2c9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f70a7973-234c-4baf-8328-c9e0637e376e tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Request method failure captured: Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13OM-qsEUbsF8ByF8nZ6NOGYRoSe1q6rUMJ_6foaAKel1KjdjQSS8fDXfTB9akLDLwW4L9yNKMVyinGXfiI2i8OOb2mbsjqU2M_AVzMVMzG-7Rn61_Vx9oez8GxEPm1mNrL8uzNQdDSoiwHv9W3Co0eWO7eeHToeDh_xOiYCf8M3RI Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:04:50.602115 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}] Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2203898fe1ca4f6199866eae06cf7daa Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: action_args: {} Oct 22 03:04:50.603526 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:50.604414 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 22 03:04:50.605713 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.613991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f70a7973-234c-4baf-8328-c9e0637e376e tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:50.614431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9737a136-90f2-4195-9300-09617c7567a8 tempest-FlavorsV255TestJSON-1771183574 tempest-FlavorsV255TestJSON-1771183574-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.620307 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f70a7973-234c-4baf-8328-c9e0637e376e tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.433332 Oct 22 03:04:50.623123 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 66/158] 10.222.0.25 () {58 vars in 1167 bytes} [Sat Oct 22 03:04:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 441 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:50.645154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-850142a1-20dc-435c-ae98-f56a6fe4ca7b tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Calling method '.version_select at 0x7f0d1afd2a60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.645154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-850142a1-20dc-435c-ae98-f56a6fe4ca7b tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '2203898fe1ca4f6199866eae06cf7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede85425a5a342f7bb3ac738dd2c9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-850142a1-20dc-435c-ae98-f56a6fe4ca7b tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Request method failure captured: Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13OM-qsEUbsF8ByF8nZ6NOGYRoSe1q6rUMJ_6foaAKel1KjdjQSS8fDXfTB9akLDLwW4L9yNKMVyinGXfiI2i8OOb2mbsjqU2M_AVzMVMzG-7Rn61_Vx9oez8GxEPm1mNrL8uzNQdDSoiwHv9W3Co0eWO7eeHToeDh_xOiYCf8M3RI Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:04:50.645671 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}] Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2203898fe1ca4f6199866eae06cf7daa Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: action_args: {} Oct 22 03:04:50.646757 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:50.647623 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 22 03:04:50.648663 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.649670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-850142a1-20dc-435c-ae98-f56a6fe4ca7b tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:50.649670 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-850142a1-20dc-435c-ae98-f56a6fe4ca7b tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017814 Oct 22 03:04:50.655522 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9737a136-90f2-4195-9300-09617c7567a8 tempest-FlavorsV255TestJSON-1771183574 tempest-FlavorsV255TestJSON-1771183574-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1207230851" status: 202 len: 0 microversion: 2.55 time: 0.046737 Oct 22 03:04:50.656651 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 93/159] 10.222.0.25 () {60 vars in 1202 bytes} [Sat Oct 22 03:04:50 2022] DELETE /compute/v2.1/flavors/1207230851 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:04:50.662013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4e37323a-0514-4d33-a337-ed7bc69f60c0 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Calling method '.version_select at 0x7f0d1ad750d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.664039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4e37323a-0514-4d33-a337-ed7bc69f60c0 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '2203898fe1ca4f6199866eae06cf7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede85425a5a342f7bb3ac738dd2c9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4e37323a-0514-4d33-a337-ed7bc69f60c0 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Request method failure captured: Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13OM-qsEUbsF8ByF8nZ6NOGYRoSe1q6rUMJ_6foaAKel1KjdjQSS8fDXfTB9akLDLwW4L9yNKMVyinGXfiI2i8OOb2mbsjqU2M_AVzMVMzG-7Rn61_Vx9oez8GxEPm1mNrL8uzNQdDSoiwHv9W3Co0eWO7eeHToeDh_xOiYCf8M3RI Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:50.666152 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}] Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2203898fe1ca4f6199866eae06cf7daa Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: action_args: {} Oct 22 03:04:50.667276 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:50.667947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 22 03:04:50.668975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:50.672479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4e37323a-0514-4d33-a337-ed7bc69f60c0 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:50.673532 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4e37323a-0514-4d33-a337-ed7bc69f60c0 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015767 Oct 22 03:04:50.673688 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 67/160] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:50 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:50.674392 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 94/161] 10.222.0.25 () {58 vars in 1179 bytes} [Sat Oct 22 03:04:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:50.682394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c696b30b-a2f3-4eef-ac7a-96816c5ae1fe tempest-FlavorsV255TestJSON-1771183574 tempest-FlavorsV255TestJSON-1771183574-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.697866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:50.698476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:50.715880 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c696b30b-a2f3-4eef-ac7a-96816c5ae1fe tempest-FlavorsV255TestJSON-1771183574 tempest-FlavorsV255TestJSON-1771183574-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.039594 Oct 22 03:04:50.717905 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 95/162] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:04:50 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:04:50.736135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:50.736585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:50.737020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:50.737731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:50.738174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:50.738590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.003293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:51.017210 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-513707e8-f66a-40ef-9889-ed035ae55424 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.341986 Oct 22 03:04:51.018625 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 68/163] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:50 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:51.105325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b1bb21f1-cb9c-47c3-b6de-cd615ac97f15 req-c81c2177-bbfd-48d6-867b-187619e67d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc00eac-c667-4bde-9fce-b747d317a36b", "tag": "2e0e405b-8ff1-4a66-a262-540f8d56e8be"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:51.127274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b1bb21f1-cb9c-47c3-b6de-cd615ac97f15 req-c81c2177-bbfd-48d6-867b-187619e67d0a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.127738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b1bb21f1-cb9c-47c3-b6de-cd615ac97f15 req-c81c2177-bbfd-48d6-867b-187619e67d0a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.128171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b1bb21f1-cb9c-47c3-b6de-cd615ac97f15 req-c81c2177-bbfd-48d6-867b-187619e67d0a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.161173 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b1bb21f1-cb9c-47c3-b6de-cd615ac97f15 req-c81c2177-bbfd-48d6-867b-187619e67d0a service nova] Creating event network-changed:2e0e405b-8ff1-4a66-a262-540f8d56e8be for instance cbc00eac-c667-4bde-9fce-b747d317a36b on n-h2-862416-2 Oct 22 03:04:51.167465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Calling method '.version_select at 0x7f0d1ad183a0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:51.169353 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b1bb21f1-cb9c-47c3-b6de-cd615ac97f15 req-c81c2177-bbfd-48d6-867b-187619e67d0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067464 Oct 22 03:04:51.169468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.169922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.170366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.176077 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 69/164] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:51.197598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.198095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.199596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.214751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.215108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:51.215234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.215677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.215804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:51.225799 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1196ad70-9dfe-472c-a900-03af0f8eff69 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.505885 Oct 22 03:04:51.226361 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 96/165] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:51.233603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.233603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.233603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.233603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.233909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.233909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.244244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18fc812c-b123-462b-b3b6-8c9317ae6af9 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Calling method '.version_select at 0x7f0d1ad18430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:51.244244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18fc812c-b123-462b-b3b6-8c9317ae6af9 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '2203898fe1ca4f6199866eae06cf7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede85425a5a342f7bb3ac738dd2c9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18fc812c-b123-462b-b3b6-8c9317ae6af9 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Request method failure captured: Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13OM-qsEUbsF8ByF8nZ6NOGYRoSe1q6rUMJ_6foaAKel1KjdjQSS8fDXfTB9akLDLwW4L9yNKMVyinGXfiI2i8OOb2mbsjqU2M_AVzMVMzG-7Rn61_Vx9oez8GxEPm1mNrL8uzNQdDSoiwHv9W3Co0eWO7eeHToeDh_xOiYCf8M3RI Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:51.245215 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}] Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2203898fe1ca4f6199866eae06cf7daa Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1'} Oct 22 03:04:51.246424 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:51.252166 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 22 03:04:51.253270 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.254130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18fc812c-b123-462b-b3b6-8c9317ae6af9 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:51.254130 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18fc812c-b123-462b-b3b6-8c9317ae6af9 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012003 Oct 22 03:04:51.255021 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 97/166] 10.222.0.25 () {58 vars in 1173 bytes} [Sat Oct 22 03:04:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:51.268009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8bac2ea-25e5-47fb-8428-117959a7b453 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Calling method '.version_select at 0x7f0d1acc4820>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:51.269725 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c8bac2ea-25e5-47fb-8428-117959a7b453 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] HTTP exception thrown: Hypervisor with ID '17931fa4-50f0-4882-88b5-f735ab7cdbfb' could not be found. Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8bac2ea-25e5-47fb-8428-117959a7b453 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Request method failure captured: Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hypervisors/17931fa4-50f0-4882-88b5-f735ab7cdbfb/uptime HTTP/1.1 Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13RS3kKb0VEPKSa7YYq857ekRCMZa7wqFkFX_ix1CXlMN0b8afE0lRtZ7Of6Vz6Cxprlt2zkDdoIKD46Z1sKKgIVxTFuJXdJz2LyUbuRWkv8lbepx2gXxgiBeUArtm59t8dy1lx3qnu_PRs3NF30IZtFfi_VIt4IH7_xxsF5xk_M8g Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 6b135e5140b046c698352c21c215b440 Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-183104536 Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:51.279731 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b135e5140b046c698352c21c215b440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b135e5140b046c698352c21c215b440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b135e5140b046c698352c21c215b440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b135e5140b046c698352c21c215b440"}]}] Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-183104536 Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 6b135e5140b046c698352c21c215b440 Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-183104536 Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 9a03cc20137c47878243316d63c1d3d7 Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: exception: Hypervisor with ID '17931fa4-50f0-4882-88b5-f735ab7cdbfb' could not be found. Oct 22 03:04:51.281544 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '17931fa4-50f0-4882-88b5-f735ab7cdbfb'} Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '17931fa4-50f0-4882-88b5-f735ab7cdbfb' Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 22 03:04:51.282188 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '17931fa4-50f0-4882-88b5-f735ab7cdbfb' could not be found. Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.288199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '17931fa4-50f0-4882-88b5-f735ab7cdbfb' could not be found. Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8bac2ea-25e5-47fb-8428-117959a7b453 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Returning 404 to user: Hypervisor with ID '17931fa4-50f0-4882-88b5-f735ab7cdbfb' could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c8bac2ea-25e5-47fb-8428-117959a7b453 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/17931fa4-50f0-4882-88b5-f735ab7cdbfb/uptime" status: 404 len: 123 microversion: 2.1 time: 0.023389 Oct 22 03:04:51.290033 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 98/167] 10.222.0.25 () {58 vars in 1278 bytes} [Sat Oct 22 03:04:51 2022] GET /compute/v2.1/os-hypervisors/17931fa4-50f0-4882-88b5-f735ab7cdbfb/uptime => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:51.294712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Calling method '.version_select at 0x7f0d1aeb1550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:51.309048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.309944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.311691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.333680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.334481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.335483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.363891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:51.364752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:51.365816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:51.383829 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a9758d6-2388-4c56-8c1d-9f3cac5c9bb0 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.095350 Oct 22 03:04:51.386994 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 99/168] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:04:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:51.408597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6694c145-4181-40c7-9326-669209556df6 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Calling method '.version_select at 0x7f0d1ac764c0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:51.421091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6694c145-4181-40c7-9326-669209556df6 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '2203898fe1ca4f6199866eae06cf7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede85425a5a342f7bb3ac738dd2c9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6694c145-4181-40c7-9326-669209556df6 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Request method failure captured: Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13OM-qsEUbsF8ByF8nZ6NOGYRoSe1q6rUMJ_6foaAKel1KjdjQSS8fDXfTB9akLDLwW4L9yNKMVyinGXfiI2i8OOb2mbsjqU2M_AVzMVMzG-7Rn61_Vx9oez8GxEPm1mNrL8uzNQdDSoiwHv9W3Co0eWO7eeHToeDh_xOiYCf8M3RI Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:51.424542 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ede85425a5a342f7bb3ac738dd2c9166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ede85425a5a342f7bb3ac738dd2c9166"}]}] Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: ede85425a5a342f7bb3ac738dd2c9166 Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-662636494 Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2203898fe1ca4f6199866eae06cf7daa Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-662636494-project Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1'} Oct 22 03:04:51.425944 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:51.427288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 22 03:04:51.430327 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.435180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6694c145-4181-40c7-9326-669209556df6 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:51.437901 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6694c145-4181-40c7-9326-669209556df6 tempest-HypervisorAdminNegativeTestJSON-662636494 tempest-HypervisorAdminNegativeTestJSON-662636494-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.040815 Oct 22 03:04:51.438955 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 100/169] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:04:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:51.455689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-995500b9-22cc-4c32-a5fd-3d390924f0b2 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Calling method '.version_select at 0x7f0d1acb89d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:51.458473 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-995500b9-22cc-4c32-a5fd-3d390924f0b2 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] HTTP exception thrown: Hypervisor with ID 'c776d13f-ecff-4a4a-b21b-576ebf2e8d94' could not be found. Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-995500b9-22cc-4c32-a5fd-3d390924f0b2 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Request method failure captured: Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hypervisors/c776d13f-ecff-4a4a-b21b-576ebf2e8d94 HTTP/1.1 Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13RS3kKb0VEPKSa7YYq857ekRCMZa7wqFkFX_ix1CXlMN0b8afE0lRtZ7Of6Vz6Cxprlt2zkDdoIKD46Z1sKKgIVxTFuJXdJz2LyUbuRWkv8lbepx2gXxgiBeUArtm59t8dy1lx3qnu_PRs3NF30IZtFfi_VIt4IH7_xxsF5xk_M8g Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 6b135e5140b046c698352c21c215b440 Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-183104536 Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:51.460552 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b135e5140b046c698352c21c215b440"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b135e5140b046c698352c21c215b440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b135e5140b046c698352c21c215b440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b135e5140b046c698352c21c215b440"}]}] Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-183104536 Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 6b135e5140b046c698352c21c215b440 Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-183104536 Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 9a03cc20137c47878243316d63c1d3d7 Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: exception: Hypervisor with ID 'c776d13f-ecff-4a4a-b21b-576ebf2e8d94' could not be found. Oct 22 03:04:51.461703 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'c776d13f-ecff-4a4a-b21b-576ebf2e8d94'} Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c776d13f-ecff-4a4a-b21b-576ebf2e8d94' Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 22 03:04:51.462333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:04:51.463512 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c776d13f-ecff-4a4a-b21b-576ebf2e8d94' could not be found. Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c776d13f-ecff-4a4a-b21b-576ebf2e8d94' could not be found. Oct 22 03:04:51.464631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:51.468615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-995500b9-22cc-4c32-a5fd-3d390924f0b2 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] Returning 404 to user: Hypervisor with ID 'c776d13f-ecff-4a4a-b21b-576ebf2e8d94' could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:51.469742 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-995500b9-22cc-4c32-a5fd-3d390924f0b2 tempest-HypervisorAdminNegativeTestJSON-183104536 tempest-HypervisorAdminNegativeTestJSON-183104536-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/c776d13f-ecff-4a4a-b21b-576ebf2e8d94" status: 404 len: 123 microversion: 2.1 time: 0.022499 Oct 22 03:04:51.470785 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 101/170] 10.222.0.25 () {58 vars in 1257 bytes} [Sat Oct 22 03:04:51 2022] GET /compute/v2.1/os-hypervisors/c776d13f-ecff-4a4a-b21b-576ebf2e8d94 => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:51.535555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:51.553744 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f117c55-b9b3-43ca-ab0a-c7f4aba6a22b tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.344304 Oct 22 03:04:51.556397 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 70/171] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:51 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:52.042621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:52.044473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:52.078308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:52.085025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:52.086231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:52.088268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:52.090514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:52.093532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:52.587839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:52.593295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:52.609795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:52.610465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:52.610716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:52.611444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:52.611893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:52.619772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:52.625006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:53.058182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:53.069304 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b4a2e05-6d10-4e69-91d6-f09a07e5308c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.485180 Oct 22 03:04:53.069857 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 71/172] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:52 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:53.429488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:53.479411 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ce2997db-8a2b-4a00-b09f-4823ab0679e2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 1.428354 Oct 22 03:04:53.500500 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 102/173] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:52 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:54.096582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:54.097915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:54.110052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:54.111454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:54.122431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:54.124381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:54.126014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:54.128745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:54.129554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:54.383968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:54.460264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:54.477324 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31b2c9d5-9056-4401-a65a-299db4e51981 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.385353 Oct 22 03:04:54.478536 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 72/174] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:54 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:04:54.513180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:54.513980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:54.523207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:54.524678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:54.525594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:54.526501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:54.527107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:54.527682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:54.864611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a28e218-1143-4d6a-ae75-66fcc41a6468 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Calling method '.version_select at 0x7f0d1af09b80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:54.868674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a28e218-1143-4d6a-ae75-66fcc41a6468 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:54.870153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a28e218-1143-4d6a-ae75-66fcc41a6468 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:54.871269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a28e218-1143-4d6a-ae75-66fcc41a6468 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:54.872026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a28e218-1143-4d6a-ae75-66fcc41a6468 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:54.872505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a28e218-1143-4d6a-ae75-66fcc41a6468 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:54.872932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a28e218-1143-4d6a-ae75-66fcc41a6468 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:54.925613 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a28e218-1143-4d6a-ae75-66fcc41a6468 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.546005 Oct 22 03:04:54.926889 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 103/175] 10.222.0.25 () {58 vars in 1128 bytes} [Sat Oct 22 03:04:54 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:54.949041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:54.957606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-76d446de-f951-4319-b245-16ed50382094 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.450052 Oct 22 03:04:54.958186 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 73/176] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:54 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:55.503819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.505947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:55.524641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:55.530228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:55.531005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:55.533370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:55.534212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:55.536956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:55.551906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b01da7f9-5bde-4f89-8032-f7c5b67d9e13 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Calling method '.version_select at 0x7f0d1ad18f70>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.560299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b01da7f9-5bde-4f89-8032-f7c5b67d9e13 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f16295bd11e74ce89958d9c6e6030226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76d7700a8841d5a27bcdfeb85a3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b01da7f9-5bde-4f89-8032-f7c5b67d9e13 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Request method failure captured: Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13TpOg-iVW6vVoqVWTsLDQpvSJ6XvpPpBwFUosxSe1X5_KzXkDNmL1C6eZKoCV9GFnXvpH1jtiTVIN32ZHoCzMF-csI_NqYQuisRNmnNireUOjQvwnGQLv_429TqG3lyUQaMHfEg6oCCqDITYJ8YYrmeorz7-b2WT3SLysU1Qn6few Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:55.565157 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}] Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f16295bd11e74ce89958d9c6e6030226 Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: action_args: {} Oct 22 03:04:55.566502 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:55.567398 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 22 03:04:55.568647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.570777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b01da7f9-5bde-4f89-8032-f7c5b67d9e13 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.570777 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b01da7f9-5bde-4f89-8032-f7c5b67d9e13 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.634625 Oct 22 03:04:55.570777 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 104/177] 10.222.0.25 () {58 vars in 1128 bytes} [Sat Oct 22 03:04:54 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 636 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:04:55.584056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9379007-599c-4fea-91db-b110131a4a04 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Calling method '.version_select at 0x7f0d1ad07940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.586765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9379007-599c-4fea-91db-b110131a4a04 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f16295bd11e74ce89958d9c6e6030226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76d7700a8841d5a27bcdfeb85a3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9379007-599c-4fea-91db-b110131a4a04 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Request method failure captured: Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts/n-d-862416-2/reboot HTTP/1.1 Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13TpOg-iVW6vVoqVWTsLDQpvSJ6XvpPpBwFUosxSe1X5_KzXkDNmL1C6eZKoCV9GFnXvpH1jtiTVIN32ZHoCzMF-csI_NqYQuisRNmnNireUOjQvwnGQLv_429TqG3lyUQaMHfEg6oCCqDITYJ8YYrmeorz7-b2WT3SLysU1Qn6few Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:55.594231 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}] Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f16295bd11e74ce89958d9c6e6030226 Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'n-d-862416-2'} Oct 22 03:04:55.595508 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:55.596288 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 22 03:04:55.597352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.598340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9379007-599c-4fea-91db-b110131a4a04 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.598340 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9379007-599c-4fea-91db-b110131a4a04 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-862416-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.022112 Oct 22 03:04:55.603082 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 105/178] 10.222.0.25 () {58 vars in 1188 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/os-hosts/n-d-862416-2/reboot => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:04:55.614684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af2463d8-8c6a-463e-ab40-42177c0ee082 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Calling method '.version_select at 0x7f0d1ad75c10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.638365 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-af2463d8-8c6a-463e-ab40-42177c0ee082 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af2463d8-8c6a-463e-ab40-42177c0ee082 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Request method failure captured: Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13WwbQkAugWhgmSHoULt1uV_k8PkYQdfgAhnK2hkJV_pnqa4HNgUXf3iOzbeSbzGyfHjhK46a3wWmNBZSNx90s7Y6wMfTbYeXJOIsNZqvkGgNmuRq_ZvZNxmntO2tikNByVyoUGM-msb3kd8J6Q4hmCW_LDCvtDL2u06OYzflkDjnM Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:55.643475 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}] Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7efcdf5c06de45069c67bda73cc00807 Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'nonexistent_hostname'} Oct 22 03:04:55.644806 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:55.645558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 22 03:04:55.646687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.647990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af2463d8-8c6a-463e-ab40-42177c0ee082 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.648841 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af2463d8-8c6a-463e-ab40-42177c0ee082 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.043388 Oct 22 03:04:55.650403 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 106/179] 10.222.0.25 () {58 vars in 1212 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:04:55.662905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4395bfbe-4402-43e9-a45b-71cbe6ab03d2 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Calling method '.version_select at 0x7f0d1aec71f0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.670314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4395bfbe-4402-43e9-a45b-71cbe6ab03d2 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f16295bd11e74ce89958d9c6e6030226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76d7700a8841d5a27bcdfeb85a3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4395bfbe-4402-43e9-a45b-71cbe6ab03d2 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Request method failure captured: Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts/n-d-862416-2 HTTP/1.1 Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13TpOg-iVW6vVoqVWTsLDQpvSJ6XvpPpBwFUosxSe1X5_KzXkDNmL1C6eZKoCV9GFnXvpH1jtiTVIN32ZHoCzMF-csI_NqYQuisRNmnNireUOjQvwnGQLv_429TqG3lyUQaMHfEg6oCCqDITYJ8YYrmeorz7-b2WT3SLysU1Qn6few Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:55.674342 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}] Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f16295bd11e74ce89958d9c6e6030226 Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'n-d-862416-2'} Oct 22 03:04:55.675851 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:55.676777 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 22 03:04:55.677986 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.682194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4395bfbe-4402-43e9-a45b-71cbe6ab03d2 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.687162 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4395bfbe-4402-43e9-a45b-71cbe6ab03d2 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-862416-2" status: 403 len: 109 microversion: 2.1 time: 0.029070 Oct 22 03:04:55.688940 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 107/180] 10.222.0.25 () {58 vars in 1167 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/os-hosts/n-d-862416-2 => generated 109 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:04:55.703494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d454f24f-2fab-4d07-8fa5-9fa8bba81038 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Calling method '.version_select at 0x7f0d1ae7caf0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.728054 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d454f24f-2fab-4d07-8fa5-9fa8bba81038 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d454f24f-2fab-4d07-8fa5-9fa8bba81038 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Request method failure captured: Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13WwbQkAugWhgmSHoULt1uV_k8PkYQdfgAhnK2hkJV_pnqa4HNgUXf3iOzbeSbzGyfHjhK46a3wWmNBZSNx90s7Y6wMfTbYeXJOIsNZqvkGgNmuRq_ZvZNxmntO2tikNByVyoUGM-msb3kd8J6Q4hmCW_LDCvtDL2u06OYzflkDjnM Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:55.733578 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}] Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7efcdf5c06de45069c67bda73cc00807 Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'nonexistent_hostname'} Oct 22 03:04:55.734985 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.736068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.737395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.741741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d454f24f-2fab-4d07-8fa5-9fa8bba81038 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.744201 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d454f24f-2fab-4d07-8fa5-9fa8bba81038 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.049492 Oct 22 03:04:55.748076 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 108/181] 10.222.0.25 () {58 vars in 1191 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:04:55.763535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01e28723-c0e7-46bb-948f-bad49c2abd39 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Calling method '.version_select at 0x7f0d1acc4ee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.767265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01e28723-c0e7-46bb-948f-bad49c2abd39 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f16295bd11e74ce89958d9c6e6030226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76d7700a8841d5a27bcdfeb85a3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01e28723-c0e7-46bb-948f-bad49c2abd39 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Request method failure captured: Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts/n-d-862416-2/shutdown HTTP/1.1 Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13TpOg-iVW6vVoqVWTsLDQpvSJ6XvpPpBwFUosxSe1X5_KzXkDNmL1C6eZKoCV9GFnXvpH1jtiTVIN32ZHoCzMF-csI_NqYQuisRNmnNireUOjQvwnGQLv_429TqG3lyUQaMHfEg6oCCqDITYJ8YYrmeorz7-b2WT3SLysU1Qn6few Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:55.769558 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}] Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f16295bd11e74ce89958d9c6e6030226 Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'n-d-862416-2'} Oct 22 03:04:55.771202 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:55.772155 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 22 03:04:55.774131 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.777569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01e28723-c0e7-46bb-948f-bad49c2abd39 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.778776 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01e28723-c0e7-46bb-948f-bad49c2abd39 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-862416-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.024727 Oct 22 03:04:55.780102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 109/182] 10.222.0.25 () {58 vars in 1194 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/os-hosts/n-d-862416-2/shutdown => generated 113 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:55.792895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd6dc84f-a4e6-4c7f-8b11-07b1c79332c0 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Calling method '.version_select at 0x7f0d1acb89d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.810194 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-fd6dc84f-a4e6-4c7f-8b11-07b1c79332c0 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd6dc84f-a4e6-4c7f-8b11-07b1c79332c0 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Request method failure captured: Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13WwbQkAugWhgmSHoULt1uV_k8PkYQdfgAhnK2hkJV_pnqa4HNgUXf3iOzbeSbzGyfHjhK46a3wWmNBZSNx90s7Y6wMfTbYeXJOIsNZqvkGgNmuRq_ZvZNxmntO2tikNByVyoUGM-msb3kd8J6Q4hmCW_LDCvtDL2u06OYzflkDjnM Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:55.813824 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}] Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7efcdf5c06de45069c67bda73cc00807 Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'nonexistent_hostname'} Oct 22 03:04:55.816048 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:55.816965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 22 03:04:55.818245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.819488 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.821629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd6dc84f-a4e6-4c7f-8b11-07b1c79332c0 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.823086 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd6dc84f-a4e6-4c7f-8b11-07b1c79332c0 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.037140 Oct 22 03:04:55.828789 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 110/183] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:04:55.836274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed992743-ab08-4e78-8489-9f318325cd71 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Calling method '.version_select at 0x7f0d1acc4e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.841715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ed992743-ab08-4e78-8489-9f318325cd71 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f16295bd11e74ce89958d9c6e6030226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76d7700a8841d5a27bcdfeb85a3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed992743-ab08-4e78-8489-9f318325cd71 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Request method failure captured: Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts/n-d-862416-2/startup HTTP/1.1 Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13TpOg-iVW6vVoqVWTsLDQpvSJ6XvpPpBwFUosxSe1X5_KzXkDNmL1C6eZKoCV9GFnXvpH1jtiTVIN32ZHoCzMF-csI_NqYQuisRNmnNireUOjQvwnGQLv_429TqG3lyUQaMHfEg6oCCqDITYJ8YYrmeorz7-b2WT3SLysU1Qn6few Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:04:55.844491 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}] Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f16295bd11e74ce89958d9c6e6030226 Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'n-d-862416-2'} Oct 22 03:04:55.846068 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:55.846843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 22 03:04:55.847899 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.854506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed992743-ab08-4e78-8489-9f318325cd71 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.856478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ed992743-ab08-4e78-8489-9f318325cd71 tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-862416-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.025724 Oct 22 03:04:55.865231 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 111/184] 10.222.0.25 () {58 vars in 1191 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/os-hosts/n-d-862416-2/startup => generated 110 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:55.873498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af2fe66a-012b-4038-be12-69ad4e2c0882 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Calling method '.version_select at 0x7f0d1ad18790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.889114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-af2fe66a-012b-4038-be12-69ad4e2c0882 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af2fe66a-012b-4038-be12-69ad4e2c0882 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Request method failure captured: Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13WwbQkAugWhgmSHoULt1uV_k8PkYQdfgAhnK2hkJV_pnqa4HNgUXf3iOzbeSbzGyfHjhK46a3wWmNBZSNx90s7Y6wMfTbYeXJOIsNZqvkGgNmuRq_ZvZNxmntO2tikNByVyoUGM-msb3kd8J6Q4hmCW_LDCvtDL2u06OYzflkDjnM Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:55.892756 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}] Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7efcdf5c06de45069c67bda73cc00807 Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'nonexistent_hostname'} Oct 22 03:04:55.894793 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:55.896667 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 22 03:04:55.898487 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af2fe66a-012b-4038-be12-69ad4e2c0882 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af2fe66a-012b-4038-be12-69ad4e2c0882 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.031074 Oct 22 03:04:55.906891 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 112/185] 10.222.0.25 () {58 vars in 1215 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:04:55.911148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1696a72-e736-4b3a-9894-7a94ecf65d44 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1ad8c670>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1696a72-e736-4b3a-9894-7a94ecf65d44 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Request method failure captured: Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/os-hosts/n-d-862416-2 HTTP/1.1 Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 51 Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13WwbQkAugWhgmSHoULt1uV_k8PkYQdfgAhnK2hkJV_pnqa4HNgUXf3iOzbeSbzGyfHjhK46a3wWmNBZSNx90s7Y6wMfTbYeXJOIsNZqvkGgNmuRq_ZvZNxmntO2tikNByVyoUGM-msb3kd8J6Q4hmCW_LDCvtDL2u06OYzflkDjnM Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:55.938955 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}] Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7efcdf5c06de45069c67bda73cc00807 Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: {"status": "enable", "maintenance_mode": "invalid"} Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.948422 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'n-d-862416-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'disable', Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'Enable', Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'Disable', Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance: Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'invalid' Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.949139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.950701 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.951725 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.951725 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:04:55.951725 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:04:55.951725 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 03:04:55.951725 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.951725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1696a72-e736-4b3a-9894-7a94ecf65d44 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.951725 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1696a72-e736-4b3a-9894-7a94ecf65d44 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-862416-2" status: 400 len: 199 microversion: 2.1 time: 0.035714 Oct 22 03:04:55.951725 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 113/186] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:04:55 2022] PUT /compute/v2.1/os-hosts/n-d-862416-2 => generated 199 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:04:55.952707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d57d03ef-2716-4d54-a5fc-5600569e805b tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1ac03040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d57d03ef-2716-4d54-a5fc-5600569e805b tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Request method failure captured: Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/os-hosts/n-d-862416-2 HTTP/1.1 Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 51 Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13WwbQkAugWhgmSHoULt1uV_k8PkYQdfgAhnK2hkJV_pnqa4HNgUXf3iOzbeSbzGyfHjhK46a3wWmNBZSNx90s7Y6wMfTbYeXJOIsNZqvkGgNmuRq_ZvZNxmntO2tikNByVyoUGM-msb3kd8J6Q4hmCW_LDCvtDL2u06OYzflkDjnM Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:04:55.960586 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}] Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7efcdf5c06de45069c67bda73cc00807 Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: {"status": "invalid", "maintenance_mode": "enable"} Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:04:55.962150 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'n-d-862416-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'disable', Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'Enable', Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'Disable', Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance: Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'invalid' Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.963079 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:55.964870 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:55.966173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:55.966173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:04:55.966173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:04:55.966173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 22 03:04:55.966173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:04:55.969339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d57d03ef-2716-4d54-a5fc-5600569e805b tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:55.972263 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d57d03ef-2716-4d54-a5fc-5600569e805b tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-862416-2" status: 400 len: 189 microversion: 2.1 time: 0.025398 Oct 22 03:04:55.975099 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 114/187] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:04:55 2022] PUT /compute/v2.1/os-hosts/n-d-862416-2 => generated 189 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:04:55.989255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:55.991664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:56.002249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:56.004483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:56.005101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:56.006048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:56.009626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:56.018037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:56.025974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:56.035281 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a515a2f2-17b6-4e37-a390-70d532efe239 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.536371 Oct 22 03:04:56.042523 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 74/188] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:56.053028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb408cb4-5ed8-4a8e-8cd3-5419bb885fac tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Action: 'update', calling method: .version_select at 0x7f0d1ba6a670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:56.056747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fb408cb4-5ed8-4a8e-8cd3-5419bb885fac tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f16295bd11e74ce89958d9c6e6030226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76d7700a8841d5a27bcdfeb85a3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb408cb4-5ed8-4a8e-8cd3-5419bb885fac tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Request method failure captured: Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/os-hosts/n-d-862416-2 HTTP/1.1 Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 50 Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13TpOg-iVW6vVoqVWTsLDQpvSJ6XvpPpBwFUosxSe1X5_KzXkDNmL1C6eZKoCV9GFnXvpH1jtiTVIN32ZHoCzMF-csI_NqYQuisRNmnNireUOjQvwnGQLv_429TqG3lyUQaMHfEg6oCCqDITYJ8YYrmeorz7-b2WT3SLysU1Qn6few Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:04:56.059076 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d76d7700a8841d5a27bcdfeb85a3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d76d7700a8841d5a27bcdfeb85a3670"}]}] Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7d76d7700a8841d5a27bcdfeb85a3670 Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1178398157 Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f16295bd11e74ce89958d9c6e6030226 Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1178398157-project Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: {"status": "enable", "maintenance_mode": "enable"} Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 22 03:04:56.060421 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'n-d-862416-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:56.061781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 22 03:04:56.062818 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.065970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb408cb4-5ed8-4a8e-8cd3-5419bb885fac tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:56.067397 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fb408cb4-5ed8-4a8e-8cd3-5419bb885fac tempest-HostsAdminNegativeTestJSON-1178398157 tempest-HostsAdminNegativeTestJSON-1178398157-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-862416-2" status: 403 len: 111 microversion: 2.1 time: 0.023641 Oct 22 03:04:56.069033 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 75/189] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:04:56 2022] PUT /compute/v2.1/os-hosts/n-d-862416-2 => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:04:56.081412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f927ff8b-6407-436f-84ad-5124fe64eb14 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1afe7e50>, body: {"status": null, "maintenance_mode": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f927ff8b-6407-436f-84ad-5124fe64eb14 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Request method failure captured: Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/os-hosts/n-d-862416-2 HTTP/1.1 Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 42 Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13WwbQkAugWhgmSHoULt1uV_k8PkYQdfgAhnK2hkJV_pnqa4HNgUXf3iOzbeSbzGyfHjhK46a3wWmNBZSNx90s7Y6wMfTbYeXJOIsNZqvkGgNmuRq_ZvZNxmntO2tikNByVyoUGM-msb3kd8J6Q4hmCW_LDCvtDL2u06OYzflkDjnM Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:04:56.085981 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}] Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7efcdf5c06de45069c67bda73cc00807 Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: {"status": null, "maintenance_mode": null} Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 22 03:04:56.087308 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'n-d-862416-2', 'body': {'status': None, 'maintenance_mode': None}} Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'disable', Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'Enable', Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'Disable', Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance: Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi None Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:56.088328 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:56.092302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:56.094871 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:04:56.094871 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:04:56.094871 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 22 03:04:56.094871 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.097234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f927ff8b-6407-436f-84ad-5124fe64eb14 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:56.098986 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f927ff8b-6407-436f-84ad-5124fe64eb14 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-862416-2" status: 400 len: 127 microversion: 2.1 time: 0.023635 Oct 22 03:04:56.106208 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 76/190] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:04:56 2022] PUT /compute/v2.1/os-hosts/n-d-862416-2 => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:04:56.118862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37ac7e8c-b7cb-4d17-95a6-b146f5792ff6 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1af3edc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:04:56.123041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.hosts [None req-37ac7e8c-b7cb-4d17-95a6-b146f5792ff6 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Enabling host nonexistent_hostname. Oct 22 03:04:56.149127 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-37ac7e8c-b7cb-4d17-95a6-b146f5792ff6 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37ac7e8c-b7cb-4d17-95a6-b146f5792ff6 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Request method failure captured: Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 50 Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13WwbQkAugWhgmSHoULt1uV_k8PkYQdfgAhnK2hkJV_pnqa4HNgUXf3iOzbeSbzGyfHjhK46a3wWmNBZSNx90s7Y6wMfTbYeXJOIsNZqvkGgNmuRq_ZvZNxmntO2tikNByVyoUGM-msb3kd8J6Q4hmCW_LDCvtDL2u06OYzflkDjnM Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:04:56.151815 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c10b8c9917014351bec0f6f96026a3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c10b8c9917014351bec0f6f96026a3cb"}]}] Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: c10b8c9917014351bec0f6f96026a3cb Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-430855027 Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7efcdf5c06de45069c67bda73cc00807 Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HostsAdminNegativeTestJSON-430855027-project-admin Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: {"status": "enable", "maintenance_mode": "enable"} Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:56.153025 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 03:04:56.153763 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:04:56.154832 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 22 03:04:56.155991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:04:56.169363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37ac7e8c-b7cb-4d17-95a6-b146f5792ff6 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:04:56.173912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-37ac7e8c-b7cb-4d17-95a6-b146f5792ff6 tempest-HostsAdminNegativeTestJSON-430855027 tempest-HostsAdminNegativeTestJSON-430855027-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.061758 Oct 22 03:04:56.176339 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 77/191] 10.222.0.25 () {60 vars in 1211 bytes} [Sat Oct 22 03:04:56 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:04:56.275890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:56.285419 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ad46af9-ace2-46ab-840c-02f292025a6f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.307527 Oct 22 03:04:56.300705 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 115/192] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:55 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:57.066549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:57.067854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:57.078399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:57.080097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:57.081014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:57.082039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:57.082905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:57.083644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:57.295291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:57.308423 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b707810b-5fbc-4e2f-810c-c6027a054128 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.245222 Oct 22 03:04:57.309868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:57.310526 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 78/193] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:57 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:57.311970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:57.325023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:57.326136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:57.326773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:57.327522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:57.327979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:57.328443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:57.537107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:57.554712 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dddffd90-3b4f-45c5-aa72-1736e5915878 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.248311 Oct 22 03:04:57.556374 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 116/194] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:57 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:58.333345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:58.333916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:58.342902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:58.343402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:58.343841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:58.344585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:58.345043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:58.345472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:58.614331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:58.626781 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ce701b1-74f8-4fa2-a2e4-f2129c896ea2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.297466 Oct 22 03:04:58.627897 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 79/195] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:58 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:58.634497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:58.635446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:58.643287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:58.644020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:58.644768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:58.645829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:58.646551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:58.647132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:58.660051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1eb9fdaa-83eb-40d9-8254-b95e38640485 tempest-InstanceUsageAuditLogTestJSON-1861719256 tempest-InstanceUsageAuditLogTestJSON-1861719256-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:58.709015 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1eb9fdaa-83eb-40d9-8254-b95e38640485 tempest-InstanceUsageAuditLogTestJSON-1861719256 tempest-InstanceUsageAuditLogTestJSON-1861719256-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22 03:04:58" status: 200 len: 318 microversion: 2.1 time: 0.218876 Oct 22 03:04:58.710239 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 117/196] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:04:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22%2003%3A04%3A58 => generated 318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:58.736139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-274edd52-fb79-40ac-8d50-d6d352a89d0d tempest-InstanceUsageAuditLogTestJSON-1861719256 tempest-InstanceUsageAuditLogTestJSON-1861719256-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:58.765645 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-274edd52-fb79-40ac-8d50-d6d352a89d0d tempest-InstanceUsageAuditLogTestJSON-1861719256 tempest-InstanceUsageAuditLogTestJSON-1861719256-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.040856 Oct 22 03:04:58.780464 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 118/197] 10.222.0.25 () {58 vars in 1185 bytes} [Sat Oct 22 03:04:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:04:58.891018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:04:58.893640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:58.904358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3d25a474-257d-4ff4-b4bd-4480aa944975 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.274279 Oct 22 03:04:58.905994 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 80/198] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:58 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:04:59.652063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:59.652811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:59.665200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:59.665803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:59.666114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:59.667261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:59.667731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:59.668161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:59.702879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=77 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:04:59.928951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:04:59.929552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:04:59.941573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:59.942085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:59.942524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:04:59.943228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:04:59.943678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:04:59.944092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:00.125234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:00.137693 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2cf890f1-0971-4e24-9106-52de986654e8 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.213121 Oct 22 03:05:00.138711 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 81/199] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:59 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:00.212675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:00.227372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-64722cee-1e2b-4540-ab90-80ce7238c730 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.579030 Oct 22 03:05:00.232102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 119/200] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:04:59 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:01.162510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:01.163891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:01.179170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:01.179848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:01.180586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:01.183383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:01.184366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:01.185016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:01.259138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:01.259497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:01.268299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:01.271025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:01.271927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:01.273690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:01.277574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:01.279287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:01.547428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:01.558707 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac21bb19-6b55-4263-8e97-c4d427b03399 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.305757 Oct 22 03:05:01.559936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 120/201] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:01 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:01.573598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:01.590938 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-36a34621-c861-4f98-957e-42b5a8113237 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.432572 Oct 22 03:05:01.595158 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 82/202] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:01 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:02.176950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1ba6af70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:02.178827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1755986817", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": "none"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:02.183081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.183613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.184033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.229490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.229982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.230415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.289623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.290125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.290561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.303711 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fbc0e541-d505-4093-8dad-a9bd94aa2adb tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.340811 Oct 22 03:05:02.308887 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 83/203] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:05:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:02.319681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1b08e9d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:02.331530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.332358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.332827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.355564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.356063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.356533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.362284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:05:02.364832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:05:02.365540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:05:02.366863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:05:02.369193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:05:02.381058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.381824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.381985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.388513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.389345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.390007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.390976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.391966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.392670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.400384 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ce162a1-6022-4261-a392-6ac5b9f98a6e tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.087119 Oct 22 03:05:02.413690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 84/204] 10.222.0.25 () {58 vars in 1167 bytes} [Sat Oct 22 03:05:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:02.413951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=19 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:02.425179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1b08e430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:02.431623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Getting quotas for project 0fa20044837549b3be6104ffe2dd7f65. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:05:02.432307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.439659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.439659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.439841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Getting quotas for user 5e6da96821c74c54ad5eb148ae9f8521 and project 0fa20044837549b3be6104ffe2dd7f65. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:05:02.460026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:UPDATE=12,nova_api:SELECT=85,nova_api:DELETE=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:02.466167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:05:02.479097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.479544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.479987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.480905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:05:02.509421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.510288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.511818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.527837 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ce89fad-e49a-449d-861f-6e8058312f6f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109377 Oct 22 03:05:02.538252 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 85/205] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:05:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:02.549487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5fd434a-c948-4e6e-afcc-049d75af1152 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1afc68b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:02.555561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fd434a-c948-4e6e-afcc-049d75af1152 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.569508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fd434a-c948-4e6e-afcc-049d75af1152 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.571334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fd434a-c948-4e6e-afcc-049d75af1152 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.582205 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bf857a02-fa6d-4ad0-89cf-7b4574efc7f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.644443 Oct 22 03:05:02.593827 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 121/206] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:05:02.602359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:02.604461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:02.615771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.616784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.617512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.618535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.619314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.620665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.637223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fd434a-c948-4e6e-afcc-049d75af1152 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.639425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fd434a-c948-4e6e-afcc-049d75af1152 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.642923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5fd434a-c948-4e6e-afcc-049d75af1152 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.664597 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a5fd434a-c948-4e6e-afcc-049d75af1152 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.124547 Oct 22 03:05:02.677856 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 86/207] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:02.690195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19329309-6ea5-40f4-8013-ed8d3ff91ef5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:02.691417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19329309-6ea5-40f4-8013-ed8d3ff91ef5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:02.885915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:02.896596 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41e2a91d-ec6e-422b-ab94-1e086eaee6d1 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.301095 Oct 22 03:05:02.914684 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 122/208] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:02 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:02.914684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:02.914684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:02.922353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19329309-6ea5-40f4-8013-ed8d3ff91ef5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:02.931771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.932560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.932986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.934153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.934748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.935317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:02.938315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19329309-6ea5-40f4-8013-ed8d3ff91ef5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:02.939808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19329309-6ea5-40f4-8013-ed8d3ff91ef5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:02.959755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19329309-6ea5-40f4-8013-ed8d3ff91ef5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1454 microversion: 2.91 time: 0.280534 Oct 22 03:05:02.961551 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 87/209] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:02 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1454 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:02.965857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b467073-12c5-499b-9fa9-e60070534f5b tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1afd21f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:02.968179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b467073-12c5-499b-9fa9-e60070534f5b tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:02.968906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b467073-12c5-499b-9fa9-e60070534f5b tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:02.978998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b467073-12c5-499b-9fa9-e60070534f5b tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.007963 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b467073-12c5-499b-9fa9-e60070534f5b tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.045244 Oct 22 03:05:03.009043 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 88/210] 10.222.0.25 () {58 vars in 1179 bytes} [Sat Oct 22 03:05:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:03.032678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1af6af70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:03.035653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.036139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.040468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.083672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.087879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.088411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.119872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.128241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.128708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.142063 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0c80b82-7063-44e0-abe5-fb25fd0ee463 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.120800 Oct 22 03:05:03.145422 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 89/211] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:05:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:03.153308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-038fbece-76a7-4aa0-8f5c-035772ec8471 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1af6a430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:03.157379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038fbece-76a7-4aa0-8f5c-035772ec8471 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.160515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038fbece-76a7-4aa0-8f5c-035772ec8471 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.160976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038fbece-76a7-4aa0-8f5c-035772ec8471 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.181837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038fbece-76a7-4aa0-8f5c-035772ec8471 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.182494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038fbece-76a7-4aa0-8f5c-035772ec8471 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.191959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038fbece-76a7-4aa0-8f5c-035772ec8471 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.206685 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-038fbece-76a7-4aa0-8f5c-035772ec8471 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.057266 Oct 22 03:05:03.209078 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 90/212] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:03.224545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba61e260-c64b-425f-9350-02adc607bb9f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1afd28b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:03.226955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba61e260-c64b-425f-9350-02adc607bb9f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.227603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba61e260-c64b-425f-9350-02adc607bb9f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.228314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba61e260-c64b-425f-9350-02adc607bb9f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.256857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba61e260-c64b-425f-9350-02adc607bb9f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.257354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba61e260-c64b-425f-9350-02adc607bb9f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.257801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba61e260-c64b-425f-9350-02adc607bb9f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.263750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:03.273168 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f875ac25-201b-4981-a6b3-17d413c8a8a2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.373566 Oct 22 03:05:03.275027 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba61e260-c64b-425f-9350-02adc607bb9f tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.054949 Oct 22 03:05:03.276146 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 91/213] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:03 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:03.289827 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 123/214] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:02 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:03.293003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Calling method '.version_select at 0x7f0d1af6ac10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:03.294983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.295536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.296190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.324885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.325378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.325889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.353629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.354156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.354565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.395448 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a9da2cc-11c7-4464-958e-70aa1268f2f7 tempest-HypervisorAdminTestJSON-1651737997 tempest-HypervisorAdminTestJSON-1651737997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.106190 Oct 22 03:05:03.396079 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 92/215] 10.222.0.25 () {58 vars in 1173 bytes} [Sat Oct 22 03:05:03 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:03.937542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:03.938167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:03.950612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.951930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.956536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.957353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:03.957834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:03.958268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:03.990742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:03.991621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:04.007673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:04.013834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:04.014766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:04.015772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:04.016467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:04.017061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:04.105053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:04.323696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:04.338018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:04.342984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:04.356861 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ebcedae-c116-49b5-b760-5c4c4a10cf02 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1527 microversion: 2.91 time: 0.368835 Oct 22 03:05:04.360956 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 93/216] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:03 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1527 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:04.374811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:04.375724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:04.391382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:04.393262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:04.395616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:04.397270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:04.398864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:04.399431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:04.526946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:04.539107 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4bd0386c-c6c1-4f11-b765-f0bfd47f2078 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.607743 Oct 22 03:05:04.539428 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 124/217] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:03 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:04.744822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-3c5b92e0-1367-4d59-b80e-9242f2c5ac05 req-566ff25f-2f60-4484-a36d-10d054d0f7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc00eac-c667-4bde-9fce-b747d317a36b", "name": "network-vif-plugged", "status": "completed", "tag": "2e0e405b-8ff1-4a66-a262-540f8d56e8be"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:04.759455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3c5b92e0-1367-4d59-b80e-9242f2c5ac05 req-566ff25f-2f60-4484-a36d-10d054d0f7b7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:04.760155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3c5b92e0-1367-4d59-b80e-9242f2c5ac05 req-566ff25f-2f60-4484-a36d-10d054d0f7b7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:04.760941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3c5b92e0-1367-4d59-b80e-9242f2c5ac05 req-566ff25f-2f60-4484-a36d-10d054d0f7b7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:04.783181 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-3c5b92e0-1367-4d59-b80e-9242f2c5ac05 req-566ff25f-2f60-4484-a36d-10d054d0f7b7 service nova] Creating event network-vif-plugged:2e0e405b-8ff1-4a66-a262-540f8d56e8be for instance cbc00eac-c667-4bde-9fce-b747d317a36b on n-h2-862416-2 Oct 22 03:05:04.783916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3c5b92e0-1367-4d59-b80e-9242f2c5ac05 req-566ff25f-2f60-4484-a36d-10d054d0f7b7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:05:04.784647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3c5b92e0-1367-4d59-b80e-9242f2c5ac05 req-566ff25f-2f60-4484-a36d-10d054d0f7b7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:05:04.785857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:04.786528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:04.787894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:04.788893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:04.789515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:04.790004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:04.818595 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.compute.rpcapi [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 22 03:05:04.819519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] Releasing lock "compute-rpcapi-router" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:05:04.851995 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e3cc2c54-d561-4d00-9650-2ffca50a0f4f None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190281 Oct 22 03:05:04.853041 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 125/218] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:04.870253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:04.885113 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4dd4c48f-c77f-4663-9ed0-8a05be0d8c74 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.522802 Oct 22 03:05:04.893461 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 94/219] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:04 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:05.393026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:05.393726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:05.406945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:05.407440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:05.407882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:05.408624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:05.409088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:05.409509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:05.564584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:05.565334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:05.574475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:05.574975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:05.575403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:05.576848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:05.577935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:05.578645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:05.692828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:05.706625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:05.708430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:05.727631 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4d9b41c-876d-4c0e-a7f6-3c0dfd0ce604 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1533 microversion: 2.91 time: 0.343075 Oct 22 03:05:05.730111 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 126/220] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:05 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1533 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:05.907943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:05.908810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:05.919683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:05.920994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:05.921871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:05.925048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:05.925716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:05.926322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:05.998105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:06.010207 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39a7af1e-2db3-432a-89d0-e16a3e674416 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.450058 Oct 22 03:05:06.012683 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 95/221] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:05 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:06.167378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:06.177573 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1727a7f1-fa56-44f6-b3b6-9cd8ccfc2623 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.273437 Oct 22 03:05:06.178760 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 127/222] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:05 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:06.761853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:06.762718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:06.774924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:06.776012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:06.777047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:06.778248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:06.781412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:06.783261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:06.909002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:06.934490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:06.939327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:06.964537 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be664fa6-68b8-4de8-8641-e328b257d4c9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1533 microversion: 2.91 time: 0.207394 Oct 22 03:05:06.965626 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 96/223] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:06 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1533 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:06.981005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4e7895a3-0a8e-43af-b563-29340a0cfd5f req-73e18ec8-dc31-46d8-a5ad-69eea5a9e8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fb7988-2331-4539-bc11-7f0e337f1a8c", "name": "network-vif-plugged", "status": "completed", "tag": "65019e24-b881-4ea6-ab0f-f7ef34f2d814"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:06.995759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4e7895a3-0a8e-43af-b563-29340a0cfd5f req-73e18ec8-dc31-46d8-a5ad-69eea5a9e8f0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:06.996254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4e7895a3-0a8e-43af-b563-29340a0cfd5f req-73e18ec8-dc31-46d8-a5ad-69eea5a9e8f0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:06.996693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4e7895a3-0a8e-43af-b563-29340a0cfd5f req-73e18ec8-dc31-46d8-a5ad-69eea5a9e8f0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:07.038894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:07.039967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:07.056745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:07.057234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:07.063217 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4e7895a3-0a8e-43af-b563-29340a0cfd5f req-73e18ec8-dc31-46d8-a5ad-69eea5a9e8f0 service nova] Creating event network-vif-plugged:65019e24-b881-4ea6-ab0f-f7ef34f2d814 for instance 40fb7988-2331-4539-bc11-7f0e337f1a8c on n-h1-862416-2 Oct 22 03:05:07.064009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:07.064896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:07.065380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:07.065812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:07.070790 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4e7895a3-0a8e-43af-b563-29340a0cfd5f req-73e18ec8-dc31-46d8-a5ad-69eea5a9e8f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095400 Oct 22 03:05:07.071948 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 128/224] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:07.205444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:07.206068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:07.220368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:07.221088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:07.221690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:07.222546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:07.223322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:07.224157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:07.536502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:07.546235 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd352bbd-3240-4f8f-81a7-f0395bada314 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 0.347661 Oct 22 03:05:07.547038 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 129/225] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:07 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:07.649340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:07.663491 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1c4302e8-2238-436b-8882-49cf45cd2606 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1320 microversion: 2.1 time: 0.627148 Oct 22 03:05:07.667114 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 97/226] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:07 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1320 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:07.996560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:07.997830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:08.019078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:08.025310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:08.025991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:08.026923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:08.027541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:08.028136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:08.445724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:08.457338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:08.465930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:08.482095 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5bcc71e-0b2e-4bf2-9644-e3cd8e366dbc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1554 microversion: 2.91 time: 0.489880 Oct 22 03:05:08.496606 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 130/227] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:07 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1554 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:08.575237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:08.575856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:08.585999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:08.586503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:08.586942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:08.587658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:08.588117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:08.597469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.036618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:09.037422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:09.040760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:09.052482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.053352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.054106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.055895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.057255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.058097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.410026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lazy-loading 'services' on Instance uuid 08867d3d-1927-46a5-921a-a7e74f48e0ad {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:09.530804 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa70fe86-bbe2-422b-9212-971e826e8464 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1959 microversion: 2.91 time: 1.023778 Oct 22 03:05:09.545561 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 98/228] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:08 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1959 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:09.562878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:09.563684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:09.570736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.571518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.572160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.573143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.573808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.574435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.596028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:09.611461 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4d0d38d-ddf4-4ba4-9c4b-f46692fb49c9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1337 microversion: 2.1 time: 1.039758 Oct 22 03:05:09.613493 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 131/229] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:08 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1337 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:09.767550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Calling method '.version_select at 0x7f0d1aba4c10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:09.769672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.770454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.771001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.824997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.826973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.828054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.854968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.857899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.858609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.874957 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4f379fe-1e52-4bfd-924e-d29435a6ae63 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.260153 Oct 22 03:05:09.879409 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 132/230] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:05:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:09.884012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:09.889592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:09.906226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.906791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.907322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:09.908035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:09.908614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:09.912765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.106230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lazy-loading 'services' on Instance uuid 08867d3d-1927-46a5-921a-a7e74f48e0ad {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:10.183466 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-acdcb7b1-2891-4d74-883b-7da64e4965fb tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1959 microversion: 2.91 time: 0.302559 Oct 22 03:05:10.184258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 133/231] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:09 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1959 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:10.212431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Calling method '.version_select at 0x7f0d1c221040>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:10.223593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.226065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.226601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.279176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.279837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.284085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.328241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:10.341410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03638e8a-943a-43fd-8e5c-d1885c29d348 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1469 microversion: 2.1 time: 0.794295 Oct 22 03:05:10.356137 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 99/232] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:09 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1469 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:10.375495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-110cd90c-056b-4fbf-bb81-8eefb8c77a46 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:10.383298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-110cd90c-056b-4fbf-bb81-8eefb8c77a46 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.384373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-110cd90c-056b-4fbf-bb81-8eefb8c77a46 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.385727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-110cd90c-056b-4fbf-bb81-8eefb8c77a46 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.389912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-110cd90c-056b-4fbf-bb81-8eefb8c77a46 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.390698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-110cd90c-056b-4fbf-bb81-8eefb8c77a46 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.391289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-110cd90c-056b-4fbf-bb81-8eefb8c77a46 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.414876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.415693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.416777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.431751 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a6c798ea-2353-4d40-a0dc-8cabc11d2e0c tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-862416-2/servers" status: 200 len: 275 microversion: 2.1 time: 0.227827 Oct 22 03:05:10.436143 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 134/233] 10.222.0.25 () {58 vars in 1212 bytes} [Sat Oct 22 03:05:10 2022] GET /compute/v2.1/os-hypervisors/n-h1-862416-2/servers => generated 275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:10.458545 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-110cd90c-056b-4fbf-bb81-8eefb8c77a46 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 519 microversion: 2.91 time: 0.101126 Oct 22 03:05:10.459721 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 100/234] 10.222.0.25 () {60 vars in 1217 bytes} [Sat Oct 22 03:05:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 519 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:10.464818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Calling method '.version_select at 0x7f0d1ae83700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:10.467255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.467904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.468543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.492931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.494085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.494738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.516160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.518457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.519138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.533703 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-78849ebd-9977-40fe-a362-5b91406f7533 tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.072581 Oct 22 03:05:10.544639 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 101/235] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:05:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:10.550786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:10.551542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:10.558880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.559525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.560110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.561170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.561623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.562040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.633055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lazy-loading 'flavor' on Instance uuid 08867d3d-1927-46a5-921a-a7e74f48e0ad {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:10.764094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:10.765316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:10.786357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.792755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.793615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.794574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:10.795593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:10.796122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:10.912877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:05:11.017267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:11.148973 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0a5c5b62-9bde-4bf5-8913-f6dc5c231094 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 204 len: 0 microversion: 2.1 time: 0.702749 Oct 22 03:05:11.149564 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 135/236] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:05:10 2022] DELETE /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:05:11.158530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a1b98b7-e57c-44d1-9b8e-9f642a96a6bb tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Calling method '.version_select at 0x7f0d1ad8c160>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:11.160373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1b98b7-e57c-44d1-9b8e-9f642a96a6bb tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.160894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1b98b7-e57c-44d1-9b8e-9f642a96a6bb tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.161323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1b98b7-e57c-44d1-9b8e-9f642a96a6bb tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.180202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1b98b7-e57c-44d1-9b8e-9f642a96a6bb tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.180813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1b98b7-e57c-44d1-9b8e-9f642a96a6bb tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.181489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1b98b7-e57c-44d1-9b8e-9f642a96a6bb tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.191158 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a1b98b7-e57c-44d1-9b8e-9f642a96a6bb tempest-HypervisorAdminUnderV252Test-1470178572 tempest-HypervisorAdminUnderV252Test-1470178572-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-862416-2/search" status: 200 len: 104 microversion: 2.1 time: 0.037071 Oct 22 03:05:11.192007 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba44ae9e-11dc-4599-9c49-fd23f8c0b217 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "POST /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad/action" status: 202 len: 0 microversion: 2.91 time: 0.645031 Oct 22 03:05:11.199463 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 102/237] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:05:10 2022] POST /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:05:11.200730 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 136/238] 10.222.0.25 () {58 vars in 1209 bytes} [Sat Oct 22 03:05:11 2022] GET /compute/v2.1/os-hypervisors/n-h1-862416-2/search => generated 104 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:11.206451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:11.207180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:11.214443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.215301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.215747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.217173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.217451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.217849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.252908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:11.253626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:11.289944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.290648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.291241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.293253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.296819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.297445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.718383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:11.722041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:11.749356 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-42b5255b-e99b-42fb-ae23-818a3f8befbf tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1475 microversion: 2.1 time: 0.545738 Oct 22 03:05:11.758887 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bff30c34-4cac-4790-8adb-588905f54bec tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1486 microversion: 2.1 time: 0.532825 Oct 22 03:05:11.761854 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 103/239] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:11 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1486 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:11.772238 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 137/240] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:11 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1475 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:11.788379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:11.789211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:11.790018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:11.791443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:11.810152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.813472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.814628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.818570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.819818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.820754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.822636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.822798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:11.824780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.827533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:11.828026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:11.840893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:12.028281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:12.043980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:12.052640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:12.066133 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b2f1aae-f0b4-4d9b-b470-0f2f58883e51 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1560 microversion: 2.91 time: 0.302764 Oct 22 03:05:12.066643 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 104/241] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:11 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:12.458237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=14 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:12.586704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-de342482-0610-4c10-92b2-7377aa7e8770 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1637 microversion: 2.1 time: 0.799821 Oct 22 03:05:12.600527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 138/242] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:11 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1637 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:12.612176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:12.613187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:12.637792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:12.639989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:12.640578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:12.641935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:12.646929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:12.648668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:12.720675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:05:12.774794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:12.778503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:12.797686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:12.801388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:12.802310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:12.804125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:12.806800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:12.813057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:12.937134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:12.982239 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b11690dd-abd8-482e-bcf7-966310c7159f tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 204 len: 0 microversion: 2.1 time: 0.374376 Oct 22 03:05:12.992181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 105/243] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:05:12 2022] DELETE /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:05:13.020553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:13.022677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:13.058939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:13.059450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:13.059898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:13.068385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:13.070872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:13.072814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:13.346198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:13.356989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:13.370346 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f444ddd-1f61-47ab-8e91-aadd8a1eb41a tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1492 microversion: 2.1 time: 0.374972 Oct 22 03:05:13.371751 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 106/244] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:12 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1492 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:13.388526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:13.390724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:13.405541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:13.406795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:13.407385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:13.409375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:13.409994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:13.410746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:13.646061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:13.665974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:13.668956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:13.676036 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-893eeeca-7cb8-4350-a2f5-e2cfc576bf69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1560 microversion: 2.91 time: 0.302820 Oct 22 03:05:13.677223 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 107/245] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:13 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1560 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:13.793695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:13.806593 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-207c2159-a93e-422b-b17c-4effc30030dd tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1475 microversion: 2.1 time: 1.035294 Oct 22 03:05:13.808664 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 139/246] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:12 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1475 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:14.397205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:14.398544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:14.411501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:14.412167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:14.412764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:14.413733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:14.417778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:14.418432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:14.709989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:14.710650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:14.718611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:14.722593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:14.723862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:14.724937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:14.725994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:14.726606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:14.797971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:14.978157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:14.993924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:15.004340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:15.024613 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-69ed7001-7dc9-4a7f-b089-5aaca4131267 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1560 microversion: 2.91 time: 0.315584 Oct 22 03:05:15.025465 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 140/247] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:14 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1560 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:15.054196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:15.055006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:15.061476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:15.064925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:15.065590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:15.066481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:15.067114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:15.067686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:15.079748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:15.090619 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-772d758a-5263-4811-b2cd-fb7c4d850e3e tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1492 microversion: 2.1 time: 0.697397 Oct 22 03:05:15.113988 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 108/248] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:14 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1492 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:15.379161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d0ff73de-2a5a-41e8-b0b7-1ac9038bc35d req-18e52a88-d442-4e59-85e8-615e56a30948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc00eac-c667-4bde-9fce-b747d317a36b", "name": "network-vif-deleted", "tag": "2e0e405b-8ff1-4a66-a262-540f8d56e8be"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:15.397403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d0ff73de-2a5a-41e8-b0b7-1ac9038bc35d req-18e52a88-d442-4e59-85e8-615e56a30948 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:15.398575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d0ff73de-2a5a-41e8-b0b7-1ac9038bc35d req-18e52a88-d442-4e59-85e8-615e56a30948 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:15.399160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d0ff73de-2a5a-41e8-b0b7-1ac9038bc35d req-18e52a88-d442-4e59-85e8-615e56a30948 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:15.420860 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d0ff73de-2a5a-41e8-b0b7-1ac9038bc35d req-18e52a88-d442-4e59-85e8-615e56a30948 service nova] Creating event network-vif-deleted:2e0e405b-8ff1-4a66-a262-540f8d56e8be for instance cbc00eac-c667-4bde-9fce-b747d317a36b on n-h2-862416-2 Oct 22 03:05:15.426826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:15.437399 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-54f8b3c5-59ae-4fa7-a5af-a1b53d847776 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1433 microversion: 2.1 time: 0.393181 Oct 22 03:05:15.455290 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 141/249] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:15 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1433 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:15.492831 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d0ff73de-2a5a-41e8-b0b7-1ac9038bc35d req-18e52a88-d442-4e59-85e8-615e56a30948 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106970 Oct 22 03:05:15.493626 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 109/250] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:16.058861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:16.061669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:16.070249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:16.072853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:16.074271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:16.077088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:16.077827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:16.078619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:16.131026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:16.131727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:16.175734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:16.178291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:16.179375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:16.184058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:16.186520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:16.187538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:16.389952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:16.407388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:16.417592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:16.435081 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa3633e1-6682-4666-b76b-cc87e1a0e5dd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1560 microversion: 2.91 time: 0.380737 Oct 22 03:05:16.435755 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 142/251] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:16 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1560 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:16.474264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:16.477814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:16.491386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:16.492263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:16.493971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:16.496827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:16.497604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:16.499651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:16.601500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:16.602435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:16.607140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:16.609316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lazy-loading 'fault' on Instance uuid cbc00eac-c667-4bde-9fce-b747d317a36b {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:16.629977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:16.656737 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4821d11-44ac-4a0d-85a0-88d5ca668fc9 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1450 microversion: 2.1 time: 0.531278 Oct 22 03:05:16.680588 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 110/252] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:16 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1450 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:16.755462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:16.773299 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b974db0c-982f-458a-bd93-2d533f987833 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 200 len: 1310 microversion: 2.1 time: 0.303636 Oct 22 03:05:16.775602 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 143/253] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:16 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 1310 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:17.479035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:17.481594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:17.554888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:17.558085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b7a1497d-7667-45c7-a628-77acb07b1a27 req-440b2857-15e1-44ba-87b9-5fc231cef517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fb7988-2331-4539-bc11-7f0e337f1a8c", "name": "network-vif-deleted", "tag": "65019e24-b881-4ea6-ab0f-f7ef34f2d814"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:17.576673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:17.577246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:17.588950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:17.590693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:17.592526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:17.595661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b7a1497d-7667-45c7-a628-77acb07b1a27 req-440b2857-15e1-44ba-87b9-5fc231cef517 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:17.601384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b7a1497d-7667-45c7-a628-77acb07b1a27 req-440b2857-15e1-44ba-87b9-5fc231cef517 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:17.601843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b7a1497d-7667-45c7-a628-77acb07b1a27 req-440b2857-15e1-44ba-87b9-5fc231cef517 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:17.655955 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b7a1497d-7667-45c7-a628-77acb07b1a27 req-440b2857-15e1-44ba-87b9-5fc231cef517 service nova] Creating event network-vif-deleted:65019e24-b881-4ea6-ab0f-f7ef34f2d814 for instance 40fb7988-2331-4539-bc11-7f0e337f1a8c on n-h1-862416-2 Oct 22 03:05:17.675451 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b7a1497d-7667-45c7-a628-77acb07b1a27 req-440b2857-15e1-44ba-87b9-5fc231cef517 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126902 Oct 22 03:05:17.677645 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 144/254] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 22 03:05:17.697502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:17.698459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:17.720647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:17.722254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:17.724180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:17.726916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:17.727581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:17.728994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:17.808906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:17.810106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:17.810962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:17.811868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lazy-loading 'fault' on Instance uuid 40fb7988-2331-4539-bc11-7f0e337f1a8c {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:18.011827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e2c4b21fee46a5862d8610e5abe7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8e2401cc2342a1b556d18dc00e1ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:18.062543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3277a25e-e210-4240-b641-09befdd81f56 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 200 len: 1327 microversion: 2.1 time: 0.378673 Oct 22 03:05:18.096562 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 145/255] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:17 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 1327 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:18.104438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:18.105819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:18.114776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:18.117921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:18.119064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:18.122048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:18.124087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:18.124754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:18.148862 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] HTTP exception thrown: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Request method failure captured: Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b HTTP/1.1 Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13DDhD38e10xFhGs-pKKHugJU-Z1EvS69NEZfuVlgv7M6BQoI3RacHfiXTSVOWN64prCxiMPKsZ9jUceYcWzp_egv1oiErI6p99m4njRVt9L7DpHVgs00lpkBmAXO2nTUwmqZ5z6eja5XKjqAwGsyRwvDop8MqEhprRyPbTco9N0Dw Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:18.157921 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb48d5632707444191801ef0a8940ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}] Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f0cf56d422d54c14a43abdc352756ada Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:18.159218 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'cbc00eac-c667-4bde-9fce-b747d317a36b'} Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:18.160028 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:18.161453 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.171319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Returning 404 to user: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:18.175117 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1c5a6c9c-b73e-452d-bb3a-2544069be2e0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 404 len: 111 microversion: 2.1 time: 0.076871 Oct 22 03:05:18.179461 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 146/256] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:18 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:18.207731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:18.227982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:18.229630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:18.257448 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8273eaa0-bc56-426b-8b7f-6ed9c6818a0e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1560 microversion: 2.91 time: 0.783829 Oct 22 03:05:18.258050 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 111/257] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:17 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1560 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:18.549334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1872393577", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:18.634552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-553c4315-7675-4d9c-a0ff-0960aab9f0fd tempest-InstanceUsageAuditLogNegativeTestJSON-999598939 tempest-InstanceUsageAuditLogNegativeTestJSON-999598939-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:18.637892 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-553c4315-7675-4d9c-a0ff-0960aab9f0fd tempest-InstanceUsageAuditLogNegativeTestJSON-999598939 tempest-InstanceUsageAuditLogNegativeTestJSON-999598939-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-553c4315-7675-4d9c-a0ff-0960aab9f0fd tempest-InstanceUsageAuditLogNegativeTestJSON-999598939 tempest-InstanceUsageAuditLogNegativeTestJSON-999598939-project-admin] Request method failure captured: Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13uPdoSIEr5QvvyxWczd0Ts70ycpa1iY3L2n67J2OzoXmZqe2FpmYxgQKyxyUZpNPXBbnc0oKZ_7VDoC9mSaFjfG4C52d-MR0ivi7midOe_gw7kJiBpSesqTrGPcv7c6FOknC-HTyDLZpTnVcE1RNZRJUM_ChSx8JWvpc81B8OQa3k Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 1f8d9992288340d5a49cd13f0dcaadb9 Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-999598939 Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:05:18.644720 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f8d9992288340d5a49cd13f0dcaadb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f8d9992288340d5a49cd13f0dcaadb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f8d9992288340d5a49cd13f0dcaadb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f8d9992288340d5a49cd13f0dcaadb9"}]}] Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-999598939 Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 1f8d9992288340d5a49cd13f0dcaadb9 Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-999598939 Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-999598939-project-admin Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 127d91f13af6402aa8831da8861f437b Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-999598939-project-admin Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:18.646138 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid timestamp for date invalid_time Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'invalid_time'} Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:18.646890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 22 03:05:18.648292 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.650688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-553c4315-7675-4d9c-a0ff-0960aab9f0fd tempest-InstanceUsageAuditLogNegativeTestJSON-999598939 tempest-InstanceUsageAuditLogNegativeTestJSON-999598939-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:18.651683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-553c4315-7675-4d9c-a0ff-0960aab9f0fd tempest-InstanceUsageAuditLogNegativeTestJSON-999598939 tempest-InstanceUsageAuditLogNegativeTestJSON-999598939-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.370099 Oct 22 03:05:18.653255 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 147/258] 10.222.0.25 () {58 vars in 1224 bytes} [Sat Oct 22 03:05:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:05:18.674586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:05:18.898112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4d287d27-1824-4e5a-9072-c14995c7be3e tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:18.900465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4d287d27-1824-4e5a-9072-c14995c7be3e tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a5402a7ee95c41df93499b5a9ac17f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '698ddec424684c31adafee33af149fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4d287d27-1824-4e5a-9072-c14995c7be3e tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] Request method failure captured: Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13sFsyO88vvyjbz5b7_AWzMlEYmTvAD7pxSvMe0ZCm3Ji72p5AybBKVMx8r-nvAGHWoiGyRnYOTsUZu8cUtAHp73d8JKui9RNvgLIgWKtESyRLmMVX-Gf8lE_pZfQDUctf1T7TA13bYdqb5IufKaRD32zCuJTZMogiDU6Uc-1kC2Jc Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 698ddec424684c31adafee33af149fd3 Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:18.907711 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_698ddec424684c31adafee33af149fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/698ddec424684c31adafee33af149fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/698ddec424684c31adafee33af149fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/698ddec424684c31adafee33af149fd3"}]}] Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 698ddec424684c31adafee33af149fd3 Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: a5402a7ee95c41df93499b5a9ac17f88 Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project Oct 22 03:05:18.909174 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: action_args: {} Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:18.909773 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 22 03:05:18.910930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.911859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4d287d27-1824-4e5a-9072-c14995c7be3e tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:18.911859 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4d287d27-1824-4e5a-9072-c14995c7be3e tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.245935 Oct 22 03:05:18.916168 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 148/259] 10.222.0.25 () {58 vars in 1185 bytes} [Sat Oct 22 03:05:18 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 254 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:18.960981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65aa08df-bd38-47fe-85ea-498d219f8ad0 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:18.972590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65aa08df-bd38-47fe-85ea-498d219f8ad0 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a5402a7ee95c41df93499b5a9ac17f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '698ddec424684c31adafee33af149fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65aa08df-bd38-47fe-85ea-498d219f8ad0 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] Request method failure captured: Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22%2003:05:18 HTTP/1.1 Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13sFsyO88vvyjbz5b7_AWzMlEYmTvAD7pxSvMe0ZCm3Ji72p5AybBKVMx8r-nvAGHWoiGyRnYOTsUZu8cUtAHp73d8JKui9RNvgLIgWKtESyRLmMVX-Gf8lE_pZfQDUctf1T7TA13bYdqb5IufKaRD32zCuJTZMogiDU6Uc-1kC2Jc Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 698ddec424684c31adafee33af149fd3 Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:18.974250 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_698ddec424684c31adafee33af149fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/698ddec424684c31adafee33af149fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/698ddec424684c31adafee33af149fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/698ddec424684c31adafee33af149fd3"}]}] Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 698ddec424684c31adafee33af149fd3 Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: a5402a7ee95c41df93499b5a9ac17f88 Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project Oct 22 03:05:18.976041 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '2022-10-22 03:05:18'} Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:18.976750 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 22 03:05:18.978321 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:18.990117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65aa08df-bd38-47fe-85ea-498d219f8ad0 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:18.991629 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65aa08df-bd38-47fe-85ea-498d219f8ad0 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634 tempest-InstanceUsageAuditLogNegativeTestJSON-1182370634-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22 03:05:18" status: 403 len: 128 microversion: 2.1 time: 0.054768 Oct 22 03:05:18.996777 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 149/260] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:05:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-22%2003%3A05%3A18 => generated 128 bytes in 80 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:19.096490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:19.101017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:19.113718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:19.118794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:19.119513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:19.120861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:19.123503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:19.126931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:19.191449 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] HTTP exception thrown: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Request method failure captured: Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c HTTP/1.1 Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127ekG_WjQC10Ekao4GsmGvFvnob0sEw87eElNJYwp3nith4FxyfdmgfHV3oIZCZIHxNUvIdvSPVO0KeL-RZHFylxIDeVhVbkgpyUsv_Uuul3x1kDik-AQkKIvxJxp1y7MNnd4LvAalz_BKBgQin2BsLWT3l00N-cf07bbqjv3REpQ Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8f8e2401cc2342a1b556d18dc00e1ec1 Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:19.192303 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f8e2401cc2342a1b556d18dc00e1ec1"}]}] Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8f8e2401cc2342a1b556d18dc00e1ec1 Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminTestJSON-1748043626-project Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d8e2c4b21fee46a5862d8610e5abe7be Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminTestJSON-1748043626-project Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:19.193545 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '40fb7988-2331-4539-bc11-7f0e337f1a8c'} Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:19.194232 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:19.195332 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:19.196348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Returning 404 to user: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:19.197739 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9fae86a-4f78-443d-8569-c99969b578f3 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 404 len: 111 microversion: 2.1 time: 0.108728 Oct 22 03:05:19.199980 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 150/261] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:19 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:19.215838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37389f76-4b17-441c-bfc5-df0e504a377a tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:19.247172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37389f76-4b17-441c-bfc5-df0e504a377a tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:19.247680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37389f76-4b17-441c-bfc5-df0e504a377a tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:19.248150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37389f76-4b17-441c-bfc5-df0e504a377a tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:19.496696 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37389f76-4b17-441c-bfc5-df0e504a377a tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.1 time: 0.290821 Oct 22 03:05:19.509562 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 151/262] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:05:19 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:19.523850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:19.524986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:19.551671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:19.552179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:19.566991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:19.568165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:19.570848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:19.571485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:19.730100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:19.741519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:19.743024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:19.759426 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d5f07424-0fc2-4926-9d13-1ff436aba9b7 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.248611 Oct 22 03:05:19.787079 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 152/263] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:19 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:19.799982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4476cf4e-31e1-4254-8598-e91e5d9a9475 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:19.839626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:19.886947 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4476cf4e-31e1-4254-8598-e91e5d9a9475 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.097069 Oct 22 03:05:19.896421 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 153/264] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:19 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:19.915905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01ab9307-7b9e-47d3-abd0-0e91f3a01385 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-690609061"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:19.921746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-01ab9307-7b9e-47d3-abd0-0e91f3a01385 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid 91ab39ee-96c2-440e-9d8a-ac519e4f6f90 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:19.938093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:05:19.938674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:05:19.939325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:05:19.940308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:05:19.941381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:05:19.981692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:19.982708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:19.985883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:19.988126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:19.989331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:19.996509 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01ab9307-7b9e-47d3-abd0-0e91f3a01385 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.085339 Oct 22 03:05:19.997061 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 154/265] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:05:19 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:19.999311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:20.017525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7502c74-b985-4bc8-a368-871a195cee6c tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:20.048020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7502c74-b985-4bc8-a368-871a195cee6c tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:20.049840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7502c74-b985-4bc8-a368-871a195cee6c tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:20.050587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7502c74-b985-4bc8-a368-871a195cee6c tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:20.097426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Getting quotas for project fb48d5632707444191801ef0a8940ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:05:20.120721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Getting quotas for user f0cf56d422d54c14a43abdc352756ada and project fb48d5632707444191801ef0a8940ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:05:20.146647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:05:20.153756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:05:20.208690 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7502c74-b985-4bc8-a368-871a195cee6c tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.198951 Oct 22 03:05:20.210466 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 155/266] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:05:20 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:20.223295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d22f1435-0f56-4bfb-905e-908ffa168215 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:20.235559 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d22f1435-0f56-4bfb-905e-908ffa168215 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.017571 Oct 22 03:05:20.236150 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 156/267] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:05:20 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:20.262128 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23c6007b-4865-479d-8d39-ed60602c3f49 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.716943 Oct 22 03:05:20.263947 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 112/268] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:05:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:05:20.280070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ba60b88-3407-483a-b912-1c197b969d7a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:20.281300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2ba60b88-3407-483a-b912-1c197b969d7a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:20.282639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b84bfde9-e77d-42cf-9a4b-23e2d231e0a7 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:20.313320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84bfde9-e77d-42cf-9a4b-23e2d231e0a7 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:20.313807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84bfde9-e77d-42cf-9a4b-23e2d231e0a7 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:20.314243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84bfde9-e77d-42cf-9a4b-23e2d231e0a7 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:20.509947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ba60b88-3407-483a-b912-1c197b969d7a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:20.522931 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ba60b88-3407-483a-b912-1c197b969d7a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1220 microversion: 2.1 time: 0.250964 Oct 22 03:05:20.532823 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 113/269] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:20 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1220 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:20.552001 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b84bfde9-e77d-42cf-9a4b-23e2d231e0a7 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.296153 Oct 22 03:05:20.563584 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 157/270] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:05:20 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:20.566072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2837b01-7c08-4d8c-9096-5aba477472ff tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:20.625054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2837b01-7c08-4d8c-9096-5aba477472ff tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.061939 Oct 22 03:05:20.633647 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 114/271] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:20 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 22 03:05:20.643637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fae4b190-1417-433a-bde5-31daf7d21b01 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-793843719"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:20.648435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-fae4b190-1417-433a-bde5-31daf7d21b01 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid 31e5df8b-d4ec-48c8-a85e-023f14e7ccee for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:20.691678 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fae4b190-1417-433a-bde5-31daf7d21b01 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054734 Oct 22 03:05:20.692970 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 158/272] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:05:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:20.705300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de077f7e-c5a8-4ec9-89db-54b535f8d786 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:20.730164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de077f7e-c5a8-4ec9-89db-54b535f8d786 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:20.734229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de077f7e-c5a8-4ec9-89db-54b535f8d786 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:20.735127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de077f7e-c5a8-4ec9-89db-54b535f8d786 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:20.796822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:20.797665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:20.810010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:20.814068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:20.814631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:20.815655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:20.816246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:20.816922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:20.991476 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de077f7e-c5a8-4ec9-89db-54b535f8d786 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.291126 Oct 22 03:05:20.999384 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 115/273] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:05:20 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:20.999580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:21.003795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-160b68fc-1140-4267-860f-e78e0d27cbe6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:21.020534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:21.022234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:21.033428 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4bc5817c-8e73-49b2-a99a-a7e060499d45 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.246401 Oct 22 03:05:21.034009 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 159/274] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:20 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:21.044547 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-160b68fc-1140-4267-860f-e78e0d27cbe6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.044253 Oct 22 03:05:21.045399 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 116/275] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:05:20 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:21.065828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-475666ad-568a-4a6f-898f-389a6431de10 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:21.095864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-475666ad-568a-4a6f-898f-389a6431de10 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:21.096660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-475666ad-568a-4a6f-898f-389a6431de10 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:21.097251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-475666ad-568a-4a6f-898f-389a6431de10 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:21.268960 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-475666ad-568a-4a6f-898f-389a6431de10 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.212539 Oct 22 03:05:21.270207 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 160/276] 10.222.0.25 () {60 vars in 1191 bytes} [Sat Oct 22 03:05:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:21.285151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cac02930-b61e-40cd-aedf-b84e527659c6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:21.325378 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cac02930-b61e-40cd-aedf-b84e527659c6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.047416 Oct 22 03:05:21.328189 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 117/277] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:21 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:21.342543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5fc5ccd2-d6de-4887-b08e-76b46230768f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-669151195"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:21.346315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-5fc5ccd2-d6de-4887-b08e-76b46230768f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid 02e8d9a7-dbdf-48af-be8e-e77c500cf218 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:21.388056 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5fc5ccd2-d6de-4887-b08e-76b46230768f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053248 Oct 22 03:05:21.389290 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 161/278] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:05:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:21.407416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44e55c7c-e85d-415c-b463-9b1a91587d94 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:21.428129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44e55c7c-e85d-415c-b463-9b1a91587d94 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:21.429028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44e55c7c-e85d-415c-b463-9b1a91587d94 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:21.436977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44e55c7c-e85d-415c-b463-9b1a91587d94 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:21.557099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:21.557724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:21.570095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:21.573184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:21.573646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:21.574369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:21.577514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:21.578142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:21.661510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44e55c7c-e85d-415c-b463-9b1a91587d94 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.264218 Oct 22 03:05:21.662113 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 118/279] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:05:21 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:21.677531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b537391-e2ad-4a83-8ee3-b14902b972f6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:21.702114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b537391-e2ad-4a83-8ee3-b14902b972f6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:21.702606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b537391-e2ad-4a83-8ee3-b14902b972f6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:21.704319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b537391-e2ad-4a83-8ee3-b14902b972f6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:21.860574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:21.870738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:21.895800 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04502e69-d57a-4220-bc1b-5e602fab8fee tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1224 microversion: 2.1 time: 0.342444 Oct 22 03:05:21.897253 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 162/280] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:21 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1224 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:21.998660 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0b537391-e2ad-4a83-8ee3-b14902b972f6 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.328568 Oct 22 03:05:21.999279 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 119/281] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:05:21 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:22.011089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5871d66a-c7fc-46a4-956c-36b3bd1d346c tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.065938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.066540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:22.094047 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5871d66a-c7fc-46a4-956c-36b3bd1d346c tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.074498 Oct 22 03:05:22.097794 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 163/282] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:22 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:22.099366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:22.100025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:22.100887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:22.103003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:22.105792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:22.107790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:22.109495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a902f171-230d-4f08-ad1a-885bab9b1a91 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-344182762"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:22.116002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-a902f171-230d-4f08-ad1a-885bab9b1a91 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid e0510e5f-8360-4486-9f8d-e50aa71653f2 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:22.172457 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a902f171-230d-4f08-ad1a-885bab9b1a91 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055902 Oct 22 03:05:22.176175 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 164/283] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:05:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:22.191214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f4f3c85a-eb8e-415c-ae33-3afe6c1c5bee tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-457679719"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:22.203746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-f4f3c85a-eb8e-415c-ae33-3afe6c1c5bee tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid 2a101d4d-86d3-4dbb-b0d4-eb9474e038fd for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:22.219513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:22.253100 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f4f3c85a-eb8e-415c-ae33-3afe6c1c5bee tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074159 Oct 22 03:05:22.253706 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 165/284] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:05:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:22.264954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f70d86ff-349e-4644-afc4-53e60f000d0f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.322697 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f70d86ff-349e-4644-afc4-53e60f000d0f tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.067766 Oct 22 03:05:22.328898 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 166/285] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:22 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:22.338382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d44e8e3-72ec-409e-9a4c-bfd65e4dbd76 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:22.363587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d44e8e3-72ec-409e-9a4c-bfd65e4dbd76 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:22.364087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d44e8e3-72ec-409e-9a4c-bfd65e4dbd76 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:22.364560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d44e8e3-72ec-409e-9a4c-bfd65e4dbd76 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:22.383961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:22.399804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:22.407333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:22.423979 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50d4d4b4-c73a-4fc0-96f1-3152260ebf89 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.363782 Oct 22 03:05:22.430642 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 120/286] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:22 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:22.442110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-790e59b8-9238-46eb-8d9c-80f6eb83fda5 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-790e59b8-9238-46eb-8d9c-80f6eb83fda5 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-790e59b8-9238-46eb-8d9c-80f6eb83fda5 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Request method failure captured: Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU1293vkySnUisY3B29gn8qD6o0f0WDBP1HHX9_h4l34_iqUcEUcxH0gVPhb_KSGA0TRHatsFwnaGmP4vI3QYNb3_Y_zrFND744qdU4xqjH9InGcpJOapyQYuh2e3o1xaYUJSqp2kWY2dDM0-D74gvPMGyBs8Snh1_nxS0zdwo2c2TSM Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9a0a2669736041f38fa97a4a23585a65 Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:05:22.472286 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a0a2669736041f38fa97a4a23585a65"}]}] Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9a0a2669736041f38fa97a4a23585a65 Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminTestJSON-1721887404-project-admin Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: fc792f055c764d7ca5664f3af93142f3 Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminTestJSON-1721887404-project-admin Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: exception: Aggregate 11 could not be found. Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '11'} Oct 22 03:05:22.473758 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.474592 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 22 03:05:22.476137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.477458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-790e59b8-9238-46eb-8d9c-80f6eb83fda5 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:22.477458 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-790e59b8-9238-46eb-8d9c-80f6eb83fda5 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.040755 Oct 22 03:05:22.477458 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 121/287] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:22 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:05:22.492352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a970ba06-0ec0-4b9e-85a5-1a3ed792d2fd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.544516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a970ba06-0ec0-4b9e-85a5-1a3ed792d2fd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a970ba06-0ec0-4b9e-85a5-1a3ed792d2fd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Request method failure captured: Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU1293vkySnUisY3B29gn8qD6o0f0WDBP1HHX9_h4l34_iqUcEUcxH0gVPhb_KSGA0TRHatsFwnaGmP4vI3QYNb3_Y_zrFND744qdU4xqjH9InGcpJOapyQYuh2e3o1xaYUJSqp2kWY2dDM0-D74gvPMGyBs8Snh1_nxS0zdwo2c2TSM Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9a0a2669736041f38fa97a4a23585a65 Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:05:22.547793 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a0a2669736041f38fa97a4a23585a65"}]}] Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9a0a2669736041f38fa97a4a23585a65 Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminTestJSON-1721887404-project-admin Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: fc792f055c764d7ca5664f3af93142f3 Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminTestJSON-1721887404-project-admin Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: exception: Aggregate 11 could not be found. Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '11'} Oct 22 03:05:22.549017 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:05:22.549755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.550793 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.551919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.551919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:22.551919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:22.551919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 22 03:05:22.551919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.551919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a970ba06-0ec0-4b9e-85a5-1a3ed792d2fd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:22.551919 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a970ba06-0ec0-4b9e-85a5-1a3ed792d2fd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.067853 Oct 22 03:05:22.551919 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 122/288] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:22 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:05:22.564433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08d1c99d-2624-4572-a0b0-d712d05fd7dd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1353338484", "name": "tempest-test_aggregate-1124492560"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:22.617408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.aggregate [None req-08d1c99d-2624-4572-a0b0-d712d05fd7dd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid f536b7f0-de61-475a-ae83-9a546d3a1266 for aggregate {{(pid=120581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:22.680274 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08d1c99d-2624-4572-a0b0-d712d05fd7dd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.120191 Oct 22 03:05:22.680933 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 123/289] 10.222.0.25 () {60 vars in 1165 bytes} [Sat Oct 22 03:05:22 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:05:22.695529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea931309-bc7e-4aef-a8c8-bc3d089f2e80 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.695974 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d44e8e3-72ec-409e-9a4c-bfd65e4dbd76 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.366955 Oct 22 03:05:22.704336 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 167/290] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:05:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:22.710152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-661eb70e-4ebc-4fcd-87ea-33997bac895b tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:22.722304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-661eb70e-4ebc-4fcd-87ea-33997bac895b tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9f34301104ab4b72a4c37bd7138e4560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b9859d98054eae94ebb07fbe62a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-661eb70e-4ebc-4fcd-87ea-33997bac895b tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Request method failure captured: Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 42 Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127WfAd9VgQuiVdWrHp-ACP003TKFAfhAqTyfGbvvuAwW9F5WdmD1XpVkWtgfhjG-CZg4ycpC7BtuIBZ7BbnvSe_Hqd_CRh8K8YbJogsRmFOpPBEHxZ60Q2JRLgUIb2wY0netyBIhdwqpBk3A2VsZ4gGygWmwifvHzHOYfe89374tU Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:22.727646 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b6b9859d98054eae94ebb07fbe62a556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b6b9859d98054eae94ebb07fbe62a556"}]}] Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: b6b9859d98054eae94ebb07fbe62a556 Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-236540023 Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 9f34301104ab4b72a4c37bd7138e4560 Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-236540023-project Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: {"remove_host": {"host": "n-h1-862416-2"}} Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:22.728933 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h1-862416-2'}}} Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:22.729671 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 22 03:05:22.730688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.741327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-661eb70e-4ebc-4fcd-87ea-33997bac895b tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:22.744107 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-661eb70e-4ebc-4fcd-87ea-33997bac895b tempest-AggregatesAdminNegativeTestJSON-236540023 tempest-AggregatesAdminNegativeTestJSON-236540023-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.038105 Oct 22 03:05:22.746331 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 168/291] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:05:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:22.765027 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea931309-bc7e-4aef-a8c8-bc3d089f2e80 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.074391 Oct 22 03:05:22.765634 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 124/292] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:22 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:22.772663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9e9f32fa-b524-490b-bc4b-b94193e85b5a tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:22.778814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c48c83c-74c2-4ddf-82d9-ef78bb45b3ad tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.814344 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1c48c83c-74c2-4ddf-82d9-ef78bb45b3ad tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 22 03:05:22.815436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e9f32fa-b524-490b-bc4b-b94193e85b5a tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c48c83c-74c2-4ddf-82d9-ef78bb45b3ad tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Request method failure captured: Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU1293vkySnUisY3B29gn8qD6o0f0WDBP1HHX9_h4l34_iqUcEUcxH0gVPhb_KSGA0TRHatsFwnaGmP4vI3QYNb3_Y_zrFND744qdU4xqjH9InGcpJOapyQYuh2e3o1xaYUJSqp2kWY2dDM0-D74gvPMGyBs8Snh1_nxS0zdwo2c2TSM Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9a0a2669736041f38fa97a4a23585a65 Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:05:22.815920 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a0a2669736041f38fa97a4a23585a65"}]}] Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9a0a2669736041f38fa97a4a23585a65 Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminTestJSON-1721887404-project-admin Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: fc792f055c764d7ca5664f3af93142f3 Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminTestJSON-1721887404-project-admin Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: exception: Aggregate 13 could not be found. Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '13'} Oct 22 03:05:22.817153 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.817867 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 22 03:05:22.818898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.820016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c48c83c-74c2-4ddf-82d9-ef78bb45b3ad tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:22.820016 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1c48c83c-74c2-4ddf-82d9-ef78bb45b3ad tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.042274 Oct 22 03:05:22.820016 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 125/293] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:22 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:05:22.828862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e9f32fa-b524-490b-bc4b-b94193e85b5a tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:22.829942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e9f32fa-b524-490b-bc4b-b94193e85b5a tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:22.852140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ae4edf77-d09a-4e3f-9d6b-698279738dbd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.899554 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ae4edf77-d09a-4e3f-9d6b-698279738dbd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ae4edf77-d09a-4e3f-9d6b-698279738dbd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Request method failure captured: Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU1293vkySnUisY3B29gn8qD6o0f0WDBP1HHX9_h4l34_iqUcEUcxH0gVPhb_KSGA0TRHatsFwnaGmP4vI3QYNb3_Y_zrFND744qdU4xqjH9InGcpJOapyQYuh2e3o1xaYUJSqp2kWY2dDM0-D74gvPMGyBs8Snh1_nxS0zdwo2c2TSM Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9a0a2669736041f38fa97a4a23585a65 Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:05:22.905899 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a0a2669736041f38fa97a4a23585a65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a0a2669736041f38fa97a4a23585a65"}]}] Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9a0a2669736041f38fa97a4a23585a65 Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1721887404 Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminTestJSON-1721887404-project-admin Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: fc792f055c764d7ca5664f3af93142f3 Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminTestJSON-1721887404-project-admin Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: exception: Aggregate 13 could not be found. Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '13'} Oct 22 03:05:22.907378 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:05:22.908097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:22.909492 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:22.910773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:22.910773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:22.910773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:22.910773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 22 03:05:22.910773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:22.911823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ae4edf77-d09a-4e3f-9d6b-698279738dbd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:22.912876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ae4edf77-d09a-4e3f-9d6b-698279738dbd tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.080930 Oct 22 03:05:22.913445 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 126/294] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:22 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:05:22.937132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:22.943434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:22.964778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:22.967932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:22.968667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:22.971082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:22.972719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:22.974749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.049315 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9e9f32fa-b524-490b-bc4b-b94193e85b5a tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.293997 Oct 22 03:05:23.057724 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 169/295] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:05:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.071512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd847406-de7b-4383-a8d9-863b38701560 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-834196882"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:23.076759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-fd847406-de7b-4383-a8d9-863b38701560 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid 27a78d99-796d-49ab-a289-d0c6e92030d3 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:23.116964 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd847406-de7b-4383-a8d9-863b38701560 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057858 Oct 22 03:05:23.118150 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 170/296] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:05:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.134596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-052aae17-ddb7-432e-afe0-03779c1302a0 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.165822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:23.175039 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-052aae17-ddb7-432e-afe0-03779c1302a0 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.045821 Oct 22 03:05:23.183449 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 171/297] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:23 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:23.186299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f300cf38-c5df-4917-98dd-59e1b98b72b0 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1278 microversion: 2.1 time: 0.266284 Oct 22 03:05:23.186448 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 127/298] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:22 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:23.190510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-552e9a3e-a559-4987-8002-759677f4ce51 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.203160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-41c1075f-3404-4607-8f35-3013cefcde3c tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-851430755"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:23.204644 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-552e9a3e-a559-4987-8002-759677f4ce51 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.019477 Oct 22 03:05:23.205468 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 172/299] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:23 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.206546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.aggregate [None req-41c1075f-3404-4607-8f35-3013cefcde3c tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Generated uuid c2dd4a07-74b0-4f90-831b-42581493d6dd for aggregate {{(pid=120581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:23.222347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4656abb-38bf-497c-9cac-d0a23ea87a41 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:23.266108 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4656abb-38bf-497c-9cac-d0a23ea87a41 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.048564 Oct 22 03:05:23.274604 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 173/300] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:05:23 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.277994 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-41c1075f-3404-4607-8f35-3013cefcde3c tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084006 Oct 22 03:05:23.285436 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 128/301] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:05:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.289467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e1f6a01-81bd-428e-a1d0-cd4d10e79fe7 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.291576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ee9a959-c613-4547-800d-47e91d4f3ec8 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Calling method '.version_select at 0x7f0d1abd2a60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.299751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee9a959-c613-4547-800d-47e91d4f3ec8 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.300260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee9a959-c613-4547-800d-47e91d4f3ec8 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.302895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee9a959-c613-4547-800d-47e91d4f3ec8 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.303750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee9a959-c613-4547-800d-47e91d4f3ec8 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.304255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee9a959-c613-4547-800d-47e91d4f3ec8 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.304688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee9a959-c613-4547-800d-47e91d4f3ec8 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.311075 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e1f6a01-81bd-428e-a1d0-cd4d10e79fe7 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.027424 Oct 22 03:05:23.312788 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 129/302] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:05:23 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.325480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:23.334639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=81,nova_api:INSERT=9 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:23.347994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.348521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.349587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.360074 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ee9a959-c613-4547-800d-47e91d4f3ec8 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.088438 Oct 22 03:05:23.361381 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 174/303] 10.222.0.25 () {58 vars in 1128 bytes} [Sat Oct 22 03:05:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.362671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.363148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.363592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.371190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c09bfd7-7381-444f-a9b2-b997497a2735 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.380910 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.compute.aggregates [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 22 03:05:23.381428 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Request method failure captured: Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 42 Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU129bqZ1BmGSKpvVa9ry6bigUUgGdtCPxaBiLr5fU4ScuLzU8SzNzE45jCWOwl2ww93ISXk08WfiSrper_OyCHgB3vmn_3BNqd96ITHWvXx6u2evU83dcJ2JZCmgtjttSUn-QGWpTdAGfLDByeQlcw-fxX7CTaxCYqBaovC_wV7prrg Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:05:23.383329 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f48255d03ca14a7983348f809f853256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f48255d03ca14a7983348f809f853256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f48255d03ca14a7983348f809f853256"}]}] Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f48255d03ca14a7983348f809f853256 Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443 Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f2bc147c69c54292a059b5d7054d7c96 Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: {"remove_host": {"host": "nonexist_host"}} Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:23.384609 n-d-862416-2 devstack@n-api.service[120581]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 22 03:05:23.385339 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 22 03:05:23.386455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.389755 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b6d9bb1-fb51-41c4-b1ee-50a8b742f0f3 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.071045 Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 130/304] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:05:23 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:05:23.390889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0260fe3b-b722-48df-b620-9af2eee7e469 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Calling method '.version_select at 0x7f0d1ac2c8b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.394357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0260fe3b-b722-48df-b620-9af2eee7e469 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.394839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0260fe3b-b722-48df-b620-9af2eee7e469 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.395277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0260fe3b-b722-48df-b620-9af2eee7e469 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.396007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0260fe3b-b722-48df-b620-9af2eee7e469 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.396511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0260fe3b-b722-48df-b620-9af2eee7e469 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.396937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0260fe3b-b722-48df-b620-9af2eee7e469 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.414510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c09bfd7-7381-444f-a9b2-b997497a2735 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.051159 Oct 22 03:05:23.415870 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 175/305] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:23 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:23.427219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1e2c084-1628-4b54-bf79-759e4477d691 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.481215 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1e2c084-1628-4b54-bf79-759e4477d691 tempest-AggregatesAdminNegativeTestJSON-1909254443 tempest-AggregatesAdminNegativeTestJSON-1909254443-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.063926 Oct 22 03:05:23.481963 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0260fe3b-b722-48df-b620-9af2eee7e469 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.094424 Oct 22 03:05:23.483235 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 131/306] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:23 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.484519 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 176/307] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:23 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:23.490206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a2e669c-0856-4f28-858b-00cad2fac632 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-676653480", "availability_zone": "tempest-test_az-697998393"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:23.495831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.aggregate [None req-5a2e669c-0856-4f28-858b-00cad2fac632 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid ff8cc388-e217-479e-bd03-252ed69e778c for aggregate {{(pid=120581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:23.513301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.514000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:23.538437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.539011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.539465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.540236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.540700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.541128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.545928 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a2e669c-0856-4f28-858b-00cad2fac632 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.061067 Oct 22 03:05:23.548649 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 132/308] 10.222.0.25 () {60 vars in 1165 bytes} [Sat Oct 22 03:05:23 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.564056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1ac10d7b-11da-4c1c-9a28-9e654f05aea0 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Calling method '.version_select at 0x7f0d1ac2cc10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.574859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ac10d7b-11da-4c1c-9a28-9e654f05aea0 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.577159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ac10d7b-11da-4c1c-9a28-9e654f05aea0 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.577737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ac10d7b-11da-4c1c-9a28-9e654f05aea0 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.580187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ac10d7b-11da-4c1c-9a28-9e654f05aea0 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.582557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ac10d7b-11da-4c1c-9a28-9e654f05aea0 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.584069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ac10d7b-11da-4c1c-9a28-9e654f05aea0 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.663364 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1ac10d7b-11da-4c1c-9a28-9e654f05aea0 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.112661 Oct 22 03:05:23.667390 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 133/309] 10.222.0.25 () {58 vars in 1128 bytes} [Sat Oct 22 03:05:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.679628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6cbcc19-296a-4e03-bb10-753e743bbbea tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-676653480_new", "availability_zone": "tempest-test_az-697998393_new"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:23.842572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6cbcc19-296a-4e03-bb10-753e743bbbea tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.843181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6cbcc19-296a-4e03-bb10-753e743bbbea tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.843760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6cbcc19-296a-4e03-bb10-753e743bbbea tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.903126 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6cbcc19-296a-4e03-bb10-753e743bbbea tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 334 microversion: 2.1 time: 0.232177 Oct 22 03:05:23.905849 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 134/310] 10.222.0.25 () {60 vars in 1173 bytes} [Sat Oct 22 03:05:23 2022] PUT /compute/v2.1/os-aggregates/16 => generated 334 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:23.916466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4382ec85-4cd7-4b26-a3ae-2f1ee7bb9021 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Calling method '.version_select at 0x7f0d1acd4280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:23.924527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:23.937495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4382ec85-4cd7-4b26-a3ae-2f1ee7bb9021 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.937826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4382ec85-4cd7-4b26-a3ae-2f1ee7bb9021 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.938270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4382ec85-4cd7-4b26-a3ae-2f1ee7bb9021 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.939361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:23.942478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:23.960235 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bcba844c-9932-454e-b038-53469f62ca6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.474604 Oct 22 03:05:23.961592 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 177/311] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:23 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:23.971825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4382ec85-4cd7-4b26-a3ae-2f1ee7bb9021 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:23.972678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4382ec85-4cd7-4b26-a3ae-2f1ee7bb9021 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:23.972788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4382ec85-4cd7-4b26-a3ae-2f1ee7bb9021 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:23.979633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-552e82a2-1ad7-4981-a70f-e3a6327b5d77 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.005303 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-552e82a2-1ad7-4981-a70f-e3a6327b5d77 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.038500 Oct 22 03:05:24.005972 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 178/312] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:05:23 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:24.018259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-340a1d96-53ef-417d-b4b5-9359659e91c3 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.043983 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-340a1d96-53ef-417d-b4b5-9359659e91c3 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.029735 Oct 22 03:05:24.045471 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 179/313] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:24 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:24.057294 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4382ec85-4cd7-4b26-a3ae-2f1ee7bb9021 tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-862416-2" status: 200 len: 467 microversion: 2.1 time: 0.146628 Oct 22 03:05:24.064246 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 135/314] 10.222.0.25 () {58 vars in 1170 bytes} [Sat Oct 22 03:05:23 2022] GET /compute/v2.1/os-hosts/n-h1-862416-2 => generated 467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:24.068471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40c97f81-cf65-44c2-9351-0b1cd47b940b tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Calling method '.version_select at 0x7f0d1ad18040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.069504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-26694c70-93f6-4779-bbbf-498e6ee9cbc8 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-216634629"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:24.081635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-26694c70-93f6-4779-bbbf-498e6ee9cbc8 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Generated uuid 950fbf0a-1657-4caa-8692-f92bd8f457b4 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:24.087512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c97f81-cf65-44c2-9351-0b1cd47b940b tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:24.088036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c97f81-cf65-44c2-9351-0b1cd47b940b tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:24.088583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c97f81-cf65-44c2-9351-0b1cd47b940b tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:24.122165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c97f81-cf65-44c2-9351-0b1cd47b940b tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:24.123443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c97f81-cf65-44c2-9351-0b1cd47b940b tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:24.124334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40c97f81-cf65-44c2-9351-0b1cd47b940b tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:24.151867 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-26694c70-93f6-4779-bbbf-498e6ee9cbc8 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.098877 Oct 22 03:05:24.157031 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 180/315] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:05:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:24.162441 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40c97f81-cf65-44c2-9351-0b1cd47b940b tempest-HostsAdminTestJSON-2014721656 tempest-HostsAdminTestJSON-2014721656-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-862416-2" status: 200 len: 467 microversion: 2.1 time: 0.097782 Oct 22 03:05:24.168019 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 136/316] 10.222.0.25 () {58 vars in 1170 bytes} [Sat Oct 22 03:05:24 2022] GET /compute/v2.1/os-hosts/n-h2-862416-2 => generated 467 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:24.180278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0b2157c-3ed7-42d8-ab18-fe26ba7f3168 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.212834 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0b2157c-3ed7-42d8-ab18-fe26ba7f3168 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.049910 Oct 22 03:05:24.214290 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 181/317] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:05:24 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:24.216459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.218353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:24.230654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:24.231143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:24.231586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:24.232396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:24.233255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:24.233367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:24.234700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bb1353f-04fa-4d5c-9e1b-c086f031a063 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.305450 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4bb1353f-04fa-4d5c-9e1b-c086f031a063 tempest-AggregatesAdminTestJSON-1721887404 tempest-AggregatesAdminTestJSON-1721887404-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.078235 Oct 22 03:05:24.306938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 182/318] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:05:24 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:05:24.323736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.326850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:24.345886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:24.346391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:24.346911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:24.347703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:24.348171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:24.349185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:24.392783 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] HTTP exception thrown: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Request method failure captured: Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c HTTP/1.1 Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127ekG_WjQC10Ekao4GsmGvFvnob0sEw87eElNJYwp3nith4FxyfdmgfHV3oIZCZIHxNUvIdvSPVO0KeL-RZHFylxIDeVhVbkgpyUsv_Uuul3x1kDik-AQkKIvxJxp1y7MNnd4LvAalz_BKBgQin2BsLWT3l00N-cf07bbqjv3REpQ Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8f8e2401cc2342a1b556d18dc00e1ec1 Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:24.397058 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f8e2401cc2342a1b556d18dc00e1ec1"}]}] Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8f8e2401cc2342a1b556d18dc00e1ec1 Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminTestJSON-1748043626-project Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d8e2c4b21fee46a5862d8610e5abe7be Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminTestJSON-1748043626-project Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.398229 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '40fb7988-2331-4539-bc11-7f0e337f1a8c'} Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:24.398956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.400033 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.401836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Returning 404 to user: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:24.403371 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-474e9a8e-047a-474f-83fb-bdf5bce21aa6 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 404 len: 111 microversion: 2.1 time: 0.087226 Oct 22 03:05:24.410853 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 183/319] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:05:24 2022] DELETE /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:24.423727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.424720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] [instance: 40fb7988-2331-4539-bc11-7f0e337f1a8c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:24.434855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:24.436372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:24.436914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:24.439740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:24.440674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:24.441161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:24.441603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:24.448494 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aac1837e-55c9-4a00-b5c5-545dbae6ca09 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1278 microversion: 2.1 time: 0.235468 Oct 22 03:05:24.459007 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 137/320] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:24 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:24.478237 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] HTTP exception thrown: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Request method failure captured: Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c HTTP/1.1 Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU127ekG_WjQC10Ekao4GsmGvFvnob0sEw87eElNJYwp3nith4FxyfdmgfHV3oIZCZIHxNUvIdvSPVO0KeL-RZHFylxIDeVhVbkgpyUsv_Uuul3x1kDik-AQkKIvxJxp1y7MNnd4LvAalz_BKBgQin2BsLWT3l00N-cf07bbqjv3REpQ Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8f8e2401cc2342a1b556d18dc00e1ec1 Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:24.479865 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f8e2401cc2342a1b556d18dc00e1ec1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f8e2401cc2342a1b556d18dc00e1ec1"}]}] Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8f8e2401cc2342a1b556d18dc00e1ec1 Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1748043626 Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AggregatesAdminTestJSON-1748043626-project Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d8e2c4b21fee46a5862d8610e5abe7be Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AggregatesAdminTestJSON-1748043626-project Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.481278 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '40fb7988-2331-4539-bc11-7f0e337f1a8c'} Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:24.481931 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. Oct 22 03:05:24.484405 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:24.489251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] Returning 404 to user: Instance 40fb7988-2331-4539-bc11-7f0e337f1a8c could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:24.493450 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6243b638-2b72-4eee-b277-fc9f32064ac2 tempest-AggregatesAdminTestJSON-1748043626 tempest-AggregatesAdminTestJSON-1748043626-project] 10.222.0.25 "GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c" status: 404 len: 111 microversion: 2.1 time: 0.075824 Oct 22 03:05:24.495988 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 184/321] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:24 2022] GET /compute/v2.1/servers/40fb7988-2331-4539-bc11-7f0e337f1a8c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:24.989484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:24.990094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:25.002639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:25.003429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:25.004697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:25.006388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:25.007356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:25.009384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:25.304917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:25.314500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:25.328979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:25.337756 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a6c18a0-a279-4d5a-ac23-96d6f61f8866 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.352149 Oct 22 03:05:25.338346 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 138/322] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:24 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:25.485029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:25.486682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:25.496978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:25.499292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:25.500112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:25.503829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:25.505644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:25.507812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:26.111137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:26.127067 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77e98138-9463-489e-8449-49d673f7b8c3 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1320 microversion: 2.1 time: 0.646606 Oct 22 03:05:26.127657 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 185/323] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:25 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1320 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:26.370083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:26.370580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:26.378432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:26.378905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:26.379344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:26.385988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:26.386759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:26.386918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:26.517924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-755632340", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "88c94f0e-626b-4b04-b426-00fe37fe6119"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:26.622125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:26.646788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:26.650714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:26.659054 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bcc75c89-45f7-47c6-9d84-0459bdd6c70f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.293056 Oct 22 03:05:26.660253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] validate_networks() for [('88c94f0e-626b-4b04-b426-00fe37fe6119', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:05:26.660497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 186/324] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:26 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:27.155387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:27.156095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:27.165727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:27.169532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:27.169895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:27.170871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:27.173474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:27.174137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:27.654282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:27.666879 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ea324ca-90a4-43d9-af51-e31aa8a2b7c2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1320 microversion: 2.1 time: 0.516219 Oct 22 03:05:27.668988 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 187/325] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:27 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:27.687247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a44d049c-71a9-4094-8cf1-d0ee947aad53 req-078701de-98e0-4f3e-bbe2-b67dc9c2bacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dd0d61-1afa-4f86-94d5-7b9aea41c98f", "tag": "1145c53f-099f-466b-9f4c-c4ec73048e91"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:27.719136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a44d049c-71a9-4094-8cf1-d0ee947aad53 req-078701de-98e0-4f3e-bbe2-b67dc9c2bacc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:27.719698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a44d049c-71a9-4094-8cf1-d0ee947aad53 req-078701de-98e0-4f3e-bbe2-b67dc9c2bacc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:27.720143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a44d049c-71a9-4094-8cf1-d0ee947aad53 req-078701de-98e0-4f3e-bbe2-b67dc9c2bacc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:27.743072 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a44d049c-71a9-4094-8cf1-d0ee947aad53 req-078701de-98e0-4f3e-bbe2-b67dc9c2bacc service nova] Creating event network-changed:1145c53f-099f-466b-9f4c-c4ec73048e91 for instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f on n-h2-862416-2 Oct 22 03:05:27.749153 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a44d049c-71a9-4094-8cf1-d0ee947aad53 req-078701de-98e0-4f3e-bbe2-b67dc9c2bacc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078214 Oct 22 03:05:27.750525 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 188/326] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:27.759779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:27.760716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:27.771248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:27.771916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:27.772575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:27.773587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:27.774737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:27.775331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:28.068573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:28.083634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:28.085277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:28.090948 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3dbe3f12-538a-47d4-be22-7effbe2db816 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.337797 Oct 22 03:05:28.092199 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 189/327] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:27 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:28.693920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:28.694574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:28.704909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:28.705413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:28.705855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:28.709358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:28.711078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:28.711713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:29.275563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:29.290184 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e79da2e8-e4f0-4855-bd2f-8a3f9f306766 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1320 microversion: 2.1 time: 0.600734 Oct 22 03:05:29.290798 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 190/328] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:28 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:29.324649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:29.328525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:29.344112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:29.347127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:29.349013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:29.349995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:29.350666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:29.358201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:29.480834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:05:29.481290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:05:29.481720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:05:29.482210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:05:29.482610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:05:29.502138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:29.502623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:29.503058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:29.503791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:29.505441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:29.505896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:29.545791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for project e33669cd6c0040cda12f8063688eacc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:05:29.554807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for user 2868158117ea4f7797f9931a97bcedfd and project e33669cd6c0040cda12f8063688eacc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:05:29.574881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:29.582842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:05:29.585322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:05:29.587609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:29.589302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:29.604578 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-42e55a70-7069-43bf-b9cd-bfa756bbdc9c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.295119 Oct 22 03:05:29.606125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 191/329] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:29 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:29.739363 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-741d2c5b-a812-41c0-9a44-2993cb30703a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.868053 Oct 22 03:05:29.742449 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 139/330] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3872 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:05:29.754019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb81bd21-858c-4520-b76b-e7a18341bc2e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:29.755239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb81bd21-858c-4520-b76b-e7a18341bc2e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:29.935614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb81bd21-858c-4520-b76b-e7a18341bc2e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:29.943939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb81bd21-858c-4520-b76b-e7a18341bc2e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:29.953703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb81bd21-858c-4520-b76b-e7a18341bc2e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:29.955017 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb81bd21-858c-4520-b76b-e7a18341bc2e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1261 microversion: 2.25 time: 0.205465 Oct 22 03:05:29.968767 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 192/331] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:29 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:30.315946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:30.316738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:30.334317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:30.335663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:30.336914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:30.338810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:30.339712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:30.342194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:30.650211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-679978f5-77e2-44de-8648-0e7e9164abee tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Action: 'create', calling method: .version_select at 0x7f0d1ab734c0>, body: {"keypair": {"name": "tempest-keypair-500920283", "type": "ssh", "user_id": "919bc991448e4e31934e8867b6e8a542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDXNMmU4RKKuCByxKzuiu+kWHyLlcDw2TzpCsYexp8V6bO45DJF28JuqEudRVLrCpxVrl409Xzfmpr2SXNgaVkDhglDquF+Yo6EbwXIXZKhNvZfVzPgx0kkioYMfsuFQA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:30.711340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-679978f5-77e2-44de-8648-0e7e9164abee tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Getting quotas for project 45c6d7c866714f13a3d2e818bf90fe62. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:05:30.745029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:30.747051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-679978f5-77e2-44de-8648-0e7e9164abee tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Getting quotas for user 1768f207c6b1408eb711ef86e4469a8b and project 45c6d7c866714f13a3d2e818bf90fe62. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:05:30.837869 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-679978f5-77e2-44de-8648-0e7e9164abee tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.800332 Oct 22 03:05:30.839300 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 140/332] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:05:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 808 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 03:05:30.846259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:30.847646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:30.869042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:30.877232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:30.877780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:30.878842 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb518b32-f441-41b2-8cbf-915a440f5b60 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1320 microversion: 2.1 time: 0.567463 Oct 22 03:05:30.879256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:30.879996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:30.887532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:30.888945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:30.900161 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 193/333] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:30 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:05:30.910600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9a24529-7048-4f8d-835b-e944668bca2f tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Action: 'create', calling method: .version_select at 0x7f0d1abd2280>, body: {"keypair": {"name": "tempest-keypair-1689416371", "type": "ssh", "user_id": "919bc991448e4e31934e8867b6e8a542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnJayh/M4OiPAbFXy0QoOJ2OdsyYypYfSEu6HuaUEr6N9sPWJPUqPF17WKbQqVhGlbRF/eMy/N8DmZOHKKqFdj1ztADGxIp69GSEdSOnlHt9/JLcjxPNV8eNV4XCLlpJg=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:30.992379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a9a24529-7048-4f8d-835b-e944668bca2f tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Getting quotas for project 45c6d7c866714f13a3d2e818bf90fe62. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:05:31.014804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a9a24529-7048-4f8d-835b-e944668bca2f tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Getting quotas for user 1768f207c6b1408eb711ef86e4469a8b and project 45c6d7c866714f13a3d2e818bf90fe62. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:05:31.074533 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9a24529-7048-4f8d-835b-e944668bca2f tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.172929 Oct 22 03:05:31.075409 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 194/334] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:05:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 03:05:31.085005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:31.085811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:31.093338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:31.094148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:31.094805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:31.095747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:31.096531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:31.097172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:31.275645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:31.284950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:31.286684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:31.291918 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f73412c6-26e1-412d-b8f0-7304de2f21e8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.451452 Oct 22 03:05:31.292548 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 141/335] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:30 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:31.297839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e03ff52-71f7-45a5-af46-a8f59d78341c tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Calling method '.version_select at 0x7f0d1ab73940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:31.307978 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e03ff52-71f7-45a5-af46-a8f59d78341c tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-500920283?user_id=919bc991448e4e31934e8867b6e8a542" status: 200 len: 511 microversion: 2.10 time: 0.014207 Oct 22 03:05:31.308830 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 142/336] 10.222.0.25 () {60 vars in 1337 bytes} [Sat Oct 22 03:05:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-500920283?user_id=919bc991448e4e31934e8867b6e8a542 => generated 511 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:31.326349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a263a34-1172-4fb6-8cfa-9c1cb1845c9d tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Action: 'create', calling method: .version_select at 0x7f0d1ab73280>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1629249092", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp8o7guiKjUnVMGBaJt/xHzjPM34jHu/ncWQv/ByBY97AoOBYn/wliATEBu6K7VWOaB6SpkkesS5ZROHovkwFojR+dk43Ph7v023zXiLrwaXz+ntZ10Ia38PPQKApbCHA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:31.348510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9a263a34-1172-4fb6-8cfa-9c1cb1845c9d tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Getting quotas for project 45c6d7c866714f13a3d2e818bf90fe62. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:05:31.354585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9a263a34-1172-4fb6-8cfa-9c1cb1845c9d tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Getting quotas for user 1768f207c6b1408eb711ef86e4469a8b and project 45c6d7c866714f13a3d2e818bf90fe62. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:05:31.389690 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a263a34-1172-4fb6-8cfa-9c1cb1845c9d tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.067386 Oct 22 03:05:31.396944 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 143/337] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:05:31 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 22 03:05:31.397521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:31.405431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:31.406861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:31.408028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05ee1c4d-9813-432c-a03e-22e02c0bf0b1 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Calling method '.version_select at 0x7f0d1ab84940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:31.408481 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46b3d290-2ce9-4206-9fad-ec58c1381411 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1313 microversion: 2.25 time: 0.332122 Oct 22 03:05:31.409746 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 195/338] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:31 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:31.413755 n-d-862416-2 devstack@n-api.service[120581]: WARNING oslo_db.sqlalchemy.utils [None req-05ee1c4d-9813-432c-a03e-22e02c0bf0b1 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 03:05:31.425317 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05ee1c4d-9813-432c-a03e-22e02c0bf0b1 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=919bc991448e4e31934e8867b6e8a542" status: 200 len: 725 microversion: 2.10 time: 0.026016 Oct 22 03:05:31.427975 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 144/339] 10.222.0.25 () {60 vars in 1259 bytes} [Sat Oct 22 03:05:31 2022] GET /compute/v2.1/os-keypairs?user_id=919bc991448e4e31934e8867b6e8a542 => generated 725 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:31.442875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-06ff8c2a-a9a5-4570-aa00-fdc46a89ecc8 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Calling method '.version_select at 0x7f0d1a968ee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:31.484676 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-06ff8c2a-a9a5-4570-aa00-fdc46a89ecc8 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1629249092" status: 204 len: 0 microversion: 2.10 time: 0.045380 Oct 22 03:05:31.490480 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 196/340] 10.222.0.25 () {60 vars in 1325 bytes} [Sat Oct 22 03:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1629249092 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:05:31.497248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c95edfba-a038-4c56-a139-2af2f83bf2b7 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Calling method '.version_select at 0x7f0d1ac2c4c0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:31.532373 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c95edfba-a038-4c56-a139-2af2f83bf2b7 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689416371?user_id=919bc991448e4e31934e8867b6e8a542" status: 204 len: 0 microversion: 2.10 time: 0.040374 Oct 22 03:05:31.533353 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 145/341] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689416371?user_id=919bc991448e4e31934e8867b6e8a542 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:05:31.542688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dcb6165d-9df1-453d-b282-04691e25ce11 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] Calling method '.version_select at 0x7f0d1a9808b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:31.580474 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dcb6165d-9df1-453d-b282-04691e25ce11 tempest-KeyPairsV210TestJSON-1024464439 tempest-KeyPairsV210TestJSON-1024464439-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-500920283?user_id=919bc991448e4e31934e8867b6e8a542" status: 204 len: 0 microversion: 2.10 time: 0.039942 Oct 22 03:05:31.597985 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 197/342] 10.222.0.25 () {60 vars in 1340 bytes} [Sat Oct 22 03:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-500920283?user_id=919bc991448e4e31934e8867b6e8a542 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:05:31.907102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:31.907726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:31.918876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:31.919402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:31.919864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:31.924438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:31.925498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:31.926119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:32.126466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:32.134720 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f555a38-841a-4032-a024-9be097a208d8 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1320 microversion: 2.1 time: 0.232015 Oct 22 03:05:32.154694 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 146/343] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:31 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:32.322160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:32.322987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:32.334353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:32.337265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:32.337848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:32.339293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:32.340778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:32.344220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:32.449935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:32.451009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:32.462539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:32.463281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:32.464728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:32.466051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:32.472873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:32.472873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:32.483609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:32.609920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:32.623847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:32.630167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:32.631597 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-749d311a-7c60-4315-a372-e302e5f99dd0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1319 microversion: 2.25 time: 0.186032 Oct 22 03:05:32.632627 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 147/344] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:32 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:32.636112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:32.649343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:32.650890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:32.658622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=10,nova_api:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:32.661804 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a461a32e-53d1-4bfd-ad88-2c16ffff48ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.344090 Oct 22 03:05:32.666928 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 198/345] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:32 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:33.162621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:33.163261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:33.183521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:33.186053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:33.187339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:33.190571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:33.191157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:33.191669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:33.647302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:33.658324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:33.659162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:33.662659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:33.663922 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f82fe85-fcec-4f3f-8c4b-5587738243bc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1320 microversion: 2.1 time: 0.503624 Oct 22 03:05:33.665984 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 148/346] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:33 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:33.686508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:33.687368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:33.688061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:33.697413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:33.699517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:33.701835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:33.705690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:33.707508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:33.721555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:33.724050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:33.727538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:33.728580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:33.732433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:33.733395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:33.909187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:33.920033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:33.928816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:33.942546 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25dfdacd-6c37-4385-b09a-7c887ce5fef8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.247637 Oct 22 03:05:33.947532 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 149/347] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:33 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:34.024025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:34.040877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:34.049738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:34.052379 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1994374-ea06-40d1-a19c-5bc2bc7557cd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1319 microversion: 2.25 time: 0.398747 Oct 22 03:05:34.055439 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 199/348] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:33 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:34.543750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Calling method '.version_select at 0x7f0d1ab55550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:34.552515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:34.557556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:34.566000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:34.666990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9489a402-5360-45fc-9ee1-41474b9992db tempest-QuotaClassesAdmin257Test-57043763 tempest-QuotaClassesAdmin257Test-57043763-project-admin] Calling method '.version_select at 0x7f0d1a903af0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:34.669658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:34.670444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:34.671287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:34.686781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:34.687497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:34.688074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:34.695587 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9489a402-5360-45fc-9ee1-41474b9992db tempest-QuotaClassesAdmin257Test-57043763 tempest-QuotaClassesAdmin257Test-57043763-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.638415 Oct 22 03:05:34.696473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 200/349] 10.222.0.25 () {60 vars in 1226 bytes} [Sat Oct 22 03:05:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:34.701676 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a0d7e6b4-e32a-452e-aa9a-7e52290eca90 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.751895 Oct 22 03:05:34.702883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 150/350] 10.222.0.25 () {60 vars in 1208 bytes} [Sat Oct 22 03:05:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:34.707925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e71dae58-4201-44ea-adcc-b911d1eee8a7 req-1df3f482-12fd-46eb-8db6-aac095bb7cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dd0d61-1afa-4f86-94d5-7b9aea41c98f", "name": "network-vif-plugged", "status": "completed", "tag": "1145c53f-099f-466b-9f4c-c4ec73048e91"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:34.729583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e71dae58-4201-44ea-adcc-b911d1eee8a7 req-1df3f482-12fd-46eb-8db6-aac095bb7cac service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:34.730277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e71dae58-4201-44ea-adcc-b911d1eee8a7 req-1df3f482-12fd-46eb-8db6-aac095bb7cac service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:34.730916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e71dae58-4201-44ea-adcc-b911d1eee8a7 req-1df3f482-12fd-46eb-8db6-aac095bb7cac service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:34.757365 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e71dae58-4201-44ea-adcc-b911d1eee8a7 req-1df3f482-12fd-46eb-8db6-aac095bb7cac service nova] Creating event network-vif-plugged:1145c53f-099f-466b-9f4c-c4ec73048e91 for instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f on n-h2-862416-2 Oct 22 03:05:34.771358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e71dae58-4201-44ea-adcc-b911d1eee8a7 req-1df3f482-12fd-46eb-8db6-aac095bb7cac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066783 Oct 22 03:05:34.772244 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 151/351] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:34.785764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:34.788044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:34.806146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:34.813743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:34.814561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:34.816418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:34.816857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:34.820770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:34.860577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a93f35de-874f-443d-a29c-b4a2a9f26717 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1563312223", "ram": 512, "vcpus": 1, "disk": 10, "id": 445666896, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:34.898631 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a93f35de-874f-443d-a29c-b4a2a9f26717 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.199559 Oct 22 03:05:34.911722 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 201/352] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:05:34 2022] POST /compute/v2.1/flavors => generated 413 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:34.917079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4d81190e-78e3-43d0-93ef-dbbc1dffde7f tempest-QuotaClassesAdmin257Test-57043763 tempest-QuotaClassesAdmin257Test-57043763-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a929ee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:35.059735 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4d81190e-78e3-43d0-93ef-dbbc1dffde7f tempest-QuotaClassesAdmin257Test-57043763 tempest-QuotaClassesAdmin257Test-57043763-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.145794 Oct 22 03:05:35.061115 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 202/353] 10.222.0.25 () {62 vars in 1247 bytes} [Sat Oct 22 03:05:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:35.067397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5eb3444b-80d2-47e8-b0ef-1942e2650dd5 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1653690584"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:35.076199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-5eb3444b-80d2-47e8-b0ef-1942e2650dd5 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Generated uuid ebff20d7-9447-49bc-8796-f3de68cbc8a9 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:05:35.102008 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5eb3444b-80d2-47e8-b0ef-1942e2650dd5 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.039579 Oct 22 03:05:35.102600 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 203/354] 10.222.0.25 () {62 vars in 1205 bytes} [Sat Oct 22 03:05:35 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:35.114657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.131558 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-452ae8ff-7c5d-4a72-8e6d-22282eaf0bea tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1320 microversion: 2.1 time: 0.357883 Oct 22 03:05:35.132466 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 152/355] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:34 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:35.141291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:35.143259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:35.160101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:35.160833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:35.161461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:35.162322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:35.162923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:35.163528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:35.319621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.333869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.339302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.352470 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7e20e2ae-1477-4acb-89f8-c15dd3c0dbcc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.218750 Oct 22 03:05:35.370250 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 153/356] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:35 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:35.378707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d9d2d92d-8ae7-45be-ac68-9dc11f423f2c tempest-QuotaClassesAdmin257Test-57043763 tempest-QuotaClassesAdmin257Test-57043763-project-admin] Calling method '.version_select at 0x7f0d1ab65040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:35.400337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d9d2d92d-8ae7-45be-ac68-9dc11f423f2c tempest-QuotaClassesAdmin257Test-57043763 tempest-QuotaClassesAdmin257Test-57043763-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.028156 Oct 22 03:05:35.403025 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 154/357] 10.222.0.25 () {60 vars in 1226 bytes} [Sat Oct 22 03:05:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:35.409994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:35.411096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:35.419869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:35.421793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:35.422534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:35.423522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:35.424460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:35.425296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:35.505458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f93c29d-868f-456c-9976-81375fa77e56 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:35.517020 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-5f93c29d-868f-456c-9976-81375fa77e56 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] HTTP exception thrown: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f93c29d-868f-456c-9976-81375fa77e56 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Request method failure captured: Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/flavors/445666896/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU138Nz1Cr2cY4Rtym2_8pPTD5Nk7Ide8qQPKr24A8b1IZQ6wTxo_BrSlPi6286c0KpUEYDeFkxQj4hy8f_TagmUm0AWmO5h02wrvZGxWll3SwkgXI2HgclnbyvcZAYjmlZxTo5b_XB-KnxIOyaTPi2q-fb9Z6QCE89CNf2OVI5TxUHA Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 4e074eb112b4418c847946dc0355b93c Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:35.518804 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e074eb112b4418c847946dc0355b93c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e074eb112b4418c847946dc0355b93c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e074eb112b4418c847946dc0355b93c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e074eb112b4418c847946dc0355b93c"}]}] Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 4e074eb112b4418c847946dc0355b93c Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: bfa0240a444f43978c30ad7b4aab7da7 Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:35.520199 n-d-862416-2 devstack@n-api.service[120582]: exception: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'flavor_id': '445666896', 'id': 'hw:cpu_thread_policy'} Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:35.520881 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f93c29d-868f-456c-9976-81375fa77e56 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Returning 404 to user: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f93c29d-868f-456c-9976-81375fa77e56 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] 10.222.0.25 "GET /compute/v2.1/flavors/445666896/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.416684 Oct 22 03:05:35.522147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 204/358] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:05:35 2022] GET /compute/v2.1/flavors/445666896/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:35.530588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-33efa9c6-e71a-480e-88d6-fa31d592e91b tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-930621137"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:35.666647 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-33efa9c6-e71a-480e-88d6-fa31d592e91b tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.144245 Oct 22 03:05:35.668041 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 205/359] 10.222.0.25 () {62 vars in 1213 bytes} [Sat Oct 22 03:05:35 2022] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:35.678670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d2ccdc3-e76d-4f38-a910-9c01fa454122 tempest-QuotaClassesAdmin257Test-57043763 tempest-QuotaClassesAdmin257Test-57043763-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a929e50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:35.714514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.727806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.731737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.737142 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-934506d4-f0bb-409c-9fa1-0565d3100a87 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1361 microversion: 2.25 time: 0.331795 Oct 22 03:05:35.759339 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 155/360] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:35 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:35.780662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05fc22ea-590c-42ba-a31e-57b9e46417e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:35.801093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-05fc22ea-590c-42ba-a31e-57b9e46417e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'bfa0240a444f43978c30ad7b4aab7da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e074eb112b4418c847946dc0355b93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05fc22ea-590c-42ba-a31e-57b9e46417e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Request method failure captured: Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/flavors/445666896/os-extra_specs HTTP/1.1 Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 66 Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU138Nz1Cr2cY4Rtym2_8pPTD5Nk7Ide8qQPKr24A8b1IZQ6wTxo_BrSlPi6286c0KpUEYDeFkxQj4hy8f_TagmUm0AWmO5h02wrvZGxWll3SwkgXI2HgclnbyvcZAYjmlZxTo5b_XB-KnxIOyaTPi2q-fb9Z6QCE89CNf2OVI5TxUHA Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 4e074eb112b4418c847946dc0355b93c Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:05:35.803775 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e074eb112b4418c847946dc0355b93c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e074eb112b4418c847946dc0355b93c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e074eb112b4418c847946dc0355b93c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e074eb112b4418c847946dc0355b93c"}]}] Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 4e074eb112b4418c847946dc0355b93c Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: bfa0240a444f43978c30ad7b4aab7da7 Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 22 03:05:35.805689 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'flavor_id': '445666896', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:05:35.806601 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 22 03:05:35.807933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.811288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05fc22ea-590c-42ba-a31e-57b9e46417e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:35.813753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05fc22ea-590c-42ba-a31e-57b9e46417e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] 10.222.0.25 "POST /compute/v2.1/flavors/445666896/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.053193 Oct 22 03:05:35.815273 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 156/361] 10.222.0.25 () {60 vars in 1221 bytes} [Sat Oct 22 03:05:35 2022] POST /compute/v2.1/flavors/445666896/os-extra_specs => generated 124 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:35.820309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efc0db6e-e2a4-4f8c-b138-96ea7820b584 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:35.843091 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efc0db6e-e2a4-4f8c-b138-96ea7820b584 tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.026575 Oct 22 03:05:35.847305 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d2ccdc3-e76d-4f38-a910-9c01fa454122 tempest-QuotaClassesAdmin257Test-57043763 tempest-QuotaClassesAdmin257Test-57043763-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.176244 Oct 22 03:05:35.848153 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 206/362] 10.222.0.25 () {62 vars in 1247 bytes} [Sat Oct 22 03:05:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:35.863446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-10edfdff-fb48-4ea8-a450-16f72da96542 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:35.868506 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 157/363] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Oct 22 03:05:35 2022] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:35.874918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b30942e-c04f-44ff-bf53-28928b1e8b0b tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:35.892832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b30942e-c04f-44ff-bf53-28928b1e8b0b tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:35.896261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b30942e-c04f-44ff-bf53-28928b1e8b0b tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:35.896703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b30942e-c04f-44ff-bf53-28928b1e8b0b tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:35.928559 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-10edfdff-fb48-4ea8-a450-16f72da96542 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/445666896/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068714 Oct 22 03:05:35.930196 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 207/364] 10.222.0.25 () {60 vars in 1221 bytes} [Sat Oct 22 03:05:35 2022] POST /compute/v2.1/flavors/445666896/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:05:35.946549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5420445-e864-4498-a603-fb003384b34f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:35.952343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5420445-e864-4498-a603-fb003384b34f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'bfa0240a444f43978c30ad7b4aab7da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e074eb112b4418c847946dc0355b93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5420445-e864-4498-a603-fb003384b34f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Request method failure captured: Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU138Nz1Cr2cY4Rtym2_8pPTD5Nk7Ide8qQPKr24A8b1IZQ6wTxo_BrSlPi6286c0KpUEYDeFkxQj4hy8f_TagmUm0AWmO5h02wrvZGxWll3SwkgXI2HgclnbyvcZAYjmlZxTo5b_XB-KnxIOyaTPi2q-fb9Z6QCE89CNf2OVI5TxUHA Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 4e074eb112b4418c847946dc0355b93c Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:35.954567 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e074eb112b4418c847946dc0355b93c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e074eb112b4418c847946dc0355b93c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e074eb112b4418c847946dc0355b93c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e074eb112b4418c847946dc0355b93c"}]}] Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 4e074eb112b4418c847946dc0355b93c Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: bfa0240a444f43978c30ad7b4aab7da7 Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:35.956040 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'flavor_id': '445666896', 'id': 'hw:numa_nodes'} Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:35.956807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 22 03:05:35.958153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:35.964920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5420445-e864-4498-a603-fb003384b34f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:35.966050 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a5420445-e864-4498-a603-fb003384b34f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.028960 Oct 22 03:05:35.967919 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 208/365] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:05:35 2022] DELETE /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:35.988633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d1b81c6-2bf9-49d1-9f47-0b4b7c1c785b tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:36.054464 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d1b81c6-2bf9-49d1-9f47-0b4b7c1c785b tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/445666896/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059770 Oct 22 03:05:36.055163 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 209/366] 10.222.0.25 () {60 vars in 1221 bytes} [Sat Oct 22 03:05:35 2022] POST /compute/v2.1/flavors/445666896/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:05:36.065685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2d7962e-7ad5-4ab9-9bee-b491c7f2a21f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:36.069195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a2d7962e-7ad5-4ab9-9bee-b491c7f2a21f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'bfa0240a444f43978c30ad7b4aab7da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e074eb112b4418c847946dc0355b93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2d7962e-7ad5-4ab9-9bee-b491c7f2a21f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Request method failure captured: Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 22 Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU138Nz1Cr2cY4Rtym2_8pPTD5Nk7Ide8qQPKr24A8b1IZQ6wTxo_BrSlPi6286c0KpUEYDeFkxQj4hy8f_TagmUm0AWmO5h02wrvZGxWll3SwkgXI2HgclnbyvcZAYjmlZxTo5b_XB-KnxIOyaTPi2q-fb9Z6QCE89CNf2OVI5TxUHA Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 4e074eb112b4418c847946dc0355b93c Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:05:36.071219 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e074eb112b4418c847946dc0355b93c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e074eb112b4418c847946dc0355b93c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e074eb112b4418c847946dc0355b93c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e074eb112b4418c847946dc0355b93c"}]}] Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 4e074eb112b4418c847946dc0355b93c Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: bfa0240a444f43978c30ad7b4aab7da7 Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: {"hw:numa_nodes": "1"} Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:36.072733 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'flavor_id': '445666896', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:05:36.073632 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 22 03:05:36.076428 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.077727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2d7962e-7ad5-4ab9-9bee-b491c7f2a21f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:36.077727 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a2d7962e-7ad5-4ab9-9bee-b491c7f2a21f tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428 tempest-FlavorsExtraSpecsNegativeTestJSON-1114554428-project] 10.222.0.25 "PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012528 Oct 22 03:05:36.080680 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 210/367] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:05:36 2022] PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:05:36.085609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-956d36cc-c0c5-40f6-b29f-2983f4fb9d62 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:36.098319 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-956d36cc-c0c5-40f6-b29f-2983f4fb9d62 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] HTTP exception thrown: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-956d36cc-c0c5-40f6-b29f-2983f4fb9d62 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Request method failure captured: Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/flavors/445666896/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13-6ZnaRmSmDSryrUDqSZyd_ZsmYVPcyZ5b1r8bT1gp0Fki7X8JPMTwNNfJkKObKfHJRP6EzpJJFnihimufctWfu74bmz7DzDEpUvVTl93kjkSn0lbNOaLP6Fdb9T1bUVt5euWaLul_xXq3q_HQwyWNiN4dgiJlTc35g8Zc5nahHvE Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 957765e3752041faa93599cccc662176 Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:05:36.100905 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_957765e3752041faa93599cccc662176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/957765e3752041faa93599cccc662176"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/957765e3752041faa93599cccc662176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/957765e3752041faa93599cccc662176"}]}] Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 957765e3752041faa93599cccc662176 Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f678b9827f4e4635a8d9d09633c4bb2c Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:36.102970 n-d-862416-2 devstack@n-api.service[120582]: exception: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'flavor_id': '445666896', 'id': 'hw:cpu_thread_policy'} Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:36.104670 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.113932 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.113932 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:36.113932 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:36.113932 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:36.113932 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:36.113932 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. Oct 22 03:05:36.113932 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.114717 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b30942e-c04f-44ff-bf53-28928b1e8b0b tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 314 microversion: 2.41 time: 0.236418 Oct 22 03:05:36.114717 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 158/368] 10.222.0.25 () {62 vars in 1235 bytes} [Sat Oct 22 03:05:35 2022] POST /compute/v2.1/os-aggregates/18/action => generated 314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:36.116072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-956d36cc-c0c5-40f6-b29f-2983f4fb9d62 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Returning 404 to user: Flavor 445666896 has no extra specs with key hw:cpu_thread_policy. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:36.117151 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-956d36cc-c0c5-40f6-b29f-2983f4fb9d62 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/445666896/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.035375 Oct 22 03:05:36.118788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ceb8deb1-4210-413f-b2e0-7744087440da tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:36.123235 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 211/369] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:05:36 2022] DELETE /compute/v2.1/flavors/445666896/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:36.130938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a70151f-7086-4a5c-b133-170f08f4bc7a tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:36.134839 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-5a70151f-7086-4a5c-b133-170f08f4bc7a tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a70151f-7086-4a5c-b133-170f08f4bc7a tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Request method failure captured: Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 27 Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13-6ZnaRmSmDSryrUDqSZyd_ZsmYVPcyZ5b1r8bT1gp0Fki7X8JPMTwNNfJkKObKfHJRP6EzpJJFnihimufctWfu74bmz7DzDEpUvVTl93kjkSn0lbNOaLP6Fdb9T1bUVt5euWaLul_xXq3q_HQwyWNiN4dgiJlTc35g8Zc5nahHvE Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 957765e3752041faa93599cccc662176 Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:05:36.136620 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_957765e3752041faa93599cccc662176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/957765e3752041faa93599cccc662176"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/957765e3752041faa93599cccc662176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/957765e3752041faa93599cccc662176"}]}] Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 957765e3752041faa93599cccc662176 Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f678b9827f4e4635a8d9d09633c4bb2c Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: {"hw:cpu_policy": "shared"} Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:36.138188 n-d-862416-2 devstack@n-api.service[120582]: exception: Request body and URI mismatch Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'flavor_id': '445666896', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:36.139020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:36.140392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:36.140392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:36.140392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 22 03:05:36.140392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.140688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ceb8deb1-4210-413f-b2e0-7744087440da tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:36.140688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ceb8deb1-4210-413f-b2e0-7744087440da tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:36.140688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ceb8deb1-4210-413f-b2e0-7744087440da tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:36.141440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a70151f-7086-4a5c-b133-170f08f4bc7a tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:36.145177 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a70151f-7086-4a5c-b133-170f08f4bc7a tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019943 Oct 22 03:05:36.145768 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 212/370] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:05:36 2022] PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes => generated 73 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:05:36.161078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-497243b5-9715-4876-a3be-758861c91e32 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-497243b5-9715-4876-a3be-758861c91e32 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Request method failure captured: Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 49 Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13-6ZnaRmSmDSryrUDqSZyd_ZsmYVPcyZ5b1r8bT1gp0Fki7X8JPMTwNNfJkKObKfHJRP6EzpJJFnihimufctWfu74bmz7DzDEpUvVTl93kjkSn0lbNOaLP6Fdb9T1bUVt5euWaLul_xXq3q_HQwyWNiN4dgiJlTc35g8Zc5nahHvE Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 957765e3752041faa93599cccc662176 Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:05:36.166188 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_957765e3752041faa93599cccc662176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/957765e3752041faa93599cccc662176"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/957765e3752041faa93599cccc662176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/957765e3752041faa93599cccc662176"}]}] Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 957765e3752041faa93599cccc662176 Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f678b9827f4e4635a8d9d09633c4bb2c Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 22 03:05:36.167795 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'flavor_id': '445666896', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance: Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 22 03:05:36.168679 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.173699 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-497243b5-9715-4876-a3be-758861c91e32 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-497243b5-9715-4876-a3be-758861c91e32 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.014048 Oct 22 03:05:36.175264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 213/371] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:05:36 2022] PUT /compute/v2.1/flavors/445666896/os-extra_specs/hw:numa_nodes => generated 117 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:05:36.182824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:36.183797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:36.198092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:36.198570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:36.199361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:36.200462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:36.201182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:36.202065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:36.389725 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ceb8deb1-4210-413f-b2e0-7744087440da tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.274698 Oct 22 03:05:36.391662 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 159/372] 10.222.0.25 () {62 vars in 1235 bytes} [Sat Oct 22 03:05:36 2022] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:36.408128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfa435da-e27a-4fe7-b08e-bc58dab8dbf7 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:36.452645 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfa435da-e27a-4fe7-b08e-bc58dab8dbf7 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/445666896" status: 202 len: 0 microversion: 2.1 time: 0.059418 Oct 22 03:05:36.455768 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 160/373] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:05:36 2022] DELETE /compute/v2.1/flavors/445666896 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:05:36.461039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:36.469862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:36.484115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:36.484910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:36.485500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:36.486360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:36.486960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:36.492897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:36.545014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:36.563810 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3577ed10-3601-4401-ae07-b3284c63e4fc tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1320 microversion: 2.1 time: 0.386786 Oct 22 03:05:36.572655 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 214/374] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:36 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:36.581491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-068746bc-78c6-42d4-a43c-858dca567b9e tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:36.620925 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-068746bc-78c6-42d4-a43c-858dca567b9e tempest-AggregatesAdminTestV241-1663310526 tempest-AggregatesAdminTestV241-1663310526-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.047114 Oct 22 03:05:36.627250 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 215/375] 10.222.0.25 () {60 vars in 1196 bytes} [Sat Oct 22 03:05:36 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:36.634374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f6e7e44f-9d33-4fc9-89b5-1fe220bb6d1e tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:36.644957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:36.655292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:36.661354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:36.671675 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-985b5b4f-cdc9-4894-adaa-3428450a5afd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.214367 Oct 22 03:05:36.672277 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 161/376] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:36 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:36.680341 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f6e7e44f-9d33-4fc9-89b5-1fe220bb6d1e tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712 tempest-FlavorsExtraSpecsNegativeTestJSON-2014254712-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052520 Oct 22 03:05:36.680341 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 216/377] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:05:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:36.767880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:36.768508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:36.793829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:36.794896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:36.796754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:36.800654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:36.801155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:36.801645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:37.313705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:37.327469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:37.332223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:37.336706 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-59792f64-f200-4a3b-af21-e6cde751375f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1361 microversion: 2.25 time: 0.571443 Oct 22 03:05:37.349526 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 162/378] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:36 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1361 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:37.377460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fd9287e2-56c4-4179-8c71-30a9eeb1c839 req-d4546c77-52cb-4df1-b999-64cd42fe9504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992", "tag": "212bb93a-8709-465c-8065-5f0349088f1a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:37.413923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fd9287e2-56c4-4179-8c71-30a9eeb1c839 req-d4546c77-52cb-4df1-b999-64cd42fe9504 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:37.414688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fd9287e2-56c4-4179-8c71-30a9eeb1c839 req-d4546c77-52cb-4df1-b999-64cd42fe9504 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:37.415559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fd9287e2-56c4-4179-8c71-30a9eeb1c839 req-d4546c77-52cb-4df1-b999-64cd42fe9504 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:37.446300 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fd9287e2-56c4-4179-8c71-30a9eeb1c839 req-d4546c77-52cb-4df1-b999-64cd42fe9504 service nova] Creating event network-changed:212bb93a-8709-465c-8065-5f0349088f1a for instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 on n-h1-862416-2 Oct 22 03:05:37.461013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fd9287e2-56c4-4179-8c71-30a9eeb1c839 req-d4546c77-52cb-4df1-b999-64cd42fe9504 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087721 Oct 22 03:05:37.463753 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 217/379] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:37.590788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:37.592133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:37.605237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:37.605747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:37.606193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:37.606942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:37.609580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:37.610050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:37.702671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:37.703530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:37.717155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:37.717579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:37.718025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:37.718745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:37.719203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:37.719632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:37.926369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:37.934770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:37.940848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:37.950355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:37.952845 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b77ea83b-4704-4fd9-baae-921f56d9a414 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1469 microversion: 2.1 time: 0.366024 Oct 22 03:05:37.955413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:UPDATE=15,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:37.957590 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f897ebcb-36bf-44c1-ab02-811f06f90a05 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1560 microversion: 2.91 time: 0.259906 Oct 22 03:05:37.972963 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 163/380] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:37 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1469 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:37.973621 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 218/381] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:37 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1560 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:37.984310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:37.990131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:38.005697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.007155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.007607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.009608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.010752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.014739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.274434 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44d2d24e-3e64-444f-ada9-20fcaa144ee8 tempest-DeleteServersAdminTestJSON-1673577893 tempest-DeleteServersAdminTestJSON-1673577893-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f/action" status: 202 len: 0 microversion: 2.1 time: 0.295413 Oct 22 03:05:38.275569 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 164/382] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:05:37 2022] POST /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:05:38.285517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:38.286474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:38.298537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.299028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.301834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.301834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.304077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.304874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.334677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:38.365701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:38.366698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:38.379971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.380574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.381020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.382308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.385220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.385664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.387859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.388550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.389032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.389667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lazy-loading 'fault' on Instance uuid 92dd0d61-1afa-4f86-94d5-7b9aea41c98f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:38.807701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:38.821816 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c77e310a-1842-4a00-b5b6-d3ff3a04783c tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1452 microversion: 2.1 time: 0.535125 Oct 22 03:05:38.822483 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 219/383] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:38 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1452 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:38.850002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:38.852478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:38.874921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.875339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.875769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.876510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:38.885426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:38.885426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:38.945398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:05:39.114705 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-986b9198-21fa-4472-88a5-bf8e427d4a9e tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "DELETE /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 204 len: 0 microversion: 2.1 time: 0.271376 Oct 22 03:05:39.116322 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 220/384] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:05:38 2022] DELETE /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:05:39.126120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:39.126896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:39.134432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:39.135707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:39.136382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:39.137975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:39.138723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:39.140802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:39.265666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:39.282298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:39.285933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:39.287868 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cba8fed2-88fd-4cf1-b541-11840d77e1c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1361 microversion: 2.25 time: 0.926249 Oct 22 03:05:39.291231 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 165/385] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:38 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1361 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:39.299405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:39.300015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:39.301972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:39.320352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:39.320994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:39.321554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:39.322517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:39.323083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:39.323817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:39.339583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:39.351099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:39.357604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:39.364242 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b276008-0cbc-497f-9f35-70781b723636 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.246433 Oct 22 03:05:39.370809 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 221/386] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:39 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:39.402052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:39.402597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:39.402984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:39.403441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lazy-loading 'fault' on Instance uuid 92dd0d61-1afa-4f86-94d5-7b9aea41c98f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:39.518774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:39.654223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:39.663460 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b403332-bc0f-474d-8525-6f67e7e8b6e2 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1458 microversion: 2.1 time: 0.368740 Oct 22 03:05:39.664401 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 166/387] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:39 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1458 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:40.321550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:40.322508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:40.329446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:40.336125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:40.338977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:40.343835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:40.344759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:40.346613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:40.393620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:40.799233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e87768cb-89dc-4a97-8445-15a6da881d7d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a903af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:40.860516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:40.869227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:40.872863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:40.877421 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b3f08f99-5371-48b2-80b1-081e2e0d4b9d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1361 microversion: 2.25 time: 0.561041 Oct 22 03:05:40.878236 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 167/388] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:40 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:40.886071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:40.888765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:40.904009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:40.905000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:40.905621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:40.907307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:40.909744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:40.910488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:41.480973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:41.495152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:41.498393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:41.520717 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-80530967-fef6-457b-b3b7-500f9305a5d4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.637038 Oct 22 03:05:41.534528 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 168/389] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:40 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:41.555641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:41.556606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:41.566442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:41.567128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:41.567809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:41.568955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:41.569566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:41.570855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:41.638192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87768cb-89dc-4a97-8445-15a6da881d7d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:41.638680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87768cb-89dc-4a97-8445-15a6da881d7d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:41.639305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87768cb-89dc-4a97-8445-15a6da881d7d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:41.640033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87768cb-89dc-4a97-8445-15a6da881d7d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:41.640549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87768cb-89dc-4a97-8445-15a6da881d7d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:41.640973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87768cb-89dc-4a97-8445-15a6da881d7d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:41.649447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:41.650209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:41.654127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:41.655090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lazy-loading 'fault' on Instance uuid 92dd0d61-1afa-4f86-94d5-7b9aea41c98f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:41.861478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e87768cb-89dc-4a97-8445-15a6da881d7d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/02d0398607f6423998c0fa7181ac8bfa" status: 200 len: 148 microversion: 2.57 time: 1.896124 Oct 22 03:05:41.866855 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 222/390] 10.222.0.25 () {62 vars in 1303 bytes} [Sat Oct 22 03:05:39 2022] PUT /compute/v2.1/os-quota-sets/02d0398607f6423998c0fa7181ac8bfa => generated 148 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:41.886315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cac7d3cc-f47e-4271-9319-c6b632ae9374 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Calling method '.version_select at 0x7f0d1a903b80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:42.167596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:42.192037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-288acfc0-3af8-4ce0-8883-cbc163e72886 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1458 microversion: 2.1 time: 0.649055 Oct 22 03:05:42.219379 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 169/391] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:41 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1458 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:42.226207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:42.227171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:42.238053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:42.239839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:42.240610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:42.241683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:42.243718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:42.244524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:42.686449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cac7d3cc-f47e-4271-9319-c6b632ae9374 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:42.686991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cac7d3cc-f47e-4271-9319-c6b632ae9374 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:42.687425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cac7d3cc-f47e-4271-9319-c6b632ae9374 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:42.688175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cac7d3cc-f47e-4271-9319-c6b632ae9374 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:42.690113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cac7d3cc-f47e-4271-9319-c6b632ae9374 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:42.691751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cac7d3cc-f47e-4271-9319-c6b632ae9374 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:42.767733 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cac7d3cc-f47e-4271-9319-c6b632ae9374 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/02d0398607f6423998c0fa7181ac8bfa/detail" status: 200 len: 463 microversion: 2.57 time: 0.892571 Oct 22 03:05:42.784535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 223/392] 10.222.0.25 () {60 vars in 1304 bytes} [Sat Oct 22 03:05:41 2022] GET /compute/v2.1/os-quota-sets/02d0398607f6423998c0fa7181ac8bfa/detail => generated 463 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:42.792686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e8f8ca53-7409-4749-8754-e44d6378e311 req-65e04f23-d9fe-4ed8-a026-fb6ba5de0a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dd0d61-1afa-4f86-94d5-7b9aea41c98f", "name": "network-vif-deleted", "tag": "1145c53f-099f-466b-9f4c-c4ec73048e91"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:42.806063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e8f8ca53-7409-4749-8754-e44d6378e311 req-65e04f23-d9fe-4ed8-a026-fb6ba5de0a9c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:42.806920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e8f8ca53-7409-4749-8754-e44d6378e311 req-65e04f23-d9fe-4ed8-a026-fb6ba5de0a9c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:42.807647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e8f8ca53-7409-4749-8754-e44d6378e311 req-65e04f23-d9fe-4ed8-a026-fb6ba5de0a9c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:42.822715 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e8f8ca53-7409-4749-8754-e44d6378e311 req-65e04f23-d9fe-4ed8-a026-fb6ba5de0a9c service nova] Creating event network-vif-deleted:1145c53f-099f-466b-9f4c-c4ec73048e91 for instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f on n-h2-862416-2 Oct 22 03:05:42.829857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e8f8ca53-7409-4749-8754-e44d6378e311 req-65e04f23-d9fe-4ed8-a026-fb6ba5de0a9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042651 Oct 22 03:05:42.834603 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 224/393] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:42.842890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:42.843789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:42.855956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:42.856527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:42.857136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:42.857872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:42.858528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:42.858793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:42.994287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:43.034521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:43.042068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:43.072778 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13dab3c6-c9d6-4b97-8dec-97dce131f4b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.236846 Oct 22 03:05:43.073374 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 225/394] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:42 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:43.219647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:43.223556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:43.241191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:43.242827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:43.244836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:43.245305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:43.248520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:43.249522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:43.251781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:43.253377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:43.263821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:43.267595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35b8d2ef-7801-47a7-a635-addb27e24b58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1361 microversion: 2.25 time: 1.046383 Oct 22 03:05:43.281694 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 170/395] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:42 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1361 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:43.385749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:43.388441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:43.389307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:43.392187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lazy-loading 'fault' on Instance uuid 92dd0d61-1afa-4f86-94d5-7b9aea41c98f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:43.491295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3fc84564-ac9d-4d06-ae53-215e562d2086 req-95816d7d-d291-4182-9e51-e3452085519b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992", "name": "network-vif-plugged", "status": "completed", "tag": "212bb93a-8709-465c-8065-5f0349088f1a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:43.504725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cf56d422d54c14a43abdc352756ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb48d5632707444191801ef0a8940ef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:43.515674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a35e9b61-5966-40ba-811f-1991819f5f20 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 200 len: 1310 microversion: 2.1 time: 0.299876 Oct 22 03:05:43.516483 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 226/396] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:43 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 1310 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:43.520849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3fc84564-ac9d-4d06-ae53-215e562d2086 req-95816d7d-d291-4182-9e51-e3452085519b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:43.523056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3fc84564-ac9d-4d06-ae53-215e562d2086 req-95816d7d-d291-4182-9e51-e3452085519b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:43.523904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3fc84564-ac9d-4d06-ae53-215e562d2086 req-95816d7d-d291-4182-9e51-e3452085519b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:43.559741 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3fc84564-ac9d-4d06-ae53-215e562d2086 req-95816d7d-d291-4182-9e51-e3452085519b service nova] Creating event network-vif-plugged:212bb93a-8709-465c-8065-5f0349088f1a for instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 on n-h1-862416-2 Oct 22 03:05:43.573222 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3fc84564-ac9d-4d06-ae53-215e562d2086 req-95816d7d-d291-4182-9e51-e3452085519b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086799 Oct 22 03:05:43.579108 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 171/397] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:43.687746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a870a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:44.107468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:44.109046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:44.123026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.123522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.123957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.129890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.130516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.130989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.266716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:44.277511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:44.281780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:44.291338 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-033394c3-bccd-48a9-9f46-0f11520b40fd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.190050 Oct 22 03:05:44.305994 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 172/398] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:44 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:44.323567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:44.324452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:44.331120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.332001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.333256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.334451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.335061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.335648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.488284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.491369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.492585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.493584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.496461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.497130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.515236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:44.524502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:44.525957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:44.527498 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1522ed86-ebb5-488b-9b35-422dfc3a8844 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1361 microversion: 2.25 time: 0.208997 Oct 22 03:05:44.528445 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 173/399] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:44 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:44.544297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:44.545202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:44.565488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.567165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.569228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.571789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.572783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.574125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.598651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.599536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.599981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.603319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.603804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.604294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.612360 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] HTTP exception thrown: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Request method failure captured: Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f HTTP/1.1 Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13DDhD38e10xFhGs-pKKHugJU-Z1EvS69NEZfuVlgv7M6BQoI3RacHfiXTSVOWN64prCxiMPKsZ9jUceYcWzp_egv1oiErI6p99m4njRVt9L7DpHVgs00lpkBmAXO2nTUwmqZ5z6eja5XKjqAwGsyRwvDop8MqEhprRyPbTco9N0Dw Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:05:44.619035 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb48d5632707444191801ef0a8940ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}] Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f0cf56d422d54c14a43abdc352756ada Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.620683 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '92dd0d61-1afa-4f86-94d5-7b9aea41c98f'} Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:44.621641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.623280 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.624799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Returning 404 to user: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:44.627497 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9318e868-a439-4f03-96c5-a70800914c86 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 404 len: 111 microversion: 2.1 time: 0.088499 Oct 22 03:05:44.640673 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 174/400] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:44 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:44.647403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:44.648515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:44.656404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.657160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.657941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.658960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.659616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.660250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.676621 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] HTTP exception thrown: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Request method failure captured: Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f HTTP/1.1 Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13DDhD38e10xFhGs-pKKHugJU-Z1EvS69NEZfuVlgv7M6BQoI3RacHfiXTSVOWN64prCxiMPKsZ9jUceYcWzp_egv1oiErI6p99m4njRVt9L7DpHVgs00lpkBmAXO2nTUwmqZ5z6eja5XKjqAwGsyRwvDop8MqEhprRyPbTco9N0Dw Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:05:44.678165 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb48d5632707444191801ef0a8940ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}] Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f0cf56d422d54c14a43abdc352756ada Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.679377 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '92dd0d61-1afa-4f86-94d5-7b9aea41c98f'} Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:44.680114 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.681271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.682382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Returning 404 to user: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:44.682382 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f3e76221-9d03-4312-b940-27e2576abb0a tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "DELETE /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 404 len: 111 microversion: 2.1 time: 0.037473 Oct 22 03:05:44.683452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 175/401] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:05:44 2022] DELETE /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:44.688515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:44.689130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: 92dd0d61-1afa-4f86-94d5-7b9aea41c98f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:44.696581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.697379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.697826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.698539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.698997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.700682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.723326 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] HTTP exception thrown: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Request method failure captured: Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f HTTP/1.1 Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13DDhD38e10xFhGs-pKKHugJU-Z1EvS69NEZfuVlgv7M6BQoI3RacHfiXTSVOWN64prCxiMPKsZ9jUceYcWzp_egv1oiErI6p99m4njRVt9L7DpHVgs00lpkBmAXO2nTUwmqZ5z6eja5XKjqAwGsyRwvDop8MqEhprRyPbTco9N0Dw Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:05:44.726999 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb48d5632707444191801ef0a8940ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}] Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f0cf56d422d54c14a43abdc352756ada Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.728351 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '92dd0d61-1afa-4f86-94d5-7b9aea41c98f'} Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:44.729029 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. Oct 22 03:05:44.730503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.734353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Returning 404 to user: Instance 92dd0d61-1afa-4f86-94d5-7b9aea41c98f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:44.735475 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4127bf09-2ee3-490d-836e-cd1dc444a8ad tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f" status: 404 len: 111 microversion: 2.1 time: 0.051044 Oct 22 03:05:44.740557 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 176/402] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:44 2022] GET /compute/v2.1/servers/92dd0d61-1afa-4f86-94d5-7b9aea41c98f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:44.747336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:44.748341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:44.754999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.755793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.756540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.757482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.758148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.758910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.779270 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] HTTP exception thrown: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.779707 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-359ec1af-8551-47be-9d11-22f20afeec47 tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/02d0398607f6423998c0fa7181ac8bfa?user_id=86f19d2a3fd14086893b25fa499aafeb" status: 200 len: 148 microversion: 2.57 time: 1.095201 Oct 22 03:05:44.780919 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 227/403] 10.222.0.25 () {62 vars in 1384 bytes} [Sat Oct 22 03:05:43 2022] PUT /compute/v2.1/os-quota-sets/02d0398607f6423998c0fa7181ac8bfa?user_id=86f19d2a3fd14086893b25fa499aafeb => generated 148 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Request method failure captured: Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b HTTP/1.1 Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13DDhD38e10xFhGs-pKKHugJU-Z1EvS69NEZfuVlgv7M6BQoI3RacHfiXTSVOWN64prCxiMPKsZ9jUceYcWzp_egv1oiErI6p99m4njRVt9L7DpHVgs00lpkBmAXO2nTUwmqZ5z6eja5XKjqAwGsyRwvDop8MqEhprRyPbTco9N0Dw Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:05:44.783153 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb48d5632707444191801ef0a8940ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}] Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f0cf56d422d54c14a43abdc352756ada Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.784393 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'cbc00eac-c667-4bde-9fce-b747d317a36b'} Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:44.785064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.786190 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.788507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Returning 404 to user: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:44.788507 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7586e340-d008-4b27-9407-58875819c450 tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 404 len: 111 microversion: 2.1 time: 0.042473 Oct 22 03:05:44.788507 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 177/404] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:05:44 2022] DELETE /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:44.801405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c57845e-b694-4b95-bba8-a13cd86dd99d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] Calling method '.version_select at 0x7f0d1a870af0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:44.804019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:44.807334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] [instance: cbc00eac-c667-4bde-9fce-b747d317a36b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:44.823545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.824045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.824507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.825216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:44.826292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:44.826724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:44.848521 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] HTTP exception thrown: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Request method failure captured: Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b HTTP/1.1 Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13DDhD38e10xFhGs-pKKHugJU-Z1EvS69NEZfuVlgv7M6BQoI3RacHfiXTSVOWN64prCxiMPKsZ9jUceYcWzp_egv1oiErI6p99m4njRVt9L7DpHVgs00lpkBmAXO2nTUwmqZ5z6eja5XKjqAwGsyRwvDop8MqEhprRyPbTco9N0Dw Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:05:44.850081 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb48d5632707444191801ef0a8940ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb48d5632707444191801ef0a8940ef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb48d5632707444191801ef0a8940ef9"}]}] Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fb48d5632707444191801ef0a8940ef9 Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-23731102 Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f0cf56d422d54c14a43abdc352756ada Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersAdminTestJSON-23731102-project Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.851698 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'cbc00eac-c667-4bde-9fce-b747d317a36b'} Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:05:44.852467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. Oct 22 03:05:44.853816 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:05:44.854845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] Returning 404 to user: Instance cbc00eac-c667-4bde-9fce-b747d317a36b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:05:44.854845 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec2afe5c-c13a-4b50-852e-de54fe1ec80f tempest-DeleteServersAdminTestJSON-23731102 tempest-DeleteServersAdminTestJSON-23731102-project] 10.222.0.25 "GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b" status: 404 len: 111 microversion: 2.1 time: 0.054519 Oct 22 03:05:44.854845 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 178/405] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:44 2022] GET /compute/v2.1/servers/cbc00eac-c667-4bde-9fce-b747d317a36b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:05:45.325821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:45.326443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:45.332966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:45.333771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:45.334453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:45.335375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:45.336071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:45.336736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:45.398277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=24 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:45.470647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:45.479113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:45.483951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:45.504054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ef72de4-1255-46bb-9516-f4eeb169d5d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.182487 Oct 22 03:05:45.504997 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 179/406] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:45 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:45.556300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:45.557411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:45.569384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:45.570591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:45.571301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:45.572302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:45.572952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:45.573583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:45.805994 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1c57845e-b694-4b95-bba8-a13cd86dd99d tempest-QuotasAdminTestV257-1343885008 tempest-QuotasAdminTestV257-1343885008-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/02d0398607f6423998c0fa7181ac8bfa?user_id=86f19d2a3fd14086893b25fa499aafeb" status: 200 len: 190 microversion: 2.57 time: 1.011020 Oct 22 03:05:45.811975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:45.818136 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 228/407] 10.222.0.25 () {60 vars in 1364 bytes} [Sat Oct 22 03:05:44 2022] GET /compute/v2.1/os-quota-sets/02d0398607f6423998c0fa7181ac8bfa?user_id=86f19d2a3fd14086893b25fa499aafeb => generated 190 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:45.828597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:45.833445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:45.834673 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-29152549-c48a-4c1d-b9f2-1208b77ed4f8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1557 microversion: 2.25 time: 0.283679 Oct 22 03:05:45.835244 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 180/408] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:45 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1557 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:46.547309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:46.555623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:46.564355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:46.566383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:46.567662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:46.568574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:46.569034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:46.569459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:46.601089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:46.601639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:46.613076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:46.613570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:46.614015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:46.614719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:46.615174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:46.615599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:46.682781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:46.699633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:46.704160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:46.724002 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3206972d-799e-44b7-abe2-b8a0a00fadea tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.187110 Oct 22 03:05:46.727097 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 181/409] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:46 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:46.870242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:46.890857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c115b10d-2c6b-4eae-81a8-4c34afc41176 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 2049 microversion: 2.25 time: 1.031657 Oct 22 03:05:46.891517 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 229/410] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:45 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 2049 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:46.917455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:46.918051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:46.925203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:46.926029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:46.926651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:46.927506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:46.928107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:46.928843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:47.144171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:47.159913 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4744ecaf-60a0-4ebb-8951-6ed03ec90ec2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 2049 microversion: 2.25 time: 0.246014 Oct 22 03:05:47.173009 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 230/411] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:46 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 2049 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:47.188371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9de188a-9fc2-4fbf-a7cf-bdc624c8cf8a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:47.192682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9de188a-9fc2-4fbf-a7cf-bdc624c8cf8a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:47.193725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9de188a-9fc2-4fbf-a7cf-bdc624c8cf8a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:47.194399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9de188a-9fc2-4fbf-a7cf-bdc624c8cf8a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:47.195520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9de188a-9fc2-4fbf-a7cf-bdc624c8cf8a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:47.196295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9de188a-9fc2-4fbf-a7cf-bdc624c8cf8a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:47.196945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9de188a-9fc2-4fbf-a7cf-bdc624c8cf8a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:47.229531 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9de188a-9fc2-4fbf-a7cf-bdc624c8cf8a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.045617 Oct 22 03:05:47.239503 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 231/412] 10.222.0.25 () {60 vars in 1217 bytes} [Sat Oct 22 03:05:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:47.250116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-2", "block_migration": "auto"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:47.252511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:47.265975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:47.266465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:47.269463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:47.271860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:47.274748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:47.276696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:47.646085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1316179906", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:47.740873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:05:48.116186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:05:48.116629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:05:48.117108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:05:48.117535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:05:48.117920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:05:48.143806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:48.144496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:48.145105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:48.145999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:48.146607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:48.147194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:48.196263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Getting quotas for project 94702d905cb947b1b9d2237eaf51d93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:05:48.210227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Getting quotas for user c05424e067934bdbaa92c060a20e98ae and project 94702d905cb947b1b9d2237eaf51d93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:05:48.242462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:05:48.245036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:05:48.292421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'flavor' on Instance uuid dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:05:48.339707 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-817455b4-d26f-47c4-b2e7-20129de43f5c tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.539781 Oct 22 03:05:48.343692 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 182/413] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:05:48.435707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Going to try to live migrate instance to n-h2-862416-2 {{(pid=120582) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:05:48.889907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Calling method '.version_select at 0x7f0d1abeaee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:48.892495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:48.893149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:48.896633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:48.935903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:48.936712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:48.937405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:48.959247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:48.965950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:48.967663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:48.978116 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-917b3dbf-0dc2-46a7-b415-a63277e9f00e tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.632821 Oct 22 03:05:48.979308 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 183/414] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:05:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:48.996269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:48.997959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:49.021360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:49.022148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:49.022749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:49.023627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:49.024412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:49.024992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:49.177603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:49.196655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:49.206918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:49.230592 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4b9160f-8f3a-40a9-bfe9-14868a9b5b1e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.249530 Oct 22 03:05:49.250511 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 184/415] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:48 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:49.274740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4408742-de8a-4f94-9963-cfa634501cf3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:49.275799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4408742-de8a-4f94-9963-cfa634501cf3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:49.488690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4408742-de8a-4f94-9963-cfa634501cf3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:49.519072 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4408742-de8a-4f94-9963-cfa634501cf3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1222 microversion: 2.1 time: 0.264708 Oct 22 03:05:49.520501 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 185/416] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:49 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1222 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:49.569245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ffaf4b97-9088-45eb-91a4-b7a5dfe4071d tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Calling method '.version_select at 0x7f0d1aa23940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:49.573630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffaf4b97-9088-45eb-91a4-b7a5dfe4071d tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:49.580382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffaf4b97-9088-45eb-91a4-b7a5dfe4071d tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:49.583904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffaf4b97-9088-45eb-91a4-b7a5dfe4071d tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:49.656685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffaf4b97-9088-45eb-91a4-b7a5dfe4071d tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:49.658817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffaf4b97-9088-45eb-91a4-b7a5dfe4071d tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:49.672168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffaf4b97-9088-45eb-91a4-b7a5dfe4071d tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:49.690563 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ffaf4b97-9088-45eb-91a4-b7a5dfe4071d tempest-HypervisorAdminV228Test-2042054835 tempest-HypervisorAdminV228Test-2042054835-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.167101 Oct 22 03:05:49.694366 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 186/417] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Oct 22 03:05:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:05:50.269841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:50.271898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:50.284894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:50.286045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:50.286882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:50.288919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:50.291215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:50.292981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:50.613224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:50.628383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:50.632470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:50.647043 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-46fc2f57-e9c2-4390-a640-c3f8e7bd327f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.381633 Oct 22 03:05:50.700621 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 187/418] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:50 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:50.724577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:50.729653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:50.754303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:50.759000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:50.761326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:50.768292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:50.772153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:50.772916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:50.976084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:51.007893 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-22a03c94-a0f1-4ba8-852d-d2086a3f2069 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1282 microversion: 2.1 time: 0.303360 Oct 22 03:05:51.016523 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 188/419] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:50 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1282 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:51.696350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:51.698242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:51.722627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:51.723344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:51.724552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:51.726543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:51.731535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:51.732931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:52.038305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:52.051659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:52.064905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:52.073799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:52.099012 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1123dc9-8a56-4b1e-8406-cc15e91bc521 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.420718 Oct 22 03:05:52.101230 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 189/420] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:51 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:05:52.121430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:52.124289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:52.147026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:52.148633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:52.150725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:52.153846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:52.154571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:52.156796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:52.477125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:52.516824 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0329e95b-14ff-4bb5-84e5-7882e2c1c1f3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1280 microversion: 2.1 time: 0.411901 Oct 22 03:05:52.519600 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 190/421] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:52 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:53.517937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b330fb5-0683-4ebf-8cc4-4b3e4d641c73 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Calling method '.version_select at 0x7f0d1aade550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:55.013130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:55.062524 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b330fb5-0683-4ebf-8cc4-4b3e4d641c73 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/9a9223a0dea0435f81e2c8feaa523a17" status: 200 len: 371 microversion: 2.1 time: 2.078554 Oct 22 03:05:55.067124 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 191/422] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:05:52 2022] GET /compute/v2.1/os-quota-sets/9a9223a0dea0435f81e2c8feaa523a17 => generated 371 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:55.099424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:55.102522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:55.129807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:55.133122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:55.134323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:55.136330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:55.137117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:55.137907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:55.475693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:55.494537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:55.496009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:55.510864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c52cf393-6098-49c9-8584-a604dee808fa tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.441395 Oct 22 03:05:55.513480 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 192/423] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:55 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:55.531830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:55.533442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:55.548610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:55.550979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:55.552732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:55.563996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:55.567654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:55.568377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:55.790432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:55.923704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-afbfcf0c-4128-4296-8bc0-3305c7e9c50d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992/action" status: 202 len: 0 microversion: 2.25 time: 8.682667 Oct 22 03:05:55.925408 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 232/424] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:05:47 2022] POST /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992/action => generated 0 bytes in 8685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:05:55.933403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-23bf9067-c522-4d0d-a797-5e0992dd6be6 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a77d0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:56.073193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:56.090171 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-76cf841e-b746-4593-8e06-a1b9d373561f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 0.573083 Oct 22 03:05:56.092786 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 193/425] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:55 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:56.640134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bf9067-c522-4d0d-a797-5e0992dd6be6 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:56.641758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bf9067-c522-4d0d-a797-5e0992dd6be6 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:56.642648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bf9067-c522-4d0d-a797-5e0992dd6be6 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:56.646380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bf9067-c522-4d0d-a797-5e0992dd6be6 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:56.650193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bf9067-c522-4d0d-a797-5e0992dd6be6 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:56.650836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bf9067-c522-4d0d-a797-5e0992dd6be6 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:56.658729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a278f979-8042-4e4b-9ffe-f2f2bdcfba8e tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1622263760", "ram": 512, "vcpus": 1, "disk": 10, "id": 78640897, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:56.695682 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a278f979-8042-4e4b-9ffe-f2f2bdcfba8e tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.598759 Oct 22 03:05:56.697650 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 194/426] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:05:56 2022] POST /compute/v2.1/flavors => generated 410 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:56.712350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:56.714267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:56.737238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:56.740700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:56.742026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:56.745291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:56.746528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:56.749279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:56.756037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:56.843088 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-23bf9067-c522-4d0d-a797-5e0992dd6be6 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/9a9223a0dea0435f81e2c8feaa523a17" status: 200 len: 328 microversion: 2.1 time: 0.913254 Oct 22 03:05:56.848184 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 233/427] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:05:55 2022] PUT /compute/v2.1/os-quota-sets/9a9223a0dea0435f81e2c8feaa523a17 => generated 328 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:56.859480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:56.860540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:56.875421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:56.876785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:56.877723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:56.879311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:56.881610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:56.884942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:57.212353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:57.224423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:57.227931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:57.254972 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b389be6-fb4d-45cf-b700-323eeeccfc5e tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.405478 Oct 22 03:05:57.256551 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 234/428] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:56 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:57.262642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-94b9dbbd-a981-45e2-b113-d2a388291046 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:57.370766 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-94b9dbbd-a981-45e2-b113-d2a388291046 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/78640897/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.109713 Oct 22 03:05:57.375923 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 235/429] 10.222.0.25 () {60 vars in 1218 bytes} [Sat Oct 22 03:05:57 2022] POST /compute/v2.1/flavors/78640897/os-extra_specs => generated 66 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:05:57.401226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2cd2f8b-b306-49a0-832a-9a7cd966dc10 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:57.462838 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2cd2f8b-b306-49a0-832a-9a7cd966dc10 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/9a9223a0dea0435f81e2c8feaa523a17" status: 202 len: 0 microversion: 2.1 time: 0.083648 Oct 22 03:05:57.469088 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 236/430] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:05:57 2022] DELETE /compute/v2.1/os-quota-sets/9a9223a0dea0435f81e2c8feaa523a17 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:05:57.500057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:57.500788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:57.532688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:57.540106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:57.544848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:57.545695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:57.546188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:57.546680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:57.625080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:57.699624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:57.714842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:57.720593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:57.724094 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-670ca6a1-a8a9-4a1e-b147-5dab03d21c2b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 1.024175 Oct 22 03:05:57.726430 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 195/431] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:56 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:58.162257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:05:58.206508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-284b5457-a5a6-4632-8fbd-6d4c51913c35 tempest-FlavorsExtraSpecsTestJSON-1699302717 tempest-FlavorsExtraSpecsTestJSON-1699302717-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:58.229726 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-284b5457-a5a6-4632-8fbd-6d4c51913c35 tempest-FlavorsExtraSpecsTestJSON-1699302717 tempest-FlavorsExtraSpecsTestJSON-1699302717-project] 10.222.0.25 "GET /compute/v2.1/flavors/78640897/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.501865 Oct 22 03:05:58.239975 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 196/432] 10.222.0.25 () {58 vars in 1197 bytes} [Sat Oct 22 03:05:57 2022] GET /compute/v2.1/flavors/78640897/os-extra_specs => generated 66 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:05:58.240577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6aaa3b5a-e9cf-43f7-9620-6d8887fbc11d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Calling method '.version_select at 0x7f0d1aa97dc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:58.748923 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6aaa3b5a-e9cf-43f7-9620-6d8887fbc11d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/9a9223a0dea0435f81e2c8feaa523a17" status: 200 len: 371 microversion: 2.1 time: 0.511284 Oct 22 03:05:58.752496 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 197/433] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:05:58 2022] GET /compute/v2.1/os-quota-sets/9a9223a0dea0435f81e2c8feaa523a17 => generated 371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:05:58.913695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:58.930926 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-007f6e2a-62ca-42b8-9ceb-7a168c99d35e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 1.460371 Oct 22 03:05:58.932290 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 237/434] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:05:57 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:05:58.948600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-36428a90-3283-4120-9e08-6796921216bc tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:59.005249 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-36428a90-3283-4120-9e08-6796921216bc tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/78640897/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069848 Oct 22 03:05:59.011059 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 238/435] 10.222.0.25 () {60 vars in 1218 bytes} [Sat Oct 22 03:05:58 2022] POST /compute/v2.1/flavors/78640897/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:05:59.017150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:59.017771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:59.032080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:59.033480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:59.036255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:59.038816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:59.039364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:59.039712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:59.361175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1651456439", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:05:59.459751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:05:59.480107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:59.501027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:59.503041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:05:59.517982 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-25ee49ac-0258-46f3-b95e-375c3ca7b369 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.505761 Oct 22 03:05:59.522244 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 239/436] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:59 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:05:59.533203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:05:59.537783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:05:59.565179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:59.565681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:59.568115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:05:59.569800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:05:59.570439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:05:59.574732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:00.077812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:00.088367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:00.100686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:00.104257 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4a8592a-c0aa-497e-bbe0-9645ddc80e88 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.580766 Oct 22 03:06:00.111850 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 240/437] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:05:59 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:00.119737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80853cd9-110a-4ea9-8fcd-34945be379ef tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Calling method '.version_select at 0x7f0d1a78f8b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:00.157653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:00.159341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:00.160131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:00.160570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:00.161093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:00.176073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:00.177695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:00.178650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:00.179806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:00.180441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:00.182270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:00.205190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Getting quotas for project 6c1fad27341547a8bf328352ff67d8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:00.213420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Getting quotas for user 82b5f5151aef42a6a50e7f6748f35ba1 and project 6c1fad27341547a8bf328352ff67d8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:00.230657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:00.237077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:00.355351 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1224bf8c-9e45-4301-a955-a85ba8f894c9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597298 Oct 22 03:06:00.359758 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 198/438] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:06:00.371556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f8700939-7d54-43b8-b20f-0985bc271b4c tempest-FlavorsExtraSpecsTestJSON-1699302717 tempest-FlavorsExtraSpecsTestJSON-1699302717-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:00.399036 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f8700939-7d54-43b8-b20f-0985bc271b4c tempest-FlavorsExtraSpecsTestJSON-1699302717 tempest-FlavorsExtraSpecsTestJSON-1699302717-project] 10.222.0.25 "GET /compute/v2.1/flavors/78640897/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030808 Oct 22 03:06:00.401752 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 199/439] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:06:00 2022] GET /compute/v2.1/flavors/78640897/os-extra_specs/hw:numa_nodes => generated 22 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:06:00.414375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b4f014ba-7b42-47ba-938f-551b2d9d4c77 req-69437aa5-6caa-4839-981f-6c9aedf84c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23fabeb-4a39-4f68-b702-71589168a4e6", "tag": "0994e38e-d384-4037-9651-25060522a5c6"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:00.441664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b4f014ba-7b42-47ba-938f-551b2d9d4c77 req-69437aa5-6caa-4839-981f-6c9aedf84c50 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:00.442360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b4f014ba-7b42-47ba-938f-551b2d9d4c77 req-69437aa5-6caa-4839-981f-6c9aedf84c50 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:00.444123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b4f014ba-7b42-47ba-938f-551b2d9d4c77 req-69437aa5-6caa-4839-981f-6c9aedf84c50 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:00.465076 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b4f014ba-7b42-47ba-938f-551b2d9d4c77 req-69437aa5-6caa-4839-981f-6c9aedf84c50 service nova] Creating event network-changed:0994e38e-d384-4037-9651-25060522a5c6 for instance f23fabeb-4a39-4f68-b702-71589168a4e6 on n-h2-862416-2 Oct 22 03:06:00.489223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b4f014ba-7b42-47ba-938f-551b2d9d4c77 req-69437aa5-6caa-4839-981f-6c9aedf84c50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085793 Oct 22 03:06:00.492087 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 200/440] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:00.506715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:00.509135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:00.526716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:00.527815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:00.529515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:00.532037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:00.533924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:00.535464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:00.761001 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80853cd9-110a-4ea9-8fcd-34945be379ef tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/2d102bce117648f0a98b657eeca4a340/defaults" status: 200 len: 371 microversion: 2.1 time: 0.643601 Oct 22 03:06:00.763456 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 241/441] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:06:00 2022] GET /compute/v2.1/os-quota-sets/2d102bce117648f0a98b657eeca4a340/defaults => generated 371 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:00.778970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63ae7999-a392-4e55-9b96-a3c669b25e77 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:00.785407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63ae7999-a392-4e55-9b96-a3c669b25e77 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:00.815466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:00.827166 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67eafaeb-94f4-45ba-aa0a-675f0f3146cf tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 0.332902 Oct 22 03:06:00.843258 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 201/442] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:00 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:00.854046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d348c142-cb67-414e-aafb-832b17aaec37 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:00.886935 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d348c142-cb67-414e-aafb-832b17aaec37 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/78640897/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042384 Oct 22 03:06:00.888281 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 202/443] 10.222.0.25 () {60 vars in 1218 bytes} [Sat Oct 22 03:06:00 2022] POST /compute/v2.1/flavors/78640897/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:06:00.894068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:00.895222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:00.905940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:00.908348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:00.910128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:00.910990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:00.912728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:00.913344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:01.025996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-63ae7999-a392-4e55-9b96-a3c669b25e77 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:01.038418 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63ae7999-a392-4e55-9b96-a3c669b25e77 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1223 microversion: 2.1 time: 0.272344 Oct 22 03:06:01.040494 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 242/444] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:00 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1223 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:01.055554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-612d6d11-b9be-409d-9bd6-b0fb54ecab05 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.070273 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-612d6d11-b9be-409d-9bd6-b0fb54ecab05 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/78640897/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028415 Oct 22 03:06:01.079428 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 243/445] 10.222.0.25 () {58 vars in 1197 bytes} [Sat Oct 22 03:06:01 2022] GET /compute/v2.1/flavors/78640897/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:06:01.085345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:01.088929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-255c5934-6e20-4d0f-a9a8-494019e67653 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:01.095488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:01.104086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:01.114064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d14cc7a-3b42-407f-a99a-3b29891e0463 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.224624 Oct 22 03:06:01.116986 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 203/446] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:00 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:01.139159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.140059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:01.152557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:01.154783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:01.155931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:01.157680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:01.159005 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-255c5934-6e20-4d0f-a9a8-494019e67653 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/78640897/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.078411 Oct 22 03:06:01.159511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:01.161744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:01.173076 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 244/447] 10.222.0.25 () {60 vars in 1259 bytes} [Sat Oct 22 03:06:01 2022] PUT /compute/v2.1/flavors/78640897/os-extra_specs/hw:numa_nodes => generated 22 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:06:01.177441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ba3d075-ffb4-4d80-939d-8c95b3ed2a7e tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.204414 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ba3d075-ffb4-4d80-939d-8c95b3ed2a7e tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/78640897/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014810 Oct 22 03:06:01.210598 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 245/448] 10.222.0.25 () {58 vars in 1197 bytes} [Sat Oct 22 03:06:01 2022] GET /compute/v2.1/flavors/78640897/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:06:01.217710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d6caa43f-79f7-4739-a18a-e109d3905814 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.283441 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d6caa43f-79f7-4739-a18a-e109d3905814 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/78640897/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.071697 Oct 22 03:06:01.287348 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 246/449] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:06:01 2022] DELETE /compute/v2.1/flavors/78640897/os-extra_specs/hw:numa_nodes => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:06:01.294073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7bdcfff9-ab26-4820-8354-53a4b7786b33 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.349813 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7bdcfff9-ab26-4820-8354-53a4b7786b33 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/78640897/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.061337 Oct 22 03:06:01.354202 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 247/450] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:06:01 2022] DELETE /compute/v2.1/flavors/78640897/os-extra_specs/hw:cpu_policy => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:06:01.363970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49bf3d16-0338-46e2-8e18-a99421fb2f67 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.378635 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49bf3d16-0338-46e2-8e18-a99421fb2f67 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/78640897/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023090 Oct 22 03:06:01.390052 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 248/451] 10.222.0.25 () {58 vars in 1197 bytes} [Sat Oct 22 03:06:01 2022] GET /compute/v2.1/flavors/78640897/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:06:01.395078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d5f78cf-bd4f-4ad4-80ec-40338b685e38 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.439723 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d5f78cf-bd4f-4ad4-80ec-40338b685e38 tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/78640897" status: 202 len: 0 microversion: 2.1 time: 0.048227 Oct 22 03:06:01.440619 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 249/452] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:06:01 2022] DELETE /compute/v2.1/flavors/78640897 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:06:01.460028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b5077f7-ff66-4436-9f05-9c9803c3e86c tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.516459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:01.530039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:01.532833 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b5077f7-ff66-4436-9f05-9c9803c3e86c tempest-FlavorsExtraSpecsTestJSON-706430022 tempest-FlavorsExtraSpecsTestJSON-706430022-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076932 Oct 22 03:06:01.534050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:01.535437 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 250/453] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:06:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:01.536802 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b134836-c412-46ac-8272-1969f50fb384 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.401319 Oct 22 03:06:01.552599 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 204/454] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:01 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:01.859350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:01.860155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:01.874004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:01.874731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:01.875319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:01.876176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:01.877435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:01.879338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:02.178359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:02.200891 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28e104bf-d4c0-475a-8534-b5fdc400c28b tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 0.346232 Oct 22 03:06:02.201809 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 205/455] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:01 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:06:02.207883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63edb01e-2b3e-44a0-ac08-dfe069ca2771 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1aa83b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:02.475615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1402874776", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:02.579873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:06:02.687389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63edb01e-2b3e-44a0-ac08-dfe069ca2771 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:02.687988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63edb01e-2b3e-44a0-ac08-dfe069ca2771 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:02.688538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63edb01e-2b3e-44a0-ac08-dfe069ca2771 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:02.692585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63edb01e-2b3e-44a0-ac08-dfe069ca2771 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:02.695222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63edb01e-2b3e-44a0-ac08-dfe069ca2771 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:02.695970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63edb01e-2b3e-44a0-ac08-dfe069ca2771 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:02.911037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63edb01e-2b3e-44a0-ac08-dfe069ca2771 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/0f833a5f674041b2b114c5bf06a1f23f" status: 200 len: 328 microversion: 2.1 time: 0.707802 Oct 22 03:06:02.922457 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 206/456] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:06:02 2022] PUT /compute/v2.1/os-quota-sets/0f833a5f674041b2b114c5bf06a1f23f => generated 328 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:02.944125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:02.945219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:02.954006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:02.955136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:02.956001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:02.957193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:02.957793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:02.958494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.028897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:03.029512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:03.030080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:03.030496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:03.030910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:03.042914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.043403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.044083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.045119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.045862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.046513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.062133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:03.068498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:03.074097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for user 7bf9da8e55124a7aae0938bb828b8f8a and project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:03.093551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:03.096744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:03.118021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:03.130181 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4087d943-f050-4371-b54c-c6927cfcb27b tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1219 microversion: 2.1 time: 0.201056 Oct 22 03:06:03.131318 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 207/457] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:02 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1219 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:03.138609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:03.140090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:03.161480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.169830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.171353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.172642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.174527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.176802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.257961 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a68c675-8396-4a2b-86ad-f4eec2447299 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.474110 Oct 22 03:06:03.268034 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 251/458] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:06:03.276043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:03.305569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:03.319303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.319802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.320257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.321190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.322242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.322671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.402510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:03.415878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:03.420172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:03.434449 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b0435601-d8e2-4e6d-84d5-1830d1d692a2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.301813 Oct 22 03:06:03.436225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 208/459] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:03 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:03.462564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5495ac81-c901-4460-b361-7e60abb83e97 req-39d3bcaa-54a1-4f71-8bbe-e8542c746c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992", "name": "network-vif-unplugged", "status": "completed", "tag": "212bb93a-8709-465c-8065-5f0349088f1a"}, {"name": "network-changed", "server_uuid": "dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992", "tag": "212bb93a-8709-465c-8065-5f0349088f1a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:03.498378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5495ac81-c901-4460-b361-7e60abb83e97 req-39d3bcaa-54a1-4f71-8bbe-e8542c746c55 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.498378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5495ac81-c901-4460-b361-7e60abb83e97 req-39d3bcaa-54a1-4f71-8bbe-e8542c746c55 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.498378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5495ac81-c901-4460-b361-7e60abb83e97 req-39d3bcaa-54a1-4f71-8bbe-e8542c746c55 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.535826 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5495ac81-c901-4460-b361-7e60abb83e97 req-39d3bcaa-54a1-4f71-8bbe-e8542c746c55 service nova] Creating event network-vif-unplugged:212bb93a-8709-465c-8065-5f0349088f1a for instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 on n-h1-862416-2 Oct 22 03:06:03.536891 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5495ac81-c901-4460-b361-7e60abb83e97 req-39d3bcaa-54a1-4f71-8bbe-e8542c746c55 service nova] Creating event network-changed:212bb93a-8709-465c-8065-5f0349088f1a for instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 on n-h1-862416-2 Oct 22 03:06:03.546663 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5495ac81-c901-4460-b361-7e60abb83e97 req-39d3bcaa-54a1-4f71-8bbe-e8542c746c55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.109170 Oct 22 03:06:03.548516 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 209/460] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:03.556558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-708704af-4397-4d35-b1e4-7e9bf2595956 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Calling method '.version_select at 0x7f0d1aa5d280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:03.641825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:03.658721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:03.661136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:03.662786 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b87018c1-e909-4215-81a0-679bf1bf7f43 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.393420 Oct 22 03:06:03.663925 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 252/461] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:03 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:03.670932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:03.672511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:03.679308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.680132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.681154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.682388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.683168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.686654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.814251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708704af-4397-4d35-b1e4-7e9bf2595956 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.818267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708704af-4397-4d35-b1e4-7e9bf2595956 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.822707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708704af-4397-4d35-b1e4-7e9bf2595956 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.826748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708704af-4397-4d35-b1e4-7e9bf2595956 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:03.827724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708704af-4397-4d35-b1e4-7e9bf2595956 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:03.831790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708704af-4397-4d35-b1e4-7e9bf2595956 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:03.924562 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-708704af-4397-4d35-b1e4-7e9bf2595956 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/0f833a5f674041b2b114c5bf06a1f23f/detail" status: 200 len: 916 microversion: 2.1 time: 0.374501 Oct 22 03:06:03.927834 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 210/462] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:06:03 2022] GET /compute/v2.1/os-quota-sets/0f833a5f674041b2b114c5bf06a1f23f/detail => generated 916 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:03.936289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bab54455-0e2a-4b88-8f80-c31432a9b044 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:03.937887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bab54455-0e2a-4b88-8f80-c31432a9b044 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:04.391190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bab54455-0e2a-4b88-8f80-c31432a9b044 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:04.407623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bab54455-0e2a-4b88-8f80-c31432a9b044 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1213 microversion: 2.1 time: 0.477302 Oct 22 03:06:04.408320 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 211/463] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:03 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1213 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:04.427533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:04.430268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:04.451908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:04.495571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:04.496061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:04.498875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:04.500535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:04.503743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:04.504416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:04.761780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:04.779040 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-51b82385-680e-48fe-8d12-017895cbb822 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1275 microversion: 2.1 time: 0.362209 Oct 22 03:06:04.781221 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 212/464] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:04 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1275 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:04.807250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:04.808310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:04.833863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:04.834700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:04.836774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:04.838559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:04.839687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:04.842693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:04.850644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:04.859410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-87f91331-cb86-40f0-94af-a93b59e521e3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 1.194115 Oct 22 03:06:04.867057 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 253/465] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:03 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:04.900171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a77e160>, body: {"quota_set": {"ram": "2048"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:05.339249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:05.355560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:05.358914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:05.361909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.362410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.362869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.363581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.364035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.364493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.378133 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-493b59eb-810a-4ab9-b870-ef1771d42a56 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.591938 Oct 22 03:06:05.379168 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 213/466] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:04 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:05.390032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:05.391040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:05.405372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=16 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:05.406671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.412416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.413709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.414634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.415362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.427594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.499470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.500615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.501485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.502451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.504093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.504721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.646252 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fed83114-49af-4d5c-abbf-379d5740df9d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/0f833a5f674041b2b114c5bf06a1f23f?user_id=c4f042d2362f42c99a345874aa897b89" status: 200 len: 328 microversion: 2.1 time: 0.776903 Oct 22 03:06:05.646885 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 254/467] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:06:04 2022] PUT /compute/v2.1/os-quota-sets/0f833a5f674041b2b114c5bf06a1f23f?user_id=c4f042d2362f42c99a345874aa897b89 => generated 328 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:05.671559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:05.672186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:05.691186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.691689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.692444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.695341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.695973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.696604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.903443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:05.907545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:05.914317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:05.916245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:05.917708 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10f4bfbb-d532-49c8-b5b9-240147cb437e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.537327 Oct 22 03:06:05.919821 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 214/468] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:05 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:05.943732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ca89a1a-fb0f-464d-9327-8ea52cae8252 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Calling method '.version_select at 0x7f0d1aa5d670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:05.947414 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb4d2186-a2a7-4320-aaf0-782e5e73b8fa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1265 microversion: 2.1 time: 0.298356 Oct 22 03:06:05.961950 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 255/469] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:05 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:05.973188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:05.973786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:05.995534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:05.996021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:05.996621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:05.999510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:06.004558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:06.005500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:06.120262 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ca89a1a-fb0f-464d-9327-8ea52cae8252 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/0f833a5f674041b2b114c5bf06a1f23f?user_id=c4f042d2362f42c99a345874aa897b89" status: 200 len: 370 microversion: 2.1 time: 0.198939 Oct 22 03:06:06.120851 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 215/470] 10.222.0.25 () {58 vars in 1323 bytes} [Sat Oct 22 03:06:05 2022] GET /compute/v2.1/os-quota-sets/0f833a5f674041b2b114c5bf06a1f23f?user_id=c4f042d2362f42c99a345874aa897b89 => generated 370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:06.134135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:06.134748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:06.149874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:06.150389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:06.150982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:06.151629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:06.152275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:06.153544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:06.371505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:06.391236 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-348c5bca-7aa1-476f-9379-0d6e819106a8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1281 microversion: 2.1 time: 0.421815 Oct 22 03:06:06.443159 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 256/471] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:05 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1281 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:06.460803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:06.463698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:06.485339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:06.488405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:06.489085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:06.495256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:06.495762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:06.499880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:06.696418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:06.707084 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b1f7771a-1b44-4998-87db-0a9c19fb5cd1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 0.581514 Oct 22 03:06:06.707911 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 216/472] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:06 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:06.861575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c8867c7-be79-431e-8e56-f8e38814793d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Calling method '.version_select at 0x7f0d1aa1c0d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:07.280118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:07.293110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:07.298308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:07.327977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6062aaf1-0ef5-415a-b3be-d4f4c5c6b4f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1537 microversion: 2.91 time: 0.878986 Oct 22 03:06:07.329312 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 257/473] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:06 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1537 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:07.338742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:07.344338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:07.355723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:07.361177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:07.361873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:07.362768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:07.363369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:07.365883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:07.487285 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1c8867c7-be79-431e-8e56-f8e38814793d tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/2d102bce117648f0a98b657eeca4a340/defaults" status: 200 len: 371 microversion: 2.1 time: 0.632537 Oct 22 03:06:07.488494 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 217/474] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:06:06 2022] GET /compute/v2.1/os-quota-sets/2d102bce117648f0a98b657eeca4a340/defaults => generated 371 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:07.493494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:07.494261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:07.505973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:07.506688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:07.507138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:07.507859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:07.513166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:07.513322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:07.695519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:07.701146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:07.716980 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f11158eb-e611-4536-9163-6039ea4b4c48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1271 microversion: 2.1 time: 0.226822 Oct 22 03:06:07.732858 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 218/475] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:07 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:07.740503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:07.742128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:07.758851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:07.759665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:07.760463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:07.761423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:07.762536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:07.764613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:07.843290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:07.852500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:07.853951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:07.859844 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f9fe921-cb73-43da-b0f4-5d3642e2276d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.529290 Oct 22 03:06:07.867553 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 258/476] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:07 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:07.889878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1c27625-df43-4833-aaf1-72747c574777 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a85e0d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:07.969459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:07.982506 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2d273c4e-c714-484c-a783-032ca7352c45 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1281 microversion: 2.1 time: 0.248141 Oct 22 03:06:07.986788 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 219/477] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:07 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:08.007407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:08.008362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:08.023751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:08.034156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:08.035791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:08.036912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:08.039182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:08.040707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:08.353939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:08.366072 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2c11ef27-cbf8-4e0f-98bd-fb2fa4dff724 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 0.377966 Oct 22 03:06:08.368263 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 220/478] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:07 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:08.384352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:08.391260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:08.418193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:08.420251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:08.421051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:08.423373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:08.424790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:08.425445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:08.530689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1c27625-df43-4833-aaf1-72747c574777 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:08.531240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1c27625-df43-4833-aaf1-72747c574777 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:08.531605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1c27625-df43-4833-aaf1-72747c574777 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:08.541171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1c27625-df43-4833-aaf1-72747c574777 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:08.541799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1c27625-df43-4833-aaf1-72747c574777 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:08.542253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1c27625-df43-4833-aaf1-72747c574777 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:08.671452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:08.684825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:08.690050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:08.720826 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c3cd8bd-fcbc-44b4-8c27-49712b5f4fed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1537 microversion: 2.91 time: 0.341584 Oct 22 03:06:08.721740 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 221/479] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:08 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1537 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:08.746013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:08.746754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:08.756079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:08.756629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:08.757066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:08.761493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:08.762834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:08.763616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:08.982327 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1c27625-df43-4833-aaf1-72747c574777 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/2d102bce117648f0a98b657eeca4a340" status: 200 len: 329 microversion: 2.1 time: 1.107311 Oct 22 03:06:08.986498 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 259/480] 10.222.0.25 () {60 vars in 1263 bytes} [Sat Oct 22 03:06:07 2022] PUT /compute/v2.1/os-quota-sets/2d102bce117648f0a98b657eeca4a340 => generated 329 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:08.992872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:08.999348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:09.013416 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab8f1447-e642-4bb3-98da-0950de0f477d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1271 microversion: 2.1 time: 0.267707 Oct 22 03:06:09.031762 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 222/481] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:08 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:09.033344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:09.043719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9d2ce53-a755-4a87-9b61-cce413d3d873 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1aa0f040>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:09.061340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:09.062112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:09.064270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:09.065979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:09.067674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:09.068353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:09.554155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9d2ce53-a755-4a87-9b61-cce413d3d873 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:09.554651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9d2ce53-a755-4a87-9b61-cce413d3d873 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:09.555094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9d2ce53-a755-4a87-9b61-cce413d3d873 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:09.555824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9d2ce53-a755-4a87-9b61-cce413d3d873 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:09.568641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9d2ce53-a755-4a87-9b61-cce413d3d873 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:09.570126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9d2ce53-a755-4a87-9b61-cce413d3d873 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:09.577469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:09.594162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:09.609932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:09.618601 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-337e471a-31e3-4c81-8b57-feb08f685d12 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.625294 Oct 22 03:06:09.624010 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 260/482] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:08 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:09.642078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:09.647084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:09.662190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:09.665703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:09.669453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:09.671931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:09.672749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:09.674946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.088336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:10.090895 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9d2ce53-a755-4a87-9b61-cce413d3d873 tempest-QuotasAdminTestJSON-1839886180 tempest-QuotasAdminTestJSON-1839886180-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/2d102bce117648f0a98b657eeca4a340" status: 200 len: 329 microversion: 2.1 time: 1.057464 Oct 22 03:06:10.102218 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 223/483] 10.222.0.25 () {60 vars in 1263 bytes} [Sat Oct 22 03:06:09 2022] PUT /compute/v2.1/os-quota-sets/2d102bce117648f0a98b657eeca4a340 => generated 329 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:10.108123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:10.108771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:10.116455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.116948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.117417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.118799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.119324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.119754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.125089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:10.135438 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2cdb573d-53d4-4a14-9f36-a6c003b33c32 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1323 microversion: 2.1 time: 0.505966 Oct 22 03:06:10.139442 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 261/484] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:09 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:10.160671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-63bce7b2-e12b-4710-812e-f20984ac8347 req-1dbe7c16-a4fa-4f6a-a12b-97f6615d00d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23fabeb-4a39-4f68-b702-71589168a4e6", "name": "network-vif-plugged", "status": "completed", "tag": "0994e38e-d384-4037-9651-25060522a5c6"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:10.182195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-63bce7b2-e12b-4710-812e-f20984ac8347 req-1dbe7c16-a4fa-4f6a-a12b-97f6615d00d7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.182704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-63bce7b2-e12b-4710-812e-f20984ac8347 req-1dbe7c16-a4fa-4f6a-a12b-97f6615d00d7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.183245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-63bce7b2-e12b-4710-812e-f20984ac8347 req-1dbe7c16-a4fa-4f6a-a12b-97f6615d00d7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.222707 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-63bce7b2-e12b-4710-812e-f20984ac8347 req-1dbe7c16-a4fa-4f6a-a12b-97f6615d00d7 service nova] Creating event network-vif-plugged:0994e38e-d384-4037-9651-25060522a5c6 for instance f23fabeb-4a39-4f68-b702-71589168a4e6 on n-h2-862416-2 Oct 22 03:06:10.229941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-63bce7b2-e12b-4710-812e-f20984ac8347 req-1dbe7c16-a4fa-4f6a-a12b-97f6615d00d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088813 Oct 22 03:06:10.230770 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 262/485] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:10.491487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Calling method '.version_select at 0x7f0d1a77d700>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:10.498187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.502497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.503456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.548713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.549926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.552546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.589209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=18 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:10.597327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.598674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.601137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.634937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.635433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.635867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.676540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.678796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.679416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.709965 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3f56d61e-f445-47e0-988c-84df37a724ba tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.478032 Oct 22 03:06:10.717054 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 263/486] 10.222.0.25 () {60 vars in 1243 bytes} [Sat Oct 22 03:06:10 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:10.721118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:10.726644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:10.727706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:10.733196 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca175ee2-6763-462b-b19a-454442040314 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 0.628294 Oct 22 03:06:10.735535 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 224/487] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:10 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:10.747293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c1860aeb-f8fe-4d59-b681-da86ba64e250 req-84b33f4b-6ede-4751-b61f-d6307fc887cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57", "tag": "92107697-1f24-4f17-a8fa-4473046b1330"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:10.752880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.753416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.753838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.761071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.761588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.762779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.779401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c1860aeb-f8fe-4d59-b681-da86ba64e250 req-84b33f4b-6ede-4751-b61f-d6307fc887cd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.779897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c1860aeb-f8fe-4d59-b681-da86ba64e250 req-84b33f4b-6ede-4751-b61f-d6307fc887cd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.786461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c1860aeb-f8fe-4d59-b681-da86ba64e250 req-84b33f4b-6ede-4751-b61f-d6307fc887cd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.808354 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c1860aeb-f8fe-4d59-b681-da86ba64e250 req-84b33f4b-6ede-4751-b61f-d6307fc887cd service nova] Creating event network-changed:92107697-1f24-4f17-a8fa-4473046b1330 for instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 on n-h2-862416-2 Oct 22 03:06:10.817678 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c1860aeb-f8fe-4d59-b681-da86ba64e250 req-84b33f4b-6ede-4751-b61f-d6307fc887cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079353 Oct 22 03:06:10.821251 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 225/488] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:10.834575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:10.837652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:10.847865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.854218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.854888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.857950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.858780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.860602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.874345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:10.885765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:10.887881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:10.897094 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ab02cf3-b366-444f-8b15-2a465440374c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1480 microversion: 2.91 time: 0.178533 Oct 22 03:06:10.898161 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 264/489] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:10 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1480 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:10.916797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:10.917479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:10.939924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.940491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.940987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:10.948239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:10.948739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:10.949183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.306735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:11.319220 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5dd1b224-8b16-47c6-a49d-e62ac0359918 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 0.493760 Oct 22 03:06:11.320246 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 226/490] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:10 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:11.329093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Calling method '.version_select at 0x7f0d1aa0fca0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:11.334485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.343380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.345554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.372357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.373360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.374685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.403349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.404191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.405509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.422578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.423767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.432484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.481801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.483331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.483331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.493381 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1fa855d-2f95-489f-b437-c22d0166d69f tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.171204 Oct 22 03:06:11.502799 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 227/491] 10.222.0.25 () {60 vars in 1222 bytes} [Sat Oct 22 03:06:11 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:06:11.517778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:11.520088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:11.526369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.526975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.527524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.529597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.530211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.530756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.600944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:11.619263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:11.625946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:11.628649 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-56f05bae-171f-44d0-b15c-f2b1de38c77f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.729379 Oct 22 03:06:11.630387 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 265/492] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:10 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:11.642157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862416-2". {{(pid=120581) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 03:06:11.645016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:11.646763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:11.659682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.660177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.662263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.664132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.664967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.667086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.678325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:11.771588 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea37195a-5252-4cc3-8454-c9364be4fb75 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad/action" status: 202 len: 0 microversion: 2.91 time: 0.274408 Oct 22 03:06:11.773222 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 228/493] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:06:11 2022] POST /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:06:11.781470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a8285c0-82a4-4c0b-88a6-55f9baa06431 tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Calling method '.version_select at 0x7f0d1a964790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:11.794263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a8285c0-82a4-4c0b-88a6-55f9baa06431 tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.795057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a8285c0-82a4-4c0b-88a6-55f9baa06431 tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.795809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a8285c0-82a4-4c0b-88a6-55f9baa06431 tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.839575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a8285c0-82a4-4c0b-88a6-55f9baa06431 tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.841360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a8285c0-82a4-4c0b-88a6-55f9baa06431 tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.841360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a8285c0-82a4-4c0b-88a6-55f9baa06431 tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.853952 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a8285c0-82a4-4c0b-88a6-55f9baa06431 tempest-HypervisorAdminV253TestBase-696128942 tempest-HypervisorAdminV253TestBase-696128942-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2770926a-52f2-47ac-8f69-639b506a46a2" status: 200 len: 792 microversion: 2.53 time: 0.079051 Oct 22 03:06:11.867644 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 229/494] 10.222.0.25 () {60 vars in 1298 bytes} [Sat Oct 22 03:06:11 2022] GET /compute/v2.1/os-hypervisors/2770926a-52f2-47ac-8f69-639b506a46a2 => generated 792 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:06:11.874178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:11.875140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:11.882306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.882948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.883522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:11.884467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:11.885370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:11.885912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:12.159126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:12.168805 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2f6c85d7-184f-4425-80d9-e4035dd3a2d9 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1322 microversion: 2.1 time: 0.298123 Oct 22 03:06:12.194963 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 230/495] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:11 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:12.213874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:12.218987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:12.227712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:12.236574 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-26c5ca77-0f39-4f8c-86fd-db3acd2d435a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1323 microversion: 2.1 time: 0.602885 Oct 22 03:06:12.237158 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 266/496] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:11 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1323 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:12.238256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:12.240304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:12.241009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:12.242940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:12.245703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:12.246928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:12.347423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:12.351818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:12.367843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:12.368615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:12.369229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:12.370179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:12.370794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:12.371934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:12.417146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:12.433009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:12.442400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:12.451859 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-474bc5b6-bad8-499d-8216-633aee4d20dc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1488 microversion: 2.91 time: 0.251781 Oct 22 03:06:12.453018 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 231/497] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:12 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1488 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:12.608950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:12.622661 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68172122-cf80-4ebe-abb9-d85444a9d9f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 0.277531 Oct 22 03:06:12.639261 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 267/498] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:12 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:06:12.657163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:12.657863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:12.666709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:12.675614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:12.676390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:12.680005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:12.682491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:12.684252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:13.198889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:13.200492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:13.214336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:13.215439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:13.216674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:13.217860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:13.218992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:13.220104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:13.346542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:13.358332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:13.360045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:13.361489 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01fe8278-a05d-4ab4-87b4-c60e050cd714 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.709310 Oct 22 03:06:13.373019 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 232/499] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:12 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:13.386725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:13.388551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:13.395158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:13.395754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:13.396322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:13.397122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:13.397813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:13.398582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:13.512004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:13.523873 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bf15ac17-9010-48fe-b038-6c1dff7b4d9d tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1472 microversion: 2.1 time: 0.328817 Oct 22 03:06:13.533921 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 268/500] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:13 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:06:13.545330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:13.549079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:13.561285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:13.562186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:13.562870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:13.563823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:13.564587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:13.565340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:13.766311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:13.777939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:13.779862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:13.786849 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ebe0349-dad3-4a29-be4d-228bd13770ed tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1488 microversion: 2.91 time: 0.251301 Oct 22 03:06:13.788167 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 269/501] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:13 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1488 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:13.901687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:13.916720 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-afbefc18-e82f-4080-b352-562b3ff3afd2 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1323 microversion: 2.1 time: 0.541165 Oct 22 03:06:13.918293 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 233/502] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:13 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1323 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:13.931444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:13.932056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:13.956947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:13.957491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:13.960736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:13.966525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:13.968573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:13.971559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:14.038161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:14.334889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:14.347257 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1ee0374-681e-4066-9d39-56ff341e370e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 0.420789 Oct 22 03:06:14.364531 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 234/503] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:13 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:14.520399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a3942a7-7538-4fc9-b47d-b79bc259d84e tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:14.521041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a3942a7-7538-4fc9-b47d-b79bc259d84e tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] [instance: 6a8a8ef7-573c-4271-bde3-7710a4a175ba] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:14.531052 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3a3942a7-7538-4fc9-b47d-b79bc259d84e tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] HTTP exception thrown: Instance 6a8a8ef7-573c-4271-bde3-7710a4a175ba could not be found. Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a3942a7-7538-4fc9-b47d-b79bc259d84e tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Request method failure captured: Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/6a8a8ef7-573c-4271-bde3-7710a4a175ba/action HTTP/1.1 Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 15 Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU14JNh2u5sle3XT4MmW8VrMxg2LiNHTzs0tMalnCmOpgabM0cTIbq_YcKtKzZz16ii5I7GrYK6-nC0o9wSY2IFg9rv1Cs9B0yqKyXsQEBWmuNmG16dRPlec0EEP_1cEgV22yifgyQiSzydwAktFkm80nr4rp-5kqjpYi1buHRV7EX8E Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:06:14.544723 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}] Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7950bc78025244fd96faa9817b456408 Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: {"migrate": {}} Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:06:14.546219 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 6a8a8ef7-573c-4271-bde3-7710a4a175ba could not be found. Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '6a8a8ef7-573c-4271-bde3-7710a4a175ba', 'body': {'migrate': {}}} Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8a8ef7-573c-4271-bde3-7710a4a175ba could not be found. Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:14.547807 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8a8ef7-573c-4271-bde3-7710a4a175ba could not be found. Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8a8ef7-573c-4271-bde3-7710a4a175ba could not be found. Oct 22 03:06:14.550056 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:14.551837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a3942a7-7538-4fc9-b47d-b79bc259d84e tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Returning 404 to user: Instance 6a8a8ef7-573c-4271-bde3-7710a4a175ba could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:14.551837 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a3942a7-7538-4fc9-b47d-b79bc259d84e tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6a8a8ef7-573c-4271-bde3-7710a4a175ba/action" status: 404 len: 111 microversion: 2.1 time: 0.756811 Oct 22 03:06:14.551837 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 270/504] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:06:13 2022] POST /compute/v2.1/servers/6a8a8ef7-573c-4271-bde3-7710a4a175ba/action => generated 111 bytes in 758 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:06:14.551837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:14.552158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:14.595996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:14.597354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:14.601327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:14.602624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:14.604921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:14.605343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:14.674424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6b5e8480-adcc-4206-9097-1e94befe2b5e req-72d929c6-7137-48b1-99bb-98076cb067f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f275fc7f-8fe1-4e0c-b717-0889031f866b", "tag": "acdf2dde-8d5f-421c-be80-ccc69afad608"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:14.694291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6b5e8480-adcc-4206-9097-1e94befe2b5e req-72d929c6-7137-48b1-99bb-98076cb067f4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:14.694904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6b5e8480-adcc-4206-9097-1e94befe2b5e req-72d929c6-7137-48b1-99bb-98076cb067f4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:14.695438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6b5e8480-adcc-4206-9097-1e94befe2b5e req-72d929c6-7137-48b1-99bb-98076cb067f4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:14.710395 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6b5e8480-adcc-4206-9097-1e94befe2b5e req-72d929c6-7137-48b1-99bb-98076cb067f4 service nova] Creating event network-changed:acdf2dde-8d5f-421c-be80-ccc69afad608 for instance f275fc7f-8fe1-4e0c-b717-0889031f866b on n-h2-862416-2 Oct 22 03:06:14.717808 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6b5e8480-adcc-4206-9097-1e94befe2b5e req-72d929c6-7137-48b1-99bb-98076cb067f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351755 Oct 22 03:06:14.719317 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 235/505] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:14.747277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-794467556", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:14.821424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:06:15.294796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:15.311417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:15.312944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:15.314159 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cb998622-9493-4226-8ec0-7c6b0e2475e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.766525 Oct 22 03:06:15.315011 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 271/506] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:14 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:15.319847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:15.329199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:15.339640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:15.340690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:15.341175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:15.341966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:15.342432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:15.342865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:15.585653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:15.586703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:15.587353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:15.587906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:15.588496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:15.601804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=69 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:15.609579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:15.611644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:15.613717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:15.615788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:15.616935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:15.619023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:15.680566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:15.690184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Getting quotas for project 94702d905cb947b1b9d2237eaf51d93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:15.691352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:15.695395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:15.703679 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2aa17c2a-c895-401e-8425-51f2355f17b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.387599 Oct 22 03:06:15.704790 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 272/507] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:15 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:15.708480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Getting quotas for user c05424e067934bdbaa92c060a20e98ae and project 94702d905cb947b1b9d2237eaf51d93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:15.709573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:15.710182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:15.736508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:15.748928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:15.749677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:15.750622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:15.753969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:15.759196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:15.759645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:15.762800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:15.832849 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-46ddd2c0-701b-48a2-914d-546c6ca70cd5 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.089573 Oct 22 03:06:15.834744 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 236/508] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:06:15.842285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:15.843124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:15.859204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:15.862326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:15.863288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:15.864621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:15.865256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:15.865844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:16.333254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:16.349096 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77a47997-b319-4a79-8235-5fc157719f18 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1323 microversion: 2.1 time: 0.638583 Oct 22 03:06:16.351276 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 273/509] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:15 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1323 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:16.365619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d03c401-0b23-45bb-be9f-a2dafa9a716a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:16.374630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6d03c401-0b23-45bb-be9f-a2dafa9a716a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:16.984105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:17.003664 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3d034448-fee8-4b97-aeda-9b79b9d848ed tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 1.167380 Oct 22 03:06:17.007236 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 237/510] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:15 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:17.027610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:17.029193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:17.047127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:17.049010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:17.051528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:17.055328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:17.069952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:17.070629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:17.252145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6d03c401-0b23-45bb-be9f-a2dafa9a716a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:17.259667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d03c401-0b23-45bb-be9f-a2dafa9a716a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1221 microversion: 2.1 time: 0.905743 Oct 22 03:06:17.266660 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 274/511] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:16 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1221 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:17.292568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:17.298748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:17.330633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:17.334425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:17.336053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:17.340663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:17.345176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:17.348419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:17.530830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:17.549576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:17.560261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:17.577085 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0fa54eb0-c7f6-4776-b437-a74d2eb18274 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.308412 Oct 22 03:06:17.583743 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 275/512] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:17 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:17.643119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:17.663175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:17.666423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:17.678840 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-984a0c27-61b0-4137-ad62-7e4bf486e132 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.668350 Oct 22 03:06:17.684630 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 238/513] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:17 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:17.932107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28ef9df3-bd81-4797-9732-c1d1858d3ca1 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:17.941245 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28ef9df3-bd81-4797-9732-c1d1858d3ca1 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.356076 Oct 22 03:06:17.941836 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 276/514] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:06:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:17.946651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:17.947258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:17.970466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:17.972368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:17.973055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:17.976080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:17.979690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:17.981450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:18.253008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:18.267547 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f994808a-1fa0-4329-9386-af1933087e7a tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1323 microversion: 2.1 time: 0.324375 Oct 22 03:06:18.268901 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 277/515] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:17 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:18.389201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-638316816", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:18.496112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:06:18.572146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:18.682114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba434947-4e21-40a2-85c8-83d3e0a68120 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-42464053", "id": 1148142946, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:18.729245 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba434947-4e21-40a2-85c8-83d3e0a68120 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.458427 Oct 22 03:06:18.733044 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 278/516] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:18 2022] POST /compute/v2.1/flavors => generated 423 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:18.747656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:18.749422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:18.766145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:18.768607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:18.771608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:18.773107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:18.779263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:18.781756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:18.923356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:18.924075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:18.924783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:18.925400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:18.926019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:18.938995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:18.939825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:18.940597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:18.941550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:18.942266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:18.942910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:18.965197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Getting quotas for project 7fbe2f2bb3224e83a89df6ec4e84735b. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:18.973009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Getting quotas for user 3f8560b839d44c479e3016ef9e4b3ff1 and project 7fbe2f2bb3224e83a89df6ec4e84735b. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:18.990755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:18.994140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:19.048339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:19.058053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4cbe427-974e-44b3-86c3-be24b928dbbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 0.323654 Oct 22 03:06:19.062099 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 279/517] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:18 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:19.075501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:19.076507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:19.090724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:19.093166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:19.096440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:19.097264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:19.097798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:19.099325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:19.101396 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0bf88e71-294b-486b-a325-1387cc68afc2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414443 Oct 22 03:06:19.109039 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 239/518] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:06:19.119225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:19.120574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:19.146675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:19.152163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:19.155035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:19.156257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:19.160697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:19.161376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:19.254357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:19.267083 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3f1b3cca-39f2-4f5a-994b-b0a7cd8432df tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1281 microversion: 2.1 time: 0.203855 Oct 22 03:06:19.280267 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 280/519] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:19 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:19.280267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:19.280267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:19.306628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:19.307134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:19.307582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:19.308391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:19.318915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:19.319779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:19.384870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:19.400317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:19.404757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:19.422503 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2f4d1fd-6e51-4e1d-aa97-594f1cf3a7a5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.311133 Oct 22 03:06:19.424500 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 240/520] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:19 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:19.435235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b682af45-ee0e-48d7-8339-3748c8aa8b4a tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:19.460682 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b682af45-ee0e-48d7-8339-3748c8aa8b4a tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034377 Oct 22 03:06:19.462046 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 241/521] 10.222.0.25 () {58 vars in 1182 bytes} [Sat Oct 22 03:06:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:06:19.473311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:19.474884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:19.494102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:19.496864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:19.498575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:19.500565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:19.501817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:19.502811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:19.673564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:19.691305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:19.696850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:19.701732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a5fa92c4-0064-4e07-b1ee-3c34966c1fea tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1567 microversion: 2.25 time: 0.428248 Oct 22 03:06:19.702642 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 281/522] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:19 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1567 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:19.753389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-746269558", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:19.949098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:06:20.063478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:20.078751 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d90223a7-3a87-43d4-b925-27ec5b982314 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1323 microversion: 2.1 time: 0.609073 Oct 22 03:06:20.081331 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 242/523] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:19 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:20.093557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac40a546-2300-493b-bff8-31e2eab5fce5 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-264934091", "id": 1962332186, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:20.137931 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac40a546-2300-493b-bff8-31e2eab5fce5 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.055056 Oct 22 03:06:20.142760 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 243/524] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:20 2022] POST /compute/v2.1/flavors => generated 424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:20.153653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:20.156051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:20.177360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:20.181132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:20.182682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:20.185360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:20.186280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:20.187788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:20.734118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:20.747189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-219d2196-adf5-48b9-a2de-abf5c7f6669d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 0.602820 Oct 22 03:06:20.747800 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 244/525] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:20 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:20.766539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32ce79cd-092d-4285-bf02-973a98d8312a tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:20.789158 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32ce79cd-092d-4285-bf02-973a98d8312a tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040196 Oct 22 03:06:20.789750 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 245/526] 10.222.0.25 () {58 vars in 1182 bytes} [Sat Oct 22 03:06:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:06:20.807292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:20.809819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:20.826764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:20.828923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:20.831652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:20.835529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:20.838583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:20.839430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.167613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:21.183583 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d664ddf-dabe-44e7-afee-a6982e72e686 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1279 microversion: 2.1 time: 0.392704 Oct 22 03:06:21.186222 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 246/527] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:20 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1279 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:21.202202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:21.203237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:21.235571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.244515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.247705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.250165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.252469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.255727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.361364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:21.362642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:21.363188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:21.363625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:21.364063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:21.381698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.382572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.384744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.386221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.388153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.391502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.436942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Getting quotas for project 7fbe2f2bb3224e83a89df6ec4e84735b. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:21.451285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Getting quotas for user 3f8560b839d44c479e3016ef9e4b3ff1 and project 7fbe2f2bb3224e83a89df6ec4e84735b. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:21.495220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:21.495772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:21.498677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:21.509734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:21.513721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:21.542961 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-788f6b52-bf54-4e61-8108-578cbadcd607 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.353089 Oct 22 03:06:21.543674 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 247/528] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:21 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:21.555525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-85ee8ad6-d9c7-48d3-a9cb-393b03ac884d req-2f410fff-1a4f-4a0a-a69d-351a603ab496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57", "name": "network-vif-plugged", "status": "completed", "tag": "92107697-1f24-4f17-a8fa-4473046b1330"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:21.584953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-85ee8ad6-d9c7-48d3-a9cb-393b03ac884d req-2f410fff-1a4f-4a0a-a69d-351a603ab496 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.585492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-85ee8ad6-d9c7-48d3-a9cb-393b03ac884d req-2f410fff-1a4f-4a0a-a69d-351a603ab496 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.585982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-85ee8ad6-d9c7-48d3-a9cb-393b03ac884d req-2f410fff-1a4f-4a0a-a69d-351a603ab496 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.613750 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-85ee8ad6-d9c7-48d3-a9cb-393b03ac884d req-2f410fff-1a4f-4a0a-a69d-351a603ab496 service nova] Creating event network-vif-plugged:92107697-1f24-4f17-a8fa-4473046b1330 for instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 on n-h2-862416-2 Oct 22 03:06:21.619214 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-76f48fa2-2398-40c6-bd57-7e26e7e7a9bf tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900077 Oct 22 03:06:21.622765 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 282/529] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:06:21.629027 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-85ee8ad6-d9c7-48d3-a9cb-393b03ac884d req-2f410fff-1a4f-4a0a-a69d-351a603ab496 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083669 Oct 22 03:06:21.629370 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 248/530] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:21.633989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:21.635335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:21.643906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a1863ad-b449-4b74-80e3-98b4162d6d26 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Action: 'create', calling method: .version_select at 0x7f0d1aa5d9d0>, body: {"keypair": {"name": "tempest-keypair-1806393372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGa9EqYOY1Ux/E1r/gVsyOKLPnWuYoiQV6G0k5uPL36Oo5e13LWaa/PmnL9olJ9+K+e+6+uVRt6MhPYNh0GNo3eN75IqHlVYeh8RhmgtUE328+MgIJ60Zo93Hn2xKppuQg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:21.679943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:21.685325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.685964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.686409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.687145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.691128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.691957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.743446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-1a1863ad-b449-4b74-80e3-98b4162d6d26 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Getting quotas for project 71769feb32e1436285707bbdf76bf70e. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:21.784869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-1a1863ad-b449-4b74-80e3-98b4162d6d26 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Getting quotas for user 069a8403cf9e414d99e83da9192f2057 and project 71769feb32e1436285707bbdf76bf70e. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:21.876973 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a1863ad-b449-4b74-80e3-98b4162d6d26 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.243148 Oct 22 03:06:21.882710 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 249/531] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:06:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:21.888643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:21.892727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:21.910336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.912970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.913526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:21.914512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:21.916852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:21.922373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:22.294885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:22.332455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10ea4906-1df4-4d09-bbaa-04dc96a7892d tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1323 microversion: 2.1 time: 0.429439 Oct 22 03:06:22.350663 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 250/532] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:21 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:22.734219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df4554ac-c734-40ea-aadd-6c29bc733ac4 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1aa23940>, body: {"quota_set": {"ram": "5120"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:22.888076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df4554ac-c734-40ea-aadd-6c29bc733ac4 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:22.888076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df4554ac-c734-40ea-aadd-6c29bc733ac4 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:22.888907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df4554ac-c734-40ea-aadd-6c29bc733ac4 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:22.903415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df4554ac-c734-40ea-aadd-6c29bc733ac4 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:22.906755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df4554ac-c734-40ea-aadd-6c29bc733ac4 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:22.908046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df4554ac-c734-40ea-aadd-6c29bc733ac4 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:23.123173 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df4554ac-c734-40ea-aadd-6c29bc733ac4 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/9d212ff26b6643aeb07c5793b5788e40" status: 200 len: 240 microversion: 2.36 time: 0.767678 Oct 22 03:06:23.148137 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 251/533] 10.222.0.25 () {62 vars in 1303 bytes} [Sat Oct 22 03:06:22 2022] PUT /compute/v2.1/os-quota-sets/9d212ff26b6643aeb07c5793b5788e40 => generated 240 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:06:23.150659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:23.159237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:23.163246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:23.177571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:23.189151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:23.192532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:23.193035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:23.193504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:23.193930 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea63ce5d-0ffd-4c4a-85c1-0106307afa79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1557 microversion: 2.25 time: 1.569932 Oct 22 03:06:23.194242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:23.194694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:23.195183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:23.198457 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 283/534] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:21 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1557 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:23.211998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:23.212838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:23.223505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:23.227332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:23.228854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:23.232683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:23.234647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:23.236458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:23.423318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:23.442314 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-345a538f-fbea-42b9-a43a-820d25d50ea1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1217 microversion: 2.1 time: 0.292817 Oct 22 03:06:23.444732 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 252/535] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:23 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:23.460643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:23.461268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:23.495927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:23.509846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:23.512714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:23.517776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:23.526801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:23.529379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:23.953628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:23.962571 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd8ec323-0ff2-4838-85f0-1cdfd2da650f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 0.762582 Oct 22 03:06:23.967408 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 284/536] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:23 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:23.986275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:23.987504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:23.999074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.002348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.003030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.004007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.008031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.008518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.061854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:24.070465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a2d472fe-792f-41dd-8ca0-50fa09657284 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.624402 Oct 22 03:06:24.081265 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 253/537] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:23 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:24.092115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4345544-660c-4f3e-8d60-bfc840965443 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Calling method '.version_select at 0x7f0d1a998670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:24.110302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:24.124770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:24.127064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:24.139275 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff853c46-03a4-441d-ae7c-aa22be3b0453 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.169362 Oct 22 03:06:24.142016 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 285/538] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:23 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:24.147064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-069b39d7-41e9-4915-9f3c-b586a19fa2c8 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '.version_select at 0x7f0d1a84f550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:24.154725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-069b39d7-41e9-4915-9f3c-b586a19fa2c8 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.155936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-069b39d7-41e9-4915-9f3c-b586a19fa2c8 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.156494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-069b39d7-41e9-4915-9f3c-b586a19fa2c8 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.188634 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-069b39d7-41e9-4915-9f3c-b586a19fa2c8 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.044684 Oct 22 03:06:24.190080 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 286/539] 10.222.0.25 () {60 vars in 1184 bytes} [Sat Oct 22 03:06:24 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:06:24.198120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:24.199088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:24.207348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.208132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.208852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.209791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.210473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.211143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.235150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4345544-660c-4f3e-8d60-bfc840965443 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.235879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4345544-660c-4f3e-8d60-bfc840965443 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.236507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4345544-660c-4f3e-8d60-bfc840965443 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.237996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4345544-660c-4f3e-8d60-bfc840965443 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.239004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4345544-660c-4f3e-8d60-bfc840965443 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.239604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4345544-660c-4f3e-8d60-bfc840965443 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.266687 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4345544-660c-4f3e-8d60-bfc840965443 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/9d212ff26b6643aeb07c5793b5788e40/detail" status: 200 len: 672 microversion: 2.36 time: 0.184212 Oct 22 03:06:24.267917 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 254/540] 10.222.0.25 () {60 vars in 1304 bytes} [Sat Oct 22 03:06:24 2022] GET /compute/v2.1/os-quota-sets/9d212ff26b6643aeb07c5793b5788e40/detail => generated 672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:06:24.273173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:24.274326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:24.315961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.317667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.319275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.327633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.329298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.331158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.417598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:24.430050 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1a6d399-f229-4c92-ae9c-e4d0a296b000 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1323 microversion: 2.1 time: 0.236666 Oct 22 03:06:24.433143 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 287/541] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:24 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:24.468958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:24.469376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:24.478816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.479548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.480227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.482638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.483537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.484197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.488043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:24.669739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:24.683269 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62bc7147-ff0a-4ec8-a6eb-12aa0056ea1e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1209 microversion: 2.1 time: 0.221117 Oct 22 03:06:24.689104 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 288/542] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:24 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1209 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:24.710660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a85e430>, body: {"quota_set": {"ram": "2048"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:24.901871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.902882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.908965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:24.910180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:24.910822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:24.911477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:25.044843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:25.060489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:25.062750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:25.065290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:25.067724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:25.070742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:25.211976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:25.243203 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bdce5090-1ca7-42d2-a67b-6180d60ec8d0 tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/9d212ff26b6643aeb07c5793b5788e40?user_id=d101f26c6e1646889597f1a11a0bdfda" status: 200 len: 240 microversion: 2.36 time: 0.552510 Oct 22 03:06:25.244158 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 289/543] 10.222.0.25 () {62 vars in 1384 bytes} [Sat Oct 22 03:06:24 2022] PUT /compute/v2.1/os-quota-sets/9d212ff26b6643aeb07c5793b5788e40?user_id=d101f26c6e1646889597f1a11a0bdfda => generated 240 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:06:25.249182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:25.252092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:25.259134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:25.259792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:25.260662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:25.262534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:25.263343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:25.263930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:25.540838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:25.561449 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-61f80bb7-2907-47ab-837e-3b28ee83aaf1 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 2049 microversion: 2.25 time: 1.291796 Oct 22 03:06:25.572719 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 255/544] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:24 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 2049 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:25.584588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:25.587543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:25.598259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:25.598703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:25.602216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:25.604990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:25.605719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:25.606852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:25.956882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:25.990945 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cd3aac5a-caea-4043-8b24-303884e5698f tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.413907 Oct 22 03:06:25.995225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 256/545] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:25 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:26.009522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:26.010414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:26.017138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:26.026381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.026989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.027955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.028750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.029265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.029757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.030472 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c2a6e4b5-4a79-42fe-8dfa-f641391bcbb5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 0.785022 Oct 22 03:06:26.031220 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 290/546] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:25 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:26.035386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea5b0d4a-ba78-4f8b-8d60-925187b12b3c tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] Calling method '.version_select at 0x7f0d1a6faee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:26.141115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=83 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:26.173433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:26.174695 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea5b0d4a-ba78-4f8b-8d60-925187b12b3c tempest-QuotasAdminTestV236-87744821 tempest-QuotasAdminTestV236-87744821-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/9d212ff26b6643aeb07c5793b5788e40?user_id=d101f26c6e1646889597f1a11a0bdfda" status: 200 len: 282 microversion: 2.36 time: 0.142559 Oct 22 03:06:26.175780 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 291/547] 10.222.0.25 () {60 vars in 1364 bytes} [Sat Oct 22 03:06:26 2022] GET /compute/v2.1/os-quota-sets/9d212ff26b6643aeb07c5793b5788e40?user_id=d101f26c6e1646889597f1a11a0bdfda => generated 282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:06:26.190627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-cf12648f-9e56-4de1-a661-c5f35655db87 req-376b1952-e79b-4f6a-abf5-1d41fed09bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f275fc7f-8fe1-4e0c-b717-0889031f866b", "name": "network-vif-plugged", "status": "completed", "tag": "acdf2dde-8d5f-421c-be80-ccc69afad608"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:26.193072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:26.194445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:26.201853 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c860ab7b-6cf1-4738-95f7-8075f1d8bc28 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.204921 Oct 22 03:06:26.213081 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 257/548] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:25 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:26.220315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cf12648f-9e56-4de1-a661-c5f35655db87 req-376b1952-e79b-4f6a-abf5-1d41fed09bc7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.222333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cf12648f-9e56-4de1-a661-c5f35655db87 req-376b1952-e79b-4f6a-abf5-1d41fed09bc7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.222995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cf12648f-9e56-4de1-a661-c5f35655db87 req-376b1952-e79b-4f6a-abf5-1d41fed09bc7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.232281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:26.233134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:26.241621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.242173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.242610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.243441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.243928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.244525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.269786 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-cf12648f-9e56-4de1-a661-c5f35655db87 req-376b1952-e79b-4f6a-abf5-1d41fed09bc7 service nova] Creating event network-vif-plugged:acdf2dde-8d5f-421c-be80-ccc69afad608 for instance f275fc7f-8fe1-4e0c-b717-0889031f866b on n-h2-862416-2 Oct 22 03:06:26.289396 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-cf12648f-9e56-4de1-a661-c5f35655db87 req-376b1952-e79b-4f6a-abf5-1d41fed09bc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112111 Oct 22 03:06:26.295875 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 292/549] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:26.318528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:26.324522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:26.348248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.356915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.363230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.364420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.365113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.368862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.688403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:26.700430 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86a701ad-b6b9-44f6-ba58-61b737225f51 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1283 microversion: 2.1 time: 0.398145 Oct 22 03:06:26.703528 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 293/550] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:26 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1283 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:26.717670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1630732842", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "88c94f0e-626b-4b04-b426-00fe37fe6119"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:26.787713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:26.798671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:26.803631 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db4acc33-4661-4aae-bbe8-2259431dcc56 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1473 microversion: 2.1 time: 0.587090 Oct 22 03:06:26.806874 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 258/551] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:26 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1473 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:26.829308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:26.830005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:26.843468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.844151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.847369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.848393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.848908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.851306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.856859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] validate_networks() for [('88c94f0e-626b-4b04-b426-00fe37fe6119', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:06:26.906566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Request method failure captured: Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57/diagnostics HTTP/1.1 Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14TaywFvFj-ESake_7ekjrTCT-MIW9yL4wB3JGhnAiqamcT93Fu-QNxnnrZ4DXDIydawigNRY-wYhI3zFLOlOrP8NBMejqKNx19Atw0Wba_hpxYE4U_AfdbGqzHroo3aJ0mxNwyokz9lWAQ1_1jytUqqr5-UIu1G3ovKntXaV3NDDk Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 6c1fad27341547a8bf328352ff67d8ca Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1218876328 Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:06:26.908934 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c1fad27341547a8bf328352ff67d8ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c1fad27341547a8bf328352ff67d8ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c1fad27341547a8bf328352ff67d8ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c1fad27341547a8bf328352ff67d8ca"}]}] Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1218876328 Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 6c1fad27341547a8bf328352ff67d8ca Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1218876328 Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerDiagnosticsNegativeTest-1218876328-project Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 82b5f5151aef42a6a50e7f6748f35ba1 Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1218876328-project Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:06:26.910609 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': 'd8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57'} Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:06:26.911436 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 22 03:06:26.913007 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:26.915543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:26.916757 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad6c6591-f7df-4722-a332-61295cafc3a9 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.093098 Oct 22 03:06:26.918243 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 259/552] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:06:26 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57/diagnostics => generated 117 bytes in 95 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:06:26.930337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:26.931245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:26.940408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.941403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.942148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:26.943147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:26.943981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:26.944730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:27.046104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:06:27.257348 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48da53f4-175a-4663-a4b4-873b22113da8 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 204 len: 0 microversion: 2.1 time: 0.332441 Oct 22 03:06:27.258574 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 260/553] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:06:26 2022] DELETE /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:06:27.267622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:27.273173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:27.290030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:27.290905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:27.291749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:27.292840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:27.294805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:27.295696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:27.833361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:27.845193 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35b90cc2-e0fb-4d00-ab61-a18eaccf1c9e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.585060 Oct 22 03:06:27.851273 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 261/554] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:27 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:27.876399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:27.877734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:27.898557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:27.900666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:27.901114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:27.901844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:27.904505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:27.905280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.367989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:28.381452 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0907b7c6-a2fa-437d-92f1-c7628ac9b5db tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1313 microversion: 2.1 time: 0.528319 Oct 22 03:06:28.397381 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 262/555] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:27 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:28.411526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:28.412549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:28.423303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:28.423865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:28.424413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.425712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:28.426605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:28.428805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.594838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:28.615511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:28.619980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:28.629376 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b380628d-79a9-4bd5-a45c-eb134a8df98f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.224666 Oct 22 03:06:28.631078 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 263/556] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:28 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:28.644991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:28.646924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:28.668979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:28.671562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:28.672416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.674675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:28.675759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:28.676557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.844456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:28.855671 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a89dcbcf-3d9c-4a55-b221-e14e4553162e tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1479 microversion: 2.1 time: 0.223166 Oct 22 03:06:28.856572 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 264/557] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:28 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1479 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:28.861685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:28.862471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:28.868413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:28.869702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:28.870153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.871891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:28.872400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:28.872990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.944773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:28.946257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:28.947749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:28.949581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:28.951539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:28.959735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:28.965345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:28.966248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:28.966848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.967924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:28.968676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:28.969108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:28.975013 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d6055db9-936a-4acd-b94b-2791a580d2c8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1271 microversion: 2.1 time: 0.117222 Oct 22 03:06:28.988412 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 265/558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:28 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:28.993483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:28.994087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:28.999816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for project e33669cd6c0040cda12f8063688eacc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:29.012557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:29.013051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:29.013385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for user 2868158117ea4f7797f9931a97bcedfd and project e33669cd6c0040cda12f8063688eacc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:29.013503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:29.014160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:29.014612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:29.015034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:29.039566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:29.043666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:29.123228 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b7717c38-1e17-4161-92f5-8f73bbdcfa09 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.417690 Oct 22 03:06:29.126441 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 294/559] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:06:29.136481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-60acfdef-65b8-4060-bcdf-87b6290801da req-3dc30743-9747-402b-aed1-0f5821745782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0063126-a79b-40eb-b050-d6842f4cd6f9", "tag": "a84845d5-cf94-4e06-ad51-31c0bec143f4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:29.166496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-60acfdef-65b8-4060-bcdf-87b6290801da req-3dc30743-9747-402b-aed1-0f5821745782 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:29.167263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-60acfdef-65b8-4060-bcdf-87b6290801da req-3dc30743-9747-402b-aed1-0f5821745782 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:29.170323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-60acfdef-65b8-4060-bcdf-87b6290801da req-3dc30743-9747-402b-aed1-0f5821745782 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:29.218172 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-60acfdef-65b8-4060-bcdf-87b6290801da req-3dc30743-9747-402b-aed1-0f5821745782 service nova] Creating event network-changed:a84845d5-cf94-4e06-ad51-31c0bec143f4 for instance d0063126-a79b-40eb-b050-d6842f4cd6f9 on n-h1-862416-2 Oct 22 03:06:29.235541 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-60acfdef-65b8-4060-bcdf-87b6290801da req-3dc30743-9747-402b-aed1-0f5821745782 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102477 Oct 22 03:06:29.237891 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 295/560] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:29.255283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0633a5cc-eca0-444c-9f93-8606def99de2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:29.256145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0633a5cc-eca0-444c-9f93-8606def99de2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:29.441881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:29.451728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75fc20e3-6cb8-4efd-89da-22eef27fa4f2 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.467986 Oct 22 03:06:29.452966 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 266/561] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:28 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:29.458146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:29.458758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:29.467362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:29.468011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:29.468674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:29.469550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:29.470168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:29.470785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:29.482061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0633a5cc-eca0-444c-9f93-8606def99de2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:29.491629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0633a5cc-eca0-444c-9f93-8606def99de2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:29.494146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0633a5cc-eca0-444c-9f93-8606def99de2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:29.496384 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0633a5cc-eca0-444c-9f93-8606def99de2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1262 microversion: 2.25 time: 0.254987 Oct 22 03:06:29.514077 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 296/562] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:29 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1262 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:29.664017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:29.665392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:29.674323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:29.675379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:29.676005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:29.676980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:29.677768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:29.678359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:29.795363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:29.822621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:29.828384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:29.835962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-10f12499-1d25-4c32-a8d1-ed06db2e40e6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.176335 Oct 22 03:06:29.837161 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 297/563] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:29 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:06:29.846410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2109118473", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "1962332186", "adminPass": "***", "networks": [{"uuid": "bb7eb31f-2b35-44cf-b5ec-ba25a836c4a9"}], "security_groups": [{"name": "tempest-securitygroup--1512475799"}], "key_name": "tempest-keypair-1806393372", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:30.036557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:30.046022 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4290abef-a9af-4336-83a3-5ec3fb8b15d4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1462 microversion: 2.1 time: 0.591876 Oct 22 03:06:30.051136 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 267/564] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:29 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1462 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:30.053949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] validate_networks() for [('bb7eb31f-2b35-44cf-b5ec-ba25a836c4a9', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:06:30.056907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:30.057725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:30.078242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:30.078752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:30.079190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:30.079915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:30.080414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:30.093039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:30.677580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82b5f5151aef42a6a50e7f6748f35ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1fad27341547a8bf328352ff67d8ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:30.688832 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e86bfc1-9bb6-4257-8217-3303383d0d48 tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 200 len: 1479 microversion: 2.1 time: 0.636157 Oct 22 03:06:30.717919 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 268/565] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:30 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 1479 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:30.724023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:30.725970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:30.734384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:30.735107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:30.735684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:30.736796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:30.737428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:30.738750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:31.164061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:31.173613 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b5f81c41-9aaf-4dbc-b27b-861786c030fb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.452530 Oct 22 03:06:31.183212 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 269/566] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:30 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:31.435928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:31.436828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:31.443288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:31.443965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:31.444606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:31.445553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:31.446198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:31.446758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:31.748370 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c458635-8ba3-4da8-8159-2c4cc5380b22 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1613 microversion: 2.1 time: 0.561563 Oct 22 03:06:31.748973 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 270/567] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:31 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1613 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:31.756474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:31.757072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:31.785572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:31.787368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:31.788317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:31.790663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:31.794802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:31.795351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.079515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:32.080066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:32.080607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:32.081527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:32.082641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:32.104256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.105854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.107239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.109057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.109973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.110654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.157269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Getting quotas for project 71769feb32e1436285707bbdf76bf70e. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:32.167218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Getting quotas for user 069a8403cf9e414d99e83da9192f2057 and project 71769feb32e1436285707bbdf76bf70e. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:32.199692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:32.201144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:32.207408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:32.210532 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5ece568-b459-4aa2-bc0c-4327f62fade1 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.460526 Oct 22 03:06:32.211117 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 271/568] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:31 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:32.234518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:32.236047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:32.243040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.243819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.244495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.246124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.247026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.247795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.294948 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c06b21e-eb59-4a00-a7e0-04890078cb3d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.455147 Oct 22 03:06:32.295919 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 298/569] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:06:32.304072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:32.304754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:32.315484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.316202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.316740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.317514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.318020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.318684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.388906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:32.401154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:32.405669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:32.407050 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dcfbe84e-ed52-4023-8556-4c89cd6aa4e8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1320 microversion: 2.25 time: 0.179791 Oct 22 03:06:32.407989 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 272/570] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:32 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:32.424437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-caa078a0-a81e-4865-b6f3-c2dacde7eb70 req-1f9b0550-9f07-4a52-94e3-19d4842929db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57", "name": "network-vif-deleted", "tag": "92107697-1f24-4f17-a8fa-4473046b1330"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:32.447518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-caa078a0-a81e-4865-b6f3-c2dacde7eb70 req-1f9b0550-9f07-4a52-94e3-19d4842929db service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.448651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-caa078a0-a81e-4865-b6f3-c2dacde7eb70 req-1f9b0550-9f07-4a52-94e3-19d4842929db service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.449107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-caa078a0-a81e-4865-b6f3-c2dacde7eb70 req-1f9b0550-9f07-4a52-94e3-19d4842929db service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.481924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:32.497383 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-caa078a0-a81e-4865-b6f3-c2dacde7eb70 req-1f9b0550-9f07-4a52-94e3-19d4842929db service nova] Creating event network-vif-deleted:92107697-1f24-4f17-a8fa-4473046b1330 for instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 on n-h2-862416-2 Oct 22 03:06:32.498316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:32.500239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:32.512984 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-caa078a0-a81e-4865-b6f3-c2dacde7eb70 req-1f9b0550-9f07-4a52-94e3-19d4842929db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100331 Oct 22 03:06:32.514671 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 273/571] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:32.518444 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d126ffe-6f18-454c-9b1c-61a41456185d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.215770 Oct 22 03:06:32.520862 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 299/572] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:32 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:32.526046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:32.530650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] [instance: d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:32.534270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:32.534932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:32.546403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.548771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.550434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.551915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.552104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.552693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.553338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.553991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.554711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.555644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.557308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.557770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.589074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] HTTP exception thrown: Instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 could not be found. Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Request method failure captured: Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 HTTP/1.1 Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14TaywFvFj-ESake_7ekjrTCT-MIW9yL4wB3JGhnAiqamcT93Fu-QNxnnrZ4DXDIydawigNRY-wYhI3zFLOlOrP8NBMejqKNx19Atw0Wba_hpxYE4U_AfdbGqzHroo3aJ0mxNwyokz9lWAQ1_1jytUqqr5-UIu1G3ovKntXaV3NDDk Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 6c1fad27341547a8bf328352ff67d8ca Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1218876328 Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:06:32.595330 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c1fad27341547a8bf328352ff67d8ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c1fad27341547a8bf328352ff67d8ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c1fad27341547a8bf328352ff67d8ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c1fad27341547a8bf328352ff67d8ca"}]}] Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1218876328 Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 6c1fad27341547a8bf328352ff67d8ca Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1218876328 Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerDiagnosticsNegativeTest-1218876328-project Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 82b5f5151aef42a6a50e7f6748f35ba1 Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1218876328-project Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 could not be found. Oct 22 03:06:32.596952 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57'} Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 could not be found. Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:32.597825 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 could not be found. Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 could not be found. Oct 22 03:06:32.599253 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:32.602517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] Returning 404 to user: Instance d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:32.604402 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-559b6b66-af1c-4965-a9d2-cbaaf5bd9d3f tempest-ServerDiagnosticsNegativeTest-1218876328 tempest-ServerDiagnosticsNegativeTest-1218876328-project] 10.222.0.25 "GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57" status: 404 len: 111 microversion: 2.1 time: 0.087703 Oct 22 03:06:32.608778 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 274/573] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:32 2022] GET /compute/v2.1/servers/d8d7f4f1-d1a1-4f6e-93be-7cea2fc28b57 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:06:32.618908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:32.620199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:32.634880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.635369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.635806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.636602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:32.637049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:32.640811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:32.679094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:32.683881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0d9d3f9802454ad8a186ba287fc19510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e2d6ef5d9242119570da553c434958', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:32.685106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] flavor_id is None. Assuming migration. {{(pid=120582) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 22 03:06:32.685704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120582) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 03:06:33.132223 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90d86487-0985-43c6-8405-ff8b37361b17 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b/action" status: 202 len: 0 microversion: 2.1 time: 0.607548 Oct 22 03:06:33.134734 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 300/574] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:06:32 2022] POST /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:06:33.151725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f0e1f4fd-0a29-4c37-bd58-303137873cdf tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:33.154031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f0e1f4fd-0a29-4c37-bd58-303137873cdf tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:33.165091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:33.173957 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8f53201-24a0-4e25-a20c-3d94e2573dcd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.565480 Oct 22 03:06:33.176900 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 275/575] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:32 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:33.182244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:33.183079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:33.190290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:33.191123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:33.192037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:33.193003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:33.193670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:33.194529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:33.330081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f0e1f4fd-0a29-4c37-bd58-303137873cdf tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:33.341626 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f0e1f4fd-0a29-4c37-bd58-303137873cdf tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1265 microversion: 2.1 time: 0.205624 Oct 22 03:06:33.342852 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 301/576] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:33 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:33.362418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:33.368692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:33.383934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:33.385823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:33.388598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:33.389929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:33.390683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:33.391385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:33.594181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:33.607281 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fcc8898c-4472-467e-aaa2-e118f0e6ad17 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1471 microversion: 2.1 time: 0.429133 Oct 22 03:06:33.607871 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 276/577] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:33 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:33.612891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:33.618183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:33.666885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:33.667895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:33.669723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:33.671036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:33.673142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:33.674862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.047284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:34.057538 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2a86424e-d2de-418d-980d-025d3626a993 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.713129 Oct 22 03:06:34.068268 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 302/578] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:33 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:34.068268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e24e0124-b077-4155-8a3b-afb07fbb378b req-1e799ac7-1e5d-44f2-a729-4a0729f4c6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896b7177-4fd2-47b7-866b-4f7cb6ea78aa", "tag": "c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:34.095680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e24e0124-b077-4155-8a3b-afb07fbb378b req-1e799ac7-1e5d-44f2-a729-4a0729f4c6cc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.096522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e24e0124-b077-4155-8a3b-afb07fbb378b req-1e799ac7-1e5d-44f2-a729-4a0729f4c6cc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.101740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e24e0124-b077-4155-8a3b-afb07fbb378b req-1e799ac7-1e5d-44f2-a729-4a0729f4c6cc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.133974 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e24e0124-b077-4155-8a3b-afb07fbb378b req-1e799ac7-1e5d-44f2-a729-4a0729f4c6cc service nova] Creating event network-changed:c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c for instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa on n-h1-862416-2 Oct 22 03:06:34.148998 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e24e0124-b077-4155-8a3b-afb07fbb378b req-1e799ac7-1e5d-44f2-a729-4a0729f4c6cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087770 Oct 22 03:06:34.149899 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 303/579] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:34.155791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:34.157567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:34.166909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.169319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.170116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.171464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.172310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.173021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.231806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=25 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:34.252863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=16 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:34.553281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:34.566904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:34.569075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:34.570510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10fe9647-fe93-4376-90ec-047464cc6ae6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 0.961151 Oct 22 03:06:34.571790 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 277/580] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:33 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:34.579492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:34.580736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:34.588504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.590871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.591411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.592281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.592737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.593161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.609810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:34.621740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:34.630185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:34.672912 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d2c6b7c-eba6-4d46-8a27-05a59e2ba14a tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1533 microversion: 2.91 time: 0.520619 Oct 22 03:06:34.676823 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 304/581] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:34 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1533 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:34.697591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:34.698435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:34.710593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.711144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.712554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.715373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.717689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.718254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.868981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:34.882232 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2e457b16-760b-4dbb-869d-f31270b33a08 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1323 microversion: 2.1 time: 0.199012 Oct 22 03:06:34.897505 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 305/582] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:34 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:34.905344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f3a8064e-5f93-4692-82ea-8615b05a662f req-69ec4d44-8ded-4e13-9b73-af9bb261efdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf863bc6-44d7-4aa7-af7e-a40756171b7c", "tag": "e42f0e36-6d11-4cba-88fa-c23783ee9a83"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:34.916700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f3a8064e-5f93-4692-82ea-8615b05a662f req-69ec4d44-8ded-4e13-9b73-af9bb261efdf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.918579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f3a8064e-5f93-4692-82ea-8615b05a662f req-69ec4d44-8ded-4e13-9b73-af9bb261efdf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.919337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f3a8064e-5f93-4692-82ea-8615b05a662f req-69ec4d44-8ded-4e13-9b73-af9bb261efdf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.935647 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f3a8064e-5f93-4692-82ea-8615b05a662f req-69ec4d44-8ded-4e13-9b73-af9bb261efdf service nova] Creating event network-changed:e42f0e36-6d11-4cba-88fa-c23783ee9a83 for instance bf863bc6-44d7-4aa7-af7e-a40756171b7c on n-h1-862416-2 Oct 22 03:06:34.941749 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f3a8064e-5f93-4692-82ea-8615b05a662f req-69ec4d44-8ded-4e13-9b73-af9bb261efdf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041303 Oct 22 03:06:34.942916 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 306/583] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:34.949208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:34.950207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:34.956980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.958011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.959621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:34.960606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:34.961283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:34.961965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.001438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:35.010261 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-22bd750b-e27c-4ca8-bda6-fe3f13eb1168 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.436963 Oct 22 03:06:35.015787 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 278/584] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:34 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:35.020735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:35.026410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:35.041299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.042048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.043164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.046833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.047498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.048097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.173565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lazy-loading 'services' on Instance uuid 08867d3d-1927-46a5-921a-a7e74f48e0ad {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:35.197330 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ef37ab4-3c43-4b67-9507-8274f3233209 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1938 microversion: 2.91 time: 0.179523 Oct 22 03:06:35.198139 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 279/585] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:35 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1938 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:35.204381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:35.205119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:35.211011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:35.213181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.213983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.214543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.217350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.218043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.218531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.405867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:35.429202 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-85b98e7e-20a2-4a63-9755-6222d258b300 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1471 microversion: 2.1 time: 0.484558 Oct 22 03:06:35.430157 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 307/586] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:34 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1471 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:35.442019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:35.442870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:35.452053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.453084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.454927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.458437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.460896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.462269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.504546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lazy-loading 'flavor' on Instance uuid 08867d3d-1927-46a5-921a-a7e74f48e0ad {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:35.530135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:35.539126 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6774efe7-fe86-4f40-9347-827a4750dc72 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.339708 Oct 22 03:06:35.543558 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 280/587] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:35 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:35.601697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:35.602435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:35.609087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.613686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.614452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.616979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.618565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.625041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.651414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:35.852419 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8953dfa3-4c08-462e-8824-76a03e7fe880 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "POST /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad/action" status: 202 len: 0 microversion: 2.91 time: 0.420605 Oct 22 03:06:35.862017 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 308/588] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:06:35 2022] POST /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:06:35.870589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:35.871089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:35.880838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.881487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.881985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:35.883530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:35.883680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:35.884034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:36.125331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:36.157783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:36.163817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:36.179889 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5fea1537-f358-449d-9c28-9c3ddd75433c tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.316331 Oct 22 03:06:36.191446 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 309/589] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:35 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:36.198291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:36.198291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:36.208302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:36.208302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:36.208302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:36.208302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:36.208787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:36.208787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:36.361317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:36.374500 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-53ce81fe-ac22-44e5-9570-fbf05b67569f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1323 microversion: 2.1 time: 0.192393 Oct 22 03:06:36.375103 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 310/590] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:36 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:36.379678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:36.380243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:36.400449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:36.400946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:36.401707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:36.404727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:36.405214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:36.405644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:36.649361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:36.665305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:36.666822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:36.672886 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e82424dd-b8f7-4418-a5ca-ab31736e9567 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 1.079209 Oct 22 03:06:36.684244 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 281/591] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:35 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:36.684244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:36.684244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:36.695905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:36.703948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:36.703948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:36.704260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:36.704728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:36.705408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:36.949375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:36.961049 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-812db85f-9907-4790-85c3-9a45ea6bdb61 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.584821 Oct 22 03:06:36.962092 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 311/592] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:36 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:36.989726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:36.990710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:36.997906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:36.998403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:36.998852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:36.999830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:37.000323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:37.000758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:37.149882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:37.159026 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2093b2ee-00da-4a25-8b49-906845aadad5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1471 microversion: 2.1 time: 0.483404 Oct 22 03:06:37.172602 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 282/593] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:36 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:37.172602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-32ea2f79-535c-4c0a-ba78-d99b3bb663f1 req-02f15b04-d1d4-465c-b09b-b3dbc04dcfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c61b591-09ae-4f8c-877a-972aefaf2591", "tag": "93d2b602-d49e-42d9-b515-4384e2056ba0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:37.186703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-32ea2f79-535c-4c0a-ba78-d99b3bb663f1 req-02f15b04-d1d4-465c-b09b-b3dbc04dcfd4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:37.187194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-32ea2f79-535c-4c0a-ba78-d99b3bb663f1 req-02f15b04-d1d4-465c-b09b-b3dbc04dcfd4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:37.187626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-32ea2f79-535c-4c0a-ba78-d99b3bb663f1 req-02f15b04-d1d4-465c-b09b-b3dbc04dcfd4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:37.207010 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-32ea2f79-535c-4c0a-ba78-d99b3bb663f1 req-02f15b04-d1d4-465c-b09b-b3dbc04dcfd4 service nova] Creating event network-changed:93d2b602-d49e-42d9-b515-4384e2056ba0 for instance 1c61b591-09ae-4f8c-877a-972aefaf2591 on n-h2-862416-2 Oct 22 03:06:37.215248 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-32ea2f79-535c-4c0a-ba78-d99b3bb663f1 req-02f15b04-d1d4-465c-b09b-b3dbc04dcfd4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053456 Oct 22 03:06:37.216287 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 283/594] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:37.224729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:37.226117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:37.233184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:37.234087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:37.235708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:37.241080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:37.241914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:37.242708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:37.256649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:37.268118 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c9a2669-7fa4-4bfd-a9c0-92b62e47d6c3 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.293374 Oct 22 03:06:37.268832 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 312/595] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:36 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:37.399982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:37.400688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:37.415145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:37.417203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:37.421512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:37.422518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:37.423014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:37.424918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:37.499830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:37.512898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:37.515026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:37.534055 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e28131c3-26f0-4518-be92-4b1e90330559 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.315774 Oct 22 03:06:37.538223 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 284/596] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:37 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:37.718811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:37.720792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:37.740575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:37.742994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:37.743472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:37.744332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:37.744675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:37.748147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:38.295931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:38.296987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:38.309123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:38.314310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:38.315889 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9061e7ce-6fa6-4689-9329-901a68eb7ebd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 0.613480 Oct 22 03:06:38.319216 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 285/597] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:37 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:38.323123 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-897c4edd-efd3-4dff-8eef-543ff838b924 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.927927 Oct 22 03:06:38.326623 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 313/598] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:37 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:06:38.331342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:38.332199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:38.336570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:38.337203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:38.343647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:38.344400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:38.350782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:38.351506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:38.352513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:38.353188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:38.353828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:38.362062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:38.362704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:38.363154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:38.363881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:38.364371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:38.364799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:38.769848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:38.784523 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37298706-388e-4e30-8f72-7fb43899595f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1471 microversion: 2.1 time: 0.456714 Oct 22 03:06:38.785267 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 314/599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:38 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1471 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:38.791945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:38.793870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:38.800809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:38.801735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:38.802588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:38.804130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:38.804867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:38.805524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:38.933176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:38.945951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2b62c80-0bff-4909-b5da-d47c70dd9d40 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.625435 Oct 22 03:06:38.962201 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 286/600] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:38 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:39.135214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1316988489", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": "none"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:39.205683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:39.206112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:39.206588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:39.206990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:39.207393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:39.218195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.218681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.219454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:39.221078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.221754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.222668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:39.246525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Getting quotas for project cb766f6c2a3246d1bbc09eb33de7ff17. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:39.253664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Getting quotas for user d9a54aa1fdc74750b25ac2455142d7f8 and project cb766f6c2a3246d1bbc09eb33de7ff17. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:39.269007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:39.272333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:39.333717 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e2651dc-2de7-4d82-b5ee-e216e8b032db tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.370048 Oct 22 03:06:39.334976 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 287/601] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:06:39.341738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-07f4f858-9bfd-4f4c-9872-b4205888b602 req-4b02a1ef-05e8-446f-90c9-ebb522b79cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0063126-a79b-40eb-b050-d6842f4cd6f9", "name": "network-vif-plugged", "status": "completed", "tag": "a84845d5-cf94-4e06-ad51-31c0bec143f4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:39.353860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-07f4f858-9bfd-4f4c-9872-b4205888b602 req-4b02a1ef-05e8-446f-90c9-ebb522b79cc1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.354845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-07f4f858-9bfd-4f4c-9872-b4205888b602 req-4b02a1ef-05e8-446f-90c9-ebb522b79cc1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.355493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-07f4f858-9bfd-4f4c-9872-b4205888b602 req-4b02a1ef-05e8-446f-90c9-ebb522b79cc1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:39.371328 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-07f4f858-9bfd-4f4c-9872-b4205888b602 req-4b02a1ef-05e8-446f-90c9-ebb522b79cc1 service nova] Creating event network-vif-plugged:a84845d5-cf94-4e06-ad51-31c0bec143f4 for instance d0063126-a79b-40eb-b050-d6842f4cd6f9 on n-h1-862416-2 Oct 22 03:06:39.394746 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-07f4f858-9bfd-4f4c-9872-b4205888b602 req-4b02a1ef-05e8-446f-90c9-ebb522b79cc1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058240 Oct 22 03:06:39.396745 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 288/602] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:39.414276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:39.417428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:39.437491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.438306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.438949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:39.439870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.454825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.455596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:39.531043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.539603 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6b54ed86-09e2-42b3-b604-167622590125 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.753056 Oct 22 03:06:39.559826 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 315/603] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:38 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:39.571681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f01a7cd9-ed15-41d3-bd0f-1a8fc1fb2a43 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:39.580980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f01a7cd9-ed15-41d3-bd0f-1a8fc1fb2a43 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:39.708868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f01a7cd9-ed15-41d3-bd0f-1a8fc1fb2a43 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.718633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f01a7cd9-ed15-41d3-bd0f-1a8fc1fb2a43 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.720825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f01a7cd9-ed15-41d3-bd0f-1a8fc1fb2a43 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.727984 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f01a7cd9-ed15-41d3-bd0f-1a8fc1fb2a43 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "PUT /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1359 microversion: 2.75 time: 0.166387 Oct 22 03:06:39.729201 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 316/604] 10.222.0.25 () {62 vars in 1297 bytes} [Sat Oct 22 03:06:39 2022] PUT /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:39.735028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:39.736018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:39.742983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.743697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.744384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:39.745405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.746114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.746735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:39.916634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.926086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.934804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.936323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.939354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.941043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:39.942254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1277f5e-5624-4a24-bb3b-57cb986befce tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 0.211080 Oct 22 03:06:39.942750 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-07f796af-e009-453d-bb3e-73b4eeb8d89f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.543192 Oct 22 03:06:39.943345 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 289/605] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:39 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:39.948490 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 317/606] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:39 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:39.954996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:39.959939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:39.973066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-446bcbf9-2e74-40c3-a73e-6be64f133a46 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:39.973672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-446bcbf9-2e74-40c3-a73e-6be64f133a46 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:39.976031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.978251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.980511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:39.981283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:39.981757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:39.982196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.109988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-446bcbf9-2e74-40c3-a73e-6be64f133a46 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:40.125034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-446bcbf9-2e74-40c3-a73e-6be64f133a46 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:40.129546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-446bcbf9-2e74-40c3-a73e-6be64f133a46 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:40.139542 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-446bcbf9-2e74-40c3-a73e-6be64f133a46 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1359 microversion: 2.75 time: 0.177290 Oct 22 03:06:40.142360 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 290/607] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:39 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:40.147781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:40.148615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:40.157118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.157893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.158634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.160685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.161306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.162513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.163702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:40.174699 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37bbb48d-e768-4d6f-b2a6-6d5312375b0e tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.229377 Oct 22 03:06:40.175293 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 318/608] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:39 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:40.182814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7c160407-0bc0-4c3d-97c1-93b909fab37f req-870465e4-e4af-49c4-b97d-3cf50e982765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51400e5d-785f-4aff-9f3a-ec73d15dc8fe", "tag": "24f72835-b67d-4621-a0d2-606f7568d386"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:40.195065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7c160407-0bc0-4c3d-97c1-93b909fab37f req-870465e4-e4af-49c4-b97d-3cf50e982765 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.195552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7c160407-0bc0-4c3d-97c1-93b909fab37f req-870465e4-e4af-49c4-b97d-3cf50e982765 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.196384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7c160407-0bc0-4c3d-97c1-93b909fab37f req-870465e4-e4af-49c4-b97d-3cf50e982765 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.209531 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7c160407-0bc0-4c3d-97c1-93b909fab37f req-870465e4-e4af-49c4-b97d-3cf50e982765 service nova] Creating event network-changed:24f72835-b67d-4621-a0d2-606f7568d386 for instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe on n-h2-862416-2 Oct 22 03:06:40.215234 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7c160407-0bc0-4c3d-97c1-93b909fab37f req-870465e4-e4af-49c4-b97d-3cf50e982765 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037988 Oct 22 03:06:40.216465 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 319/609] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:40.221649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:40.222343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:40.228658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.229141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.229578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.230980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.231448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.231881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.354123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:40.363153 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-353822e9-6a0e-4ea4-984c-f435aad1f460 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1471 microversion: 2.1 time: 0.219344 Oct 22 03:06:40.363980 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 291/610] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:40 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:40.413893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:40.423577 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c8536940-59e8-4e15-9761-a69a5fdfda82 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.205865 Oct 22 03:06:40.433689 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 320/611] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:40 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:40.571475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:40.572456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:40.580202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.580724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.581166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.581877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.582333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.582944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.720400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:40.728574 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-22ae02de-604d-479b-9175-5f3af01dacdd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1321 microversion: 2.1 time: 0.161464 Oct 22 03:06:40.729345 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 292/612] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:40 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:40.970268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:40.970955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:40.979121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:40.981543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:40.993201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.993807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.994348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.995267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.995861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.996919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.997272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:40.998431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:40.998681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:40.999186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.000843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.001502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.106678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.123240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.125866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.136455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e236aa5-fb5c-47d6-83f3-8566d4f565d0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.160459 Oct 22 03:06:41.139811 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 293/613] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:40 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:06:41.175483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:41.177022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:41.189066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:41.190771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.191487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.192613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:41.193268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.194038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.298564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.309242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:41.313824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.315456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.325667 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27e3d523-c738-4cd8-8e7f-16e274811ba5 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1411 microversion: 2.75 time: 0.154789 Oct 22 03:06:41.334221 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 294/614] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:41 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:41.351595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:41.351595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:41.362739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:41.364438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.364969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.365952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:41.367049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.367557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.431873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.448189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.450421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.460532 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5d9d78e-c707-49c1-9f7a-9c25a142bdfc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 0.492992 Oct 22 03:06:41.462044 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 321/615] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:40 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:41.481134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:41.483940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:41.501048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:41.506287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.510555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.511491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:41.511980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.513932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.769769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:41.781066 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9ff32047-a046-4030-b3d7-558ebdfc3d44 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.443569 Oct 22 03:06:41.797404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 295/616] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:41 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:41.797404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:41.806049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:41.826461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:41.827395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.827857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:41.828625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:41.832431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:41.832971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.135484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=11 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:42.182132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.201184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-658576b3-5d8f-4755-8b5b-5f3322a01e9a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.409761 Oct 22 03:06:42.203972 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 296/617] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:41 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:42.212538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:42.213772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:42.223280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.224018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.225328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.226731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.227475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.228665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.257801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.269562 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-76fd726e-7301-4b43-90c1-373bc447faaa tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1471 microversion: 2.1 time: 0.805088 Oct 22 03:06:42.273744 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 322/618] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:41 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1471 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:42.279766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f168714f-095d-4a11-8188-5fc632a43bb2 req-5c3dd7d1-6682-4328-a985-9dc99d231cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896b7177-4fd2-47b7-866b-4f7cb6ea78aa", "name": "network-vif-plugged", "status": "completed", "tag": "c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:42.295794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f168714f-095d-4a11-8188-5fc632a43bb2 req-5c3dd7d1-6682-4328-a985-9dc99d231cba service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.296517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f168714f-095d-4a11-8188-5fc632a43bb2 req-5c3dd7d1-6682-4328-a985-9dc99d231cba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.297032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f168714f-095d-4a11-8188-5fc632a43bb2 req-5c3dd7d1-6682-4328-a985-9dc99d231cba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.312022 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f168714f-095d-4a11-8188-5fc632a43bb2 req-5c3dd7d1-6682-4328-a985-9dc99d231cba service nova] Creating event network-vif-plugged:c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c for instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa on n-h1-862416-2 Oct 22 03:06:42.321095 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f168714f-095d-4a11-8188-5fc632a43bb2 req-5c3dd7d1-6682-4328-a985-9dc99d231cba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045868 Oct 22 03:06:42.322063 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 323/619] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:42.338081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:42.339156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:42.349645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.352187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.353065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.353975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.354708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.355435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.492513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.501510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7fcf953c-1cc0-43c4-bf0e-e5017aa9da7e tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1470 microversion: 2.1 time: 0.296197 Oct 22 03:06:42.502752 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 297/620] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:42 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:42.507014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:42.507671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:42.529973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.530473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.531046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.532427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.532890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.533319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.634843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.646662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.648119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.656482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.659728 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-71e2dd2d-325c-47c1-9846-e771539c145f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.336265 Oct 22 03:06:42.660743 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 324/621] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:42 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:42.665631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:42.665769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.666583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:42.667200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:42.673707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.673947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b973e5cf-d042-4be4-9b2e-97b6eb706d61 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1417 microversion: 2.75 time: 0.170518 Oct 22 03:06:42.687117 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 298/622] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:42 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1417 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:42.687117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:42.687117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:42.687956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.688869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.689117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.689609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.690045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.690553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.690734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.691193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.691622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.691855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.692534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.726850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lazy-loading 'flavor' on Instance uuid d0063126-a79b-40eb-b050-d6842f4cd6f9 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:42.860546 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5768ff39-4a89-406c-9460-3b10e43a0125 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9/action" status: 202 len: 0 microversion: 2.1 time: 0.183671 Oct 22 03:06:42.864533 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 299/623] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:06:42 2022] POST /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:06:42.867358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:42.868674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:42.880495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.881599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.885571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:42.887379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:42.888062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:42.888718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.100674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.109252 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-246f775a-b5ac-4abe-a541-98a95d2908f0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.246509 Oct 22 03:06:43.113923 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 300/624] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:42 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:43.119106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:43.119970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:43.127483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.128048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.128613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.129432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.129926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.130357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.416961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.423108 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47bc71b0-b901-45f6-acc5-2f2bae295e8b tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1629 microversion: 2.1 time: 0.310899 Oct 22 03:06:43.423976 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 301/625] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:43 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1629 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:43.427924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.429413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:43.429878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:43.433537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.436452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.436756 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-936d999a-946c-41fd-b727-d7bf5beb5aa2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 0.774347 Oct 22 03:06:43.437152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.437754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.438173 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 325/626] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:42 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:43.443245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:43.450604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.452781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.452988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:43.453715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.459511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.460242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.460840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.462314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.463350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.463952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.645932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.662876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-659d8203-5549-488a-9579-fcf669b2795b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.237696 Oct 22 03:06:43.664184 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 302/627] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:43 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:43.692452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:43.693076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:43.705867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.709870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.711015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.711837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.712756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.712896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.805727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.817952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.820025 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-42e4587b-72da-481b-afa6-4f24c034ab8d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1471 microversion: 2.1 time: 0.380513 Oct 22 03:06:43.832954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.833846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 326/628] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:43 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:43.840692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.844966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:43.845774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:43.846887 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1c4e4953-ee97-4aef-9b99-ec32b8d4d092 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.156839 Oct 22 03:06:43.847950 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 303/629] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:43 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:43.852919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.854483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.856366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.857256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:43.857863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:43.858439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:43.864660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:43.950512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.960070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.961556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:43.967830 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-caf6741e-e299-4a8d-b1de-f23f41423b2a tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1417 microversion: 2.75 time: 0.132623 Oct 22 03:06:43.968656 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 327/630] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:43 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1417 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:44.134256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:44.135122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:44.141851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.142327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.142948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.143653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.144104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.144718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.295354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:44.314124 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d1b29fae-d382-43db-aef4-bdf95805dfcc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.183701 Oct 22 03:06:44.325728 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 304/631] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:44 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:44.337769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-02c4df97-3b34-4362-a8ae-483efb24945a req-837dc60d-75d0-4c7d-a6ad-1f458f18d0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf863bc6-44d7-4aa7-af7e-a40756171b7c", "name": "network-vif-plugged", "status": "completed", "tag": "e42f0e36-6d11-4cba-88fa-c23783ee9a83"}, {"server_uuid": "1c61b591-09ae-4f8c-877a-972aefaf2591", "name": "network-vif-plugged", "status": "completed", "tag": "93d2b602-d49e-42d9-b515-4384e2056ba0"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:44.349891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-02c4df97-3b34-4362-a8ae-483efb24945a req-837dc60d-75d0-4c7d-a6ad-1f458f18d0d6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.350783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-02c4df97-3b34-4362-a8ae-483efb24945a req-837dc60d-75d0-4c7d-a6ad-1f458f18d0d6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.351307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-02c4df97-3b34-4362-a8ae-483efb24945a req-837dc60d-75d0-4c7d-a6ad-1f458f18d0d6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.369417 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-02c4df97-3b34-4362-a8ae-483efb24945a req-837dc60d-75d0-4c7d-a6ad-1f458f18d0d6 service nova] Creating event network-vif-plugged:e42f0e36-6d11-4cba-88fa-c23783ee9a83 for instance bf863bc6-44d7-4aa7-af7e-a40756171b7c on n-h1-862416-2 Oct 22 03:06:44.370032 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-02c4df97-3b34-4362-a8ae-483efb24945a req-837dc60d-75d0-4c7d-a6ad-1f458f18d0d6 service nova] Creating event network-vif-plugged:93d2b602-d49e-42d9-b515-4384e2056ba0 for instance 1c61b591-09ae-4f8c-877a-972aefaf2591 on n-h2-862416-2 Oct 22 03:06:44.379478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-02c4df97-3b34-4362-a8ae-483efb24945a req-837dc60d-75d0-4c7d-a6ad-1f458f18d0d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045779 Oct 22 03:06:44.380260 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 328/632] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:44.448512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:44.449446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:44.456850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.457534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.458137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.461258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.461891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.462486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.469737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:44.470668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:44.477171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.477666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.478098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.478800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.479246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.479869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.630743 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e5506bb1-cd6b-448e-8306-e4f39a06e720 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1612 microversion: 2.1 time: 0.186529 Oct 22 03:06:44.631742 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 305/633] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:44 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1612 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:44.651462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:44.658002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:44.658482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:44.663764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:44.665223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:44.666508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1b96eee-f82c-4a4c-80d3-1a1a3e46d49f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 0.204868 Oct 22 03:06:44.667253 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 329/634] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:44 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:44.668091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.668799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.669238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.669975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.670430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.670857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.693971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:44.694590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:44.704563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.705058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.705680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.706555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:44.707172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:44.707762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:44.772051 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] HTTP exception thrown: Cannot 'migrate' instance d0063126-a79b-40eb-b050-d6842f4cd6f9 while it is in vm_state suspended Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Request method failure captured: Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9/action HTTP/1.1 Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 15 Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14JNh2u5sle3XT4MmW8VrMxg2LiNHTzs0tMalnCmOpgabM0cTIbq_YcKtKzZz16ii5I7GrYK6-nC0o9wSY2IFg9rv1Cs9B0yqKyXsQEBWmuNmG16dRPlec0EEP_1cEgV22yifgyQiSzydwAktFkm80nr4rp-5kqjpYi1buHRV7EX8E Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:06:44.774043 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}] Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7950bc78025244fd96faa9817b456408 Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: {"migrate": {}} Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:06:44.780430 n-d-862416-2 devstack@n-api.service[120581]: exception: Cannot 'migrate' instance d0063126-a79b-40eb-b050-d6842f4cd6f9 while it is in vm_state suspended Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd0063126-a79b-40eb-b050-d6842f4cd6f9', 'body': {'migrate': {}}} Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d0063126-a79b-40eb-b050-d6842f4cd6f9 in vm_state suspended. Cannot resize while the instance is in this state. Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.781286 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance d0063126-a79b-40eb-b050-d6842f4cd6f9 while it is in vm_state suspended Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:44.782665 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:44.783813 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:06:44.783813 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:06:44.783813 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance d0063126-a79b-40eb-b050-d6842f4cd6f9 while it is in vm_state suspended Oct 22 03:06:44.783813 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.783813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Returning 409 to user: Cannot 'migrate' instance d0063126-a79b-40eb-b050-d6842f4cd6f9 while it is in vm_state suspended {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:44.783813 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-022b167f-1d3b-4fd0-9807-92f728c720eb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9/action" status: 409 len: 148 microversion: 2.1 time: 0.121956 Oct 22 03:06:44.783813 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 306/635] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:06:44 2022] POST /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9/action => generated 148 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:06:44.791403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92db3868-84dc-4497-aae3-4463fb9af995 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92db3868-84dc-4497-aae3-4463fb9af995 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Request method failure captured: Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6/action HTTP/1.1 Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 39 Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14JNh2u5sle3XT4MmW8VrMxg2LiNHTzs0tMalnCmOpgabM0cTIbq_YcKtKzZz16ii5I7GrYK6-nC0o9wSY2IFg9rv1Cs9B0yqKyXsQEBWmuNmG16dRPlec0EEP_1cEgV22yifgyQiSzydwAktFkm80nr4rp-5kqjpYi1buHRV7EX8E Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:06:44.796011 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}] Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7950bc78025244fd96faa9817b456408 Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: {"os-resetState": {"state": "invalid"}} Oct 22 03:06:44.797513 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f23fabeb-4a39-4f68-b702-71589168a4e6', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'invalid' Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:44.798389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:06:44.799826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 22 03:06:44.801110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.802246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92db3868-84dc-4497-aae3-4463fb9af995 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:44.803294 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92db3868-84dc-4497-aae3-4463fb9af995 tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6/action" status: 400 len: 144 microversion: 2.1 time: 0.016924 Oct 22 03:06:44.804182 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 307/636] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:06:44 2022] POST /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:06:44.818791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be4417d8-3c02-4cc1-8834-48f6b2dbc65d tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be4417d8-3c02-4cc1-8834-48f6b2dbc65d tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Request method failure captured: Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6/action HTTP/1.1 Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 31 Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14JNh2u5sle3XT4MmW8VrMxg2LiNHTzs0tMalnCmOpgabM0cTIbq_YcKtKzZz16ii5I7GrYK6-nC0o9wSY2IFg9rv1Cs9B0yqKyXsQEBWmuNmG16dRPlec0EEP_1cEgV22yifgyQiSzydwAktFkm80nr4rp-5kqjpYi1buHRV7EX8E Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:06:44.822746 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}] Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7950bc78025244fd96faa9817b456408 Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: {"os-resetState": {"state": 1}} Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:06:44.824871 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f23fabeb-4a39-4f68-b702-71589168a4e6', 'body': {'os-resetState': {'state': 1}}} Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 1 Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:44.825826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 22 03:06:44.827139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.828433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be4417d8-3c02-4cc1-8834-48f6b2dbc65d tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:44.828433 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be4417d8-3c02-4cc1-8834-48f6b2dbc65d tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6/action" status: 400 len: 120 microversion: 2.1 time: 0.017683 Oct 22 03:06:44.833893 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 308/637] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:06:44 2022] POST /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:06:44.844500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-853fbf5c-da8e-4567-8524-408a78f026bb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:44.848663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-853fbf5c-da8e-4567-8524-408a78f026bb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Failed to fetch instance by id 999 {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 03:06:44.850050 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-853fbf5c-da8e-4567-8524-408a78f026bb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-853fbf5c-da8e-4567-8524-408a78f026bb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Request method failure captured: Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 37 Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14JNh2u5sle3XT4MmW8VrMxg2LiNHTzs0tMalnCmOpgabM0cTIbq_YcKtKzZz16ii5I7GrYK6-nC0o9wSY2IFg9rv1Cs9B0yqKyXsQEBWmuNmG16dRPlec0EEP_1cEgV22yifgyQiSzydwAktFkm80nr4rp-5kqjpYi1buHRV7EX8E Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:06:44.860028 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bea834b72e384f438a3d398a07ce31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bea834b72e384f438a3d398a07ce31d3"}]}] Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bea834b72e384f438a3d398a07ce31d3 Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1965732075 Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7950bc78025244fd96faa9817b456408 Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1965732075-project-admin Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: {"os-resetState": {"state": "error"}} Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:06:44.861598 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 999 could not be found. Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:06:44.862570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 22 03:06:44.863960 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:44.867967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-853fbf5c-da8e-4567-8524-408a78f026bb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:44.868964 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-853fbf5c-da8e-4567-8524-408a78f026bb tempest-ServersAdminNegativeTestJSON-1965732075 tempest-ServersAdminNegativeTestJSON-1965732075-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.032198 Oct 22 03:06:44.872470 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 309/638] 10.222.0.25 () {60 vars in 1179 bytes} [Sat Oct 22 03:06:44 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:06:44.891279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:44.891904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:44.972865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:44.997033 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0b6e712-b02d-49bb-9147-eafde8ddae33 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.308001 Oct 22 03:06:45.016482 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 330/639] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:44 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:45.022678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:45.024912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:45.043504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.044028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.044510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.049244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.049748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.050201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.085082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:06:45.145397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.146699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.147228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.148032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.148641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.149159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.224511 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e200535-72c8-4897-85fc-7282b8db8f5a tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 204 len: 0 microversion: 2.1 time: 0.205656 Oct 22 03:06:45.226608 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 331/640] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:06:45 2022] DELETE /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:06:45.237570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:45.238277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:45.251764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.252282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.252719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.253905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.254352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.254776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.317949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.329201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5b46a18-3dd6-4043-b961-905c9f055a01 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.455591 Oct 22 03:06:45.353452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.360440 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 310/641] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:44 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:45.365841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.370301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.375271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:45.375958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:45.384231 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb961dde-287d-4e7f-b5f2-eadf975fc7ff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.155984 Oct 22 03:06:45.396234 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 332/642] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:45 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:45.396431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.396431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.396431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.396431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.396750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.396750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.396885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:45.396885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:45.405679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.405679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.405679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.405679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.406106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.406106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.495936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.510799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.514179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.528142 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97b2fb2f-b10e-41f5-b8d9-6dc4aa47d3de tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1438 microversion: 2.75 time: 0.165236 Oct 22 03:06:45.528363 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 311/643] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:45 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1438 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:45.537995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:45.538606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:45.546515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.547008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.547496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.548294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.548792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.549345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.600269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.611133 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c6e95a0-c607-46e0-aea7-0437a2f715db tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1467 microversion: 2.1 time: 0.224445 Oct 22 03:06:45.611742 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 333/644] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:45 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1467 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:45.617102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:45.620128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:45.627824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.628974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.629431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.630267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.631715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.632583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.746806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:45.747992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:45.748711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:45.749503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:45.750215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:45.795951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:45.820441 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a81af976-adee-473d-9018-5e8166a1a292 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.286665 Oct 22 03:06:45.824357 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 312/645] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:45 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:45.836105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:45.838180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:45.850632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.851753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.852201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.858790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.859854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.860340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.861618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:45.873622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:45.877550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.878221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.879074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:45.880010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:45.880791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:45.881366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.025399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.039683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.043081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.050653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8472aaf7-0142-4647-8848-486f4b74dfbb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "POST /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f/action" status: 202 len: 1495 microversion: 2.75 time: 0.437356 Oct 22 03:06:46.052147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 334/646] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:06:45 2022] POST /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f/action => generated 1495 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 03:06:46.071434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.074524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:46.075068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:46.082357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.082845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.083656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.084481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.085428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.086099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.088459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.090448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.091735 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec9d1b2a-4c09-4f0a-9ab3-1a7de11d4d05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 0.266325 Oct 22 03:06:46.092340 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 313/647] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:45 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:46.097129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:46.097858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:46.104079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.104601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.105626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.106617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.107240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.107799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.185108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.195163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.197558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.204526 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ded45e07-baa9-4a57-a5ed-a6fe1e812979 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.110897 Oct 22 03:06:46.205480 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 314/648] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:46 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:46.319088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.329734 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0a06edc7-45d0-48a5-bab3-32acdade75cd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1313 microversion: 2.1 time: 0.275975 Oct 22 03:06:46.331346 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 335/649] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:46 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:46.353461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:46.354366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:46.363198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.363759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.364273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.364940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.365399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.366141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.423487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:46.424942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:46.430933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.431706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.431992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.432910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.433687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.434330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.531128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.539788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.541871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.547664 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72a6ffa2-e76f-4e9a-a38a-8dc3f2314975 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.128311 Oct 22 03:06:46.548587 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 336/650] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:46 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:46.594862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.624624 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-37632b0b-a43c-4105-89b1-7ab073cd3e3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.274055 Oct 22 03:06:46.625253 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 315/651] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:46 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:46.644538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:46.645147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:46.665092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.665588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.666023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.667529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.668515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.669251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.838146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:46.849321 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-610d8a83-bd0f-4b03-9739-578a0862ff64 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1467 microversion: 2.1 time: 0.209189 Oct 22 03:06:46.854255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:46.856250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:46.864996 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 337/652] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:46 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1467 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:46.866893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:46.869205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.869861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.872110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:46.873269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:46.873944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:46.874571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.131439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:47.145966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:47.158726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.159654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.159654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.160374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.160837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.161464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.362155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:47.370936 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e76e0460-c0d8-4a89-a90d-a6be015a5e77 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.523516 Oct 22 03:06:47.394764 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 316/653] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:46 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:47.399798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:47.400441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:47.423130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:47.423366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.423614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.431649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.432449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:47.434155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:47.435308 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d11c6f1-595b-47b9-8c0e-74bd9493c77d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1362 microversion: 2.25 time: 0.310125 Oct 22 03:06:47.437020 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 338/654] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:47 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:47.441695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:47.442300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:47.450251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.450991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.451614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.461983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.462491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.462976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.463836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.484582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.486047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.663883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:47.676781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:47.678827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:47.700668 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38cab17e-e1da-4491-aeee-e88b3b5f495f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.291572 Oct 22 03:06:47.720102 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 317/655] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:47 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:47.735516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:47.739198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:47.748891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.750363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.750968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.752047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.752690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.753454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.910138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:47.923927 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c89a550-c741-46d4-bce7-655ef750b48f tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1462 microversion: 2.1 time: 0.485680 Oct 22 03:06:47.945226 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 339/656] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:47 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1462 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:47.954113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:47.955958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:47.966325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.970043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.972436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:47.973417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:47.975692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:47.976414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.017095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:48.027124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:48.038034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:48.039351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:48.054309 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ff46207f-d869-4590-bec9-5310c0e1b358 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.332761 Oct 22 03:06:48.064996 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 318/657] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:47 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:48.081064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:48.083647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:48.094707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:48.095638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:48.096300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.097445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:48.098090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:48.098868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.362537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:48.376729 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d4e5b55-f59d-4c93-8463-60221c35cebd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.426178 Oct 22 03:06:48.377597 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 340/658] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:47 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:48.385606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:48.386942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:48.394589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:48.398453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:48.399995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.402765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:48.413094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:48.415399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.499644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:48.513794 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f93ab4b8-63d7-4d9f-82de-113a2a5301d8 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1467 microversion: 2.1 time: 0.442711 Oct 22 03:06:48.514500 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 319/659] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:48 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1467 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:48.544631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:48.545683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:48.584333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:48.585024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:48.585958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.586908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:48.587536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:48.588145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.785165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:48.805111 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-da992449-b7a9-4a6e-bc28-cb93f42d93d2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1462 microversion: 2.1 time: 0.423956 Oct 22 03:06:48.815953 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 341/660] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:48 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1462 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:48.821147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:48.822021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:48.835104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:48.837482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:48.844760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.848646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:48.855870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:48.856744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:48.997876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.017430 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0b127ca4-27e2-46bb-b7f4-96d68a0ec840 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.491601 Oct 22 03:06:49.032803 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 320/661] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:48 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:49.032803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:49.032803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:49.032803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.032803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.033333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.036035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.036679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.037331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.147574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.157064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.158502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.159661 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1c24f39a-6162-42a4-a1cb-94f05be99c65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1558 microversion: 2.25 time: 0.342745 Oct 22 03:06:49.161770 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 342/662] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:48 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1558 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:49.167031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-35cf0833-b0ad-4a0c-ba32-fe0ad7494c7a req-ca283880-2316-496c-8024-b17ac4eaa27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0063126-a79b-40eb-b050-d6842f4cd6f9", "name": "network-vif-deleted", "tag": "a84845d5-cf94-4e06-ad51-31c0bec143f4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:49.177860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35cf0833-b0ad-4a0c-ba32-fe0ad7494c7a req-ca283880-2316-496c-8024-b17ac4eaa27d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.179116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35cf0833-b0ad-4a0c-ba32-fe0ad7494c7a req-ca283880-2316-496c-8024-b17ac4eaa27d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.179567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35cf0833-b0ad-4a0c-ba32-fe0ad7494c7a req-ca283880-2316-496c-8024-b17ac4eaa27d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.198900 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-35cf0833-b0ad-4a0c-ba32-fe0ad7494c7a req-ca283880-2316-496c-8024-b17ac4eaa27d service nova] Creating event network-vif-deleted:a84845d5-cf94-4e06-ad51-31c0bec143f4 for instance d0063126-a79b-40eb-b050-d6842f4cd6f9 on n-h1-862416-2 Oct 22 03:06:49.207198 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-35cf0833-b0ad-4a0c-ba32-fe0ad7494c7a req-ca283880-2316-496c-8024-b17ac4eaa27d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041422 Oct 22 03:06:49.208637 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 343/663] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:49.216302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:49.217010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:49.223882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.224818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.225695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.226768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.227494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.228086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.234490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.238929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:49.254839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.257516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.273855 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f10756ec-a84f-4134-a9d9-058b69ba6b37 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.254089 Oct 22 03:06:49.285601 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 321/664] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:49 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:49.297026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1590985877", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "896b7177-4fd2-47b7-866b-4f7cb6ea78aa"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:49.352742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.362901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.367352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.374498 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8d261a81-cff4-4677-acae-25a4537af2f2 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.164190 Oct 22 03:06:49.375864 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 344/665] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:49 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:49.380693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:49.381817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:49.392318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.393258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.393817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.394598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.395545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.396488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.405696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:06:49.554097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid 1c61b591-09ae-4f8c-877a-972aefaf2591 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:49.569001 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a9da614-d68c-4ab7-b949-68daebd4b9c9 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 2051 microversion: 2.25 time: 0.191850 Oct 22 03:06:49.569770 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 345/666] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:49 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 2051 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:49.575275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:49.576091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:49.581975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.582448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.582885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.583578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.584011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.584453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.715010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=21 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:49.755220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:49.755645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:49.756122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:49.756575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:49.756986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:49.757481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:49.766826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.767489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.768126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.769568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.770178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.770753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.781330 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04eb18c5-ffd6-44e5-90d8-7aac813ea605 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.210323 Oct 22 03:06:49.789380 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 346/667] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:49 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:49.791712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Getting quotas for project 7fbe2f2bb3224e83a89df6ec4e84735b. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:49.797930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Getting quotas for user 3f8560b839d44c479e3016ef9e4b3ff1 and project 7fbe2f2bb3224e83a89df6ec4e84735b. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:49.802551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:49.804678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:49.818704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:49.825861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:49.828198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.830249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.835115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.836874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.838088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.838623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.915870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.917380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.922109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.923688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lazy-loading 'fault' on Instance uuid d0063126-a79b-40eb-b050-d6842f4cd6f9 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:49.930694 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd0adfd5-ca9f-4069-b9d6-06782a8229ef tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640936 Oct 22 03:06:49.938413 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 322/668] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:06:49.953978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:49.956264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:49.974095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.975108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.976792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:49.977833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:49.978833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:49.979758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.006362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.018466 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6be7d8e2-524c-4d58-ab9c-a77fdd46f128 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 200 len: 1311 microversion: 2.1 time: 0.227490 Oct 22 03:06:50.020796 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 347/669] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:49 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 1311 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:50.036771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a30c78fa-e02a-43a4-8d41-b2e12c23ed89 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:50.038827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a30c78fa-e02a-43a4-8d41-b2e12c23ed89 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:50.040065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:50.128412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a30c78fa-e02a-43a4-8d41-b2e12c23ed89 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.137223 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a30c78fa-e02a-43a4-8d41-b2e12c23ed89 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1214 microversion: 2.1 time: 0.112769 Oct 22 03:06:50.139526 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 348/670] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:50 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:50.146644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:50.156545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:50.164826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.168092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.169234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.171650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.173108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.173658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.470144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.479915 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d9b7b60c-3ef5-408a-9b1e-e5a70448dc7d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.337795 Oct 22 03:06:50.496233 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 349/671] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:50 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:50.496233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:50.496233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:50.501577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.501787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.502291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.503201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.503661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.504088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.589888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.601646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.603916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.610392 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0247369-51da-4cc2-89d6-b9abfd8e2ef1 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.122047 Oct 22 03:06:50.611916 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 350/672] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:50 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:50.617460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:50.618393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:50.626885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.627595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.628445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.630205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.630831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.631584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.726999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.738545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.740723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:50.747941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18848ea0-d849-433f-870c-2011823e1d26 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.134318 Oct 22 03:06:50.764834 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 351/673] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:50 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:50.822864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid 1c61b591-09ae-4f8c-877a-972aefaf2591 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:50.829093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:50.832096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:50.846725 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9805ae8c-bb20-4c35-a514-a94ed2ddbe5c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 2051 microversion: 2.25 time: 0.906522 Oct 22 03:06:50.849958 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 323/674] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:49 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 2051 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:50.867211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.868094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.868857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.870020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.872054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.873051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.880380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ec25f78-6464-4726-bc23-b9d27d372cfd tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:50.884416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ec25f78-6464-4726-bc23-b9d27d372cfd tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.885593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ec25f78-6464-4726-bc23-b9d27d372cfd tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.887744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ec25f78-6464-4726-bc23-b9d27d372cfd tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.888827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ec25f78-6464-4726-bc23-b9d27d372cfd tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.889470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ec25f78-6464-4726-bc23-b9d27d372cfd tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.890068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ec25f78-6464-4726-bc23-b9d27d372cfd tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.919497 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ec25f78-6464-4726-bc23-b9d27d372cfd tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042922 Oct 22 03:06:50.920786 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 324/675] 10.222.0.25 () {60 vars in 1217 bytes} [Sat Oct 22 03:06:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:06:50.937081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:50.941520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:50.952333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.953228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.953851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:50.955018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:50.955640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:50.956993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.099124 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a7b1d403-6eb8-473b-a8cb-5ee45639afad tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591/action" status: 202 len: 0 microversion: 2.25 time: 0.169811 Oct 22 03:06:51.105247 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 325/676] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:06:50 2022] POST /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:06:51.127169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:51.128344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: d0063126-a79b-40eb-b050-d6842f4cd6f9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:51.131641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:51.141510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.141791 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6b10092-3d3b-43c4-b112-824ad450f5b3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.336630 Oct 22 03:06:51.156190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.156996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.157336 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 352/677] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:50 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:51.158498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.159320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.159904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.166660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9207a173-73d8-42ee-a26c-0b0e096f13b7 req-c8f8bcb3-dd8c-4de5-8ae0-b51769b3ba0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51400e5d-785f-4aff-9f3a-ec73d15dc8fe", "name": "network-vif-plugged", "status": "completed", "tag": "24f72835-b67d-4621-a0d2-606f7568d386"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:51.181535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9207a173-73d8-42ee-a26c-0b0e096f13b7 req-c8f8bcb3-dd8c-4de5-8ae0-b51769b3ba0a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.184863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9207a173-73d8-42ee-a26c-0b0e096f13b7 req-c8f8bcb3-dd8c-4de5-8ae0-b51769b3ba0a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.185607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9207a173-73d8-42ee-a26c-0b0e096f13b7 req-c8f8bcb3-dd8c-4de5-8ae0-b51769b3ba0a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.193125 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] HTTP exception thrown: Instance d0063126-a79b-40eb-b050-d6842f4cd6f9 could not be found. Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Request method failure captured: Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 HTTP/1.1 Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14G54NdkodAA2CLizTzsdm3wix12I2G-JmJbqe9gTcxf5nlVBHXE_HGk7xXepE1JxT5B206jmU7lSbNvxJGqoin7WqSlLmMh_Sgt4sSO-sQiqHFgMJs39tkvwNS0EHqazo8gAjWbgAmPoPkq-XcTVXmSLQA7AtH48fss6YsXaS4jnw Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 94702d905cb947b1b9d2237eaf51d93a Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1793910531 Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:06:51.201448 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94702d905cb947b1b9d2237eaf51d93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94702d905cb947b1b9d2237eaf51d93a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94702d905cb947b1b9d2237eaf51d93a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94702d905cb947b1b9d2237eaf51d93a"}]}] Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1793910531 Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 94702d905cb947b1b9d2237eaf51d93a Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1793910531 Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersAdminNegativeTestJSON-1793910531-project Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: c05424e067934bdbaa92c060a20e98ae Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1793910531-project Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d0063126-a79b-40eb-b050-d6842f4cd6f9 could not be found. Oct 22 03:06:51.203398 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd0063126-a79b-40eb-b050-d6842f4cd6f9'} Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0063126-a79b-40eb-b050-d6842f4cd6f9 could not be found. Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:51.204403 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0063126-a79b-40eb-b050-d6842f4cd6f9 could not be found. Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0063126-a79b-40eb-b050-d6842f4cd6f9 could not be found. Oct 22 03:06:51.205877 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:06:51.209637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Returning 404 to user: Instance d0063126-a79b-40eb-b050-d6842f4cd6f9 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:51.210805 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44957aee-77ca-45ad-b22b-d4e7ffcd9a32 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9" status: 404 len: 111 microversion: 2.1 time: 0.103428 Oct 22 03:06:51.215149 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 326/678] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:51 2022] GET /compute/v2.1/servers/d0063126-a79b-40eb-b050-d6842f4cd6f9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:06:51.229086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:51.230790 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9207a173-73d8-42ee-a26c-0b0e096f13b7 req-c8f8bcb3-dd8c-4de5-8ae0-b51769b3ba0a service nova] Creating event network-vif-plugged:24f72835-b67d-4621-a0d2-606f7568d386 for instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe on n-h2-862416-2 Oct 22 03:06:51.232708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:51.241120 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9207a173-73d8-42ee-a26c-0b0e096f13b7 req-c8f8bcb3-dd8c-4de5-8ae0-b51769b3ba0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082280 Oct 22 03:06:51.242035 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 353/679] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:51.248341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:51.249458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.249955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.251908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.254052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.255049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:51.255937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.256632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.272315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.273092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.273769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.274769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.275458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.276115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.373145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:51.382708 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37e7054b-02da-4c3d-9888-e69890e36c62 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1266 microversion: 2.1 time: 0.139373 Oct 22 03:06:51.383535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 354/680] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:51 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:51.405448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:51.407760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:51.416772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.416772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.416772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.416772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.417309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.417875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.489584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:06:51.617317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid 1c61b591-09ae-4f8c-877a-972aefaf2591 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:51.662201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f69e225-374e-4a18-b656-6f924808e2a7 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 2056 microversion: 2.25 time: 0.445359 Oct 22 03:06:51.672985 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 327/681] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:51 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 2056 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:51.688270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:51.693293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:51.705763 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4f3474e-0788-4344-8c66-f01b5a24af01 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 204 len: 0 microversion: 2.1 time: 0.306106 Oct 22 03:06:51.706378 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 355/682] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:06:51 2022] DELETE /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:06:51.710858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.710858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.716704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.720448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:51.721705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:51.722128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.723103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.724847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.737683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.740347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.742819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.743595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.744068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.748967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.843560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:51.856341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:51.858623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:51.864847 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f8b8fb97-b3a9-4e48-816d-861073b7b3cb tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.157287 Oct 22 03:06:51.865515 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 356/683] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:51 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:51.883693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:51.885856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:51.893089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.893685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.894191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.895595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:51.896252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:51.896714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:51.909543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:52.029022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:52.044502 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3dbd0db8-4ccb-4e32-a108-eac82bbd07cd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.370150 Oct 22 03:06:52.055739 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 328/684] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:51 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:52.063586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:52.064491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:52.081112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.082027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.082652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.085628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.086345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.086686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.288151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:52.299209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:52.301702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:52.307058 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a40b6d6a-794c-4eec-bc76-c51d2e74f7b5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.249022 Oct 22 03:06:52.307635 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 329/685] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:52 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:52.334354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:52.335192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:52.343385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.344421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.345072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.346178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.350112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.350963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.383300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:52.631142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:52.641192 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5245f25-c1a5-442c-ba2e-8a1ecde8aee3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.319118 Oct 22 03:06:52.659623 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 330/686] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:52 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:52.665083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:52.665840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:52.674264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.674891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.675430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.676325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.677587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.680436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.801977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:52.815858 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5fa3579-6f8e-4f04-b58f-25944eac2bfa tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1272 microversion: 2.1 time: 0.154496 Oct 22 03:06:52.816933 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 331/687] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:52 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:52.821591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:52.822320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:52.832601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.834468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.835155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.836819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.848972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.849536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.883958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:52.902650 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e911d5c-0777-4a3f-b294-708c4583f390 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1478 microversion: 2.1 time: 1.035152 Oct 22 03:06:52.920453 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 357/688] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:51 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1478 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:52.925856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:52.926776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:52.934149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.937127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.937803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:52.939908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:52.951547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:52.952485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:53.091708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:53.102461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:53.103986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:53.110053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-57edba55-3239-4889-8da7-10654c15ebbd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.188201 Oct 22 03:06:53.110748 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 358/689] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:52 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:53.115483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:53.116232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:53.122318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:53.122908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:53.123446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:53.124261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:53.124815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:53.125336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:53.150014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid 1c61b591-09ae-4f8c-877a-972aefaf2591 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:53.169551 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b2c3427-9b43-4b3e-b506-fd2367a5cde3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 2036 microversion: 2.25 time: 0.351278 Oct 22 03:06:53.170205 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 332/690] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:52 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 2036 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:53.196867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862416-2", "block_migration": "auto"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:53.200013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:53.206801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:53.207562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:53.208225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:53.209215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:53.209850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:53.210529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:53.285780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'flavor' on Instance uuid 1c61b591-09ae-4f8c-877a-972aefaf2591 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:06:53.300996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Going to try to live migrate instance to n-h1-862416-2 {{(pid=120581) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:06:53.379585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:53.390561 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-791238a3-9c5f-4925-b267-fb0c69fb7276 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1391 microversion: 2.1 time: 0.278512 Oct 22 03:06:53.392197 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 359/691] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:53 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:53.399641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:53.400592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:53.409353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:53.409983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:53.411114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:53.411967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:53.412667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:53.413176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:53.524256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:53.532998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:53.534397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:53.540158 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7b32a55f-c12b-4c5e-9f7c-12735ab36ce6 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.145716 Oct 22 03:06:53.552936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 360/692] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:53 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:53.937203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ed4c8db-ba8d-413a-af2f-6e3f55d84433 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Action: 'create', calling method: .version_select at 0x7f0d1a545c10>, body: {"keypair": {"name": "tempest-keypair-1869459367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC47/LXmhD7m2zlQgxzVL3WOHLbNcACE3T+q/lCge4l9Lv/cVJLR2nZnxLRqyW1VoeUBOEx/ja1xJr6MA2k6AKMQJ5A/VzvbUIQwFEZ52OoJUst80JA7Ck7QXw0SjITWug=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:53.979473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7ed4c8db-ba8d-413a-af2f-6e3f55d84433 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Getting quotas for project 302763f239654e49a981355dd63bc6f7. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:53.994487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7ed4c8db-ba8d-413a-af2f-6e3f55d84433 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Getting quotas for user ebe78fc7afed43e496e0be24a021dffa and project 302763f239654e49a981355dd63bc6f7. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:54.034524 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ed4c8db-ba8d-413a-af2f-6e3f55d84433 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.480388 Oct 22 03:06:54.035437 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 361/693] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:06:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:54.040929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:54.042987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:54.051969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:54.052841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:54.053721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:54.054712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:54.055431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:54.056066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:54.458952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:54.476350 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a06d836-488e-4396-9bff-ceb695ea19a5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.439552 Oct 22 03:06:54.476939 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 362/694] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:54 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:54.481911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:54.482292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:54.491250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:54.492035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:54.492414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:54.493070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:54.493521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:54.493944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:55.063014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:55.073234 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d1bd4509-9bdc-46b7-aca7-94a65ea2c709 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1314 microversion: 2.1 time: 0.595159 Oct 22 03:06:55.091308 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 363/695] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:54 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:55.098778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:55.099646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:55.108881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:55.109641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:55.111114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:55.112016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:55.112666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:55.113769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:55.529786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05424e067934bdbaa92c060a20e98ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94702d905cb947b1b9d2237eaf51d93a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:55.537799 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c94dd7f1-251c-4d6f-9d42-99f0cc9b9762 tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 200 len: 1478 microversion: 2.1 time: 0.445254 Oct 22 03:06:55.538382 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 364/696] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:55 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 1478 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:55.559187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:55.560085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:55.574017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:55.574778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:55.575388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:55.589548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:55.590436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:55.591139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:55.772782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:55.789636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:55.798256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:55.819473 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46f1890f-5369-44f5-a101-ebff64517ec2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.262501 Oct 22 03:06:55.836897 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 365/697] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:55 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:55.872056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:55.875435 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abc4a4ec-a42b-4847-aecb-b58cc79a25e0 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591/action" status: 202 len: 0 microversion: 2.25 time: 2.682679 Oct 22 03:06:55.876062 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 333/698] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:06:53 2022] POST /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591/action => generated 0 bytes in 2684 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:06:55.881643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:55.882470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:55.887058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:55.904680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:55.909091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:55.910137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:55.911271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:55.913942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:55.915720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:55.917678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:55.918667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:55.919040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:55.920869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:55.922488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:55.925701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.104436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:56.119758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:56.125245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:56.143600 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4075f6f2-507a-47a3-ac13-e59868e54d1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.266122 Oct 22 03:06:56.144285 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 334/699] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:55 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:56.159087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:56.159901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:56.173768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.175215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.175727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.178890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.182499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.185167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.377042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:56.386471 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-75891bc7-a0eb-4f44-8804-76fdc974ab89 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1591 microversion: 2.1 time: 0.538986 Oct 22 03:06:56.389748 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 366/700] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:55 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1591 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:56.406877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1f586a57-5d3b-4fc7-97f5-9757a34c47b6 req-18a9c1fb-35db-4308-8c92-c79aa02ba35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23fabeb-4a39-4f68-b702-71589168a4e6", "name": "network-vif-deleted", "tag": "0994e38e-d384-4037-9651-25060522a5c6"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:56.428198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1f586a57-5d3b-4fc7-97f5-9757a34c47b6 req-18a9c1fb-35db-4308-8c92-c79aa02ba35a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.431217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1f586a57-5d3b-4fc7-97f5-9757a34c47b6 req-18a9c1fb-35db-4308-8c92-c79aa02ba35a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.431808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1f586a57-5d3b-4fc7-97f5-9757a34c47b6 req-18a9c1fb-35db-4308-8c92-c79aa02ba35a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.472005 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1f586a57-5d3b-4fc7-97f5-9757a34c47b6 req-18a9c1fb-35db-4308-8c92-c79aa02ba35a service nova] Creating event network-vif-deleted:0994e38e-d384-4037-9651-25060522a5c6 for instance f23fabeb-4a39-4f68-b702-71589168a4e6 on n-h2-862416-2 Oct 22 03:06:56.501409 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1f586a57-5d3b-4fc7-97f5-9757a34c47b6 req-18a9c1fb-35db-4308-8c92-c79aa02ba35a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110321 Oct 22 03:06:56.502204 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 367/701] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:56.507684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:56.508405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:56.516341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.530018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.530621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.531404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.532502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.532951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.806409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:56.817786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:56.821135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:56.825612 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a563338e-d2e4-4583-97bd-87e0c9247e7e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.322379 Oct 22 03:06:56.828504 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 368/702] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:56 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:56.848191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:56.848830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:56.867967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.869172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.869625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.873454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.874147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.877125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.908873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:56.926463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-58908e52-98dc-4e75-bf80-89fabd607fd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.781047 Oct 22 03:06:56.927383 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 335/703] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:56 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:56.932918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:56.936418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:56.955869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.959358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.960074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:56.961496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:56.962175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:56.962837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:57.114743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:57.124458 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f526a39-0796-405c-a30c-1daddd50e8a2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1314 microversion: 2.1 time: 0.294821 Oct 22 03:06:57.125603 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 369/704] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:56 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:57.149953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:57.150911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] [instance: f23fabeb-4a39-4f68-b702-71589168a4e6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:57.165295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:57.165697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:57.166130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:57.166844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:57.167656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:57.168306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:57.182468 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-676bf576-c6ca-4a74-b182-23c799926d3f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.253716 Oct 22 03:06:57.183727 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 336/705] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:06:56 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe/os-interface => generated 285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:57.189268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:57.190025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:57.195628 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] HTTP exception thrown: Instance f23fabeb-4a39-4f68-b702-71589168a4e6 could not be found. Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Request method failure captured: Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 HTTP/1.1 Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU14G54NdkodAA2CLizTzsdm3wix12I2G-JmJbqe9gTcxf5nlVBHXE_HGk7xXepE1JxT5B206jmU7lSbNvxJGqoin7WqSlLmMh_Sgt4sSO-sQiqHFgMJs39tkvwNS0EHqazo8gAjWbgAmPoPkq-XcTVXmSLQA7AtH48fss6YsXaS4jnw Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 94702d905cb947b1b9d2237eaf51d93a Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1793910531 Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:06:57.197927 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94702d905cb947b1b9d2237eaf51d93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94702d905cb947b1b9d2237eaf51d93a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94702d905cb947b1b9d2237eaf51d93a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94702d905cb947b1b9d2237eaf51d93a"}]}] Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1793910531 Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 94702d905cb947b1b9d2237eaf51d93a Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1793910531 Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersAdminNegativeTestJSON-1793910531-project Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: c05424e067934bdbaa92c060a20e98ae Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1793910531-project Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f23fabeb-4a39-4f68-b702-71589168a4e6 could not be found. Oct 22 03:06:57.200531 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f23fabeb-4a39-4f68-b702-71589168a4e6'} Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23fabeb-4a39-4f68-b702-71589168a4e6 could not be found. Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:06:57.201781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23fabeb-4a39-4f68-b702-71589168a4e6 could not be found. Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23fabeb-4a39-4f68-b702-71589168a4e6 could not be found. Oct 22 03:06:57.203215 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:06:57.206033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] Returning 404 to user: Instance f23fabeb-4a39-4f68-b702-71589168a4e6 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:06:57.207008 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb344dd3-ece8-43b2-8a38-7275f408d7dd tempest-ServersAdminNegativeTestJSON-1793910531 tempest-ServersAdminNegativeTestJSON-1793910531-project] 10.222.0.25 "GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6" status: 404 len: 111 microversion: 2.1 time: 0.067247 Oct 22 03:06:57.207992 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 370/706] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:57 2022] GET /compute/v2.1/servers/f23fabeb-4a39-4f68-b702-71589168a4e6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:06:57.215074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:57.215786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:57.217441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:57.217985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:57.218434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:57.219182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:57.219640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:57.220320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:57.223525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:57.224291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:57.225108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:57.226291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:57.226950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:57.227713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:57.339655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:57.348057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:57.349538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:57.355749 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38ed95fe-7fdc-479a-bcdb-e392b97f21fc tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.170580 Oct 22 03:06:57.356563 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 337/707] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:57 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:57.361419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1350923385", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "32dc83c8-2538-4967-ab2c-78b44d3e44cf"}], "security_groups": [{"name": "tempest-securitygroup--660448556"}], "key_name": "tempest-keypair-1869459367", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:57.510023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] validate_networks() for [('32dc83c8-2538-4967-ab2c-78b44d3e44cf', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:06:57.789312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:57.807957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:57.822003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:57.837823 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-300faa5c-947c-4301-b07b-5b7800f97371 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.628586 Oct 22 03:06:57.840520 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 371/708] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:57 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:57.854905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:57.855614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:57.866223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:57.866724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:57.867192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:57.867891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:57.868438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:57.868844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.218334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:58.231646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:58.233691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:58.235079 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c259d8c-4bcc-47a5-9011-e9800f928ead tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.384597 Oct 22 03:06:58.241167 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 372/709] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:57 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:06:58.248658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:58.249357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:58.268349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:58.268853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:58.269290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.270024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:58.270484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:58.270909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.349324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:06:58.350758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:06:58.351926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:06:58.352552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:06:58.353676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:06:58.374600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:58.375104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:58.375550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.376943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:58.377422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:58.378168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.402547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Getting quotas for project 302763f239654e49a981355dd63bc6f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:06:58.410851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Getting quotas for user ebe78fc7afed43e496e0be24a021dffa and project 302763f239654e49a981355dd63bc6f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:06:58.429838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:06:58.434590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:06:58.514578 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2a20110-fc27-49ff-a628-44b0085c11c2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.156672 Oct 22 03:06:58.521906 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 338/710] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:06:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:06:58.521906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:58.521906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:58.532040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:58.532877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:58.533390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.534793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:58.535366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:58.536062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.805692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:58.814732 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-810e7ea2-3add-4172-bba1-e1f1e73e1115 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1314 microversion: 2.1 time: 0.298304 Oct 22 03:06:58.815219 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 339/711] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:58 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:58.825838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:58.832172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:58.843154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:58.843652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:58.844090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.851906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:58.852452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:58.852903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:58.977609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:58.988915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:58.990388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.003365 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e370e45d-1520-46dc-8cb9-d3da68c3a7d2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.183049 Oct 22 03:06:59.004958 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 340/712] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:58 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:59.009201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.010323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ddab4b25-97e9-45c4-bb9a-1830ac11c2bd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:59.011612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ddab4b25-97e9-45c4-bb9a-1830ac11c2bd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:59.019706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:06:59.045632 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bf6d581c-db74-4888-ad03-ac64db0cf853 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.802799 Oct 22 03:06:59.050440 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 373/713] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:58 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:59.063612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a4b0685f-f19c-460e-962b-62b4313e9263 req-c808a8ce-da2e-4ef7-8f00-100b87740cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ea5f98-14d7-4474-bfc8-43786db3e230", "tag": "895f206a-567b-4921-9864-2b596bbae44b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:59.086360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a4b0685f-f19c-460e-962b-62b4313e9263 req-c808a8ce-da2e-4ef7-8f00-100b87740cb2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:59.087232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a4b0685f-f19c-460e-962b-62b4313e9263 req-c808a8ce-da2e-4ef7-8f00-100b87740cb2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:59.088234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a4b0685f-f19c-460e-962b-62b4313e9263 req-c808a8ce-da2e-4ef7-8f00-100b87740cb2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:59.109993 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a4b0685f-f19c-460e-962b-62b4313e9263 req-c808a8ce-da2e-4ef7-8f00-100b87740cb2 service nova] Creating event network-changed:895f206a-567b-4921-9864-2b596bbae44b for instance e7ea5f98-14d7-4474-bfc8-43786db3e230 on n-h1-862416-2 Oct 22 03:06:59.122044 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a4b0685f-f19c-460e-962b-62b4313e9263 req-c808a8ce-da2e-4ef7-8f00-100b87740cb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070132 Oct 22 03:06:59.124011 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 374/714] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:06:59.130706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ddab4b25-97e9-45c4-bb9a-1830ac11c2bd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.131583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:59.132638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:59.144390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:59.145143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:59.145899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:59.146046 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ddab4b25-97e9-45c4-bb9a-1830ac11c2bd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1242 microversion: 2.1 time: 0.135267 Oct 22 03:06:59.146883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 341/715] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:59 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:06:59.147022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:59.159041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:59.162731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:59.270246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:59.270860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:59.277635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:59.278023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:59.279100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:59.280359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:59.281040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:59.281702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:59.287597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.303723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.307743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.321082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-525f3893-6f8d-4855-a26f-b9a2fe2e6572 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.195551 Oct 22 03:06:59.322353 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 375/716] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:59 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:59.535260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4f054b06-363b-4ab0-9fb5-24d5f2528d37 req-ab052b22-c937-43a8-ba6c-75630277adab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c61b591-09ae-4f8c-877a-972aefaf2591", "name": "network-vif-unplugged", "status": "completed", "tag": "93d2b602-d49e-42d9-b515-4384e2056ba0"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:06:59.535645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.547857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.549362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:06:59.551765 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2a2e0fd-535a-4a3d-96c4-dae5daf78cfb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.285528 Oct 22 03:06:59.564596 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 342/717] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:06:59 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:06:59.564953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4f054b06-363b-4ab0-9fb5-24d5f2528d37 req-ab052b22-c937-43a8-ba6c-75630277adab service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:59.568556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4f054b06-363b-4ab0-9fb5-24d5f2528d37 req-ab052b22-c937-43a8-ba6c-75630277adab service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:59.569240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4f054b06-363b-4ab0-9fb5-24d5f2528d37 req-ab052b22-c937-43a8-ba6c-75630277adab service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:59.591485 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4f054b06-363b-4ab0-9fb5-24d5f2528d37 req-ab052b22-c937-43a8-ba6c-75630277adab service nova] Creating event network-vif-unplugged:93d2b602-d49e-42d9-b515-4384e2056ba0 for instance 1c61b591-09ae-4f8c-877a-972aefaf2591 on n-h2-862416-2 Oct 22 03:06:59.598069 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4f054b06-363b-4ab0-9fb5-24d5f2528d37 req-ab052b22-c937-43a8-ba6c-75630277adab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068405 Oct 22 03:06:59.599258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 376/718] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:06:59.843380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:06:59.844111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:06:59.854976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:59.858338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:59.858851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:06:59.859699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:06:59.861698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:06:59.862237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.038151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:00.038952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:00.053497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.054390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.055603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.058518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.059405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.059998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.076381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.086307 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aaf71651-144e-428a-a059-664343c6b1af tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1314 microversion: 2.1 time: 0.248345 Oct 22 03:07:00.088017 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 343/719] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:06:59 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:00.094257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:00.095246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:00.099230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:00.102086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.102726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.103484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.104405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.105432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.106043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.299937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.309172 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2203978b-acd3-4a55-b04e-f7345c3a1b47 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1476 microversion: 2.1 time: 0.218810 Oct 22 03:07:00.310395 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 344/720] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:00 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:00.315390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:00.316233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:00.322800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.323539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.324592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.325493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.326900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.327499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.426969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.440316 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-51cb2e83-8a1c-446e-8c07-58ab76841265 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1238 microversion: 2.1 time: 0.128621 Oct 22 03:07:00.441208 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 345/721] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:00 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1238 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:00.446173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:00.447147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:00.472434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.473326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.473942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.475062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.475977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.477007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.478980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.489953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.492585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.501430 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c12aa6c-ca70-49f8-814a-f10ffb374bcd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.468031 Oct 22 03:07:00.502526 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 377/722] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:00 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:00.530276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:00.567312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:00.567573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:00.584146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.584949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.585625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.592772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.593783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.594439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.634334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.646597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.648170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.653658 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39ada29a-522c-4cca-b4b9-9c50c46b31e9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.211273 Oct 22 03:07:00.656605 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 346/723] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:00 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:00.665464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:00.666701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:00.678827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.680935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.681565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.682622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:00.683493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:00.683932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:00.813961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.830604 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61008bfd-f751-4680-9f48-03ad9b0d4eda tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 200 len: 1591 microversion: 2.1 time: 0.271533 Oct 22 03:07:00.832471 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 378/724] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:00 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 1591 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:00.845490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.854686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.856658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:00.857859 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb35f39a-9581-47e3-ab34-4adb0fe1a449 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.199259 Oct 22 03:07:00.858594 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 347/725] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:00 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:01.112155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:01.113955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:01.121820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.122705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.123530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.124621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.125239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.125824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.156696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-af38c3b4-df33-4783-8aa1-0f137a1299ea req-ebedf08b-9152-4807-a6db-76a95a4a4564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51400e5d-785f-4aff-9f3a-ec73d15dc8fe", "tag": "24f72835-b67d-4621-a0d2-606f7568d386"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:01.177598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-af38c3b4-df33-4783-8aa1-0f137a1299ea req-ebedf08b-9152-4807-a6db-76a95a4a4564 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.180134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-af38c3b4-df33-4783-8aa1-0f137a1299ea req-ebedf08b-9152-4807-a6db-76a95a4a4564 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.180784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-af38c3b4-df33-4783-8aa1-0f137a1299ea req-ebedf08b-9152-4807-a6db-76a95a4a4564 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.209873 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-af38c3b4-df33-4783-8aa1-0f137a1299ea req-ebedf08b-9152-4807-a6db-76a95a4a4564 service nova] Creating event network-changed:24f72835-b67d-4621-a0d2-606f7568d386 for instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe on n-h2-862416-2 Oct 22 03:07:01.225170 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-af38c3b4-df33-4783-8aa1-0f137a1299ea req-ebedf08b-9152-4807-a6db-76a95a4a4564 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071482 Oct 22 03:07:01.227348 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 348/726] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:07:01.341716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:01.342671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:01.356319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.360244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.377124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.377902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.385463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.386726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.455918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:01.466969 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-81f2190b-92fd-48fc-be29-112df2721cce tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1314 microversion: 2.1 time: 0.359903 Oct 22 03:07:01.467821 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 379/727] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:01 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:01.485720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:01.486593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:01.493263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:01.501833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.502604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.503247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.504241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.504881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.505468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.593683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:01.603714 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-09bc5162-8eea-495a-8fca-b42bb7daf2e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1475 microversion: 2.1 time: 0.270489 Oct 22 03:07:01.605009 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 349/728] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:01 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1475 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:01.610175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:01.611020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:01.623907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.624824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.625315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.626372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.626683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.627126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.744617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:01.759277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:01.761548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:01.768580 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5df27ceb-90aa-42af-bbc1-d1365afcda82 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.162318 Oct 22 03:07:01.770213 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 350/729] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:01 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:01.779387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1f3c2a4c-1ad7-4f23-afc0-fc9fca846226 req-bac0c2f9-5251-45c6-9075-9b05b0fa5874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c61b591-09ae-4f8c-877a-972aefaf2591", "tag": "93d2b602-d49e-42d9-b515-4384e2056ba0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:01.808807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:01.809978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1f3c2a4c-1ad7-4f23-afc0-fc9fca846226 req-bac0c2f9-5251-45c6-9075-9b05b0fa5874 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.810478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1f3c2a4c-1ad7-4f23-afc0-fc9fca846226 req-bac0c2f9-5251-45c6-9075-9b05b0fa5874 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.810918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1f3c2a4c-1ad7-4f23-afc0-fc9fca846226 req-bac0c2f9-5251-45c6-9075-9b05b0fa5874 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.818927 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47f6cc94-bcbe-4760-b558-ebb38ac361fd tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1294 microversion: 2.1 time: 0.336994 Oct 22 03:07:01.820365 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 380/730] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:01 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1294 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:01.833795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:01.836125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:01.854196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.855015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.856189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.860317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.861116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.861815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.862473 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1f3c2a4c-1ad7-4f23-afc0-fc9fca846226 req-bac0c2f9-5251-45c6-9075-9b05b0fa5874 service nova] Creating event network-changed:93d2b602-d49e-42d9-b515-4384e2056ba0 for instance 1c61b591-09ae-4f8c-877a-972aefaf2591 on n-h2-862416-2 Oct 22 03:07:01.874849 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1f3c2a4c-1ad7-4f23-afc0-fc9fca846226 req-bac0c2f9-5251-45c6-9075-9b05b0fa5874 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102797 Oct 22 03:07:01.875472 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 351/731] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:01.888441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ba9e802a-87b9-404c-a9bc-7bfc4e70fb54 req-b9c3c1ef-7b6f-450c-9ad0-fce71464397b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ea5f98-14d7-4474-bfc8-43786db3e230", "name": "network-vif-plugged", "status": "completed", "tag": "895f206a-567b-4921-9864-2b596bbae44b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:01.921136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ba9e802a-87b9-404c-a9bc-7bfc4e70fb54 req-b9c3c1ef-7b6f-450c-9ad0-fce71464397b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:01.922500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ba9e802a-87b9-404c-a9bc-7bfc4e70fb54 req-b9c3c1ef-7b6f-450c-9ad0-fce71464397b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:01.924030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ba9e802a-87b9-404c-a9bc-7bfc4e70fb54 req-b9c3c1ef-7b6f-450c-9ad0-fce71464397b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:01.949677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ba9e802a-87b9-404c-a9bc-7bfc4e70fb54 req-b9c3c1ef-7b6f-450c-9ad0-fce71464397b service nova] Creating event network-vif-plugged:895f206a-567b-4921-9864-2b596bbae44b for instance e7ea5f98-14d7-4474-bfc8-43786db3e230 on n-h1-862416-2 Oct 22 03:07:01.957274 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ba9e802a-87b9-404c-a9bc-7bfc4e70fb54 req-b9c3c1ef-7b6f-450c-9ad0-fce71464397b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079609 Oct 22 03:07:01.967212 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 352/732] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:01.988461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:01.989431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:01.999053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.002900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.003372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.004316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.004808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.005403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.158914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:02.175232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:02.180347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:02.192376 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5b661e23-c52a-4aeb-b067-477e6782c7f9 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.370714 Oct 22 03:07:02.193493 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 381/733] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:01 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:02.376538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:02.393785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:02.395485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:02.397451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32b3736a-572c-4212-b969-23d440d89c8a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.427827 Oct 22 03:07:02.413705 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 353/734] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:01 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:02.427885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6e21b75-c62e-483b-9ff7-1935f8b1b5ae tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:02.431878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6e21b75-c62e-483b-9ff7-1935f8b1b5ae tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.433282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6e21b75-c62e-483b-9ff7-1935f8b1b5ae tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.433924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6e21b75-c62e-483b-9ff7-1935f8b1b5ae tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.434835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6e21b75-c62e-483b-9ff7-1935f8b1b5ae tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.435447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6e21b75-c62e-483b-9ff7-1935f8b1b5ae tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.436030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6e21b75-c62e-483b-9ff7-1935f8b1b5ae tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.472385 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6e21b75-c62e-483b-9ff7-1935f8b1b5ae tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.277453 Oct 22 03:07:02.473701 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 382/735] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:07:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:02.486200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-83fb83c9-0b9e-40ad-82b0-59efba844496 tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:02.496707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83fb83c9-0b9e-40ad-82b0-59efba844496 tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.497208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83fb83c9-0b9e-40ad-82b0-59efba844496 tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.497657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83fb83c9-0b9e-40ad-82b0-59efba844496 tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.498413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83fb83c9-0b9e-40ad-82b0-59efba844496 tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.498919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83fb83c9-0b9e-40ad-82b0-59efba844496 tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.499351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83fb83c9-0b9e-40ad-82b0-59efba844496 tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.502745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:02.504617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:02.526590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.527842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.528322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.529055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.530390 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-83fb83c9-0b9e-40ad-82b0-59efba844496 tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-862416-2" status: 200 len: 578 microversion: 2.1 time: 0.047952 Oct 22 03:07:02.531330 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 354/736] 10.222.0.25 () {58 vars in 1172 bytes} [Sat Oct 22 03:07:02 2022] GET /compute/v2.1/os-services?host=n-d-862416-2 => generated 578 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:02.538403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.539242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.545477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2d6fcfb8-9a9d-4002-81ed-4fdd5f92a25d tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:02.549504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d6fcfb8-9a9d-4002-81ed-4fdd5f92a25d tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.549995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d6fcfb8-9a9d-4002-81ed-4fdd5f92a25d tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.550492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d6fcfb8-9a9d-4002-81ed-4fdd5f92a25d tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.551224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d6fcfb8-9a9d-4002-81ed-4fdd5f92a25d tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.551732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d6fcfb8-9a9d-4002-81ed-4fdd5f92a25d tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.552161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d6fcfb8-9a9d-4002-81ed-4fdd5f92a25d tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.582051 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2d6fcfb8-9a9d-4002-81ed-4fdd5f92a25d tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040364 Oct 22 03:07:02.582966 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 355/737] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:07:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:02.597669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42ad1e92-44b2-42cb-a7e1-5e831764760c tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:02.602632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42ad1e92-44b2-42cb-a7e1-5e831764760c tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.603260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42ad1e92-44b2-42cb-a7e1-5e831764760c tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.603878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42ad1e92-44b2-42cb-a7e1-5e831764760c tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.605389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42ad1e92-44b2-42cb-a7e1-5e831764760c tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.606196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42ad1e92-44b2-42cb-a7e1-5e831764760c tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.607738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42ad1e92-44b2-42cb-a7e1-5e831764760c tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.637284 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42ad1e92-44b2-42cb-a7e1-5e831764760c tempest-ServicesAdminTestJSON-1246833529 tempest-ServicesAdminTestJSON-1246833529-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.044736 Oct 22 03:07:02.646130 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 356/738] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:07:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:07:02.646130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:02.646130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:02.650719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.651269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.652250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:02.653059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:02.653525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:02.654517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.034130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.045282 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dfc91ce4-6f3f-42ea-94fa-666683ef30fd tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1314 microversion: 2.1 time: 0.554062 Oct 22 03:07:03.047721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 383/739] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:02 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:03.052778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:03.053725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:03.060316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.060997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.061619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.063339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.063966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.064599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.080030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.091596 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d6a22760-4a1f-4ee9-8333-182e8d01682f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1475 microversion: 2.1 time: 0.452839 Oct 22 03:07:03.093546 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 357/740] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:02 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1475 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:03.104051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:03.106137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:03.116546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.120712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.121989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.123063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.123965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.124641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.202503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.210546 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c181e577-ba6f-4634-b927-7d6d2aeaf2d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1300 microversion: 2.1 time: 0.115673 Oct 22 03:07:03.211204 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 358/741] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:03 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:03.221351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:03.222276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:03.229033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.230227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.230993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.231871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.232454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.232969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.303897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.312974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.315448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.317074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.322132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.324664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.324867 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-204a9c95-e6da-4a9a-9574-b595e75a3f19 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.275718 Oct 22 03:07:03.326026 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 384/742] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:03 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:03.332317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0047f55c-eb46-465b-afee-fd24829ec373 req-9d4d4ae8-5358-492c-a715-370eaab4f0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f275fc7f-8fe1-4e0c-b717-0889031f866b", "name": "network-vif-unplugged", "status": "completed", "tag": "acdf2dde-8d5f-421c-be80-ccc69afad608"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:03.343325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0047f55c-eb46-465b-afee-fd24829ec373 req-9d4d4ae8-5358-492c-a715-370eaab4f0d1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.344549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0047f55c-eb46-465b-afee-fd24829ec373 req-9d4d4ae8-5358-492c-a715-370eaab4f0d1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.345198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0047f55c-eb46-465b-afee-fd24829ec373 req-9d4d4ae8-5358-492c-a715-370eaab4f0d1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.357116 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d8792d5-0934-4d66-bf2d-3e43c44f27a0 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.139498 Oct 22 03:07:03.365443 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0047f55c-eb46-465b-afee-fd24829ec373 req-9d4d4ae8-5358-492c-a715-370eaab4f0d1 service nova] Creating event network-vif-unplugged:acdf2dde-8d5f-421c-be80-ccc69afad608 for instance f275fc7f-8fe1-4e0c-b717-0889031f866b on n-h1-862416-2 Oct 22 03:07:03.376229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-0047f55c-eb46-465b-afee-fd24829ec373 req-9d4d4ae8-5358-492c-a715-370eaab4f0d1 service nova] Instance f275fc7f-8fe1-4e0c-b717-0889031f866b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:07:03.376471 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 359/743] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:03 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:03.393608 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0047f55c-eb46-465b-afee-fd24829ec373 req-9d4d4ae8-5358-492c-a715-370eaab4f0d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065395 Oct 22 03:07:03.394621 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 385/744] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:03.426856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:03.427839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:03.435274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.436010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.436844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.437665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:03.438223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:03.438747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:03.621976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.630316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.631566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:03.633620 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30bd7b75-15fd-49c9-87e8-d50a621e3566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.210311 Oct 22 03:07:03.633620 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 360/745] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:03 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:04.068245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:04.072761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:04.073721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:04.103876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.105398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.106071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.108041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.108783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.109440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.117024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:04.118528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:04.128733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.130584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.132095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.133979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.134655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.136041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.316200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.324404 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-529058b7-dcd4-4c9f-ba41-27244cd79c56 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1475 microversion: 2.1 time: 0.211547 Oct 22 03:07:04.325481 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 361/746] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:04 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1475 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:04.331530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:04.332341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:04.342621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.343316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.343942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.344845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.345453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.346045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.544284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.546879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.558768 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f00b6ca5-79fb-4ef1-a919-0e7788592409 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1462 microversion: 2.1 time: 0.490745 Oct 22 03:07:04.560045 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 386/747] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:04 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1462 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:04.569579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:04.570493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:04.580611 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1213df03-d654-4726-8e00-ba8a9c7b40a9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.253344 Oct 22 03:07:04.581258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.581510 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 362/748] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:04 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:04.590225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:04.591114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:04.594106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.595004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.601799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.602289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.602835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.627193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.628823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.629505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.630501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:04.632193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:04.633029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:04.732134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.748440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.749896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.756149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da2613ec-f09e-4885-8717-b9d0f603e180 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.173356 Oct 22 03:07:04.758200 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 363/749] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:04 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:04.953973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.963212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.965516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:04.981867 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-12bbf745-07b6-4fe1-a1ff-77e3480c3512 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.420547 Oct 22 03:07:04.996244 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 387/750] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:04 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:05.000320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:05.001128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:05.008004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.008530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.008969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.009678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.010166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.011118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.077040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:05.084466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Searching by: {'deleted': False, 'project_id': '6861b6972e8144ac84ae8640e4692872'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:07:05.090866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.090866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.091256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.092114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.092609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.093038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.200390 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20543c46-16fa-4f32-a239-487d7b43ed5e tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.441151 Oct 22 03:07:05.201378 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 364/751] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:07:04 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:07:05.222708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:05.230132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Searching by: {'deleted': False} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:07:05.235886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.236682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.237271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.240979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.241758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.242368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.358072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:07:05.407469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:05.420936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:05.422670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:05.424062 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5878f772-9cf6-4d97-aa00-a448c47b1ca0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.440691 Oct 22 03:07:05.424891 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 388/752] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:04 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:05.429791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:05.430621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:05.437652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.438556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.439202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.440734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.441601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.442266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.478488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=23 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:05.494185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.494675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.495839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.821214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:05.831754 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e41095d-81c1-4fe6-919c-2c1122d1e58d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1475 microversion: 2.1 time: 0.405520 Oct 22 03:07:05.832838 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 389/753] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:05 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1475 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:05.838945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7e919899-df46-4eaa-9820-7144f1483335 req-efaa9877-2d7a-4ec5-9ffc-93b4b058be69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f275fc7f-8fe1-4e0c-b717-0889031f866b", "tag": "acdf2dde-8d5f-421c-be80-ccc69afad608"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:05.851480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7e919899-df46-4eaa-9820-7144f1483335 req-efaa9877-2d7a-4ec5-9ffc-93b4b058be69 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.852646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7e919899-df46-4eaa-9820-7144f1483335 req-efaa9877-2d7a-4ec5-9ffc-93b4b058be69 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.853649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7e919899-df46-4eaa-9820-7144f1483335 req-efaa9877-2d7a-4ec5-9ffc-93b4b058be69 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.872675 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7e919899-df46-4eaa-9820-7144f1483335 req-efaa9877-2d7a-4ec5-9ffc-93b4b058be69 service nova] Creating event network-changed:acdf2dde-8d5f-421c-be80-ccc69afad608 for instance f275fc7f-8fe1-4e0c-b717-0889031f866b on n-h1-862416-2 Oct 22 03:07:05.881421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-7e919899-df46-4eaa-9820-7144f1483335 req-efaa9877-2d7a-4ec5-9ffc-93b4b058be69 service nova] Instance f275fc7f-8fe1-4e0c-b717-0889031f866b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:07:05.895536 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7e919899-df46-4eaa-9820-7144f1483335 req-efaa9877-2d7a-4ec5-9ffc-93b4b058be69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060990 Oct 22 03:07:05.896756 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 390/754] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:05.902522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:05.903333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:05.904033 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38549421-67b9-4127-b01b-68ffa699f3a7 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16017 microversion: 2.1 time: 0.684905 Oct 22 03:07:05.905025 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 365/755] 10.222.0.25 () {58 vars in 1171 bytes} [Sat Oct 22 03:07:05 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16017 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:07:05.914200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.915179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.915895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.922348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:05.923678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:05.927642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.930156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.931850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.934107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.934778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.936275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:05.938152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:05.940418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:05.942201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.044105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.053293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.055036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.060492 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a150fcd-69aa-4783-9fb2-0e408ad9a366 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.154179 Oct 22 03:07:06.061076 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 366/756] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:05 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:06.071599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:06.077841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Searching by: {'deleted': False, 'project_id': '6861b6972e8144ac84ae8640e4692872'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:07:06.082826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.084029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.084511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.085278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.085923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.086356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.104728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:06.122654 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b866d06-a2da-449e-8bae-02b2fa95b04d tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=7fbe2f2bb3224e83a89df6ec4e84735b" status: 200 len: 15 microversion: 2.1 time: 0.060341 Oct 22 03:07:06.123264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 367/757] 10.222.0.25 () {58 vars in 1231 bytes} [Sat Oct 22 03:07:06 2022] GET /compute/v2.1/servers/detail?tenant_id=7fbe2f2bb3224e83a89df6ec4e84735b => generated 15 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:07:06.129067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:06.129853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:06.137849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.138575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.139183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.140062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.140709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.141653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.262957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.277812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.281062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.290269 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ed03f19-c4b0-46b3-8801-ae4e20b98a2d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.165659 Oct 22 03:07:06.301792 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 368/758] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:06 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:06.320954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:06.325845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.329204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Searching by: {'tenant_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'deleted': False} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:07:06.337077 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1c0cac88-ba15-41d6-9ecd-1bf1c0fd0559 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.438954 Oct 22 03:07:06.337944 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 391/759] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:05 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:06.339494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.340263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.341015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.342185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.343175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.343822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.386474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:07:06.455713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:06.456464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:06.465300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.466002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.466891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.468020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.468662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.469270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.501952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.502438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.502870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.693620 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e6bff1e-993a-4ad9-b044-470722deb08b tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7fbe2f2bb3224e83a89df6ec4e84735b" status: 200 len: 4822 microversion: 2.1 time: 0.383144 Oct 22 03:07:06.704239 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 369/760] 10.222.0.25 () {58 vars in 1257 bytes} [Sat Oct 22 03:07:06 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7fbe2f2bb3224e83a89df6ec4e84735b => generated 4822 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:06.723787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:06.732373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Searching by: {'tenant_id': '6861b6972e8144ac84ae8640e4692872', 'deleted': False} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:07:06.738245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.738845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.739374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.740297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.740846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.741363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.774096 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9d591b94-f289-4421-b384-edcd575e48ef tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6861b6972e8144ac84ae8640e4692872" status: 200 len: 15 microversion: 2.1 time: 0.054631 Oct 22 03:07:06.775038 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 370/761] 10.222.0.25 () {58 vars in 1257 bytes} [Sat Oct 22 03:07:06 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6861b6972e8144ac84ae8640e4692872 => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 03:07:06.797607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3936492-dca6-4c46-99ff-5cb676bb5897 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:06.802915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3936492-dca6-4c46-99ff-5cb676bb5897 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008967 Oct 22 03:07:06.816285 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 371/762] 10.222.0.25 () {58 vars in 1189 bytes} [Sat Oct 22 03:07:06 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 03:07:06.816807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.820419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.822725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.825334 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5d16610-a21b-4154-a395-0cfa42cf99eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.373644 Oct 22 03:07:06.826065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 392/763] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:06 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:06.828340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:06.830641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:06.838950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.839407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.839960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.840850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.841437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.841868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.858043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:06.858707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:06.865308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.865928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.866453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.867249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.867803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.868394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.926489 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f96661e1-cad7-4f71-a63a-f55d4d16f6d0 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action" status: 202 len: 0 microversion: 2.1 time: 0.102977 Oct 22 03:07:06.927293 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 372/764] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:07:06 2022] POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:07:06.936457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:06.941156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:06.942595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:07:06.950247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.950724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.951156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:06.951876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:06.952378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:06.952800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.038902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:07:07.109105 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ece27aa4-103a-463f-a868-580e51f9249e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.177689 Oct 22 03:07:07.109599 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 373/765] 10.222.0.25 () {58 vars in 1150 bytes} [Sat Oct 22 03:07:06 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:07:07.117430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:07.118110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:07.124786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.125169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.125673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.126436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.126962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.127450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.197588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:07.197982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:07.206482 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c8620b40-de8b-4587-aca3-eb13ac931549 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1473 microversion: 2.1 time: 0.353051 Oct 22 03:07:07.207807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:07.209418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:07.214792 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f79292d-4da9-4baa-86f6-3c1ee783c177 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.101235 Oct 22 03:07:07.215585 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 374/766] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:07 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:07.220635 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 393/767] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:06 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1473 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:07.226951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:07.229795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:07.237521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.238272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.238707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.239406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.239854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.240306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.324357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:07.325186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:07.331162 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19eaaaab-6160-4998-a966-d248fb275e9f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action" status: 202 len: 0 microversion: 2.1 time: 0.108678 Oct 22 03:07:07.335178 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 375/768] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:07:07 2022] POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:07:07.335415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.338477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.339066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.339825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.340313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.340936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.341761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:07.342388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:07.351568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.353132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.353584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.356569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.357070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.357514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.459036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:07.482161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:07.484173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:07.490819 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f6d765ff-7ec3-494f-bd43-ca38e38abb8d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.171565 Oct 22 03:07:07.492273 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 394/769] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:07 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:07.497741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:07.498341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:07.505447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.506127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.506868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.507776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.508413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.509118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.522199 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c69e9c1e-687e-4ce8-83cd-02661f6edb84 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1613 microversion: 2.1 time: 0.185323 Oct 22 03:07:07.524101 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 376/770] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:07 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1613 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:07.542831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:07.553254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:07.553886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:07.562888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:07.564826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.564984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.565342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.566072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.566824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.566971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.709001 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7d72ff6e-15cf-4db5-868b-ea1b772b8df6 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1613 microversion: 2.1 time: 0.159337 Oct 22 03:07:07.716622 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 377/771] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:07 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:07.743019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:07.752918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Searching by: {'host': 'n-h1-862416-2', 'deleted': False} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:07:07.760240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.761011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.761458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.762262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.763364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.763364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.845258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:07.854983 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2f562477-b1d3-4dc1-a162-c3e1a99fc225 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.361437 Oct 22 03:07:07.868712 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 395/772] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:07 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:07.873149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:07:07.876956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:07.877792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:07.885116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.886260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.887019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.887978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.888626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.889512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:07.951847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-85af82d6-7151-4900-a8e5-8f0d61a06218 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h1-862416-2&all_tenants=1" status: 200 len: 1973 microversion: 2.1 time: 0.214419 Oct 22 03:07:07.953139 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 378/773] 10.222.0.25 () {58 vars in 1190 bytes} [Sat Oct 22 03:07:07 2022] GET /compute/v2.1/servers?host=n-h1-862416-2&all_tenants=1 => generated 1973 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:07.976602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-98e02009-9a87-4f73-b8bc-56156d5f20e7 req-595a754e-d0db-4f87-898e-f3758b230af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593d2c59-795e-4dc7-8200-56b449d7b066", "tag": "1073dea1-b453-42fd-b459-d11d3ff92c57"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:07.988029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-98e02009-9a87-4f73-b8bc-56156d5f20e7 req-595a754e-d0db-4f87-898e-f3758b230af4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:07.988533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-98e02009-9a87-4f73-b8bc-56156d5f20e7 req-595a754e-d0db-4f87-898e-f3758b230af4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:07.988962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-98e02009-9a87-4f73-b8bc-56156d5f20e7 req-595a754e-d0db-4f87-898e-f3758b230af4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.004138 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-98e02009-9a87-4f73-b8bc-56156d5f20e7 req-595a754e-d0db-4f87-898e-f3758b230af4 service nova] Creating event network-changed:1073dea1-b453-42fd-b459-d11d3ff92c57 for instance 593d2c59-795e-4dc7-8200-56b449d7b066 on n-h2-862416-2 Oct 22 03:07:08.009916 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-98e02009-9a87-4f73-b8bc-56156d5f20e7 req-595a754e-d0db-4f87-898e-f3758b230af4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041049 Oct 22 03:07:08.011693 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 379/774] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:08.019569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:08.029689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:07:08.039065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.039572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.040033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.040807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.041343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.042878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.093669 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50823ee0-7692-4b16-856f-c81dcbe8a9e4 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.079529 Oct 22 03:07:08.096726 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 380/775] 10.222.0.25 () {58 vars in 1196 bytes} [Sat Oct 22 03:07:08 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:07:08.108664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:08.111607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:08.119219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.120137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.120950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.122480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.123066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.124814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.253569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:08.272299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3462787-8042-4e34-9491-05c038899323 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action" status: 202 len: 0 microversion: 2.1 time: 0.154744 Oct 22 03:07:08.273200 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 381/776] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:07:08 2022] POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:07:08.280275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:08.281236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:08.288970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.289878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.290531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.291485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.293295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.294846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.593271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:08.602674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:08.604196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:08.606197 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-95625c19-2536-4ca8-893f-ee0cc7305fd6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1568 microversion: 2.25 time: 0.735561 Oct 22 03:07:08.607497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 396/777] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:07 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1568 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:08.613135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:08.627701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:08.632984 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f8193a7-1c3d-45ee-bd76-a0ab52258872 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1470 microversion: 2.1 time: 0.357004 Oct 22 03:07:08.633725 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 382/778] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:08 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:08.640039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:08.643125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:08.651992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:08.657259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.663184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.663767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.665138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.665929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.666074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.666560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.666728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.667293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.668152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.668152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.668588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.784954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:07:08.785454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:07:08.786008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:07:08.786419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:07:08.786828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:07:08.825650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:08.834593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:08.836366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:08.842290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-760babe9-a2e3-44d1-b4e8-04dfe4685afc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1560 microversion: 2.91 time: 0.218481 Oct 22 03:07:08.857067 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 397/779] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:08 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:08.870980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:08.872008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:08.878602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.879379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.881614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:08.890689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.891849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.892261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.892747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.893217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.893924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.894288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.894412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.894998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.895320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.945492 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db632c08-dcce-49b6-9cf0-8c5171a8de18 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action" status: 202 len: 1066 microversion: 2.1 time: 0.310595 Oct 22 03:07:08.946663 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 383/780] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:07:08 2022] POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action => generated 1066 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 03:07:08.952939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:08.954041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:08.969082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.969611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.970089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:08.970811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:08.971312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:08.971729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.043058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:09.058224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:09.066346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:09.069461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b40db11f-db3d-44cf-925b-80a44e1be3bb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b/action" status: 204 len: 0 microversion: 2.1 time: 0.121362 Oct 22 03:07:09.070628 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 384/781] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:07:08 2022] POST /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b/action => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:07:09.072462 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7b465763-4fc9-41d1-93dc-6a4f4134e6fa tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.213613 Oct 22 03:07:09.073682 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 398/782] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:08 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:09.078651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:09.079290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:09.079697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:09.080100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:09.086345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.087066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.087699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.087907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.090325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.091230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.091946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.092531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.092848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.095860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.097107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.097771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.274499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:09.282487 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35b43c57-5c7c-4bce-b6ab-d53bf450dd66 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.210292 Oct 22 03:07:09.286452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 385/783] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:09 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:09.293923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:09.294872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:09.303252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.303402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.303945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.304928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.305632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.306168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.535993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:09.548246 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c507334-4962-474e-a1fc-c03a1c339330 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1470 microversion: 2.1 time: 0.258397 Oct 22 03:07:09.549668 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 386/784] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:09 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:09.614833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:09.633861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:09.636299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:09.643881 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2451a52f-ad5f-4695-88b3-4171da84e763 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1470 microversion: 2.1 time: 0.568847 Oct 22 03:07:09.647067 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 399/785] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:09 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1470 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:09.661987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.662495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.662940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.663674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.664134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.668415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.878044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:09.880302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:09.894035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.896842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.897499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:09.900385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:09.901556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:09.905152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.048022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.057217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.070096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.077279 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-392c656e-299a-4f17-b6b1-f3ee67d6a139 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.205016 Oct 22 03:07:10.091344 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 400/786] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:09 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:10.105172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:10.105791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:10.133509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.140926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.141606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.142545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.143168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.143750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.204168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.217231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.219064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.221639 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a3d66c0b-0e4a-4928-9bc3-8277dd0d15d9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1543 microversion: 2.25 time: 0.591179 Oct 22 03:07:10.222426 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 387/787] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:09 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1543 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:10.252435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15728d3e-fff5-4971-b817-5614c4f2a10d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '.version_select at 0x7f0d1a466280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:10.257940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15728d3e-fff5-4971-b817-5614c4f2a10d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.262445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15728d3e-fff5-4971-b817-5614c4f2a10d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.283288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15728d3e-fff5-4971-b817-5614c4f2a10d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.317404 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15728d3e-fff5-4971-b817-5614c4f2a10d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.069928 Oct 22 03:07:10.319493 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 388/788] 10.222.0.25 () {60 vars in 1184 bytes} [Sat Oct 22 03:07:10 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:10.341512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:10.342438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:10.358057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.360125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.360586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.361226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.362123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.364655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.365303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.373601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.382618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:10.389587 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-53887b4c-065a-4fb5-93ed-3b188a15fe79 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.288856 Oct 22 03:07:10.390196 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 401/789] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:10 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:10.408682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:10.409312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:10.415625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.416117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.416612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.417999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.438437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.440247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.843635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid 1c61b591-09ae-4f8c-877a-972aefaf2591 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:10.871096 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73c0d0a9-ae11-4b9e-bf9f-8577bdcf2b52 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 2036 microversion: 2.25 time: 0.475545 Oct 22 03:07:10.876542 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 402/790] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:10 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 2036 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:10.892424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:10.893703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:10.899976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.903429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.903881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:10.908389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:10.908908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:10.909514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:11.018099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.030161 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8cc63f0d-3932-4098-b965-a1824cb9db42 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.703511 Oct 22 03:07:11.031245 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 389/791] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:10 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:11.036663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:11.037476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:11.044948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:11.045684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:11.046301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:11.047223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:11.047966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:11.048465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:11.235587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.238855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.248576 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a8065c4-a583-46bc-bf30-617600c70737 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1470 microversion: 2.1 time: 0.370856 Oct 22 03:07:11.249161 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 403/792] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:10 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:11.260680 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92304068-b214-4fdd-b141-7c21e40d5198 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1470 microversion: 2.1 time: 0.217936 Oct 22 03:07:11.260680 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 390/793] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:11 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:11.267270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f05902f-45a9-4696-8692-43bd87ebdaac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Action: 'create', calling method: .version_select at 0x7f0d1a939dc0>, body: {"keypair": {"name": "tempest-keypair-1759714454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5/ypk4IPNDEaWEvSklT+Upm6oLrs3mNqHQeSuxW3rSARYjoo1mD6+/RXbgJh1wxqXSv2woCqaBM8XMvcg2cuSzdwpfBunXq1uV2y9IvpF2QnrCBBtNv9ZqtiFVA4g4yg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:11.286926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:11.287554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:11.295809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:11.296752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:11.297436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:11.298353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:11.298978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:11.299625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:11.340366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9f05902f-45a9-4696-8692-43bd87ebdaac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for project e33669cd6c0040cda12f8063688eacc4. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:07:11.356271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9f05902f-45a9-4696-8692-43bd87ebdaac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for user 2868158117ea4f7797f9931a97bcedfd and project e33669cd6c0040cda12f8063688eacc4. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:07:11.457104 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f05902f-45a9-4696-8692-43bd87ebdaac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.203281 Oct 22 03:07:11.465412 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 391/794] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:07:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 03:07:11.480379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:11.481271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:11.506116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:11.506991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:11.507647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:11.508673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:11.509356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:11.510004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:11.682699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.693297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.704874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.716228 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-163eaa15-8957-449e-99a9-a9209fb69dd0 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.249344 Oct 22 03:07:11.736238 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 392/795] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:11 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:11.736456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.748895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.750603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:11.765394 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e9ef4d4-0f51-4182-b6c7-ed8b7a899eb5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.502589 Oct 22 03:07:11.784235 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 404/796] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:11 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:12.055745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:12.056758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:12.075855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:12.080614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:12.081073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:12.087883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:12.087883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:12.087883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:12.286922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:12.288192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:12.303631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:12.306943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:12.308100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:12.310865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:12.311534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:12.312426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:12.450162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:12.728420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:12.749198 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e797f1a-3169-4e3f-bd0a-6b4af2726b09 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.696571 Oct 22 03:07:12.750980 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 393/797] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:12 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:12.772592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:12.773411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:12.783613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:12.786660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:12.787308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:12.788547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:12.789262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:12.791070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:12.837961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:12.865253 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77bb831f-ed69-400f-a446-107632dda66a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1470 microversion: 2.1 time: 0.582131 Oct 22 03:07:12.865865 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 405/798] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:12 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1470 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:12.881230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-bb8273fb-8b87-4528-ac59-acc1145f8d65 req-15b53c25-f069-4042-a69d-5ce0039e50e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f275fc7f-8fe1-4e0c-b717-0889031f866b", "name": "network-vif-plugged", "status": "completed", "tag": "acdf2dde-8d5f-421c-be80-ccc69afad608"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:12.916288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bb8273fb-8b87-4528-ac59-acc1145f8d65 req-15b53c25-f069-4042-a69d-5ce0039e50e4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:12.922473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bb8273fb-8b87-4528-ac59-acc1145f8d65 req-15b53c25-f069-4042-a69d-5ce0039e50e4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:12.923234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bb8273fb-8b87-4528-ac59-acc1145f8d65 req-15b53c25-f069-4042-a69d-5ce0039e50e4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:12.963035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-bb8273fb-8b87-4528-ac59-acc1145f8d65 req-15b53c25-f069-4042-a69d-5ce0039e50e4 service nova] Creating event network-vif-plugged:acdf2dde-8d5f-421c-be80-ccc69afad608 for instance f275fc7f-8fe1-4e0c-b717-0889031f866b on n-h1-862416-2 Oct 22 03:07:12.985678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-bb8273fb-8b87-4528-ac59-acc1145f8d65 req-15b53c25-f069-4042-a69d-5ce0039e50e4 service nova] Instance f275fc7f-8fe1-4e0c-b717-0889031f866b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:07:13.017804 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-bb8273fb-8b87-4528-ac59-acc1145f8d65 req-15b53c25-f069-4042-a69d-5ce0039e50e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150668 Oct 22 03:07:13.030307 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 406/799] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:13.035888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:13.039807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:13.049153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:13.056919 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7abce2ee-9346-4052-a5b0-3164ed01cabb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1470 microversion: 2.1 time: 0.304497 Oct 22 03:07:13.058184 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 394/800] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:12 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:13.065294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:13.065800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:13.066235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:13.066951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:13.067408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:13.067835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:13.076790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:13.077406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:13.095690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:13.096191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:13.096664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:13.097389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:13.097841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:13.098256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:13.190549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:13.205024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:13.207119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:13.214086 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-17643a15-898e-404d-8301-8d5bd1c669cd tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.154294 Oct 22 03:07:13.218523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:13.231037 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 395/801] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:13 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:13.254189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:13.255870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:13.274338 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d7933a4f-340e-44c5-a0ed-865beb524f1f tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.242489 Oct 22 03:07:13.275652 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 407/802] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:13 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:13.780141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:13.781092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:13.810890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:13.812354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:13.815189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:13.820100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:13.820920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:13.821608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:13.896643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:13.897352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:13.905483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:13.908737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:13.909584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:13.910409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:13.911187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:13.911848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:14.209182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.213515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:14.225062 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92fb075b-50a3-4b6d-97bd-3c3cfab66355 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.451752 Oct 22 03:07:14.241671 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 396/803] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:13 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:14.251826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:14.252849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:14.260979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:14.261815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:14.262638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:14.263888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:14.264552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:14.265171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:14.342090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.350340 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f3de8b9d-4f35-4795-b39d-4d019d19e9d9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1470 microversion: 2.1 time: 0.459230 Oct 22 03:07:14.360841 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 408/804] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:13 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:14.386350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:14.388640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:14.409250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:14.410061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:14.410747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:14.411683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:14.412383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:14.413026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:14.553784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.566425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.574757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.586138 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-df56eeb4-6037-44c0-b8e3-b9d812b94d24 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.211650 Oct 22 03:07:14.586997 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 409/805] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:14 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:14.600734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:14.601824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:14.614298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:14.615176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:14.617579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:14.622732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:14.623234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:14.623776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:14.708476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.722753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63ddb311-44e9-4b0e-9ce9-2922c5e6b71c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1462 microversion: 2.1 time: 0.479543 Oct 22 03:07:14.723359 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 397/806] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:14 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1462 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:14.752830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.759106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:14.759723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:14.767452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.770364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:14.792330 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38fca6c0-3b36-40a2-a893-44314a192fec tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.203731 Oct 22 03:07:14.796776 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 410/807] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:14 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:14.797324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:14.797711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:14.798176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:14.799035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:14.799401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:14.799834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.037195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-36aab9af-d573-4e7d-83c0-a7bc04d61675 req-ad520375-2b75-4704-bb88-ed2a53357f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593d2c59-795e-4dc7-8200-56b449d7b066", "name": "network-vif-plugged", "status": "completed", "tag": "1073dea1-b453-42fd-b459-d11d3ff92c57"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:15.054889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-36aab9af-d573-4e7d-83c0-a7bc04d61675 req-ad520375-2b75-4704-bb88-ed2a53357f48 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:15.062145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-36aab9af-d573-4e7d-83c0-a7bc04d61675 req-ad520375-2b75-4704-bb88-ed2a53357f48 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:15.062867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-36aab9af-d573-4e7d-83c0-a7bc04d61675 req-ad520375-2b75-4704-bb88-ed2a53357f48 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.092892 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-36aab9af-d573-4e7d-83c0-a7bc04d61675 req-ad520375-2b75-4704-bb88-ed2a53357f48 service nova] Creating event network-vif-plugged:1073dea1-b453-42fd-b459-d11d3ff92c57 for instance 593d2c59-795e-4dc7-8200-56b449d7b066 on n-h2-862416-2 Oct 22 03:07:15.101292 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9efebcfb-b445-49c4-a51a-c441f73cd1e7 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1613 microversion: 2.1 time: 0.353622 Oct 22 03:07:15.104993 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 398/808] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:14 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1613 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:15.108108 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-36aab9af-d573-4e7d-83c0-a7bc04d61675 req-ad520375-2b75-4704-bb88-ed2a53357f48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074610 Oct 22 03:07:15.110613 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 411/809] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:07:15.134885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe30bcc5-2f6d-4bd0-adcf-ea422580e1a2 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '.version_select at 0x7f0d1a4d04c0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:15.139858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe30bcc5-2f6d-4bd0-adcf-ea422580e1a2 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:15.149066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe30bcc5-2f6d-4bd0-adcf-ea422580e1a2 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:15.149786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe30bcc5-2f6d-4bd0-adcf-ea422580e1a2 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.166037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe30bcc5-2f6d-4bd0-adcf-ea422580e1a2 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.034973 Oct 22 03:07:15.174334 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 399/810] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:07:15 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:15.256173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:15.257860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:15.268829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:15.269334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:15.282215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.283105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:15.283594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:15.289934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.328866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1197932161", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:15.457064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:07:15.627742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:15.631383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:15.636347 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8119ca9b-be62-4e64-b38e-005ca8c1f48a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.384359 Oct 22 03:07:15.650781 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 412/811] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:15 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:15.662091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:15.662711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:15.694172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:15.695030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:15.703364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.722886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:15.723499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:15.723950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.903399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:07:15.903945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:07:15.904481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:07:15.907200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:07:15.907829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:07:15.928029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:15.928639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:15.929088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.931366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:15.933918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:15.934762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:15.963401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:15.968659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:07:15.974460 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd2a6883-718c-4a9e-a99c-2155a2c8087e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1470 microversion: 2.1 time: 0.320101 Oct 22 03:07:15.984381 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 413/812] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:15 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:15.991947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:15.997212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:15.998287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for user 7bf9da8e55124a7aae0938bb828b8f8a and project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:07:16.009946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:16.013265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:16.013722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:16.014493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:16.014947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:16.015380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:16.032705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:07:16.035723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:07:16.103026 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc652aa6-5a46-4a8f-9a48-4086212db081 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774552 Oct 22 03:07:16.104960 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 400/813] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:07:16.163897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:16.181986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:16.192374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:16.209298 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b68973f-730b-4e84-9a6d-b561fde8f3b3 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.217798 Oct 22 03:07:16.228680 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 414/814] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:15 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:16.243172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:16.245089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:16.264764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:16.267501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:16.268232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:16.271356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:16.272116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:16.275519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:16.448034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:16.458954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:16.469267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8301c425-0906-4107-886d-88853872fefa tempest-FloatingIPDetailsNegativeTestJSON-498760450 tempest-FloatingIPDetailsNegativeTestJSON-498760450-project] Calling method '.version_select at 0x7f0d1a4ce310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:16.471992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:16.493294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:16.496642 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-463b954c-9f83-4616-b988-ae4209412be7 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.259099 Oct 22 03:07:16.505159 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 415/815] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:16 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:16.511592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1750811444", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "88c94f0e-626b-4b04-b426-00fe37fe6119"}], "security_groups": [{"name": "tempest-securitygroup--1265979114"}], "key_name": "tempest-keypair-1759714454", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:16.585013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-8301c425-0906-4107-886d-88853872fefa tempest-FloatingIPDetailsNegativeTestJSON-498760450 tempest-FloatingIPDetailsNegativeTestJSON-498760450-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f3701546-af40-4231-8535-6f9cdc1e5285 could not be found", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:07:16.585713 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-8301c425-0906-4107-886d-88853872fefa tempest-FloatingIPDetailsNegativeTestJSON-498760450 tempest-FloatingIPDetailsNegativeTestJSON-498760450-project] HTTP exception thrown: Floating IP not found for ID f3701546-af40-4231-8535-6f9cdc1e5285 Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8301c425-0906-4107-886d-88853872fefa tempest-FloatingIPDetailsNegativeTestJSON-498760450 tempest-FloatingIPDetailsNegativeTestJSON-498760450-project] Request method failure captured: Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-floating-ips/f3701546-af40-4231-8535-6f9cdc1e5285 HTTP/1.1 Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU15jWDdpBG1FnBaoxYz8Ty9-IYiHJtSI96bJ5JK2vim4ADxM9JF-dlNy4NqF4pKN1cihUhKSpQq9RiMNDbjhHvpkEc6dWnl7gpKJ4JNnIuoZIY1bDgfOT1o14ljc83_B2SAi9eB0hhKi3jHYuHo9_uNKiNzxFQ1-EtAKNJcWTnLxsew Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 364b001d247a41c19108b76a799144c3 Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-498760450 Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:07:16.599132 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_364b001d247a41c19108b76a799144c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/364b001d247a41c19108b76a799144c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/364b001d247a41c19108b76a799144c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/364b001d247a41c19108b76a799144c3"}]}] Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-498760450 Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 364b001d247a41c19108b76a799144c3 Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-498760450 Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-498760450-project Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 99b3121f46bb4343b39fd4d9df4e32f1 Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-498760450-project Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: exception: Floating IP not found for ID f3701546-af40-4231-8535-6f9cdc1e5285 Oct 22 03:07:16.600824 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f3701546-af40-4231-8535-6f9cdc1e5285'} Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:07:16.601552 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f3701546-af40-4231-8535-6f9cdc1e5285 could not be found Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b586682-471f-43c5-b522-589b40aa86f6'] Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f3701546-af40-4231-8535-6f9cdc1e5285. Oct 22 03:07:16.602714 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f3701546-af40-4231-8535-6f9cdc1e5285 Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:07:16.603849 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:07:16.605707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:07:16.605707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f3701546-af40-4231-8535-6f9cdc1e5285 Oct 22 03:07:16.605707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:07:16.606962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8301c425-0906-4107-886d-88853872fefa tempest-FloatingIPDetailsNegativeTestJSON-498760450 tempest-FloatingIPDetailsNegativeTestJSON-498760450-project] Returning 404 to user: Floating IP not found for ID f3701546-af40-4231-8535-6f9cdc1e5285 {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:07:16.607987 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8301c425-0906-4107-886d-88853872fefa tempest-FloatingIPDetailsNegativeTestJSON-498760450 tempest-FloatingIPDetailsNegativeTestJSON-498760450-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/f3701546-af40-4231-8535-6f9cdc1e5285" status: 404 len: 111 microversion: 2.1 time: 0.501833 Oct 22 03:07:16.609147 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 401/816] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:07:16 2022] GET /compute/v2.1/os-floating-ips/f3701546-af40-4231-8535-6f9cdc1e5285 => generated 111 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:07:16.616412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96726a26-b2fd-459a-bcbd-7aae7ad197a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:16.617666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-96726a26-b2fd-459a-bcbd-7aae7ad197a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:16.727635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-96726a26-b2fd-459a-bcbd-7aae7ad197a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:16.736001 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96726a26-b2fd-459a-bcbd-7aae7ad197a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1213 microversion: 2.1 time: 0.125896 Oct 22 03:07:16.739420 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 402/817] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:16 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:16.744128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:16.753707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:16.768339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:16.768998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:16.769444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:16.770361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:16.770883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:16.771421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:16.958358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:16.971224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] validate_networks() for [('88c94f0e-626b-4b04-b426-00fe37fe6119', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:07:17.001114 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac9ddec0-f620-4504-bf72-57f09592df06 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1367 microversion: 2.1 time: 0.258290 Oct 22 03:07:17.002889 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 403/818] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:16 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:17.012506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:17.013943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:17.022647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:17.023407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:17.024231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:17.030209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:17.031546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:17.032963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:17.332458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:17.343060 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-762d2593-9d3c-4325-a20d-671a3dcc164d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1470 microversion: 2.1 time: 0.338776 Oct 22 03:07:17.354324 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 404/819] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:17 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1470 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:17.359707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:17.360560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:17.373113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:17.373984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:17.374901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:17.375806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:17.376537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:17.377137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:17.526421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:17.542888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:17.544903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:17.566202 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c65c9f99-4bc2-4ed6-a82d-2f961d01ecdc tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.210469 Oct 22 03:07:17.567007 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 405/820] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:17 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:17.572237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:17.577710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:17.598129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:17.598771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:17.599219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:17.600097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:17.600832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:17.601272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:17.753558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:17.770253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:17.778977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:17.806907 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f2f1914-3b46-46cd-9e24-943168fa1d92 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.238605 Oct 22 03:07:17.812551 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 406/821] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:17 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:17.832521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:17.835238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:17.864092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:17.864876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:17.865414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:17.868425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:17.868872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:17.869536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.033773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:18.054601 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eab6577a-0aac-4fc6-a324-6dad460733b1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1265 microversion: 2.1 time: 0.238147 Oct 22 03:07:18.055110 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 407/822] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:17 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:18.085404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:18.086280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:18.106335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:18.106828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:18.107280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.121936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:18.122756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:18.124744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.266259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:07:18.267323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:07:18.267950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:07:18.268608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:07:18.269231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:07:18.282604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:18.284643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:18.285316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.286244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:18.286868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:18.287459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.310749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for project e33669cd6c0040cda12f8063688eacc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:07:18.317578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for user 2868158117ea4f7797f9931a97bcedfd and project e33669cd6c0040cda12f8063688eacc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:07:18.336309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:07:18.341785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:07:18.403042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:18.415395 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-71748fe7-6a6a-4e9c-b8c1-c4a0d933137c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1558 microversion: 2.1 time: 0.347425 Oct 22 03:07:18.452591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c156db2d-4300-4c8e-a86a-d58736135144 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.941826 Oct 22 03:07:18.460349 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 416/823] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:07:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:07:18.465994 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 408/824] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:18 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1558 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:18.469106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:18.475809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:18.481227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:18.488668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:18.491233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:18.492603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:18.495819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.496898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:18.497785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:18.498476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.504923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:18.505424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:18.505867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.528236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:18.532506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:18.533000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:18.752312 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a940c5fd-d5d7-4b0d-88fb-cde822a6897e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.284382 Oct 22 03:07:18.762151 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 409/825] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:07:18 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-interface => generated 285 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:18.769110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55dbaeea-8dd6-40ae-92fe-42ae84430872 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:18.769719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55dbaeea-8dd6-40ae-92fe-42ae84430872 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:18.790382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:18.926076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55dbaeea-8dd6-40ae-92fe-42ae84430872 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:18.958229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55dbaeea-8dd6-40ae-92fe-42ae84430872 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:18.966757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55dbaeea-8dd6-40ae-92fe-42ae84430872 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:18.972621 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55dbaeea-8dd6-40ae-92fe-42ae84430872 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1286 microversion: 2.25 time: 0.207408 Oct 22 03:07:18.988239 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 410/826] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:18 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:18.988239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:18.988239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:19.018224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:19.018224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:19.022560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:19.023413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:19.023899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:19.024396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:19.220235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:19.238387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:19.241298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:19.255842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:19.288076 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e129bc73-42b9-4efb-b1d5-5b557f3f0d34 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.310034 Oct 22 03:07:19.288719 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 411/827] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:18 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:19.302306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:19.302951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:19.310868 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a57f26ee-5acf-4b2c-bd17-9f0e384d3563 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1470 microversion: 2.1 time: 0.849205 Oct 22 03:07:19.319589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:19.320784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:19.323812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:19.325422 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 417/828] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:18 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1470 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:19.334888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:19.335558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:19.335964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:19.339464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:19.341253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:19.361801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:19.362570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:19.363213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:19.366035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:19.366694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:19.367296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:19.582710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:19.600177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:19.604083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:19.626656 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a29dfaf1-2ec9-47c5-8607-6bf0d462dffd tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1447 microversion: 2.75 time: 0.336161 Oct 22 03:07:19.631614 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 412/829] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:19 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1447 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:19.683419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:19.700994 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5659bc40-f33c-4e01-b0b5-62cabfd8eb7a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1271 microversion: 2.1 time: 0.374325 Oct 22 03:07:19.706499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 418/830] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:19 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1271 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:20.003370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:20.003994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:20.014761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.015250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.022349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.023385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.027349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.028095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.235791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.248228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.250266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.251867 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da245967-144c-4b78-a18c-00e8bb0ae4b2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1282 microversion: 2.25 time: 0.254064 Oct 22 03:07:20.253430 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 413/831] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:19 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:20.323601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:20.324568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:20.339548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:20.340162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:20.348681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.349235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.349685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.350659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.351132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.351567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.355574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.356079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.373659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.374577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.375144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.375508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.651687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.672518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.673998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.685342 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2a0a1021-873f-4a8e-af16-5205df53a415 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.366257 Oct 22 03:07:20.696590 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 419/832] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:20 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:20.711017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:20.712454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:20.733887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.738222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.738983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.742457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.743253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.743942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.907666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.924072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.927495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:20.944367 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab8e4bcd-0e16-449d-9454-7695a576ed7d tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1465 microversion: 2.75 time: 0.246263 Oct 22 03:07:20.947507 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 420/833] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:20 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1465 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:20.958182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:20.959466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:20.988159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.988769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.989211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:20.989934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:20.990631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:20.990810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:21.278365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:21.297158 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4096de3c-f035-40fe-8f75-b01e97f8b2a7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1470 microversion: 2.1 time: 0.961948 Oct 22 03:07:21.300981 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 414/834] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:20 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1470 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:21.320679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:21.328857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:21.343867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:21.344454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:21.344898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:21.346201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:21.346661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:21.347856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:21.505231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:21.523560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:21.525052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:21.526463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c559355-a3dd-44bf-8457-5a7f24f18b89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1346 microversion: 2.25 time: 0.222928 Oct 22 03:07:21.527714 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 415/835] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:21 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1346 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:21.727281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:21.727892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:21.752382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:21.752963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:21.753347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:21.757666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:21.758160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:21.759738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:21.822468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:21.851409 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47c3fdfa-e487-4ae0-bf18-2c6e32a737ba tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.883775 Oct 22 03:07:21.852065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 421/836] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:20 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:21.978168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:21.979282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:21.989788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:21.990654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:21.991320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:21.992380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:21.993144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:21.993834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:22.028621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.039875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.042466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.059229 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-70dd497f-1495-40aa-bfa2-a4a7fe83a622 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.336388 Oct 22 03:07:22.067897 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 416/837] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:21 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:22.326654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:22.327339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:22.349453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:22.350779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:22.351573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:22.352589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:22.353652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:22.356371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:22.367534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.389735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.394458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.408485 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c6cc1b48-9056-4fc8-863d-e1ccb8b29338 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1453 microversion: 2.75 time: 0.434430 Oct 22 03:07:22.412529 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 422/838] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:21 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1453 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:22.552949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:22.553554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:22.570718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:22.574487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:22.575090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:22.575842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:22.576324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:22.576957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:22.711761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.746716 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ddc8a160-b2e7-4e26-b811-1053d21bed5e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1488 microversion: 2.1 time: 0.425215 Oct 22 03:07:22.750502 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 417/839] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:22 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1488 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:22.754176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.765995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.767447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:22.768603 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d1ea5f60-4754-466e-bb4f-81ff9e54221c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1344 microversion: 2.25 time: 0.219743 Oct 22 03:07:22.769678 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 423/840] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:22 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1344 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:22.876717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:22.877868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:22.887740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:22.888752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:22.889454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:22.890403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:22.891131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:22.891778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:22.898205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:23.012823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6bde8b52-b391-4d76-bb92-8ef05736b60f req-a95616af-76f9-46a2-80df-b44635e56e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a5235e-8a3c-4605-b8dd-8b4d246ff46f", "tag": "0c0d9fca-9ee1-400e-beab-4f911a49fd8d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:23.035505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6bde8b52-b391-4d76-bb92-8ef05736b60f req-a95616af-76f9-46a2-80df-b44635e56e21 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:23.040872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6bde8b52-b391-4d76-bb92-8ef05736b60f req-a95616af-76f9-46a2-80df-b44635e56e21 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:23.042224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6bde8b52-b391-4d76-bb92-8ef05736b60f req-a95616af-76f9-46a2-80df-b44635e56e21 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:23.065558 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6bde8b52-b391-4d76-bb92-8ef05736b60f req-a95616af-76f9-46a2-80df-b44635e56e21 service nova] Creating event network-changed:0c0d9fca-9ee1-400e-beab-4f911a49fd8d for instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f on n-h2-862416-2 Oct 22 03:07:23.084366 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6bde8b52-b391-4d76-bb92-8ef05736b60f req-a95616af-76f9-46a2-80df-b44635e56e21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065078 Oct 22 03:07:23.085717 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 424/841] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:07:23.093309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-68781f7f-e0df-41cd-a457-a76fb1a32c8d req-6ba423fc-c829-4b8f-b839-e9343c40c2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593d2c59-795e-4dc7-8200-56b449d7b066", "tag": "1073dea1-b453-42fd-b459-d11d3ff92c57"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:23.105097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-68781f7f-e0df-41cd-a457-a76fb1a32c8d req-6ba423fc-c829-4b8f-b839-e9343c40c2e0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:23.105955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-68781f7f-e0df-41cd-a457-a76fb1a32c8d req-6ba423fc-c829-4b8f-b839-e9343c40c2e0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:23.106629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-68781f7f-e0df-41cd-a457-a76fb1a32c8d req-6ba423fc-c829-4b8f-b839-e9343c40c2e0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:23.122816 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-68781f7f-e0df-41cd-a457-a76fb1a32c8d req-6ba423fc-c829-4b8f-b839-e9343c40c2e0 service nova] Creating event network-changed:1073dea1-b453-42fd-b459-d11d3ff92c57 for instance 593d2c59-795e-4dc7-8200-56b449d7b066 on n-h2-862416-2 Oct 22 03:07:23.131728 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-68781f7f-e0df-41cd-a457-a76fb1a32c8d req-6ba423fc-c829-4b8f-b839-e9343c40c2e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044064 Oct 22 03:07:23.133080 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 425/842] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:23.138905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:23.139985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:23.146544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:23.148085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:23.148820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:23.150211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:23.150945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:23.151714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:23.376632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:23.394173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:23.404249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:23.423089 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4876c2eb-c719-4feb-8cf7-601c45927aff tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.288535 Oct 22 03:07:23.447566 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 426/843] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:23 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:23.452983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:23.457131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:23.469556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:23.472583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:23.473313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:23.476668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:23.478225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:23.479655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:23.496585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:23.517612 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ed3e80b-e7eb-4d66-acbd-cea4e6d43724 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.635218 Oct 22 03:07:23.531720 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 418/844] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:22 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:23.775352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:23.776745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:23.786836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:23.794125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:23.794835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:23.799184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:23.799870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:23.800540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:23.934350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:23.951427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:23.954035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:23.967325 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-53e8aac8-69eb-4acf-8a2d-68df72afeac2 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1453 microversion: 2.75 time: 0.518065 Oct 22 03:07:23.988887 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 427/845] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:23 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1453 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:23.999427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:24.001994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:24.020962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:24.029407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:24.030077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:24.030840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:24.031416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:24.031985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:24.325651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:24.336870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c828d3e-091e-42ed-9346-81c9887ad688 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1476 microversion: 2.1 time: 0.565513 Oct 22 03:07:24.337554 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 419/846] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:23 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1476 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:24.455394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:24.456353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:24.471568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:24.472073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:24.472561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:24.473293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:24.473757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:24.476925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:24.498672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:24.508026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:24.509722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:24.513099 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8958f0c7-1b4b-4fd5-9af5-2fe33607369b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1344 microversion: 2.25 time: 0.518837 Oct 22 03:07:24.514015 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 428/847] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:23 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1344 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:24.547452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:24.548480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:24.563696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:24.567778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:24.569429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:24.571026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:24.572251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:24.573721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:24.575515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:24.597490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:24.605387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:24.612807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2cf8bfc2-5e8c-4469-a097-cb2818042e36 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.161232 Oct 22 03:07:24.627690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 420/848] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:24 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:24.889605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:24.897628 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-874427d8-904b-4494-9081-d74226a6eecb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.353958 Oct 22 03:07:24.907008 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 429/849] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:24 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:25.004943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:25.006481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:25.017373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.018183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.019146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.020036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.021049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.021627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.214914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.232524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.237063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.267269 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b215e7b-8d75-473b-91fd-063c4c7f8558 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1453 microversion: 2.75 time: 0.267694 Oct 22 03:07:25.268481 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 421/850] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:24 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1453 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:25.365649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:25.366324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:25.384614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.400339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.416436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.420850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.421567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.422169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.544758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:25.546006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:25.557530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.564257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.565240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.566657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.568486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.569168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.696644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.705292 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d48368b6-6e33-4fa2-b173-9b0808920c00 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1476 microversion: 2.1 time: 0.345674 Oct 22 03:07:25.705878 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 430/851] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:25 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:25.713669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:25.714821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:25.721735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.722424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.723058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.724417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.725048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.725905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.751517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:25.812349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.827721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.829611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.835935 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f135972d-d4b3-4e87-99f6-a0e06e675c54 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.128725 Oct 22 03:07:25.837129 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 431/852] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:25 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:25.897663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.909005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.910543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:25.913785 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d386af83-2a7f-45e1-9612-1ee09df2ff8f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.375309 Oct 22 03:07:25.928835 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 422/853] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:25 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:25.935235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:25.935880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:25.945537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.946038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.946475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:25.947197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:25.955994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:25.956667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:26.082155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f7ef2320-1d2d-4755-b424-ff9eab3f85d3 req-348aa9c6-7039-4800-a25a-0ddac11ddefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896b7177-4fd2-47b7-866b-4f7cb6ea78aa", "name": "network-vif-unplugged", "status": "completed", "tag": "c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:26.099053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=30 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:26.108422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f7ef2320-1d2d-4755-b424-ff9eab3f85d3 req-348aa9c6-7039-4800-a25a-0ddac11ddefc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:26.108910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f7ef2320-1d2d-4755-b424-ff9eab3f85d3 req-348aa9c6-7039-4800-a25a-0ddac11ddefc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:26.109351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f7ef2320-1d2d-4755-b424-ff9eab3f85d3 req-348aa9c6-7039-4800-a25a-0ddac11ddefc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:26.144150 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f7ef2320-1d2d-4755-b424-ff9eab3f85d3 req-348aa9c6-7039-4800-a25a-0ddac11ddefc service nova] Creating event network-vif-unplugged:c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c for instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa on n-h1-862416-2 Oct 22 03:07:26.165580 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f7ef2320-1d2d-4755-b424-ff9eab3f85d3 req-348aa9c6-7039-4800-a25a-0ddac11ddefc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084881 Oct 22 03:07:26.167839 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 423/854] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:26.222669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:26.239872 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e1e9f7c-2b53-4eb8-a7e3-e9bf948ec929 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.308013 Oct 22 03:07:26.241261 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 432/855] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:25 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:26.302012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:26.302714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:26.314185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:26.319005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:26.320627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:26.322636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:26.324476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:26.326451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:26.447563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:26.468986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:26.470840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:26.477495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-54d2fc3d-b530-40b0-826e-aa5332694ad6 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1438 microversion: 2.75 time: 0.180347 Oct 22 03:07:26.478448 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 424/856] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:26 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1438 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:26.676131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:26.679007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:26.690730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:26.694698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:26.695247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:26.702218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:26.702805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:26.703323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:26.738659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:26.738878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:26.757911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:26.764943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:26.771683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:26.777104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:26.777913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:26.778585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:26.956192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:07:26.956893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:07:26.957546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:07:26.958122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:07:26.958853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:07:27.114874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:27.121112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.121614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.122218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.123245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.123867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.124490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.258594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:27.283586 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83077aa5-9a6d-446c-b104-fa91494965e6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f/action" status: 202 len: 1942 microversion: 2.75 time: 0.779320 Oct 22 03:07:27.284654 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 433/857] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:07:26 2022] POST /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f/action => generated 1942 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 03:07:27.301928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:27.302965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:27.311393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.312145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.312750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.313765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.314335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.314881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.391070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:27.402633 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6bdafcc3-842e-460c-bb7b-0ee72bd8b2f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1476 microversion: 2.1 time: 0.671025 Oct 22 03:07:27.406504 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 425/858] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:26 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1476 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:27.411460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:27.428717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:27.440961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.441467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.442008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.442712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.443171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.443583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.476694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:27.490919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:27.492462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:27.510679 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d9fe3b7-8ced-447a-bc5c-6a1614d4ba1f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.218306 Oct 22 03:07:27.511581 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 434/859] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:27 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:27.516578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:27.517392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:27.529142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.530170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.530967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.533047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.533671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.534433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.891567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:27.895618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:27.903347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:27.904824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:27.905951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6154ede0-843b-4fbd-846b-883301a809b3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.498277 Oct 22 03:07:27.912749 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dfc4c36d-4d3d-4193-a14b-557fafa0fc33 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.399724 Oct 22 03:07:27.918598 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 426/860] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:27 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:27.921873 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 435/861] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:27 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:27.928450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:27.941402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:27.974213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.986203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.987038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:27.988040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:27.988807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:27.989462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.203019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:28.235185 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-62605aca-027b-437e-9c55-d6d562ce60a7 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.315291 Oct 22 03:07:28.236446 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 427/862] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:27 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:28.346317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-eea15c19-5a79-4e21-8b68-c72f0300a4a7 req-22fbd26e-caa2-43bf-a963-0c18490f5ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a218e3e3-6082-4b65-8edb-b406c7cd582f", "tag": "b0191679-9c81-4ff7-8391-549473bf995c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:28.355513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:28.360583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:28.392365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eea15c19-5a79-4e21-8b68-c72f0300a4a7 req-22fbd26e-caa2-43bf-a963-0c18490f5ab6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.402220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eea15c19-5a79-4e21-8b68-c72f0300a4a7 req-22fbd26e-caa2-43bf-a963-0c18490f5ab6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.403192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eea15c19-5a79-4e21-8b68-c72f0300a4a7 req-22fbd26e-caa2-43bf-a963-0c18490f5ab6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.430935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:28.432746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:28.435867 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-eea15c19-5a79-4e21-8b68-c72f0300a4a7 req-22fbd26e-caa2-43bf-a963-0c18490f5ab6 service nova] Creating event network-changed:b0191679-9c81-4ff7-8391-549473bf995c for instance a218e3e3-6082-4b65-8edb-b406c7cd582f on n-h2-862416-2 Oct 22 03:07:28.443261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.449558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.451528 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-eea15c19-5a79-4e21-8b68-c72f0300a4a7 req-22fbd26e-caa2-43bf-a963-0c18490f5ab6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109180 Oct 22 03:07:28.452491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.453433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.454254 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 436/863] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:28.455000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.455596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.548151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:28.549356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:28.563074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.563948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.564688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.565719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.566538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.568080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.773590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:28.790138 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-022e505c-5847-41de-b24a-aea8c0ac8335 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1476 microversion: 2.1 time: 0.361908 Oct 22 03:07:28.791027 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 428/864] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:28 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1476 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:28.811718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e7035e78-fd48-4a9b-a67c-4858aea4c516 req-e5bfaa14-3e50-4803-a1a6-54b2c880c86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896b7177-4fd2-47b7-866b-4f7cb6ea78aa", "name": "network-vif-plugged", "status": "completed", "tag": "c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:28.825453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:28.847737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:28.849261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:28.863135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e7035e78-fd48-4a9b-a67c-4858aea4c516 req-e5bfaa14-3e50-4803-a1a6-54b2c880c86c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.865229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e7035e78-fd48-4a9b-a67c-4858aea4c516 req-e5bfaa14-3e50-4803-a1a6-54b2c880c86c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.866590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e7035e78-fd48-4a9b-a67c-4858aea4c516 req-e5bfaa14-3e50-4803-a1a6-54b2c880c86c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.871560 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-71cfc1cc-6328-4661-a654-4ce858cad585 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.327699 Oct 22 03:07:28.889219 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 437/865] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:28 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:28.907251 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e7035e78-fd48-4a9b-a67c-4858aea4c516 req-e5bfaa14-3e50-4803-a1a6-54b2c880c86c service nova] Creating event network-vif-plugged:c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c for instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa on n-h1-862416-2 Oct 22 03:07:28.917928 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e7035e78-fd48-4a9b-a67c-4858aea4c516 req-e5bfaa14-3e50-4803-a1a6-54b2c880c86c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124085 Oct 22 03:07:28.918546 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 429/866] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:28.938885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:28.940403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:28.950034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.950725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.951334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.952284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.952913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.953653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.960258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=17 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:28.965690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:28.966498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:28.986073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.991323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.991897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:28.992756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:28.993303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:28.993740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:29.327906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:29.347038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-094740ba-e45a-4109-8cab-a4476590b294 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.412059 Oct 22 03:07:29.347622 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 438/867] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:28 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:29.356228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:29.360681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:29.371494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:29.375251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:29.382483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:29.383016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:29.383797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:29.384242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:29.384400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:29.384857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:29.385846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:29.387148 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-669b912e-3e99-4e38-82d6-ab0274d8a226 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.427859 Oct 22 03:07:29.387848 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 430/868] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:28 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:29.518098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:29.538371 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d916fdc-7b43-49a1-b99e-3e4b1d9669b2 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.188168 Oct 22 03:07:29.556317 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 439/869] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:29 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:29.819856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:29.820596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:29.835626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:29.838607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:29.841000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:29.843725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:29.844187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:29.845764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:29.905721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:29.906482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:29.919655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:29.920189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:29.921029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:29.921801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:29.922307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:29.922761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:30.045249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:30.058112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:30.059572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:30.069207 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e199fa84-0f1d-42cd-b7a3-eb901069839f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.167024 Oct 22 03:07:30.073908 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 440/870] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:29 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:30.090998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:30.101891 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1cce41d3-9e9e-4904-891e-82e1305f78bb tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1476 microversion: 2.1 time: 0.285932 Oct 22 03:07:30.118218 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 431/871] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:29 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:30.375043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:30.376031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:30.382455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:30.383155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:30.383772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:30.384505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:30.385356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:30.385945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:30.417127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:30.417920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:30.427865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:30.431518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:30.432425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:30.433559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:30.434822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:30.436870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:30.623452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:30.635863 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2180427e-f2cc-4360-b7a2-2116861f9024 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.264653 Oct 22 03:07:30.639211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:30.656826 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 441/872] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:30 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:30.663299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:30.665000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:30.666258 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3f82b2b-8747-4c54-a3e0-ce77a6f2538e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.253932 Oct 22 03:07:30.668845 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 432/873] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:30 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:30.679521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:30.683667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:30.697116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:30.698506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:30.699123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:30.699837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:30.700353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:30.700759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:30.788548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:30.807885 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea5b5ae1-6742-476d-a401-66fc32886c91 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.149530 Oct 22 03:07:30.809264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 442/874] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:30 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:30.979715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c86ed0e9-15b4-4c1d-adde-e106ec340485 tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Calling method '.version_select at 0x7f0d1a4bb670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:30.996055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86ed0e9-15b4-4c1d-adde-e106ec340485 tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:30.996858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86ed0e9-15b4-4c1d-adde-e106ec340485 tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:30.997474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86ed0e9-15b4-4c1d-adde-e106ec340485 tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:30.999269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86ed0e9-15b4-4c1d-adde-e106ec340485 tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.000082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86ed0e9-15b4-4c1d-adde-e106ec340485 tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.000712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86ed0e9-15b4-4c1d-adde-e106ec340485 tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.048651 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c86ed0e9-15b4-4c1d-adde-e106ec340485 tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.215861 Oct 22 03:07:31.049825 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 433/875] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Oct 22 03:07:30 2022] GET /compute/v2.1/limits => generated 511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:31.103884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:31.106157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:31.127283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:31.128422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:31.130869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:31.133963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.135701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.136812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.138290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.141092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.143495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.149831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.152884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.153328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.156025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.156723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.157301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.243659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:31.253220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:31.254672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:31.261872 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8dccf4f3-3ca6-401e-b816-8f1eea561f64 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.163559 Oct 22 03:07:31.262998 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 443/876] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:31 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:31.267684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b02adbe7-0b44-4256-bfd0-cf3f55a7c9df tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1824088590", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:31.339585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b02adbe7-0b44-4256-bfd0-cf3f55a7c9df tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:07:31.348763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:31.360751 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-826728cd-9f71-465a-a12d-f7254ff9fad5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1462 microversion: 2.1 time: 0.238486 Oct 22 03:07:31.361595 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 434/877] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:31 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1462 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:31.378489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-57b235fb-7587-4d50-a3c9-b4b642115ecd req-21d122cd-c5dc-4182-99e6-6f7750cd6c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a5235e-8a3c-4605-b8dd-8b4d246ff46f", "name": "network-vif-plugged", "status": "completed", "tag": "0c0d9fca-9ee1-400e-beab-4f911a49fd8d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:31.390256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57b235fb-7587-4d50-a3c9-b4b642115ecd req-21d122cd-c5dc-4182-99e6-6f7750cd6c4d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.391041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57b235fb-7587-4d50-a3c9-b4b642115ecd req-21d122cd-c5dc-4182-99e6-6f7750cd6c4d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.391832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57b235fb-7587-4d50-a3c9-b4b642115ecd req-21d122cd-c5dc-4182-99e6-6f7750cd6c4d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.406211 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-57b235fb-7587-4d50-a3c9-b4b642115ecd req-21d122cd-c5dc-4182-99e6-6f7750cd6c4d service nova] Creating event network-vif-plugged:0c0d9fca-9ee1-400e-beab-4f911a49fd8d for instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f on n-h2-862416-2 Oct 22 03:07:31.413323 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-57b235fb-7587-4d50-a3c9-b4b642115ecd req-21d122cd-c5dc-4182-99e6-6f7750cd6c4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042945 Oct 22 03:07:31.414336 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 435/878] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:31.420624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:31.421642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:31.428830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.429324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.429770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.430471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.430932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.431358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.594875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:31.601327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b02adbe7-0b44-4256-bfd0-cf3f55a7c9df tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Getting quotas for project 8722d39998594909b366f5976ee6ed2d. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:07:31.604334 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-050a8f80-4c61-4cba-9862-9447e0e4813e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1462 microversion: 2.1 time: 0.188385 Oct 22 03:07:31.605307 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 436/879] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:31 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1462 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:31.609930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b02adbe7-0b44-4256-bfd0-cf3f55a7c9df tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Getting quotas for user c91998a4438048b786c1e540370db4bf and project 8722d39998594909b366f5976ee6ed2d. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:07:31.628363 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-b02adbe7-0b44-4256-bfd0-cf3f55a7c9df tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b02adbe7-0b44-4256-bfd0-cf3f55a7c9df tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Request method failure captured: Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 1752 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU15yNtw0CDe0Aju74HEpHtPvS2F1gqI8-GYQxTkGNMzzNcinaoysggoib6caF1i7iKPj1beRx1w8eK84um_6VVDazm6nZ3u-rCGVRZHiCZlBXuLjJh_UC9DVYYUaKmmtUrZvF_rQUcut24RswTItQlcaD_ofn_OlC6_5_3jaJUbvcp8 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8722d39998594909b366f5976ee6ed2d Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-905257377 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8722d39998594909b366f5976ee6ed2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8722d39998594909b366f5976ee6ed2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8722d39998594909b366f5976ee6ed2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8722d39998594909b366f5976ee6ed2d"}]}] Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-905257377 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8722d39998594909b366f5976ee6ed2d Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-905257377 Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-905257377-project Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: c91998a4438048b786c1e540370db4bf Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-905257377-project Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1824088590", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:07:31.631622 n-d-862416-2 devstack@n-api.service[120582]: exception: Maximum number of metadata items exceeds 128 Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1824088590', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:07:31.634395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b02adbe7-0b44-4256-bfd0-cf3f55a7c9df tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:07:31.637916 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b02adbe7-0b44-4256-bfd0-cf3f55a7c9df tempest-AbsoluteLimitsNegativeTestJSON-905257377 tempest-AbsoluteLimitsNegativeTestJSON-905257377-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.370491 Oct 22 03:07:31.640914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:31.641497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 444/880] 10.222.0.25 () {60 vars in 1148 bytes} [Sat Oct 22 03:07:31 2022] POST /compute/v2.1/servers => generated 87 bytes in 378 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:07:31.646948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:31.663030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:31.663550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.664058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.664535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:31.664953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.666729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.667222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.667836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.673015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:31.678107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.679052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.679910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.680950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.681657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.683476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.808091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:07:31.808923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:07:31.809587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:07:31.810154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:07:31.810789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:07:31.886643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:31.894992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:31.904489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.904489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.904489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.905026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.905313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.907882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.933203 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43d66d7d-708b-4318-80bc-9c056ca687ee tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.268478 Oct 22 03:07:31.933203 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 445/881] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:31 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:31.944420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:31.945600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:31.953758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.954308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.954790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.956625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.957149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.957650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.966136 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dff767f7-1d9c-4766-9417-7f7a0e0753f1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action" status: 202 len: 1066 microversion: 2.1 time: 0.338556 Oct 22 03:07:31.967428 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 437/882] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:07:31 2022] POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action => generated 1066 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 03:07:31.973761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:31.974357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:31.986292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.988467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.989028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:31.990006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:31.990727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:31.991758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:32.036056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:32.125945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:32.167351 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5afcdb4f-57fd-46dd-b6cc-3b403a872615 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.197372 Oct 22 03:07:32.170311 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 438/883] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:31 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:32.176299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:32.184139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:32.191400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:32.192174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:32.192930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:32.194434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:32.197850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:32.200394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:32.324460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:32.337003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:32.340190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:32.343174 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e363429d-fc25-4708-a519-51eec0e2dc16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.407650 Oct 22 03:07:32.348062 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 446/884] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:31 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:32.357734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:32.359727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:32.373345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:32.374240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:32.374762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:32.378572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:32.379570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:32.381149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:32.477941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:32.484336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:32.487495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-067b54e9-e059-42ef-b70a-07fa4d06a2b1 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.316063 Oct 22 03:07:32.493283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:32.495540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:32.501035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a5cf6342-ee10-49e7-aac9-0aa8928ce0c8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1555 microversion: 2.91 time: 0.151528 Oct 22 03:07:32.502938 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 439/885] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:32 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:32.505240 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 447/886] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:32 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:32.954334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:32.955004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:32.962773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:32.963875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:32.964029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:32.964717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:32.965182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:32.965608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.117946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:33.126941 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c736bd03-b4b9-4c5c-a4ca-00172cac3fc0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1313 microversion: 2.1 time: 0.176346 Oct 22 03:07:33.128234 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 440/887] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:32 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:33.206476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:33.207079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:33.214503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:33.215002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:33.215431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.216217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:33.216693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:33.217126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.288750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:33.306025 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d01f65ca-287e-4403-be0b-c05cc3fd5862 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.103318 Oct 22 03:07:33.307093 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 448/888] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:33 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:33.370116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:33.370726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:33.376872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:33.377641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:33.378188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.378897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:33.379356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:33.379812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.513245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:33.513887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:33.520654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:33.522235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:33.524321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.525248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:33.526740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:33.527366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.549353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:33.559664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:33.561424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:33.562630 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b58043b-7caf-45fa-92ca-83468b6f9df5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.196441 Oct 22 03:07:33.563436 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 441/889] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:33 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:33.584809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:33.585590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:33.592451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:33.592952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:33.593393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.594106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:33.594575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:33.595005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:33.703540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:33.716680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:33.718360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:33.724889 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-62ccbc21-0ed3-438a-ad72-160f7053e4a8 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1537 microversion: 2.91 time: 0.160359 Oct 22 03:07:33.725998 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 442/890] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:33 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:33.737488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:33.746640 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4da9f2ad-f773-4ce2-a176-13d1e7331368 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.238660 Oct 22 03:07:33.747279 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 449/891] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:33 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:34.150255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:34.150991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:34.157828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.158325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.158766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.159481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.159930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.160395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.323222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:34.334717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:34.335325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:34.343337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-07df43df-9d8c-4652-9004-79731b0f4b3d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1463 microversion: 2.1 time: 0.196895 Oct 22 03:07:34.343947 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 443/892] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:34 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1463 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:34.345296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.345779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.346253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.346957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.347409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.347830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.366712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:34.369079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:34.376036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.376632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.377256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.378357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.379006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.379940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.453890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:34.470328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:34.471541 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cbaa4acb-aee6-4ea1-96c9-688aa1dcb3d8 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.141161 Oct 22 03:07:34.472739 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 450/893] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:34 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:34.485372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 03:07:34.496932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:07:34.497358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:07:34.497835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:07:34.498243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:07:34.498657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:07:34.592525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:34.594030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:34.601435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.602168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.602777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.603911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.604670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.605294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.647299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac1e64ad-81ad-4a27-b9e1-985942cc60cf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f/action" status: 202 len: 0 microversion: 2.1 time: 0.284337 Oct 22 03:07:34.650383 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 444/894] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:07:34 2022] POST /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:07:34.663555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:34.664178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:34.667569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:34.672862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.673726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.674464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.675203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.675866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.676534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.830372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:34.838968 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f83dbb6d-6e60-4562-8f96-62c27eb2beb8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1472 microversion: 2.1 time: 0.179669 Oct 22 03:07:34.840104 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 445/895] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:34 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:34.849629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:34.851227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:34.859458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.859950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.860966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.861836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.862626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.863202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.926079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:34.939390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:34.946412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:34.949314 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b12c025a-0b29-47e7-9e87-1619a0930c75 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.364026 Oct 22 03:07:34.949917 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 451/896] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:34 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:34.963608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:34.965732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:34.981070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.982986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.984062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.985066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:34.985521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:34.986014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:34.987038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:35.001056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:35.016515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:35.028077 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d9e463eb-1423-4593-96bd-b08a5ed452f1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1537 microversion: 2.91 time: 0.186634 Oct 22 03:07:35.029090 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 446/897] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:34 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:35.285630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-09216cbc-e42f-4b31-a615-9359347585a5 req-2d8e9622-9cda-48c7-ae42-919970676ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a218e3e3-6082-4b65-8edb-b406c7cd582f", "name": "network-vif-plugged", "status": "completed", "tag": "b0191679-9c81-4ff7-8391-549473bf995c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:35.311830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-09216cbc-e42f-4b31-a615-9359347585a5 req-2d8e9622-9cda-48c7-ae42-919970676ca0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:35.313071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-09216cbc-e42f-4b31-a615-9359347585a5 req-2d8e9622-9cda-48c7-ae42-919970676ca0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:35.313782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-09216cbc-e42f-4b31-a615-9359347585a5 req-2d8e9622-9cda-48c7-ae42-919970676ca0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:35.331693 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-09216cbc-e42f-4b31-a615-9359347585a5 req-2d8e9622-9cda-48c7-ae42-919970676ca0 service nova] Creating event network-vif-plugged:b0191679-9c81-4ff7-8391-549473bf995c for instance a218e3e3-6082-4b65-8edb-b406c7cd582f on n-h2-862416-2 Oct 22 03:07:35.339568 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-09216cbc-e42f-4b31-a615-9359347585a5 req-2d8e9622-9cda-48c7-ae42-919970676ca0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058450 Oct 22 03:07:35.341526 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 447/898] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:35.507054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:35.507730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:35.518733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:35.520258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:35.520988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:35.522140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:35.523382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:35.528621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:35.560886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:35.568686 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d5dc6c33-a7e6-46ef-adfc-3865987c43d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.615100 Oct 22 03:07:35.581062 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 452/899] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:34 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:35.695938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:35.733867 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b28545fa-775e-469c-8cb7-a86cfa78bca4 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.234746 Oct 22 03:07:35.735179 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 448/900] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:35 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:35.863254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:35.863883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:35.873115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:35.874184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:35.876141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:35.877595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:35.878639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:35.879729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:35.977437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:35.977437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:35.997245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:35.997740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:35.998177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:35.998893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:35.999414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:35.999751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.145327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.156862 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a39b1939-47e8-450d-a54a-43058cef4a97 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1472 microversion: 2.1 time: 0.297829 Oct 22 03:07:36.157554 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 453/901] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:35 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:36.176823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:36.177842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:36.186133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.186938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.187680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.188660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.189209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.189512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.190244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.208672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.210575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.214060 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e57d3cf1-9f09-4edb-9ad2-6b9f39a8b5aa tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.240674 Oct 22 03:07:36.215356 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 449/902] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:35 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:36.297213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.306461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.308297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.314050 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1f70f08-8a85-4b59-8777-12d8d1246ff1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1540 microversion: 2.91 time: 0.155359 Oct 22 03:07:36.314626 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 454/903] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:36 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1540 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:36.341869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:36.344432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:36.350996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.351473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.351909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.352632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.353090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.354288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.367813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:36.396705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862416-2". {{(pid=120581) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 03:07:36.459624 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b864899f-a592-4880-bc75-344964121c22 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad/action" status: 202 len: 0 microversion: 2.91 time: 0.122003 Oct 22 03:07:36.463370 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 450/904] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:07:36 2022] POST /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:07:36.469534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:36.470166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:36.477602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.478343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.479534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.480691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.481917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.481917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.606277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:36.606902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:36.619532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.620436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.621081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.622117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.623654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.624336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.626732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.639874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.641436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.648669 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f3496ab-0a9d-49a9-8fa4-9e7f5dcb07ee tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1548 microversion: 2.91 time: 0.183141 Oct 22 03:07:36.653447 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 455/905] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:36 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:36.793806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:36.794441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:36.802733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.803224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.803659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.804401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:36.804508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:36.804853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:36.805277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:36.814563 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-56943231-c01a-4bd6-ac5b-c3846da49df7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.214064 Oct 22 03:07:36.815158 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 451/906] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:36 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:36.911981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:36.946733 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e75658c6-4974-4023-8ad9-e6abf81d46cc tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.184087 Oct 22 03:07:36.947465 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 456/907] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:36 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:37.182476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:37.183305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:37.190874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:37.191097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:37.191487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:37.192954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:37.193075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:37.193494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:37.243062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:37.244121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:37.255800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:37.258939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:37.260242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:37.266207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:37.266814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:37.267341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:37.494492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:37.505947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d7f59186-43d1-4b45-8984-1c8ae1911ce0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1472 microversion: 2.1 time: 0.327885 Oct 22 03:07:37.515159 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 452/908] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:37 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:37.573718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:37.582893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:37.584815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:37.586161 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2b172c6b-6f1c-492f-b53c-9525701df73d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1412 microversion: 2.25 time: 0.348572 Oct 22 03:07:37.586875 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 457/909] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:37 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1412 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:37.678484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:37.679176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:37.687307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:37.687888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:37.688438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:37.689224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:37.689758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:37.690553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:37.767384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:37.783173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:37.785364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:37.797873 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3cb5d234-bd20-4bac-be4d-2c0cdd03cf76 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1490 microversion: 2.91 time: 0.123329 Oct 22 03:07:37.798494 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 453/910] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:37 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1490 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:37.843117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:37.843928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:37.863204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:37.863427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:37.863742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:37.866973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:37.867471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:37.868095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:37.976288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:37.977091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:38.002445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:38.003110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:38.003577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:38.005441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:38.006120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:38.006960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:38.109705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:38.129100 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-80b52d4d-5bb1-470f-b469-91ccfccdcb92 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.157920 Oct 22 03:07:38.136258 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 454/911] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:37 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:38.302770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:38.311820 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98ddf118-92e0-4944-8dc3-94fb6bffbbe2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.476496 Oct 22 03:07:38.313050 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 458/912] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:37 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:38.530940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:38.532615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:38.539508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:38.540426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:38.542072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:38.542072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:38.542304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:38.542979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:38.612780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:38.613758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:38.635234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:38.640614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:38.641373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:38.642882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:38.643595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:38.644292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:38.852049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:38.865915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ce121ff-1043-4f94-b264-0ed55ac88b64 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1472 microversion: 2.1 time: 0.337480 Oct 22 03:07:38.877815 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 455/913] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:38 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:38.893311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:38.894244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:38.902244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:38.902975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:38.904386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:38.905402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:38.906343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:38.906954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:38.991694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:39.003647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:39.005116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:39.011531 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-279c5d93-a76d-4c40-90e6-7e594b1da782 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.132460 Oct 22 03:07:39.012392 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 456/914] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:38 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:39.157384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:39.158751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:39.165546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:39.166862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:39.167728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:39.168770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:39.169435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:39.170046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:39.287890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:39.309146 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8f29bff6-26c6-450c-8874-400e67b805ca tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.155291 Oct 22 03:07:39.320792 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 457/915] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:39 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:39.328660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:39.337378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:39.338680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:39.339395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:39.339528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:39.346724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:39.347214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:39.347834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:39.348751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:39.349209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:39.349939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:39.350132 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d64ae60-be0e-4fdf-862c-59e3b034a45c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1607 microversion: 2.25 time: 0.742352 Oct 22 03:07:39.351516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 459/916] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:38 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1607 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:39.377878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:39.378592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:39.386856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:39.388341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:39.389175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:39.390239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:39.390935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:39.391585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:39.593295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:39.608906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-932f8614-8bb8-4b1e-8225-99bf453e0c9c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.274977 Oct 22 03:07:39.610501 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 458/917] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:39 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:39.668911 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8fb4b14a-dbcc-4f32-8cf5-e2304079d1ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.295057 Oct 22 03:07:39.669666 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 460/918] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Oct 22 03:07:39 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-interface => generated 284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:07:39.903481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:39.905146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:39.921602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:39.922534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:39.923390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:39.924467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:39.925210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:39.927519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:40.041844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:40.042979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:40.074308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:40.078977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:40.080818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:40.089719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:40.101230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:40.102052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:40.249335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:40.265788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:40.267699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:40.282379 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a6285d11-6b0c-4453-bfc1-c470d71e5134 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.246072 Oct 22 03:07:40.283557 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 461/919] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:40 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:40.341838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:40.343189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:40.347516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:40.359003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:40.359717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:40.360349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:40.361261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:40.361559 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b0336b8a-e315-4aba-bce3-b6724ef31064 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1472 microversion: 2.1 time: 0.471522 Oct 22 03:07:40.362103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:40.362693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:40.388841 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 459/920] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:39 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1472 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:40.407480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:40.639051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:40.639579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:40.640533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:40.651851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:40.655528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:40.659046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:40.659881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:40.663583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:40.664120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:40.702909 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e375d17-2a93-43fd-b72d-2d52b1a5807b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.365003 Oct 22 03:07:40.706524 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 462/921] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:40 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:40.961504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:40.977299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18f8c777-4363-4f15-a8c0-85b253b5cd0a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.342551 Oct 22 03:07:41.017284 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 460/922] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:40 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:41.311926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:41.312609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:41.321510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:41.322436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:41.323215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:41.324365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:41.325135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:41.325871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:41.389676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:41.390659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:41.392991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:41.393955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:41.408623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:41.424332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:41.425421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:41.426409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:41.427111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:41.428461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:41.516823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:41.526371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:41.529193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:41.542527 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65df3442-7f98-42d5-baec-5ac43c695d8f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.234460 Oct 22 03:07:41.556301 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 463/923] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:41 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:41.664128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:41.680144 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a119e06b-b699-4a22-b146-e0e66949a612 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.294219 Oct 22 03:07:41.683104 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 461/924] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:41 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:41.739637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:41.740353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:41.742806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:41.784007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:41.788016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:41.788974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:41.792083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:41.792857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:41.793903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:42.008773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-423cd37a-d2ce-4b22-8e3f-6880342a5b9f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Action: 'create', calling method: .version_select at 0x7f0d1a2c1ee0>, body: {"keypair": {"name": "tempest-keypair-2140371243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqiGU903uFw/Pokwr/MsR8oZBjVUUZ/apgWD4LBtho9ZrccEBGYwaf0B0rQisEmJf8PkoKPOaQKAXjWdP2XE2zeSgphtIj1DDqSgVeE7j4tXm+QlzuNiezqS6bAYohCHQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:42.053862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-423cd37a-d2ce-4b22-8e3f-6880342a5b9f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Getting quotas for project d606804daa7f4672aefaa9cb47d6498c. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:07:42.077622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-423cd37a-d2ce-4b22-8e3f-6880342a5b9f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Getting quotas for user d55a10ac9e3547a0b1260d744a5181b9 and project d606804daa7f4672aefaa9cb47d6498c. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:07:42.136850 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-423cd37a-d2ce-4b22-8e3f-6880342a5b9f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.377131 Oct 22 03:07:42.137764 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 462/925] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:07:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:07:42.142666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:42.145373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:42.162698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:42.165134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:42.168547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:42.169518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:42.171680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:42.172316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:42.187535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:42.254793 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c4d28efd-18a5-4c3a-a125-ed2a91cba06e tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.521112 Oct 22 03:07:42.260412 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 464/926] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:41 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:42.296441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8a9f8095-6ce2-42a8-8e25-b6f611b10485 req-91dcb3b3-592a-4c2a-bf1e-f5570c944c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a218e3e3-6082-4b65-8edb-b406c7cd582f", "tag": "b0191679-9c81-4ff7-8391-549473bf995c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:42.306605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8a9f8095-6ce2-42a8-8e25-b6f611b10485 req-91dcb3b3-592a-4c2a-bf1e-f5570c944c95 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:42.307427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8a9f8095-6ce2-42a8-8e25-b6f611b10485 req-91dcb3b3-592a-4c2a-bf1e-f5570c944c95 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:42.308067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8a9f8095-6ce2-42a8-8e25-b6f611b10485 req-91dcb3b3-592a-4c2a-bf1e-f5570c944c95 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:42.320769 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8a9f8095-6ce2-42a8-8e25-b6f611b10485 req-91dcb3b3-592a-4c2a-bf1e-f5570c944c95 service nova] Creating event network-changed:b0191679-9c81-4ff7-8391-549473bf995c for instance a218e3e3-6082-4b65-8edb-b406c7cd582f on n-h2-862416-2 Oct 22 03:07:42.326640 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8a9f8095-6ce2-42a8-8e25-b6f611b10485 req-91dcb3b3-592a-4c2a-bf1e-f5570c944c95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034086 Oct 22 03:07:42.327836 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 465/927] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:07:42.554665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:42.569793 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e26a5eed-4961-4cf0-91ce-1d6492755eac tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.425651 Oct 22 03:07:42.570889 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 463/928] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:42 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:42.600125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:42.606085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:42.628853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:42.631733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:42.634163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:42.637233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:42.637751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:42.639870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:42.707776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:42.708703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:42.722363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:42.731694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:42.733378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:42.736011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:42.739298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:42.740909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:42.857921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:42.876713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:42.878972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:42.897181 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4ef121da-edc4-4f52-a2a9-eba349e20b59 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.301153 Oct 22 03:07:42.917531 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 466/929] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:42 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:43.289683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:43.297184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:43.309012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:43.321151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:43.332745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:43.333768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:43.334397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:43.335061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:43.436074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:43.455253 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4488063e-b049-49f6-81b9-0c0c7c0a9be6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.752008 Oct 22 03:07:43.470393 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 464/930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:42 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:43.564586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:43.597619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:43.599729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:43.619633 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8dd2cb12-951b-418f-9dee-535411471490 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.332950 Oct 22 03:07:43.626234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:43.626744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:43.627189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:43.627911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:43.628407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:43.636723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:43.645309 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 467/931] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:43 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:43.934190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:43.934806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:43.948111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:43.954800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:43.955776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:43.957006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:43.957796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:43.958414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:44.084072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:44.097707 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7af83781-6d36-4573-9f77-3b5b3aa1b060 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.506257 Oct 22 03:07:44.098317 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 465/932] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:43 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:44.128444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:44.141018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:44.144913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:44.153710 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d6358b24-4eea-4cee-8991-39618257924d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.223447 Oct 22 03:07:44.154923 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 468/933] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:43 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:44.481885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:44.482504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:44.498653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:44.499155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:44.499599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:44.504517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:44.505380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:44.506099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:44.515913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:44.650205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:44.651610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:44.661995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:44.662759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:44.663387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:44.664312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:44.666970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:44.667594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:44.815810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:44.863096 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a888ade-1228-48d7-a280-b454a29a64a6 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.216528 Oct 22 03:07:44.863709 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 469/934] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:44 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:44.964768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:44.973208 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63f69779-5aa0-468e-9796-22353cca886d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.495068 Oct 22 03:07:44.984807 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 466/935] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:44 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:45.124689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:45.125641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:45.138280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:45.144532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:45.145137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:45.145972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:45.146529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:45.147017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:45.187310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:45.188665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:45.202146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:45.204971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:45.206184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:45.207118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:45.214746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:45.215642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:45.358827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:45.376282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:45.377000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:45.379102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:45.386723 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db002958-e735-4918-820f-d29d71de817b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.267497 Oct 22 03:07:45.387894 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 470/936] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:45 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:45.407834 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e2ee5ef7-ebbb-4223-89d7-2e9a684e78ab tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.226490 Oct 22 03:07:45.422777 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 467/937] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:45 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:45.666969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1648631471", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e9118211-4c8e-407d-937a-ebf76e929595"}], "security_groups": [{"name": "tempest-securitygroup--2035736764"}], "key_name": "tempest-keypair-2140371243", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:45.826578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] validate_networks() for [('e9118211-4c8e-407d-937a-ebf76e929595', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:07:45.894487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:45.895655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:45.907597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:45.912705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:45.913298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:45.918627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:45.919581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:45.920264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:46.012096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:46.057227 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-78e877de-0e19-45d1-bb6d-47d79cb347ac tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.162592 Oct 22 03:07:46.073297 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 468/938] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:45 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:46.079906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:46.081643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:46.100330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:46.101327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:46.108850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:46.109799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:46.110381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:46.110915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:46.439530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:46.463298 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1eccc208-6cbe-41cd-bb5e-8fe7f97cbbd6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.388446 Oct 22 03:07:46.464130 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 469/939] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:46 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:46.477660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:46.478820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:46.495164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:46.505651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:46.506123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:46.506861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:46.512733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:46.513449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:46.747654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:46.756421 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ac455d3-4299-429d-bfcd-dbbd853afe34 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.291359 Oct 22 03:07:46.757013 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 470/940] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:46 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:46.777726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:46.778345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:46.791663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:46.791663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:46.791663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:46.791663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:46.791663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:46.791663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:46.893042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:46.907677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:46.910349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:46.924709 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dab616b1-96a2-4f5a-849e-d31a39515eca tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.151012 Oct 22 03:07:46.925497 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 471/941] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:46 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:46.970392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Getting quotas for project d606804daa7f4672aefaa9cb47d6498c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:07:46.977958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:46.981808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Getting quotas for user d55a10ac9e3547a0b1260d744a5181b9 and project d606804daa7f4672aefaa9cb47d6498c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:07:46.998624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:07:46.999529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:07:47.000246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:07:47.000869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:07:47.001487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:07:47.011748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.012604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.013265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.014219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.026165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.026624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.044689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Getting quotas for project d606804daa7f4672aefaa9cb47d6498c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:07:47.050570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Getting quotas for user d55a10ac9e3547a0b1260d744a5181b9 and project d606804daa7f4672aefaa9cb47d6498c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:07:47.064190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:07:47.066958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:07:47.094864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:47.096264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:47.110594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.111376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.113919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.114840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.115478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.116310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.139506 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab6d7289-5122-4aab-8fee-300545d3717a tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.485320 Oct 22 03:07:47.147666 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 471/942] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:07:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:07:47.153652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b3ad7930-3fe1-445d-8568-9fc2ed77e6c5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:47.154265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b3ad7930-3fe1-445d-8568-9fc2ed77e6c5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:47.253654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:47.271660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b3ad7930-3fe1-445d-8568-9fc2ed77e6c5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:47.286810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ee3ad16-1fb2-434a-891f-91c8fca1c704 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.197719 Oct 22 03:07:47.288144 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 472/943] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:47 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:47.312796 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b3ad7930-3fe1-445d-8568-9fc2ed77e6c5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1278 microversion: 2.1 time: 0.163521 Oct 22 03:07:47.320819 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 472/944] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:47 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:47.488119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:47.489566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:47.496161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.496684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.497128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.497950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.498292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.498720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.657676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:47.671494 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75f15c7f-9afa-4bd2-8980-82d875134acd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.187778 Oct 22 03:07:47.672486 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 473/945] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:47 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:47.787920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:47.788522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:47.798398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.799147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.799759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.800682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.801295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.801869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.959238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:47.960036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:47.967718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.968249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.968986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:47.969899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:47.970371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:47.970803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:48.099163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:48.108351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:48.119465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:48.123097 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7680f027-7a1e-4393-bbeb-3af5331c45f7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.346010 Oct 22 03:07:48.137686 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 473/946] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:47 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:48.150678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:48.159474 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-709c37ac-0e5c-4b7f-9930-3258ac635ceb tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.207972 Oct 22 03:07:48.177913 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 474/947] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:47 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:48.320962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:48.323864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:48.339645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:48.340230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:48.340752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:48.341334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:48.341642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:48.341947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:48.342310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:48.344445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:48.348176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:48.349970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:48.349970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:48.349970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:48.350259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:48.350928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:48.418825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:48.428483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-488501de-e0e5-4e0a-bd2a-1c0f341feff0 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1274 microversion: 2.1 time: 0.090961 Oct 22 03:07:48.429643 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 475/948] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:48 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:48.437942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:48.466818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-25f96ee5-f02c-477c-84b4-e4702e7cbe2f tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.152524 Oct 22 03:07:48.471634 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 474/949] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:48 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:48.694306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:48.694937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:48.701700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:48.702187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:48.702621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:48.703309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:48.703763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:48.704183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:48.835128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:48.843737 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18d74901-4d7b-4411-bb89-bca5e1dee278 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.153211 Oct 22 03:07:48.844269 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 476/950] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:48 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:49.152921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:49.153913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:49.160241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.160924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.161524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.162364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.163014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.163477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.190030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:49.190964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:49.200132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:49.203280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.203771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.204229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.205143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.205595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.206266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.331682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:49.340765 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-810f2953-a568-43d0-9295-3f52261db49b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.192836 Oct 22 03:07:49.341490 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 475/951] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:49 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:49.454509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:49.455233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:49.461814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.461814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.462374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.464442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.464553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:49.464984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.465481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.474586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:49.476686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:49.482570 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f78569d-aac9-4d7d-8558-8bd5ca656dc4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.296538 Oct 22 03:07:49.483330 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 477/952] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:49 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:49.506643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:49.507270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:49.514694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.515189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.515634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.516529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.516990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.517422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.532228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:49.541038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dc0e0e5e-06cc-4087-8cb2-3c4a22e50c20 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1336 microversion: 2.1 time: 0.089945 Oct 22 03:07:49.542025 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 476/953] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:49 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:49.598858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:49.616332 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec1fe82a-0763-4dc1-9315-768923143c26 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.118802 Oct 22 03:07:49.616973 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 478/954] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:49 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:49.867965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:49.869131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:49.875043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.875530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.875971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:49.876700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:49.877161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:49.877593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.020622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:50.030257 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7238645f-9b4f-4adf-9a27-12ba61c997a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.166308 Oct 22 03:07:50.031012 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 477/955] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:49 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:50.364432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:50.365209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:50.372483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.372974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.373411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.374106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.374561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.375018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.515182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:50.515952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:50.522397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.522884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.523417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.524112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.524660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.525699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.602673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:50.607412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:50.611918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:50.613578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:50.615618 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfe85d52-58af-4d0a-b90a-6d28d6167643 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.255130 Oct 22 03:07:50.616892 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 479/956] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:50 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:50.619414 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9111f8e-54db-4024-a652-5850e75e7525 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.107471 Oct 22 03:07:50.619973 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 478/957] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:50 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:50.623266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:50.624127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:50.637094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.637726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.638287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.639058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.640970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.640970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.646260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:50.646878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:50.655536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.656035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.656515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.657223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.657688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.658117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.725763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:50.731982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:50.748759 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2fec961-c900-4cbf-8339-3521866168b3 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.106375 Oct 22 03:07:50.749351 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 479/958] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:50 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:50.845034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:50.852968 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df75ea57-5386-429a-9632-206bc362dd5f tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1404 microversion: 2.1 time: 0.234779 Oct 22 03:07:50.853541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 480/959] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:50 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:50.924165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-988b6c17-52be-4415-835e-c9be67931c70 req-c532d1bd-2eb9-46e2-94ba-9e0a3882936d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13afade-1045-400e-aac6-329fd672f06e", "tag": "19530e8d-ac69-49aa-ad40-def3b85e64e9"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:50.933630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-988b6c17-52be-4415-835e-c9be67931c70 req-c532d1bd-2eb9-46e2-94ba-9e0a3882936d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:50.934316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-988b6c17-52be-4415-835e-c9be67931c70 req-c532d1bd-2eb9-46e2-94ba-9e0a3882936d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:50.934752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-988b6c17-52be-4415-835e-c9be67931c70 req-c532d1bd-2eb9-46e2-94ba-9e0a3882936d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:50.946022 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-988b6c17-52be-4415-835e-c9be67931c70 req-c532d1bd-2eb9-46e2-94ba-9e0a3882936d service nova] Creating event network-changed:19530e8d-ac69-49aa-ad40-def3b85e64e9 for instance c13afade-1045-400e-aac6-329fd672f06e on n-h1-862416-2 Oct 22 03:07:50.951747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-988b6c17-52be-4415-835e-c9be67931c70 req-c532d1bd-2eb9-46e2-94ba-9e0a3882936d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031996 Oct 22 03:07:50.952391 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 480/960] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:51.054979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:51.055516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:51.062063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.062552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.062994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.063707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.064163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.064622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.280959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:51.283177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:51.289878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-095a2770-5389-4378-9fe9-b180202064e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.238824 Oct 22 03:07:51.290515 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 481/961] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:51 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:51.641075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:51.641692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:51.648094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.648612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.649050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.649517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:51.650091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.650232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:51.650340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.650623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.656998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.657476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.657903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.658588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.659033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.659450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.726899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:51.735927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:51.737396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:51.742280 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-22d95452-ee44-46d0-9fb4-16f779ff5044 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.097443 Oct 22 03:07:51.742848 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 482/962] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:51 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:51.777388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:51.778004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:51.781660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:51.784001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.784518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.784958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.785660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.786115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.786545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.789616 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af120232-c0fe-4e34-b83b-a0f290522bf0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.153730 Oct 22 03:07:51.790185 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 481/963] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:51 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:51.859984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:51.874986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:51.875620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:51.876383 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15b33177-b961-47c0-ba06-3241edcd8212 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.102852 Oct 22 03:07:51.876971 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 483/964] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:51 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:51.881472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.881959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.882485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:51.883177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:51.883635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:51.884063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.079854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:52.088384 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0eedd6e9-6333-4e35-b31f-5afb315d27fe tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1404 microversion: 2.1 time: 0.216469 Oct 22 03:07:52.088992 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 482/965] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:51 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1404 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:52.313685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:52.314290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:52.316467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:52.322288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:52.322772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:52.323207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.323901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:52.324404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:52.324825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.452822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:52.460547 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-46c07e53-9ca2-4ff6-adfb-f234fe81a3d7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.150687 Oct 22 03:07:52.461133 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 484/966] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:52 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:52.769810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:52.770518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:52.777131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:52.777615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:52.778063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.778766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:52.779226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:52.779653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.813255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:52.814005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:52.820930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:52.821418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:52.822464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.823273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:52.823969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:52.824606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.846524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:52.855203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:52.856815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:52.862617 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bb3658a6-816e-4cf2-b841-d5a413f89ba5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.096742 Oct 22 03:07:52.863202 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 483/967] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:52 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:52.904290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:52.905008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:52.911650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:52.912137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:52.912596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.913298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:52.913749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:52.914174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:52.990007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:53.009350 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4850fc02-9bba-4f02-a27b-730f1a333c4b tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.108791 Oct 22 03:07:53.010976 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 484/968] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:52 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:53.035180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:53.043520 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a750a27b-b479-4bed-9f56-590ba4128823 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.234046 Oct 22 03:07:53.044231 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 485/969] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:52 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:53.111069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:53.111590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:53.117459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:53.117935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:53.118366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:53.120221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:53.120677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:53.121104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:53.261139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:53.269818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61ec92e8-a5d8-4a3c-b51a-1df90670d504 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1404 microversion: 2.1 time: 0.162379 Oct 22 03:07:53.270423 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 485/970] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:53 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:53.483845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:53.484494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:53.490565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:53.491042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:53.491472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:53.492167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:53.493651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:53.494586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:53.640664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:53.651338 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c7f24e0-14f6-434b-8b13-8743526eb121 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.171342 Oct 22 03:07:53.652091 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 486/971] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:53 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:53.891570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:53.892179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:53.898686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:53.899178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:53.899616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:53.901130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:53.901513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:53.901941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:53.981436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:53.993689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:53.995510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:54.000800 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db5be4c4-7d48-4de3-b032-12e70b68272d tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.113102 Oct 22 03:07:54.001383 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 486/972] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:53 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:54.037646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:54.038214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:54.044625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:54.045117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:54.045555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:54.046255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:54.046715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:54.047146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:54.067884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:54.068801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:54.075866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:54.077649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:54.078277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:54.079139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:54.079470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:54.080128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:54.138781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:54.156332 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-550edc29-349f-4816-9160-67799189831d tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.122433 Oct 22 03:07:54.156919 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 487/973] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:54 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:54.222369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:54.230599 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-417f4308-a492-4baf-81d9-81816f83db8c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.166748 Oct 22 03:07:54.231184 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 487/974] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:54 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:54.294934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:54.295471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:54.301399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:54.301913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:54.302356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:54.303049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:54.303503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:54.303928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:54.438642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:54.446219 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc9f7bbd-ec9d-4cfe-9ebb-67da896d19ca tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1404 microversion: 2.1 time: 0.155727 Oct 22 03:07:54.447593 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 488/975] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:54 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:54.675179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:54.675782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:54.682890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:54.683370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:54.683808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:54.684521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:54.684972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:54.685390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:54.813038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:54.820672 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-36f4d6a5-0290-459e-8bb1-72fc07ab9aae tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.149419 Oct 22 03:07:54.821241 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 488/976] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:54 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:55.032056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:55.032718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:55.039363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.039990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.040320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.041559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.042024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.042485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.109515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:55.119033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:55.120836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:55.126260 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dae200f1-7dc8-4e0f-b450-cbecace63281 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.098242 Oct 22 03:07:55.126915 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 489/977] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:55 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:55.183486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:55.184090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:55.192268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.193224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.193729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.194571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.195704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.196166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.254374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:55.256027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:55.265193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.265680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.266554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.267259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.267715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.268145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.278057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:55.296388 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fc1906aa-7512-4d10-bd26-b662d58d8ebb tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.117202 Oct 22 03:07:55.297235 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 489/978] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:55 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:55.401689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:55.409285 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38f3d603-0d19-454f-8b67-532f984641f5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.159024 Oct 22 03:07:55.409848 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 490/979] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:55 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:55.469169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:55.470272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:55.478360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.479249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.479688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.480431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.480888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.481310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.610392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:55.617924 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39076c56-abb2-45ce-b7d0-53f28055c44e tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1404 microversion: 2.1 time: 0.152924 Oct 22 03:07:55.618540 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 490/980] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:55 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:07:55.843853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:55.844448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:55.850381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.851115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.851551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.852258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:55.852717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:55.853700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:55.989792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:55.997733 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-99ef561f-3411-4e11-bf21-a82be2d8183d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.157760 Oct 22 03:07:55.998323 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 491/981] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:55 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:56.046830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-bf436f6c-a66c-4eca-ad89-80a5fc577d2e req-022ef5a2-a7e8-4ae3-8a7a-a9143d37a54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13afade-1045-400e-aac6-329fd672f06e", "name": "network-vif-plugged", "status": "completed", "tag": "19530e8d-ac69-49aa-ad40-def3b85e64e9"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:56.056380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bf436f6c-a66c-4eca-ad89-80a5fc577d2e req-022ef5a2-a7e8-4ae3-8a7a-a9143d37a54c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.056864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bf436f6c-a66c-4eca-ad89-80a5fc577d2e req-022ef5a2-a7e8-4ae3-8a7a-a9143d37a54c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.057310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bf436f6c-a66c-4eca-ad89-80a5fc577d2e req-022ef5a2-a7e8-4ae3-8a7a-a9143d37a54c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.068962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-bf436f6c-a66c-4eca-ad89-80a5fc577d2e req-022ef5a2-a7e8-4ae3-8a7a-a9143d37a54c service nova] Creating event network-vif-plugged:19530e8d-ac69-49aa-ad40-def3b85e64e9 for instance c13afade-1045-400e-aac6-329fd672f06e on n-h1-862416-2 Oct 22 03:07:56.074629 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-bf436f6c-a66c-4eca-ad89-80a5fc577d2e req-022ef5a2-a7e8-4ae3-8a7a-a9143d37a54c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031400 Oct 22 03:07:56.075291 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 491/982] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:07:56.156257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:56.156968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:56.164319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.164867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.165839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.167068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.167522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.167947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.244888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:56.252949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:56.254376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:56.259700 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad14338c-24e5-4276-ba33-1d37e75e7c69 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.107429 Oct 22 03:07:56.260406 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 492/983] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:56 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:56.326614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:56.327303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:56.333342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.333821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.334253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.334966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.335415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.335834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.408784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:56.425281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59aad03b-b31f-48d5-a7fc-658150aab378 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.104305 Oct 22 03:07:56.425846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 492/984] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:56 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:56.433579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:56.434374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:56.440252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.440760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.441191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.441875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.442322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.442743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.575958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:56.583662 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72133672-87f9-478d-806d-be76f6dd6fb4 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.154425 Oct 22 03:07:56.584251 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 493/985] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:56 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:56.640846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:56.641497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:56.647452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.647941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.648412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.649162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:56.649567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:56.649998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:56.783161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:56.791566 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ec6889ca-7f72-4c78-8a1b-e4e3600419f3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1404 microversion: 2.1 time: 0.154561 Oct 22 03:07:56.792100 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 493/986] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:56 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:57.021400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:57.022006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:57.028060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.028586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.029026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.029725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.030180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.030603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.171038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:57.178760 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f34ad41-855e-4394-bcc6-3909472442f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.161513 Oct 22 03:07:57.179332 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 494/987] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:57 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:57.288754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:57.289359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:57.292545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:57.293263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:57.298823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.299303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.299733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.300453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.300904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.301322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.368564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:57.376963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:57.378410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:57.383215 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1fa2f649-50c3-4154-9a2d-172176bc33cf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.098403 Oct 22 03:07:57.383791 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 494/988] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:57 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:57.455557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:57.456199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:57.462920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.464010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.464491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.465179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.465635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.466056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.549124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:57.565482 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3d640250-faaf-4086-b18f-d45ebc8a4547 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.115097 Oct 22 03:07:57.566054 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 495/989] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:57 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:57.608040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:57.608714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:57.614643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.615134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.615602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.616326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.616786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.617218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.744822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:57.752394 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff5842a3-af5e-4fd4-bae5-f145c46caf17 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.148358 Oct 22 03:07:57.752958 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 495/990] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:57 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:57.814734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:57.815331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:57.821278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.822306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.822782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.823458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.823907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.824360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.956862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:57.964766 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-705c8d46-c171-497d-b404-c8647db85b21 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1591 microversion: 2.1 time: 0.153815 Oct 22 03:07:57.965334 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 496/991] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:57 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1591 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:57.986985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:57.987479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:57.994044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.994468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.994996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:57.995695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:57.996172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:57.996624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:58.015967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:58.083097 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b49f7664-27db-406f-9549-f69326687b19 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099904 Oct 22 03:07:58.083762 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 496/992] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:07:57 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:58.203567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:58.204393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:58.211450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:58.212002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:58.212500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:58.213199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:58.213644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:58.214063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:58.229627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:58.344254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:58.352501 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-059ef27c-1e9e-489e-948e-e7f17142303a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1477 microversion: 2.1 time: 0.152971 Oct 22 03:07:58.354490 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 497/993] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:58 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:58.412689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:58.413407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:58.419870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:58.420401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:58.420834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:58.421533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:58.421989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:58.422415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:58.492666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:58.502572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:58.504372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:58.510724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5c9fdd49-4137-4c43-aa64-dcccdf01eb55 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1546 microversion: 2.91 time: 0.102622 Oct 22 03:07:58.512902 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 497/994] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:58 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1546 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:58.593782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:58.594439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:58.600842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:58.601332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:58.601774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:58.602751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:58.603798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:58.604391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:58.690998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:58.710037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a4a6eaf-54ce-427b-8e9c-830196ebaa89 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1929 microversion: 2.75 time: 0.120221 Oct 22 03:07:58.710971 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 498/995] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:58 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1929 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:58.775261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:58.776180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:58.782270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:58.789677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:58.790245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:58.791328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:58.792930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:58.793929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.096856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:59.105392 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9ccd738-f790-40a6-8b31-c24a7c59c4bc tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.334305 Oct 22 03:07:59.105982 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 498/996] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:58 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:59.377343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:59.378516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:59.388313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.389048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.389656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.390531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.391149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.391742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.403940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:59.404821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:59.417509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.420771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.421409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.422235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.422863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.423327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.570939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:59.580897 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a27e551b-ce3c-45e8-8bb5-02d310df0346 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1476 microversion: 2.1 time: 0.207416 Oct 22 03:07:59.581492 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 499/997] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:59 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:59.588520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-82945366-9d04-4b96-a3bb-3dba41f2c055 req-2ad90a65-401a-4aad-81a0-986aaa9e0949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13afade-1045-400e-aac6-329fd672f06e", "tag": "19530e8d-ac69-49aa-ad40-def3b85e64e9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:07:59.598627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-82945366-9d04-4b96-a3bb-3dba41f2c055 req-2ad90a65-401a-4aad-81a0-986aaa9e0949 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.599388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-82945366-9d04-4b96-a3bb-3dba41f2c055 req-2ad90a65-401a-4aad-81a0-986aaa9e0949 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.599824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-82945366-9d04-4b96-a3bb-3dba41f2c055 req-2ad90a65-401a-4aad-81a0-986aaa9e0949 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.612612 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-82945366-9d04-4b96-a3bb-3dba41f2c055 req-2ad90a65-401a-4aad-81a0-986aaa9e0949 service nova] Creating event network-changed:19530e8d-ac69-49aa-ad40-def3b85e64e9 for instance c13afade-1045-400e-aac6-329fd672f06e on n-h1-862416-2 Oct 22 03:07:59.620006 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-82945366-9d04-4b96-a3bb-3dba41f2c055 req-2ad90a65-401a-4aad-81a0-986aaa9e0949 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036890 Oct 22 03:07:59.620842 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 500/998] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:07:59.626442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:59.627546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:59.634333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.634928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.635415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.636295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.636631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.637586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.687916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:59.695827 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-faf90761-2414-40f6-bf15-32e6b577ffc1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1591 microversion: 2.1 time: 0.296543 Oct 22 03:07:59.696749 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 499/999] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:07:59 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1591 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:07:59.709035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:59.721392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:59.723296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:07:59.729027 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea4ceaef-958c-448c-b725-56e055f28c6f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1533 microversion: 2.91 time: 0.107063 Oct 22 03:07:59.729725 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 501/1000] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:59 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1533 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:07:59.738724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:59.739424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:59.747491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.748324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.748981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.750455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.750916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.752357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.757960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:59.758800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:59.765582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.766657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.766657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.767810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.768315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.768947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.839392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:59.852393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] Lazy-loading 'services' on Instance uuid 08867d3d-1927-46a5-921a-a7e74f48e0ad {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:07:59.860755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:07:59.862282 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-895e1739-3a5d-452a-8014-2b9fb08c2678 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1935 microversion: 2.75 time: 0.127271 Oct 22 03:07:59.876232 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 500/1001] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:59 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1935 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:59.886997 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4e5c04e-1c01-4542-98ef-6377fbf22ae3 tempest-UnshelveToHostMultiNodesTest-932801319 tempest-UnshelveToHostMultiNodesTest-932801319-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1938 microversion: 2.91 time: 0.133811 Oct 22 03:07:59.887819 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 502/1002] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:07:59 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1938 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:07:59.941172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:07:59.941667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:07:59.948963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.949444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.949882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.950579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:07:59.951031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:07:59.951452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:07:59.979873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:08:00.060027 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2738cbb-b72b-4c37-ae3c-e3dc195811c5 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "DELETE /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 204 len: 0 microversion: 2.91 time: 0.122839 Oct 22 03:08:00.060719 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 501/1003] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:07:59 2022] DELETE /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:08:00.068855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:00.069457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:00.076182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:00.076692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:00.077124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:00.077876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:00.078329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:00.078746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:00.131998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:00.132741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:00.139141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:00.139635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:00.140071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:00.140823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:00.141277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:00.142173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:00.155691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:00.163843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:00.166097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:00.171055 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25f3aa59-4615-42a8-b28d-a03f7a37f0d1 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.106148 Oct 22 03:08:00.171833 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 503/1004] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:00 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:00.284019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:00.291962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7900160b-4957-42d1-98cd-5c75848247a9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.164187 Oct 22 03:08:00.292631 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 502/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:00 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:00.605181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:00.606376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:00.614587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:00.615082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:00.615522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:00.616245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:00.616687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:00.617353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:00.752482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:00.760895 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15e9f729-f624-4565-9d36-4d96f416c97a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1474 microversion: 2.1 time: 0.160291 Oct 22 03:08:00.761467 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 504/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:00 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1474 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:00.893929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:00.894505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:00.900908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:00.901409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:00.901824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:00.902554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:00.903006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:00.903429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:00.975101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:00.991729 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-109c9d58-8aab-4e91-8c5f-b749ad466c05 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1935 microversion: 2.75 time: 0.101844 Oct 22 03:08:00.992332 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 503/1007] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:00 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1935 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:01.200023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:01.200660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:01.206678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:01.207169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:01.207610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:01.208340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:01.208799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:01.209229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:01.274024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:01.282125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:01.283573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:01.288315 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-645e0daf-bce3-4ca4-8d66-208951569d9f tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.093061 Oct 22 03:08:01.288895 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 505/1008] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:01 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:01.314814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:01.315433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:01.321420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:01.322022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:01.322468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:01.323176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:01.323635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:01.324070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:01.456805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:01.465399 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-57c69804-082b-412b-b09d-2ec416ee8281 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.154367 Oct 22 03:08:01.466362 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 504/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:01 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:01.786086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:01.786928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:01.794229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:01.794721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:01.795157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:01.795859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:01.796418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:01.797273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:01.931867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:01.939491 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fd102c93-8bd8-405c-a124-e88fbe73f9c9 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1474 microversion: 2.1 time: 0.157878 Oct 22 03:08:01.940058 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 506/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:01 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:02.020435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:02.020992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:02.027576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.028058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.028525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.029217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.029677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.030103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.104358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] Lazy-loading 'services' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:02.120887 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d5254053-82df-40a1-bdd0-7ad67bbd9744 tempest-ServersAdmin275Test-45728743 tempest-ServersAdmin275Test-45728743-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1920 microversion: 2.75 time: 0.104300 Oct 22 03:08:02.121459 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 505/1011] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:02 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1920 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:02.162528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:02.163015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:02.170092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.170568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.171000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.171678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.172125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.172590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.198367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:08:02.271209 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9af2c703-b6da-4f4e-8b84-f4a6f6991c59 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 204 len: 0 microversion: 2.75 time: 0.112216 Oct 22 03:08:02.271895 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 507/1012] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:08:02 2022] DELETE /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:08:02.281330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:02.282081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:02.289070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.289818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.290842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.291717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.292424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.293035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.317777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:02.318486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:02.324505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.324998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.325471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.326182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.326640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.327068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.407656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:02.416859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:02.418436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:02.424079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d01575bc-cc13-4599-a81f-3c5f2112ee8b tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.110514 Oct 22 03:08:02.424934 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 508/1013] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:02 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:08:02.488961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:02.489734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:02.496966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.497682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.498055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.498834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.499362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.500328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.630968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:02.640417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:02.641984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:02.647726 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e632071b-d85e-4bde-81a1-4081bce08055 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1444 microversion: 2.75 time: 0.371289 Oct 22 03:08:02.648501 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 506/1014] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:02 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1444 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:02.822482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:02.830098 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c133848-3a80-4093-92c7-7a6b43ca4c0d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.345209 Oct 22 03:08:02.830673 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 509/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:02 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:02.964322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:02.964935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:02.970897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.971370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.971799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:02.972587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:02.973035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:02.973456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:03.109119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:03.116890 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3365ac41-4d00-4c8b-b410-57d06ffc6a1d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1474 microversion: 2.1 time: 0.157294 Oct 22 03:08:03.117466 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 507/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:02 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:03.243269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7c06b31d-8093-4d74-88c7-00a87bc5e64c req-db493634-1488-466c-b6bb-28c69c8aefc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a5235e-8a3c-4605-b8dd-8b4d246ff46f", "name": "network-vif-unplugged", "status": "completed", "tag": "0c0d9fca-9ee1-400e-beab-4f911a49fd8d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:03.249739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:03.254754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7c06b31d-8093-4d74-88c7-00a87bc5e64c req-db493634-1488-466c-b6bb-28c69c8aefc4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:03.255269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7c06b31d-8093-4d74-88c7-00a87bc5e64c req-db493634-1488-466c-b6bb-28c69c8aefc4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:03.255716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7c06b31d-8093-4d74-88c7-00a87bc5e64c req-db493634-1488-466c-b6bb-28c69c8aefc4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:03.268749 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7c06b31d-8093-4d74-88c7-00a87bc5e64c req-db493634-1488-466c-b6bb-28c69c8aefc4 service nova] Creating event network-vif-unplugged:0c0d9fca-9ee1-400e-beab-4f911a49fd8d for instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f on n-h2-862416-2 Oct 22 03:08:03.273964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-7c06b31d-8093-4d74-88c7-00a87bc5e64c req-db493634-1488-466c-b6bb-28c69c8aefc4 service nova] Instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:08:03.280690 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7c06b31d-8093-4d74-88c7-00a87bc5e64c req-db493634-1488-466c-b6bb-28c69c8aefc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041142 Oct 22 03:08:03.281289 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 510/1017] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:03.456826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:03.457441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:03.464821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:03.465308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:03.465747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:03.466443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:03.466903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:03.467334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:03.533388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:03.541795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:03.543241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:03.547956 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e7f68b27-c770-436a-84e7-e3cd091582b4 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.095084 Oct 22 03:08:03.548566 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 508/1018] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:03 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:03.675476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:03.676254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:03.682740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:03.683229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:03.683669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:03.684404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:03.684866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:03.685302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:03.749268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:03.757284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:03.758742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:03.763935 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a44fe54a-346f-485f-98d3-0d79ffd7e063 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1444 microversion: 2.75 time: 0.092818 Oct 22 03:08:03.764560 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 511/1019] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:03 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:03.853426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:03.854040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:03.859932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:03.860455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:03.860900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:03.861594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:03.862053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:03.862482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:04.082337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:04.090093 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd39a303-3d3f-45a6-b434-d786d58e3aa5 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1471 microversion: 2.1 time: 0.240775 Oct 22 03:08:04.090703 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 509/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:03 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:04.141362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:04.141958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:04.148420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:04.148905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:04.149372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:04.150288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:04.150742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:04.151173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:04.281525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:04.283824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:04.292443 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c29b298a-d40d-4545-b61b-5546e5e01989 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1474 microversion: 2.1 time: 0.154988 Oct 22 03:08:04.293014 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 512/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:04 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:04.574979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:04.575585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:04.581610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:04.582093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:04.582528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:04.583216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:04.583667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:04.584096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:04.647989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:04.652053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:04.657632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:04.659075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:04.664771 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-918afbea-ba43-4e6b-9fd1-6495959bde07 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.093753 Oct 22 03:08:04.665962 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 510/1022] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:04 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:04.792298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:04.792832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:04.800122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:04.800646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:04.801131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:04.801898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:04.802440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:04.802867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:04.882654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:04.892389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:04.893852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:04.899891 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ca1b642-5921-4d10-be83-0d1b36e27c95 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1444 microversion: 2.75 time: 0.111694 Oct 22 03:08:04.900696 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 513/1023] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:04 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:05.113048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:05.113652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:05.121994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.122476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.122909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.123601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.124051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.124498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.258572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:05.267032 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-533d4e40-27ec-411d-95f4-b270bd326827 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1477 microversion: 2.1 time: 0.157844 Oct 22 03:08:05.267611 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 511/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:05 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:05.316963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:05.317733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:05.324898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.325388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.325826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.326522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.327096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.327645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.461836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:05.469747 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d2b2701-3799-43a4-bc20-2c848227f37d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1471 microversion: 2.1 time: 0.157458 Oct 22 03:08:05.470306 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 514/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:05 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:05.492810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:05.494276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:05.500155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.500665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.501115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.501781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.502233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.502653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.565387 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e091d05-607d-4e96-a169-2f0bba1621cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f/action" status: 204 len: 0 microversion: 2.1 time: 0.076194 Oct 22 03:08:05.566054 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 512/1026] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:08:05 2022] POST /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:08:05.574730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:05.575264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:05.581743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.582230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.582660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.583340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.583790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.584310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.694056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:05.695502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:05.705529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.706537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.708905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.711285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.716379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.717003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.758744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:05.766582 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28c749cc-6e95-4c1e-96bd-99dcdb444d58 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1471 microversion: 2.1 time: 0.196333 Oct 22 03:08:05.767172 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 515/1027] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:05 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:05.799926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:05.809095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:05.810547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e6da96821c74c54ad5eb148ae9f8521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa20044837549b3be6104ffe2dd7f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:05.815516 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5ab68d51-083e-490a-85e4-14128aa1d1bf tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 200 len: 1539 microversion: 2.91 time: 0.126145 Oct 22 03:08:05.816098 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 513/1028] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:05 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:05.927350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:05.928035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:05.935187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.935783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.936322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.937100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.937632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.938155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.974537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:05.975034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:05.975935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:05.976173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lazy-loading 'fault' on Instance uuid 42963e49-ae28-4ad3-9302-f3f7b49ff07f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:06.035749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:06.045458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:06.046919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9a54aa1fdc74750b25ac2455142d7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb766f6c2a3246d1bbc09eb33de7ff17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:06.052105 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38156ec5-00e8-4e07-bb93-deb764433b52 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 200 len: 1449 microversion: 2.75 time: 0.129108 Oct 22 03:08:06.052719 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 516/1029] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:05 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 1449 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:06.292076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:06.292731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:06.300537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:06.301328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:06.301990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:06.302776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:06.303626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:06.304308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:06.534460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:06.542787 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-066d5027-3fdd-4463-a430-967b306e227d tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1477 microversion: 2.1 time: 0.255102 Oct 22 03:08:06.543356 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 514/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:06 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:06.790868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:06.791541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:06.798192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:06.798705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:06.799136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:06.799851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:06.800362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:06.800780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:06.843337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:06.843940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] [instance: 08867d3d-1927-46a5-921a-a7e74f48e0ad] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:06.850016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:06.850840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:06.851285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:06.851984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:06.852471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:06.852904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:06.870124 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] HTTP exception thrown: Instance 08867d3d-1927-46a5-921a-a7e74f48e0ad could not be found. Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Request method failure captured: Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad HTTP/1.1 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13c6Mxk0TsYexcxkxFPs0AgykySUh3fKyH7Wf3_EMrCAI_VO8VMqmQX7zDrrKCJfPv2Cni5aQHLMXCGLb_mKWa-u06UErSVszTKSv7FvpcAPShNoiN7bRUX-D38Rs3zmW8Fd927xZTOh8BG5fmP7pgb43VfDVGHoauK_t612AgGjiE Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.91 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0fa20044837549b3be6104ffe2dd7f65 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1646316246 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0fa20044837549b3be6104ffe2dd7f65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0fa20044837549b3be6104ffe2dd7f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0fa20044837549b3be6104ffe2dd7f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0fa20044837549b3be6104ffe2dd7f65"}]}] Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1646316246 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0fa20044837549b3be6104ffe2dd7f65 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1646316246 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-UnshelveToHostMultiNodesTest-1646316246-project Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5e6da96821c74c54ad5eb148ae9f8521 Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1646316246-project Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 08867d3d-1927-46a5-921a-a7e74f48e0ad could not be found. Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '08867d3d-1927-46a5-921a-a7e74f48e0ad'} Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08867d3d-1927-46a5-921a-a7e74f48e0ad could not be found. Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08867d3d-1927-46a5-921a-a7e74f48e0ad could not be found. Oct 22 03:08:06.871797 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08867d3d-1927-46a5-921a-a7e74f48e0ad could not be found. Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] Returning 404 to user: Instance 08867d3d-1927-46a5-921a-a7e74f48e0ad could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cb340b53-54ae-4515-b2e9-b1c07aad1162 tempest-UnshelveToHostMultiNodesTest-1646316246 tempest-UnshelveToHostMultiNodesTest-1646316246-project] 10.222.0.25 "GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad" status: 404 len: 111 microversion: 2.91 time: 0.033697 Oct 22 03:08:06.875938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 515/1031] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:06 2022] GET /compute/v2.1/servers/08867d3d-1927-46a5-921a-a7e74f48e0ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:08:06.950300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:06.958227 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-60abb0be-44e8-4216-8ee4-c426f5f5fc28 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1471 microversion: 2.1 time: 0.171282 Oct 22 03:08:06.958802 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 517/1032] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:06 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:07.082536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:07.083219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] [instance: 42963e49-ae28-4ad3-9302-f3f7b49ff07f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:07.092306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:07.092870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:07.093616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:07.094363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:07.094929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:07.096693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:07.114786 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] HTTP exception thrown: Instance 42963e49-ae28-4ad3-9302-f3f7b49ff07f could not be found. Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Request method failure captured: Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f HTTP/1.1 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU149hUBB1YgOcXJ2fmjJgIxFt5H-x1WJr7u7FJhJWA1w_8s2eqfvaK6kMyd4biWt2xxi7gxU4cHeAGlXvFqM9Oy3gup3EMvI05dU_5hWGviAWA--bPvJfFy9RZfghJK_A974smmjg6jdU-1x433JgSKRXWe5LFRJ22KQ1XF29l5nSSY Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.75 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: cb766f6c2a3246d1bbc09eb33de7ff17 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersAdmin275Test-1449394230 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cb766f6c2a3246d1bbc09eb33de7ff17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cb766f6c2a3246d1bbc09eb33de7ff17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cb766f6c2a3246d1bbc09eb33de7ff17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cb766f6c2a3246d1bbc09eb33de7ff17"}]}] Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersAdmin275Test-1449394230 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: cb766f6c2a3246d1bbc09eb33de7ff17 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersAdmin275Test-1449394230 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersAdmin275Test-1449394230-project Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d9a54aa1fdc74750b25ac2455142d7f8 Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersAdmin275Test-1449394230-project Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 42963e49-ae28-4ad3-9302-f3f7b49ff07f could not be found. Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '42963e49-ae28-4ad3-9302-f3f7b49ff07f'} Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42963e49-ae28-4ad3-9302-f3f7b49ff07f could not be found. Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42963e49-ae28-4ad3-9302-f3f7b49ff07f could not be found. Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:07.116352 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42963e49-ae28-4ad3-9302-f3f7b49ff07f could not be found. Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] Returning 404 to user: Instance 42963e49-ae28-4ad3-9302-f3f7b49ff07f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:07.120478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-05ad1dfe-970d-4f54-b400-fb01a1389be3 tempest-ServersAdmin275Test-1449394230 tempest-ServersAdmin275Test-1449394230-project] 10.222.0.25 "GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f" status: 404 len: 111 microversion: 2.75 time: 0.040764 Oct 22 03:08:07.121810 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 516/1033] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:08:07 2022] GET /compute/v2.1/servers/42963e49-ae28-4ad3-9302-f3f7b49ff07f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:08:07.227152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1842f307-8954-43fd-ac5a-30b2d8bac754 req-33a74ab7-41ce-4ba7-a2bf-7bb81351146a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a5235e-8a3c-4605-b8dd-8b4d246ff46f", "name": "network-vif-plugged", "status": "completed", "tag": "0c0d9fca-9ee1-400e-beab-4f911a49fd8d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:07.238334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1842f307-8954-43fd-ac5a-30b2d8bac754 req-33a74ab7-41ce-4ba7-a2bf-7bb81351146a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:07.239234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1842f307-8954-43fd-ac5a-30b2d8bac754 req-33a74ab7-41ce-4ba7-a2bf-7bb81351146a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:07.239924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1842f307-8954-43fd-ac5a-30b2d8bac754 req-33a74ab7-41ce-4ba7-a2bf-7bb81351146a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:07.257631 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1842f307-8954-43fd-ac5a-30b2d8bac754 req-33a74ab7-41ce-4ba7-a2bf-7bb81351146a service nova] Creating event network-vif-plugged:0c0d9fca-9ee1-400e-beab-4f911a49fd8d for instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f on n-h2-862416-2 Oct 22 03:08:07.263838 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1842f307-8954-43fd-ac5a-30b2d8bac754 req-33a74ab7-41ce-4ba7-a2bf-7bb81351146a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041252 Oct 22 03:08:07.265171 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 518/1034] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:07.566806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:07.567463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:07.575011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:07.575442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:07.575874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:07.576781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:07.577388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:07.577989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:07.745388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:07.753957 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1b979df6-0c9c-49b0-b381-deaf586eb0c7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1477 microversion: 2.1 time: 0.190730 Oct 22 03:08:07.754719 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 517/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:07 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:07.984591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:07.986006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:07.995307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:07.996173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:07.996912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:07.997850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:07.999605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:08.000875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:08.234829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:08.243822 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b3e9483-2ae1-4d58-b592-1477273ba1b5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1463 microversion: 2.1 time: 0.263963 Oct 22 03:08:08.245796 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 519/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:07 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1463 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:08.268791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:08.269395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:08.276341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:08.277103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:08.277733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:08.278613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:08.279251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:08.279841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:08.461534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:08.473835 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9961ccfa-93fb-4415-9305-662e2532b30e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1463 microversion: 2.1 time: 0.208054 Oct 22 03:08:08.476591 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 518/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:08 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1463 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:08.503613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3a1f5fd-ff0f-4636-a08e-7aef7485dd05 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'create', calling method: .version_select at 0x7f0d1a1e3310>, body: {"keypair": {"name": "tempest-keypair-861753191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHflqhXp6TJ9VoP1pGdPVor1TjTeIvAMjF8l/hZLf7Ia7b+aOR+T0GJ46UhhnTIqaKA4aNYQAaNJSwjXpyqOMWbd2D5VX7UrNkatgUkVPo1JSZMWIxoVXa18yymhoRkAw=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:08.535465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-d3a1f5fd-ff0f-4636-a08e-7aef7485dd05 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:08.542100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-d3a1f5fd-ff0f-4636-a08e-7aef7485dd05 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for user 7bf9da8e55124a7aae0938bb828b8f8a and project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:08.575117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3a1f5fd-ff0f-4636-a08e-7aef7485dd05 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076501 Oct 22 03:08:08.588398 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 520/1038] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:08:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:08.780505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:08.781238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:08.790447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:08.791233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:08.791394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:08.797379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:08.797891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:08.798472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:09.051469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:09.064759 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b9aad5b-f462-44be-a174-e78844fb37d3 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1477 microversion: 2.1 time: 0.289819 Oct 22 03:08:09.077769 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 519/1039] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:08 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:09.287825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9bd598aa-9dd6-4f27-81de-357d56087f57 req-e0de9a5d-098b-418d-aeba-d185edcf003e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896b7177-4fd2-47b7-866b-4f7cb6ea78aa", "name": "network-vif-unplugged", "status": "completed", "tag": "c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:09.299387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9bd598aa-9dd6-4f27-81de-357d56087f57 req-e0de9a5d-098b-418d-aeba-d185edcf003e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:09.300295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9bd598aa-9dd6-4f27-81de-357d56087f57 req-e0de9a5d-098b-418d-aeba-d185edcf003e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:09.300992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9bd598aa-9dd6-4f27-81de-357d56087f57 req-e0de9a5d-098b-418d-aeba-d185edcf003e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:09.313987 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9bd598aa-9dd6-4f27-81de-357d56087f57 req-e0de9a5d-098b-418d-aeba-d185edcf003e service nova] Creating event network-vif-unplugged:c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c for instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa on n-h1-862416-2 Oct 22 03:08:09.319373 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9bd598aa-9dd6-4f27-81de-357d56087f57 req-e0de9a5d-098b-418d-aeba-d185edcf003e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036184 Oct 22 03:08:09.324620 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 521/1040] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:10.092415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.099747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:10.112127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.112560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.113056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.113726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.114305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.114680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.283672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a1e14c0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:10.287823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.288628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.289244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.298233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.298715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.299143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.306486 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] HTTP exception thrown: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Request method failure captured: Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4 HTTP/1.1 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 56 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16Z1B_nDtD5r5ZbCIa84YqqGSG1QFXmF8WZQcBrCwLy_mAPVJ1jPvVrkXu4amIfF8FFz80Igg02Heqv0MKHzPaPsmT29FXTNlhzen3i8nQ9r0mUW3NFh_ybBWU8QDw-pAypnj8rGOKrLT83-I6t7os0FhsRtNvgDUkMg_0FhHhXfrg Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.53 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: deecdc68e9374c448e2f1531ede2e5e4 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deecdc68e9374c448e2f1531ede2e5e4"}]}] Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: deecdc68e9374c448e2f1531ede2e5e4 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 9d0b419dda844346b2dfb84cd4ccc9c9 Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: exception: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9037596a-ffe2-4bd7-a755-4cadff687da4', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:10.308641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Returning 404 to user: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d96704c2-010f-4446-9ef3-8371bae48afb tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4" status: 404 len: 110 microversion: 2.53 time: 0.216132 Oct 22 03:08:10.312984 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 522/1041] 10.222.0.25 () {62 vars in 1309 bytes} [Sat Oct 22 03:08:10 2022] PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4 => generated 110 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:08:10.318264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca9cb157-fbde-4dd2-a686-6af0d36f83f9 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '.version_select at 0x7f0d1a1e1ee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.322618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca9cb157-fbde-4dd2-a686-6af0d36f83f9 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.322915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca9cb157-fbde-4dd2-a686-6af0d36f83f9 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.323357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca9cb157-fbde-4dd2-a686-6af0d36f83f9 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.332193 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca9cb157-fbde-4dd2-a686-6af0d36f83f9 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.018978 Oct 22 03:08:10.332877 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 523/1042] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:10.338320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a4cb550>, body: {"status": "disabled"} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:10.348282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.348282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.348282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.351482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.351967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.352474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.357631 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] HTTP exception thrown: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Request method failure captured: Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4 HTTP/1.1 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 22 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16Z1B_nDtD5r5ZbCIa84YqqGSG1QFXmF8WZQcBrCwLy_mAPVJ1jPvVrkXu4amIfF8FFz80Igg02Heqv0MKHzPaPsmT29FXTNlhzen3i8nQ9r0mUW3NFh_ybBWU8QDw-pAypnj8rGOKrLT83-I6t7os0FhsRtNvgDUkMg_0FhHhXfrg Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.53 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: deecdc68e9374c448e2f1531ede2e5e4 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deecdc68e9374c448e2f1531ede2e5e4"}]}] Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: deecdc68e9374c448e2f1531ede2e5e4 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 9d0b419dda844346b2dfb84cd4ccc9c9 Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: {"status": "disabled"} Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: exception: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9037596a-ffe2-4bd7-a755-4cadff687da4', 'body': {'status': 'disabled'}} Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:10.359408 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Returning 404 to user: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd44f81d-65e2-4178-af47-31f0c78cb663 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4" status: 404 len: 110 microversion: 2.53 time: 0.027090 Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 524/1043] 10.222.0.25 () {62 vars in 1309 bytes} [Sat Oct 22 03:08:10 2022] PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:08:10.366781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c1d14fd-945d-4bf1-8335-1dab8fa659ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.372822 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c1d14fd-945d-4bf1-8335-1dab8fa659ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010450 Oct 22 03:08:10.373381 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 525/1044] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:10.377712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a4cbee0>, body: {"status": "enabled"} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:10.380054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:10.381184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.381676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.382118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.389771 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b9e37a84-2ad0-4ca0-9def-59333b06b3b0 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1477 microversion: 2.1 time: 0.302779 Oct 22 03:08:10.389987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.390352 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 520/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:10.390885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.391545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.396683 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] HTTP exception thrown: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.397356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a2a2ab1-a708-4f80-8d7a-ca1708e4c1b0 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-937666589", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Request method failure captured: Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4 HTTP/1.1 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 21 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16Z1B_nDtD5r5ZbCIa84YqqGSG1QFXmF8WZQcBrCwLy_mAPVJ1jPvVrkXu4amIfF8FFz80Igg02Heqv0MKHzPaPsmT29FXTNlhzen3i8nQ9r0mUW3NFh_ybBWU8QDw-pAypnj8rGOKrLT83-I6t7os0FhsRtNvgDUkMg_0FhHhXfrg Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.53 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: deecdc68e9374c448e2f1531ede2e5e4 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/deecdc68e9374c448e2f1531ede2e5e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/deecdc68e9374c448e2f1531ede2e5e4"}]}] Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: deecdc68e9374c448e2f1531ede2e5e4 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 9d0b419dda844346b2dfb84cd4ccc9c9 Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: {"status": "enabled"} Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: exception: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9037596a-ffe2-4bd7-a755-4cadff687da4', 'body': {'status': 'enabled'}} Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:10.398762 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. Oct 22 03:08:10.403426 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.407243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Returning 404 to user: Service 9037596a-ffe2-4bd7-a755-4cadff687da4 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:10.407243 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5d137e38-5962-4cf9-a8c4-b263f7403ae6 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4" status: 404 len: 110 microversion: 2.53 time: 0.032329 Oct 22 03:08:10.407243 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 526/1046] 10.222.0.25 () {62 vars in 1309 bytes} [Sat Oct 22 03:08:10 2022] PUT /compute/v2.1/os-services/9037596a-ffe2-4bd7-a755-4cadff687da4 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:08:10.417000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c9545d4c-2ca6-4a41-a263-3e86abd79287 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.420844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9545d4c-2ca6-4a41-a263-3e86abd79287 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.421335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9545d4c-2ca6-4a41-a263-3e86abd79287 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.421775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9545d4c-2ca6-4a41-a263-3e86abd79287 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.422511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9545d4c-2ca6-4a41-a263-3e86abd79287 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.422969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9545d4c-2ca6-4a41-a263-3e86abd79287 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.423089 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a2a2ab1-a708-4f80-8d7a-ca1708e4c1b0 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.030203 Oct 22 03:08:10.423396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9545d4c-2ca6-4a41-a263-3e86abd79287 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.423641 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 521/1047] 10.222.0.25 () {60 vars in 1146 bytes} [Sat Oct 22 03:08:10 2022] POST /compute/v2.1/flavors => generated 498 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:10.436676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a64db3b5-c0fe-4367-b7f9-6cb31caa1662 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.444677 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a64db3b5-c0fe-4367-b7f9-6cb31caa1662 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011725 Oct 22 03:08:10.445459 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 522/1048] 10.222.0.25 () {58 vars in 1182 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:08:10.462358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c9545d4c-2ca6-4a41-a263-3e86abd79287 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049677 Oct 22 03:08:10.463669 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 527/1049] 10.222.0.25 () {60 vars in 1178 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:08:10.478034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-820373b8-17a7-4519-bcef-e63b97258580 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.481747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-820373b8-17a7-4519-bcef-e63b97258580 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.482367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-820373b8-17a7-4519-bcef-e63b97258580 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.482809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-820373b8-17a7-4519-bcef-e63b97258580 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.483600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-820373b8-17a7-4519-bcef-e63b97258580 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.484289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-820373b8-17a7-4519-bcef-e63b97258580 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.484883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-820373b8-17a7-4519-bcef-e63b97258580 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.512088 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-820373b8-17a7-4519-bcef-e63b97258580 tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038894 Oct 22 03:08:10.512798 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 523/1050] 10.222.0.25 () {60 vars in 1211 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:08:10.527063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8f436d6-50cb-4e82-ba84-a3a7fab5c2cf tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.530505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8f436d6-50cb-4e82-ba84-a3a7fab5c2cf tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.530987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8f436d6-50cb-4e82-ba84-a3a7fab5c2cf tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.531661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8f436d6-50cb-4e82-ba84-a3a7fab5c2cf tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.532742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8f436d6-50cb-4e82-ba84-a3a7fab5c2cf tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.533529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8f436d6-50cb-4e82-ba84-a3a7fab5c2cf tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.533963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8f436d6-50cb-4e82-ba84-a3a7fab5c2cf tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.565798 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8f436d6-50cb-4e82-ba84-a3a7fab5c2cf tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.042935 Oct 22 03:08:10.572291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1755692511", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "32f6b823-ee95-42ba-81d0-ab54a26036ab"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:10.573284 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 528/1051] 10.222.0.25 () {60 vars in 1178 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:08:10.579670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48679abc-c2a7-4f55-bfe0-0d2756a6eded tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.583488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48679abc-c2a7-4f55-bfe0-0d2756a6eded tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.584337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48679abc-c2a7-4f55-bfe0-0d2756a6eded tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.584974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48679abc-c2a7-4f55-bfe0-0d2756a6eded tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.586000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48679abc-c2a7-4f55-bfe0-0d2756a6eded tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.588103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48679abc-c2a7-4f55-bfe0-0d2756a6eded tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.588586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48679abc-c2a7-4f55-bfe0-0d2756a6eded tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.613837 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48679abc-c2a7-4f55-bfe0-0d2756a6eded tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-862416-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038097 Oct 22 03:08:10.614661 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 529/1052] 10.222.0.25 () {60 vars in 1235 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/os-services?host=n-d-862416-2&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:10.627567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e65766ac-1f9c-407d-9565-03348616e5cd tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.636942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:08:10.647911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e65766ac-1f9c-407d-9565-03348616e5cd tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.648849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e65766ac-1f9c-407d-9565-03348616e5cd tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.651098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e65766ac-1f9c-407d-9565-03348616e5cd tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.652995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e65766ac-1f9c-407d-9565-03348616e5cd tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.653881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e65766ac-1f9c-407d-9565-03348616e5cd tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.654521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e65766ac-1f9c-407d-9565-03348616e5cd tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.685809 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e65766ac-1f9c-407d-9565-03348616e5cd tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.062664 Oct 22 03:08:10.686814 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 530/1053] 10.222.0.25 () {60 vars in 1178 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:08:10.699928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-29d34ad4-df9a-4597-85bd-4a90e36c674d tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.704067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29d34ad4-df9a-4597-85bd-4a90e36c674d tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.704635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29d34ad4-df9a-4597-85bd-4a90e36c674d tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.705122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29d34ad4-df9a-4597-85bd-4a90e36c674d tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.705930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29d34ad4-df9a-4597-85bd-4a90e36c674d tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.706398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29d34ad4-df9a-4597-85bd-4a90e36c674d tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.706827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29d34ad4-df9a-4597-85bd-4a90e36c674d tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.733164 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-29d34ad4-df9a-4597-85bd-4a90e36c674d tempest-ServicesAdminNegativeV253TestJSON-1237603553 tempest-ServicesAdminNegativeV253TestJSON-1237603553-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.037715 Oct 22 03:08:10.734123 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 531/1054] 10.222.0.25 () {60 vars in 1239 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:10.867263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6461169-a91d-4bb2-bf7e-1181ce2a2e8a tempest-ServicesAdminNegativeV253TestJSON-315288479 tempest-ServicesAdminNegativeV253TestJSON-315288479-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:10.872633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6461169-a91d-4bb2-bf7e-1181ce2a2e8a tempest-ServicesAdminNegativeV253TestJSON-315288479 tempest-ServicesAdminNegativeV253TestJSON-315288479-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '045325fbdc22493f83554d10a27856a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50859c3801a349319eed3dd8637bad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6461169-a91d-4bb2-bf7e-1181ce2a2e8a tempest-ServicesAdminNegativeV253TestJSON-315288479 tempest-ServicesAdminNegativeV253TestJSON-315288479-project] Request method failure captured: Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16ZaLtHoQmaurMFj9mHLmOeeaBMT-0MH8T6m9YkPDFY26o6J0AQ4lnaDSPX5ty6kOU2tbJJoc1AfAaQcmfZ0jkysPONYZHKZOEuK3M8ZAnUwyE7RXpUTsg09fLeCNYFM-4IrUHeYet5tIdyZaeXJ_JQ-haw7E0TRRyj4mVqKA2Ujjk Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.53 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 50859c3801a349319eed3dd8637bad37 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-315288479 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_50859c3801a349319eed3dd8637bad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50859c3801a349319eed3dd8637bad37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/50859c3801a349319eed3dd8637bad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/50859c3801a349319eed3dd8637bad37"}]}] Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-315288479 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 50859c3801a349319eed3dd8637bad37 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-315288479 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServicesAdminNegativeV253TestJSON-315288479-project Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 045325fbdc22493f83554d10a27856a9 Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-315288479-project Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: action_args: {} Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:08:10.875442 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 03:08:10.879421 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:10.882058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6461169-a91d-4bb2-bf7e-1181ce2a2e8a tempest-ServicesAdminNegativeV253TestJSON-315288479 tempest-ServicesAdminNegativeV253TestJSON-315288479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:10.883160 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6461169-a91d-4bb2-bf7e-1181ce2a2e8a tempest-ServicesAdminNegativeV253TestJSON-315288479 tempest-ServicesAdminNegativeV253TestJSON-315288479-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.140684 Oct 22 03:08:10.884264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 532/1055] 10.222.0.25 () {60 vars in 1178 bytes} [Sat Oct 22 03:08:10 2022] GET /compute/v2.1/os-services => generated 112 bytes in 142 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:08:10.932238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:08:10.932722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:08:10.933206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:08:10.933620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:08:10.934035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:08:10.944526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.945267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.945869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.946868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:10.947492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:10.948199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:10.970480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:10.976971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for user 7bf9da8e55124a7aae0938bb828b8f8a and project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:10.992068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:08:10.994823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:08:11.063959 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a44ed01-6c4c-47e4-9c7d-8e5593e79229 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502133 Oct 22 03:08:11.065584 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 524/1056] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:08:11.079476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b0340941-6305-4514-aea6-9bebf47624b0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:11.080479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b0340941-6305-4514-aea6-9bebf47624b0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:11.205212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b0340941-6305-4514-aea6-9bebf47624b0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:11.215699 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b0340941-6305-4514-aea6-9bebf47624b0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1279 microversion: 2.1 time: 0.141399 Oct 22 03:08:11.217036 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 533/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:11 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:11.344037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-c1f0e4df-313c-4920-8edf-ed0382722d1a req-1481e105-3131-4a4d-8f78-dcaa7794a775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896b7177-4fd2-47b7-866b-4f7cb6ea78aa", "name": "network-vif-plugged", "status": "completed", "tag": "c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:11.359228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c1f0e4df-313c-4920-8edf-ed0382722d1a req-1481e105-3131-4a4d-8f78-dcaa7794a775 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:11.360432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c1f0e4df-313c-4920-8edf-ed0382722d1a req-1481e105-3131-4a4d-8f78-dcaa7794a775 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:11.362473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c1f0e4df-313c-4920-8edf-ed0382722d1a req-1481e105-3131-4a4d-8f78-dcaa7794a775 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:11.380441 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-c1f0e4df-313c-4920-8edf-ed0382722d1a req-1481e105-3131-4a4d-8f78-dcaa7794a775 service nova] Creating event network-vif-plugged:c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c for instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa on n-h1-862416-2 Oct 22 03:08:11.389662 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-c1f0e4df-313c-4920-8edf-ed0382722d1a req-1481e105-3131-4a4d-8f78-dcaa7794a775 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051625 Oct 22 03:08:11.390580 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 525/1058] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:11.416009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:11.417750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:11.439020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:11.442911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:11.445587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:11.449025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:11.452920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:11.454927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:11.839329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:11.848517 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa29b03e-b06d-4be5-be75-0ff527b25528 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1477 microversion: 2.1 time: 0.438544 Oct 22 03:08:11.866565 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 534/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:11 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1477 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:12.240007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:12.241280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:12.254270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:12.255049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:12.255694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:12.256803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:12.257458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:12.258111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:12.360491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:12.370245 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2fad9d5a-7d1c-451d-a164-ec882a6c6a8b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1331 microversion: 2.1 time: 0.134514 Oct 22 03:08:12.371125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 526/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:12 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:12.874329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:12.875644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:12.883775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:12.886879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:12.889804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:12.891175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:12.892074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:12.894704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:13.400587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:13.401867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:13.428914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:13.429795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:13.431510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:13.433243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:13.434111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:13.434938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:13.525625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:13.546117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d3acc23-c038-42f3-b5f1-75f3b4c4d4d7 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1477 microversion: 2.1 time: 0.675627 Oct 22 03:08:13.549058 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 535/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:12 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1477 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:13.577259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:13.589842 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-06788490-ec6e-428c-93e1-5a822e7d4174 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1337 microversion: 2.1 time: 0.196323 Oct 22 03:08:13.595969 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 527/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:13 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1337 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:14.580345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:14.581096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:14.600728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:14.601291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:14.601743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:14.602602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:14.604138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:14.609159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:14.615252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:14.615880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:14.634651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:14.635146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:14.643629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:14.645155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:14.650139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:14.651822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:14.989237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:15.008828 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e091711-d41b-4663-b515-c5a9808a294e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1379 microversion: 2.1 time: 0.396281 Oct 22 03:08:15.010176 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 528/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:14 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1379 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:15.227032 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3230622c-edd0-4c31-908d-c15354bb5852 tempest-TenantUsagesNegativeTestJSON-314097345 tempest-TenantUsagesNegativeTestJSON-314097345-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-21T03%3A08%3A15.028664&end=2022-10-23T03%3A08%3A15.028664" status: 404 len: 112 microversion: - time: 0.194439 Oct 22 03:08:15.233480 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 529/1064] 10.222.0.25 () {58 vars in 1316 bytes} [Sat Oct 22 03:08:15 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-21T03%3A08%3A15.028664&end=2022-10-23T03%3A08%3A15.028664 => generated 112 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 03:08:15.239870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-70014e51-d394-4dca-bbb3-119af65ccee9 req-f2a996c4-8554-4648-aaed-89dd3172178b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:15.267266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-70014e51-d394-4dca-bbb3-119af65ccee9 req-f2a996c4-8554-4648-aaed-89dd3172178b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:15.267744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-70014e51-d394-4dca-bbb3-119af65ccee9 req-f2a996c4-8554-4648-aaed-89dd3172178b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:15.268451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:15.278076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-70014e51-d394-4dca-bbb3-119af65ccee9 req-f2a996c4-8554-4648-aaed-89dd3172178b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:15.281862 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1fc87eb8-5d73-4314-b997-7c894da6d930 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1462 microversion: 2.1 time: 0.702264 Oct 22 03:08:15.282750 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 536/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:14 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1462 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:15.315196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ec8f4e0-42e5-49ef-856d-3fca472d250a tempest-TenantUsagesNegativeTestJSON-314097345 tempest-TenantUsagesNegativeTestJSON-314097345-project-admin] Calling method '.version_select at 0x7f0d1a307670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:15.316343 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-70014e51-d394-4dca-bbb3-119af65ccee9 req-f2a996c4-8554-4648-aaed-89dd3172178b service nova] Creating event network-changed:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h2-862416-2 Oct 22 03:08:15.321525 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7ec8f4e0-42e5-49ef-856d-3fca472d250a tempest-TenantUsagesNegativeTestJSON-314097345 tempest-TenantUsagesNegativeTestJSON-314097345-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 22 03:08:15.327107 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-70014e51-d394-4dca-bbb3-119af65ccee9 req-f2a996c4-8554-4648-aaed-89dd3172178b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092302 Oct 22 03:08:15.327661 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 530/1066] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ec8f4e0-42e5-49ef-856d-3fca472d250a tempest-TenantUsagesNegativeTestJSON-314097345 tempest-TenantUsagesNegativeTestJSON-314097345-project-admin] Request method failure captured: Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-simple-tenant-usage/aa46bb64e8e4493790ef9fa03a433c79?start=2022-10-23T03%3A08%3A15.028664&end=2022-10-21T03%3A08%3A15.028664 HTTP/1.1 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16eXhtFkH06fMKYNNhpwGYymR0dJFYLkS88RnhLeU3ZKfHTIBpC6RNoCTiYwqFTdsT9poQxSEg9BhvUJDFx-CZXYVLickLCRP1-Q1FrfBVuL58dh73y3rM1JWn-hOo_1Sve0FxPOYtnPz3rBnw5OSKF4F5vN2I56pWZH-rIpT0FBR4 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fb1de615ee0d498ba073f9c1efc34d0a Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-314097345 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb1de615ee0d498ba073f9c1efc34d0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb1de615ee0d498ba073f9c1efc34d0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb1de615ee0d498ba073f9c1efc34d0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb1de615ee0d498ba073f9c1efc34d0a"}]}] Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-314097345 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fb1de615ee0d498ba073f9c1efc34d0a Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-314097345 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TenantUsagesNegativeTestJSON-314097345-project-admin Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: a1f2988de14a44a1a9bf0fc003eb4301 Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-314097345-project-admin Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid start time. The start time cannot occur after the end time. Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'aa46bb64e8e4493790ef9fa03a433c79'} Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 22 03:08:15.329664 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:15.333574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ec8f4e0-42e5-49ef-856d-3fca472d250a tempest-TenantUsagesNegativeTestJSON-314097345 tempest-TenantUsagesNegativeTestJSON-314097345-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:15.333574 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ec8f4e0-42e5-49ef-856d-3fca472d250a tempest-TenantUsagesNegativeTestJSON-314097345 tempest-TenantUsagesNegativeTestJSON-314097345-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/aa46bb64e8e4493790ef9fa03a433c79?start=2022-10-23T03%3A08%3A15.028664&end=2022-10-21T03%3A08%3A15.028664" status: 400 len: 111 microversion: 2.1 time: 0.037327 Oct 22 03:08:15.339934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:15.341255 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 537/1067] 10.222.0.25 () {58 vars in 1412 bytes} [Sat Oct 22 03:08:15 2022] GET /compute/v2.1/os-simple-tenant-usage/aa46bb64e8e4493790ef9fa03a433c79?start=2022-10-23T03%3A08%3A15.028664&end=2022-10-21T03%3A08%3A15.028664 => generated 111 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:08:15.352421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:15.367730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:15.379300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:15.379760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:15.380544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:15.381014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:15.385773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:15.594845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:15.609984 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a6e19e0-f7bf-401e-bea6-3be808129777 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action" status: 202 len: 0 microversion: 2.1 time: 0.281049 Oct 22 03:08:15.613473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 531/1068] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:08:15 2022] POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:08:15.626196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:15.626866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd15b184-ecb8-47b4-864c-b2d36d82ad6d tempest-TenantUsagesNegativeTestJSON-1076796922 tempest-TenantUsagesNegativeTestJSON-1076796922-project] Calling method '.version_select at 0x7f0d1a1e1ee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:15.628107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:15.631450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd15b184-ecb8-47b4-864c-b2d36d82ad6d tempest-TenantUsagesNegativeTestJSON-1076796922 tempest-TenantUsagesNegativeTestJSON-1076796922-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'be74a70bcff1417d92295f4b371ef82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa46bb64e8e4493790ef9fa03a433c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd15b184-ecb8-47b4-864c-b2d36d82ad6d tempest-TenantUsagesNegativeTestJSON-1076796922 tempest-TenantUsagesNegativeTestJSON-1076796922-project] Request method failure captured: Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T03%3A08%3A15.028664&end=2022-10-23T03%3A08%3A15.028664&detailed=1 HTTP/1.1 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16dKtBxbM22zojEPimOqP9UQF7cmv0AIZS0HhVekKwALj2f8ARi1BNS6e5oz3ogGzYHhXqfHcEItPWHwgfhcN4N3RXzseHrPC-chCuxvV_kYqmARfHi8P9tBZ2lN9tMF-Z6reYDMRDFQuf0ygEmy5BWWSQgLAAX4Gbtk0RO5d_7_Hs Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: aa46bb64e8e4493790ef9fa03a433c79 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1076796922 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa46bb64e8e4493790ef9fa03a433c79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa46bb64e8e4493790ef9fa03a433c79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa46bb64e8e4493790ef9fa03a433c79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa46bb64e8e4493790ef9fa03a433c79"}]}] Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1076796922 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: aa46bb64e8e4493790ef9fa03a433c79 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1076796922 Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TenantUsagesNegativeTestJSON-1076796922-project Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: be74a70bcff1417d92295f4b371ef82b Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1076796922-project Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: action_args: {} Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:08:15.632961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:15.637091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd15b184-ecb8-47b4-864c-b2d36d82ad6d tempest-TenantUsagesNegativeTestJSON-1076796922 tempest-TenantUsagesNegativeTestJSON-1076796922-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:15.641936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:15.642793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:15.643413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:15.644342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:15.644985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:15.645614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:15.648707 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd15b184-ecb8-47b4-864c-b2d36d82ad6d tempest-TenantUsagesNegativeTestJSON-1076796922 tempest-TenantUsagesNegativeTestJSON-1076796922-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T03%3A08%3A15.028664&end=2022-10-23T03%3A08%3A15.028664&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.297973 Oct 22 03:08:15.654671 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 538/1069] 10.222.0.25 () {58 vars in 1335 bytes} [Sat Oct 22 03:08:15 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T03%3A08%3A15.028664&end=2022-10-23T03%3A08%3A15.028664&detailed=1 => generated 123 bytes in 310 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:15.678922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:15.684576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:15.685431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:15.686052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:15.686685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lazy-loading 'fault' on Instance uuid 896b7177-4fd2-47b7-866b-4f7cb6ea78aa {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:15.959437 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1b663bf6-32a6-4cb3-9393-5c8f68847e68 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1596 microversion: 2.1 time: 0.341725 Oct 22 03:08:15.968451 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 532/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:15 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1596 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:15.985059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:15.987494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:16.001474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.002400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.003072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.006741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.007582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.008313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.035275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:16.035899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:16.046673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.048398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.051141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.052165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.053973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.054836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.169175 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11a484de-35be-49ff-97f6-b623cb81b362 tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action" status: 202 len: 0 microversion: 2.1 time: 0.187205 Oct 22 03:08:16.172886 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 539/1071] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:08:15 2022] POST /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:08:16.182383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:16.187067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:16.198027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.198493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.198931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.199675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.200161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.200612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.354123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:16.363992 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e80aa811-5f57-452b-9bb2-e32936b1b49f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1379 microversion: 2.1 time: 0.333092 Oct 22 03:08:16.366839 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 533/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:16 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1379 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:16.512773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:16.518232 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a1f673b7-e5f9-4fca-80ac-ce0dab9f968f tempest-ServersAdminTestJSON-1715998409 tempest-ServersAdminTestJSON-1715998409-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1613 microversion: 2.1 time: 0.342910 Oct 22 03:08:16.519696 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 540/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:16 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1613 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:16.545496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:16.546254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:16.553301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.554123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.554770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.557105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.557988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.558635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.595069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-188059500", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "91dcc407-277a-4681-b1fa-fbf08ca189a3"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:16.613188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:08:16.674899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] validate_networks() for [('91dcc407-277a-4681-b1fa-fbf08ca189a3', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:08:16.791318 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47daeed6-fa09-4882-bb33-d35312628752 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 204 len: 0 microversion: 2.1 time: 0.251462 Oct 22 03:08:16.794820 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 541/1074] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:08:16 2022] DELETE /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:08:16.802207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:16.802994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:16.812319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.814318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.816418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:16.818713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:16.819200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:16.819645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:17.079295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:17.091377 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7952470a-15b6-496b-a37b-16a995be93de tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1468 microversion: 2.1 time: 0.294287 Oct 22 03:08:17.094245 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 542/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:16 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:17.390118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:17.390725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:17.400756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:17.401331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:17.401806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:17.402439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:17.403087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:17.403745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:17.559785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:08:17.560243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:08:17.560722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:08:17.561158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:08:17.561602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:08:17.576898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:17.577330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:17.577748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:17.578484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:17.578940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:17.579366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:17.594707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:17.597810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Getting quotas for project bd702fd8e5914ca4942861c674d30400. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:17.604257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Getting quotas for user 97f455e3c732402283bd33b904abadfb and project bd702fd8e5914ca4942861c674d30400. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:17.609398 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b700a32c-d775-497e-b1a4-2d54693a6ff3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1379 microversion: 2.1 time: 0.223278 Oct 22 03:08:17.610307 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 543/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:17 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1379 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:17.618172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:08:17.620961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:08:17.671384 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9612ccc6-da83-4cd2-9ab7-ac9934acee04 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302467 Oct 22 03:08:17.672180 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 534/1077] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:08:17.683526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a20918d3-f763-49d5-b18c-126435ac6a28 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:17.684149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a20918d3-f763-49d5-b18c-126435ac6a28 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:17.749101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a20918d3-f763-49d5-b18c-126435ac6a28 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:17.756170 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a20918d3-f763-49d5-b18c-126435ac6a28 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1215 microversion: 2.1 time: 0.076491 Oct 22 03:08:17.756773 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 544/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:17 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:18.118702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:18.119437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:18.126753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:18.127580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:18.128246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:18.129185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:18.130074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:18.130947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:18.379817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:18.391203 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-496b2b1f-9810-438b-b9a5-ec6486c4127a tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1468 microversion: 2.1 time: 0.277155 Oct 22 03:08:18.395410 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 535/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:18 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:18.635200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:18.636157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:18.647993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:18.648633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:18.650774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:18.652061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:18.652912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:18.653641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:18.783399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:18.784679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:18.808756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:18.810431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:18.812856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:18.815092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:18.816596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:18.825041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:18.921566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:18.932906 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98836f1a-e331-4fa1-977b-60095fec8e13 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1211 microversion: 2.1 time: 0.156288 Oct 22 03:08:18.934225 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 536/1080] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:18 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:19.051452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0b25232d-bd4c-4d27-b3dd-804a0276901e req-6b002299-bdf3-445b-8c55-7e2acdc31f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ea5f98-14d7-4474-bfc8-43786db3e230", "name": "network-vif-deleted", "tag": "895f206a-567b-4921-9864-2b596bbae44b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:19.084254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0b25232d-bd4c-4d27-b3dd-804a0276901e req-6b002299-bdf3-445b-8c55-7e2acdc31f61 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:19.089217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0b25232d-bd4c-4d27-b3dd-804a0276901e req-6b002299-bdf3-445b-8c55-7e2acdc31f61 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:19.090315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0b25232d-bd4c-4d27-b3dd-804a0276901e req-6b002299-bdf3-445b-8c55-7e2acdc31f61 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:19.122395 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0b25232d-bd4c-4d27-b3dd-804a0276901e req-6b002299-bdf3-445b-8c55-7e2acdc31f61 service nova] Creating event network-vif-deleted:895f206a-567b-4921-9864-2b596bbae44b for instance e7ea5f98-14d7-4474-bfc8-43786db3e230 on n-h1-862416-2 Oct 22 03:08:19.130969 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0b25232d-bd4c-4d27-b3dd-804a0276901e req-6b002299-bdf3-445b-8c55-7e2acdc31f61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085217 Oct 22 03:08:19.132223 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 537/1081] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:19.140378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:19.152039 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f99df7f8-ed3c-400a-aa83-8650fb1a06c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1379 microversion: 2.1 time: 0.522034 Oct 22 03:08:19.153079 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 545/1082] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:18 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1379 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:19.400051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6870d3a9-824c-4681-a437-0bbaee53ebc7 tempest-ListImagesTestJSON-57145662 tempest-ListImagesTestJSON-57145662-project] Calling method '.version_select at 0x7f0d1a6a2040>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:19.420275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:19.421561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:19.450530 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6870d3a9-824c-4681-a437-0bbaee53ebc7 tempest-ListImagesTestJSON-57145662 tempest-ListImagesTestJSON-57145662-project] 10.222.0.25 "GET /compute/v2.1/images/78462069-c4b0-4a1c-b064-2d19ad600046" status: 200 len: 784 microversion: 2.1 time: 0.209844 Oct 22 03:08:19.451448 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 538/1083] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:08:19 2022] GET /compute/v2.1/images/78462069-c4b0-4a1c-b064-2d19ad600046 => generated 784 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:19.453758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:19.454281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:19.454732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:19.455461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:19.456145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:19.456674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:19.471228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3543563-ef18-4aa8-863f-e70627e15b26 tempest-ListImagesTestJSON-57145662 tempest-ListImagesTestJSON-57145662-project] Calling method '.version_select at 0x7f0d1a480dc0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:19.512099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:19.512958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:19.513674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:19.514506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lazy-loading 'fault' on Instance uuid e7ea5f98-14d7-4474-bfc8-43786db3e230 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:19.560670 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3543563-ef18-4aa8-863f-e70627e15b26 tempest-ListImagesTestJSON-57145662 tempest-ListImagesTestJSON-57145662-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.094903 Oct 22 03:08:19.561616 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 539/1084] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Oct 22 03:08:19 2022] GET /compute/v2.1/images => generated 445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:19.574716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79f1760a-d1af-44d0-a7e4-61d1133e1c4b tempest-ListImagesTestJSON-57145662 tempest-ListImagesTestJSON-57145662-project] Calling method '.version_select at 0x7f0d1a4ff310>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:19.579764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:19.596756 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a05b6eea-1a8e-4a1c-a477-c6be5bff544b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1304 microversion: 2.1 time: 0.180327 Oct 22 03:08:19.601006 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 546/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:19 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1304 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:19.634910 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79f1760a-d1af-44d0-a7e4-61d1133e1c4b tempest-ListImagesTestJSON-57145662 tempest-ListImagesTestJSON-57145662-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.064669 Oct 22 03:08:19.636243 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 540/1086] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:08:19 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:19.964501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:19.966187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:19.982205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:19.987969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:19.988877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:19.990739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:19.992378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:19.993603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:19.994489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:20.125598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:20.138373 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5fc294d2-93e2-496d-85f9-9d73d5ebb093 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1273 microversion: 2.1 time: 0.179486 Oct 22 03:08:20.138966 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 547/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:19 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:20.177372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:20.178866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:20.191839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:20.193320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:20.194101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:20.198545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:20.203289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:20.204142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:20.533990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:20.543256 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-05101f13-bd7b-4e46-a147-f440f4919a2c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1379 microversion: 2.1 time: 0.370886 Oct 22 03:08:20.543859 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 541/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:20 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1379 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:20.625628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:20.626360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:20.638117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:20.638701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:20.639606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:20.640530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:20.641210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:20.641803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:20.695060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:20.696105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:20.698570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:20.699253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lazy-loading 'fault' on Instance uuid e7ea5f98-14d7-4474-bfc8-43786db3e230 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:20.715162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=16 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:20.809879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:20.823638 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1449983d-9850-4629-a9bc-7643bce546e9 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 200 len: 1304 microversion: 2.1 time: 0.203300 Oct 22 03:08:20.827136 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 548/1089] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:20 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:21.165354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:21.165970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:21.177521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:21.178200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:21.178452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:21.179180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:21.179638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:21.180067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:21.572529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:21.573231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:21.587867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:21.590653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:21.593226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:21.594269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:21.597003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:21.597855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:21.673568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:21.687847 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-854261f7-fd1e-430f-841a-b187f5dbbfe4 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.526348 Oct 22 03:08:21.690577 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 542/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:21 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:21.770995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-dbfa614a-e43d-448d-a353-d1b0b2fd72d4 req-e57cb140-1d61-4a94-86ac-90dcc88c87ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "name": "network-vif-plugged", "status": "completed", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:21.791968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dbfa614a-e43d-448d-a353-d1b0b2fd72d4 req-e57cb140-1d61-4a94-86ac-90dcc88c87ae service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:21.792787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dbfa614a-e43d-448d-a353-d1b0b2fd72d4 req-e57cb140-1d61-4a94-86ac-90dcc88c87ae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:21.794645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dbfa614a-e43d-448d-a353-d1b0b2fd72d4 req-e57cb140-1d61-4a94-86ac-90dcc88c87ae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:21.819821 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-dbfa614a-e43d-448d-a353-d1b0b2fd72d4 req-e57cb140-1d61-4a94-86ac-90dcc88c87ae service nova] Creating event network-vif-plugged:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h2-862416-2 Oct 22 03:08:21.834445 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-dbfa614a-e43d-448d-a353-d1b0b2fd72d4 req-e57cb140-1d61-4a94-86ac-90dcc88c87ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067564 Oct 22 03:08:21.843946 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 543/1091] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:21.858989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:21.860386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: e7ea5f98-14d7-4474-bfc8-43786db3e230] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:21.877951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:21.881114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:21.883220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:21.885094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:21.889142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:21.890097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:21.938390 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] HTTP exception thrown: Instance e7ea5f98-14d7-4474-bfc8-43786db3e230 could not be found. Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Request method failure captured: Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 HTTP/1.1 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU14n-k-nlWrXW4lB1dxBjg5G8XgrAAivAfxQ6-FRwtVxVtc-1Mpl5-ej5IunzynqMIyWL1oGy3vQiP1zxSlAUBZQ78xEKn2Xz-p4zR9yiARaCUz3Eq4zA3lKykjvtSFMj0BFQpzeZ3cAq_E-QWxxKq-zKtimAVdRVjozp30GapyEuq4 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7fbe2f2bb3224e83a89df6ec4e84735b Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fbe2f2bb3224e83a89df6ec4e84735b"}]}] Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7fbe2f2bb3224e83a89df6ec4e84735b Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersAdminTestJSON-1539566908-project Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3f8560b839d44c479e3016ef9e4b3ff1 Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersAdminTestJSON-1539566908-project Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance e7ea5f98-14d7-4474-bfc8-43786db3e230 could not be found. Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'e7ea5f98-14d7-4474-bfc8-43786db3e230'} Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ea5f98-14d7-4474-bfc8-43786db3e230 could not be found. Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ea5f98-14d7-4474-bfc8-43786db3e230 could not be found. Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:21.948316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:21.954362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:21.954362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:21.954362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:21.954362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:21.954362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:21.954362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ea5f98-14d7-4474-bfc8-43786db3e230 could not be found. Oct 22 03:08:21.954362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:21.957034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Returning 404 to user: Instance e7ea5f98-14d7-4474-bfc8-43786db3e230 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:21.969244 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0449a8ea-b031-4995-9478-e04a640a2009 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230" status: 404 len: 111 microversion: 2.1 time: 0.117143 Oct 22 03:08:21.969417 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 544/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:21 2022] GET /compute/v2.1/servers/e7ea5f98-14d7-4474-bfc8-43786db3e230 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:08:21.990562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:21.991123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:22.013724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:22.016075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:22.017652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:22.018909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:22.019576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:22.021039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:22.073113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:08:22.247609 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c17a48d-92fc-4e72-a69f-fa172dc4cc59 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 204 len: 0 microversion: 2.1 time: 0.276031 Oct 22 03:08:22.251509 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 545/1093] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:08:21 2022] DELETE /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:08:22.258057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:22.259425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:22.273162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:22.276412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:22.277116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:22.278070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:22.280642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:22.281298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:22.394371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:22.413726 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-792d5938-b9e5-4675-9f15-21be7bf8eedf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1379 microversion: 2.1 time: 0.839396 Oct 22 03:08:22.417431 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 549/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:21 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1379 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:22.504341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:22.517751 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ec6503d6-d332-4d79-a7c0-d5656dbe19ab tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1468 microversion: 2.1 time: 0.264253 Oct 22 03:08:22.519225 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 546/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:22 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1468 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:22.621940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6d71c37d-2a3e-4bee-aa1f-3b93b3b9b01d req-5b6f8410-8b5c-46c7-8ad0-1dd3ad3a79cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cca44ac-4e26-4617-b207-fe192de0eed2", "tag": "4033401c-5ebc-44ef-bdea-5f4ad9eb5a3e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:22.632717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6d71c37d-2a3e-4bee-aa1f-3b93b3b9b01d req-5b6f8410-8b5c-46c7-8ad0-1dd3ad3a79cf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:22.634012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6d71c37d-2a3e-4bee-aa1f-3b93b3b9b01d req-5b6f8410-8b5c-46c7-8ad0-1dd3ad3a79cf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:22.635103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6d71c37d-2a3e-4bee-aa1f-3b93b3b9b01d req-5b6f8410-8b5c-46c7-8ad0-1dd3ad3a79cf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:22.646286 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6d71c37d-2a3e-4bee-aa1f-3b93b3b9b01d req-5b6f8410-8b5c-46c7-8ad0-1dd3ad3a79cf service nova] Creating event network-changed:4033401c-5ebc-44ef-bdea-5f4ad9eb5a3e for instance 8cca44ac-4e26-4617-b207-fe192de0eed2 on n-h1-862416-2 Oct 22 03:08:22.651209 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6d71c37d-2a3e-4bee-aa1f-3b93b3b9b01d req-5b6f8410-8b5c-46c7-8ad0-1dd3ad3a79cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034126 Oct 22 03:08:22.651798 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 547/1096] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:22.697803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba3bc987-3163-478e-bc20-f68e58e17202 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Action: 'create', calling method: .version_select at 0x7f0d1a4ce310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw2N9WguUoYdXXI0wxM4Vsxv3INORizHbPilGP/bodK10O2beDSa+f/vv0C0BttJUvlPtfMiDAwGsP2es2/TuOlCwq4WYlS5vpiIfIj6BLYCQ6rhLLevcjZArbwhxohrQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba3bc987-3163-478e-bc20-f68e58e17202 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Request method failure captured: Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 257 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16mkvRPdVLYoNh-EoUFDnMSXL6Xqit_qlFhBku2qUurcBF60t_DdG5Towff2dr1c1A1P7mFt4dHxQqigFKccRL5OQ7WCnytgI9a0cgXPFiNu5H7j_mBl9PYJ7R5vpPCzGX5EgEMlw49MX40uO1tHSI7uUHvoqOIwNUZ74cdtOIfjhA Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}] Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw2N9WguUoYdXXI0wxM4Vsxv3INORizHbPilGP/bodK10O2beDSa+f/vv0C0BttJUvlPtfMiDAwGsP2es2/TuOlCwq4WYlS5vpiIfIj6BLYCQ6rhLLevcjZArbwhxohrQ=="}} Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw2N9WguUoYdXXI0wxM4Vsxv3INORizHbPilGP/bodK10O2beDSa+f/vv0C0BttJUvlPtfMiDAwGsP2es2/TuOlCwq4WYlS5vpiIfIj6BLYCQ6rhLLevcjZArbwhxohrQ=='}}} Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 22 03:08:22.702076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba3bc987-3163-478e-bc20-f68e58e17202 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:22.706154 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba3bc987-3163-478e-bc20-f68e58e17202 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.135502 Oct 22 03:08:22.710240 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 550/1097] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:08:22 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:08:22.713536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:22.714418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:22.714562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c08ea002-613d-4240-936b-0fe5fdef3ea7 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Action: 'create', calling method: .version_select at 0x7f0d1a47d790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1470904421", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:22.720795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:22.721275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:22.721871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:22.722748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:22.723252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:22.723679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:22.731913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-c08ea002-613d-4240-936b-0fe5fdef3ea7 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:22.737294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-c08ea002-613d-4240-936b-0fe5fdef3ea7 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for user b5b2e752cc4d40e4b9e4d71955153854 and project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:22.755475 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c08ea002-613d-4240-936b-0fe5fdef3ea7 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c08ea002-613d-4240-936b-0fe5fdef3ea7 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Request method failure captured: Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 2167 Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16mkvRPdVLYoNh-EoUFDnMSXL6Xqit_qlFhBku2qUurcBF60t_DdG5Towff2dr1c1A1P7mFt4dHxQqigFKccRL5OQ7WCnytgI9a0cgXPFiNu5H7j_mBl9PYJ7R5vpPCzGX5EgEMlw49MX40uO1tHSI7uUHvoqOIwNUZ74cdtOIfjhA Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}] Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1470904421", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:22.766399 n-d-862416-2 devstack@n-api.service[120581]: exception: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1470904421', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:22.768974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c08ea002-613d-4240-936b-0fe5fdef3ea7 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c08ea002-613d-4240-936b-0fe5fdef3ea7 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.057628 Oct 22 03:08:22.772135 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 551/1098] 10.222.0.25 () {60 vars in 1160 bytes} [Sat Oct 22 03:08:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:08:22.780085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-49b65fac-1bf0-43c6-a415-7a05474033be tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Action: 'create', calling method: .version_select at 0x7f0d1a47dca0>, body: {"keypair": {"name": "tempest-keypair-1826631837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4CwloO75IDndo+7Vp2s+6JjDZSfTRKcc3kUpvkFYyMN+3QuRuaWw8umf5UQYnbjlYK7yRx8nNnXRLZr627VUH9PGKmx8c5dPgStKMGTEXEN5h8HCs8p0ah/0kviJIx2w=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:22.796367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-49b65fac-1bf0-43c6-a415-7a05474033be tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:22.801394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-49b65fac-1bf0-43c6-a415-7a05474033be tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for user b5b2e752cc4d40e4b9e4d71955153854 and project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:22.826320 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-49b65fac-1bf0-43c6-a415-7a05474033be tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049989 Oct 22 03:08:22.826934 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 552/1099] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:08:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:22.840934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63c5ad7a-bf3b-4ee1-980c-882f881db78c tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Action: 'create', calling method: .version_select at 0x7f0d1a47d1f0>, body: {"keypair": {"name": "tempest-keypair-1826631837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnQ1X53ub2qA+eEd1nqvCVaZXL7hd93tj5Cx9Qc5v1fro/I3CvdMADUzv40+rJYxgTpPPNbAPSamGUEppxonQeWFbreiW4JRIjKIzwk3mtw9ps6Byl5LiUFRuAFDFcrrQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:22.857283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-63c5ad7a-bf3b-4ee1-980c-882f881db78c tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:22.862130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:22.862428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-63c5ad7a-bf3b-4ee1-980c-882f881db78c tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for user b5b2e752cc4d40e4b9e4d71955153854 and project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:22.869927 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e0f3ee6-ba23-4db6-b3b7-23c052812037 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.162656 Oct 22 03:08:22.870499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 548/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:22 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:22.886861 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-63c5ad7a-bf3b-4ee1-980c-882f881db78c tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] HTTP exception thrown: Key pair 'tempest-keypair-1826631837' already exists. Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63c5ad7a-bf3b-4ee1-980c-882f881db78c tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Request method failure captured: Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 273 Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16mkvRPdVLYoNh-EoUFDnMSXL6Xqit_qlFhBku2qUurcBF60t_DdG5Towff2dr1c1A1P7mFt4dHxQqigFKccRL5OQ7WCnytgI9a0cgXPFiNu5H7j_mBl9PYJ7R5vpPCzGX5EgEMlw49MX40uO1tHSI7uUHvoqOIwNUZ74cdtOIfjhA Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}] Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: {"keypair": {"name": "tempest-keypair-1826631837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnQ1X53ub2qA+eEd1nqvCVaZXL7hd93tj5Cx9Qc5v1fro/I3CvdMADUzv40+rJYxgTpPPNbAPSamGUEppxonQeWFbreiW4JRIjKIzwk3mtw9ps6Byl5LiUFRuAFDFcrrQ=="}} Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: exception: Key pair 'tempest-keypair-1826631837' already exists. Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1826631837', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnQ1X53ub2qA+eEd1nqvCVaZXL7hd93tj5Cx9Qc5v1fro/I3CvdMADUzv40+rJYxgTpPPNbAPSamGUEppxonQeWFbreiW4JRIjKIzwk3mtw9ps6Byl5LiUFRuAFDFcrrQ=='}}} Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result.read() Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b5b2e752cc4d40e4b9e4d71955153854-tempest-keypair-1826631837' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 22 03:08:22.901413 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi session.flush() Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result.read() Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 22 03:08:22.905814 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b5b2e752cc4d40e4b9e4d71955153854-tempest-keypair-1826631837' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 22, 3, 8, 22, 879313), 'updated_at': None, 'name': 'tempest-keypair-1826631837', 'user_id': 'b5b2e752cc4d40e4b9e4d71955153854', 'fingerprint': '5e:48:5c:bc:7a:ea:b5:c1:7c:48:dc:d7:db:dc:56:bd', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnQ1X53ub2qA+eEd1nqvCVaZXL7hd93tj5Cx9Qc5v1fro/I3CvdMADUzv40+rJYxgTpPPNbAPSamGUEppxonQeWFbreiW4JRIjKIzwk3mtw9ps6Byl5LiUFRuAFDFcrrQ==', 'type': 'ssh'}] Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi keypair.create() Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._create() Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1826631837' already exists. Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 22 03:08:22.910036 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1826631837' already exists. Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1826631837' already exists. Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63c5ad7a-bf3b-4ee1-980c-882f881db78c tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Returning 409 to user: Key pair 'tempest-keypair-1826631837' already exists. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63c5ad7a-bf3b-4ee1-980c-882f881db78c tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.066527 Oct 22 03:08:22.914046 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 553/1101] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:08:22 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:08:22.915547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3733d014-8977-4b8a-9fc4-cbe1daafc254 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Calling method '.version_select at 0x7f0d1a45a0d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:22.932429 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3733d014-8977-4b8a-9fc4-cbe1daafc254 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826631837" status: 202 len: 0 microversion: 2.1 time: 0.024422 Oct 22 03:08:22.933016 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 549/1102] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:08:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826631837 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:08:22.944993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9d7545c1-3411-454f-9485-923297d52e89 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Action: 'create', calling method: .version_select at 0x7f0d1a9918b0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG03xET+L14Ccp4MEw5LUjMHoE8W1NBdj/iRndnQl3HNt2d5LxHB2T7jrojilDo6ClC0eP4NVaaB5WWa+gCOmtV8gKy7xe/I9XWf4jTwokPLSdEwEbRQ/h18h+IFGo7tw=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9d7545c1-3411-454f-9485-923297d52e89 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Request method failure captured: Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 247 Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16mkvRPdVLYoNh-EoUFDnMSXL6Xqit_qlFhBku2qUurcBF60t_DdG5Towff2dr1c1A1P7mFt4dHxQqigFKccRL5OQ7WCnytgI9a0cgXPFiNu5H7j_mBl9PYJ7R5vpPCzGX5EgEMlw49MX40uO1tHSI7uUHvoqOIwNUZ74cdtOIfjhA Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}] Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG03xET+L14Ccp4MEw5LUjMHoE8W1NBdj/iRndnQl3HNt2d5LxHB2T7jrojilDo6ClC0eP4NVaaB5WWa+gCOmtV8gKy7xe/I9XWf4jTwokPLSdEwEbRQ/h18h+IFGo7tw=="}} Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG03xET+L14Ccp4MEw5LUjMHoE8W1NBdj/iRndnQl3HNt2d5LxHB2T7jrojilDo6ClC0eP4NVaaB5WWa+gCOmtV8gKy7xe/I9XWf4jTwokPLSdEwEbRQ/h18h+IFGo7tw=='}}} Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '' Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:08:22.950078 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9d7545c1-3411-454f-9485-923297d52e89 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9d7545c1-3411-454f-9485-923297d52e89 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010602 Oct 22 03:08:22.954491 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 554/1103] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:08:22 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:08:22.961185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3535a978-6a45-4975-8be4-27a2a92726a1 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Action: 'create', calling method: .version_select at 0x7f0d1a425d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-836202926", "public_key": " "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:22.978931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-3535a978-6a45-4975-8be4-27a2a92726a1 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:22.984176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-3535a978-6a45-4975-8be4-27a2a92726a1 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for user b5b2e752cc4d40e4b9e4d71955153854 and project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:23.000544 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3535a978-6a45-4975-8be4-27a2a92726a1 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3535a978-6a45-4975-8be4-27a2a92726a1 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Request method failure captured: Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 94 Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16mkvRPdVLYoNh-EoUFDnMSXL6Xqit_qlFhBku2qUurcBF60t_DdG5Towff2dr1c1A1P7mFt4dHxQqigFKccRL5OQ7WCnytgI9a0cgXPFiNu5H7j_mBl9PYJ7R5vpPCzGX5EgEMlw49MX40uO1tHSI7uUHvoqOIwNUZ74cdtOIfjhA Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}] Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-836202926", "public_key": " "}} Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: exception: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-836202926', 'public_key': ' '}}} Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.003187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3535a978-6a45-4975-8be4-27a2a92726a1 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3535a978-6a45-4975-8be4-27a2a92726a1 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047376 Oct 22 03:08:23.007506 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 550/1104] 10.222.0.25 () {60 vars in 1158 bytes} [Sat Oct 22 03:08:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:08:23.017977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0165963e-6f78-479d-a35a-f60dbe05e24d tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Action: 'create', calling method: .version_select at 0x7f0d1a47d9d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtSgFrgTaaeazQWVVyY9NHo+xIzdr01excGEUv4rdipTWY62Kvfbu6PwmTY1dQORJht/tv3smYaT8bLvsdsCJK0nkTIo3SvsBdr3wiQPfOuJRAW++k6veZl6KbUuFJf6g=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0165963e-6f78-479d-a35a-f60dbe05e24d tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Request method failure captured: Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 507 Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16mkvRPdVLYoNh-EoUFDnMSXL6Xqit_qlFhBku2qUurcBF60t_DdG5Towff2dr1c1A1P7mFt4dHxQqigFKccRL5OQ7WCnytgI9a0cgXPFiNu5H7j_mBl9PYJ7R5vpPCzGX5EgEMlw49MX40uO1tHSI7uUHvoqOIwNUZ74cdtOIfjhA Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}] Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtSgFrgTaaeazQWVVyY9NHo+xIzdr01excGEUv4rdipTWY62Kvfbu6PwmTY1dQORJht/tv3smYaT8bLvsdsCJK0nkTIo3SvsBdr3wiQPfOuJRAW++k6veZl6KbUuFJf6g=="}} Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtSgFrgTaaeazQWVVyY9NHo+xIzdr01excGEUv4rdipTWY62Kvfbu6PwmTY1dQORJht/tv3smYaT8bLvsdsCJK0nkTIo3SvsBdr3wiQPfOuJRAW++k6veZl6KbUuFJf6g=='}}} Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 22 03:08:23.021880 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0165963e-6f78-479d-a35a-f60dbe05e24d tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:23.025643 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0165963e-6f78-479d-a35a-f60dbe05e24d tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009976 Oct 22 03:08:23.033467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d4af3ac-d179-48c7-a2d4-2c78dbcda199 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Action: 'create', calling method: .version_select at 0x7f0d1a5b3430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1572245286", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:23.038783 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 555/1105] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:08:23 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:08:23.051679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7d4af3ac-d179-48c7-a2d4-2c78dbcda199 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:23.058071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7d4af3ac-d179-48c7-a2d4-2c78dbcda199 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Getting quotas for user b5b2e752cc4d40e4b9e4d71955153854 and project 270f426e0cd04d938a87a8a2d300bd1f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:23.074701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-7d4af3ac-d179-48c7-a2d4-2c78dbcda199 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d4af3ac-d179-48c7-a2d4-2c78dbcda199 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Request method failure captured: Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 118 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16mkvRPdVLYoNh-EoUFDnMSXL6Xqit_qlFhBku2qUurcBF60t_DdG5Towff2dr1c1A1P7mFt4dHxQqigFKccRL5OQ7WCnytgI9a0cgXPFiNu5H7j_mBl9PYJ7R5vpPCzGX5EgEMlw49MX40uO1tHSI7uUHvoqOIwNUZ74cdtOIfjhA Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}] Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1572245286", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: exception: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1572245286', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 22 03:08:23.076811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d4af3ac-d179-48c7-a2d4-2c78dbcda199 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d4af3ac-d179-48c7-a2d4-2c78dbcda199 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.048626 Oct 22 03:08:23.081303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 551/1106] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:08:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:08:23.088247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0aeb4bf5-859c-45d5-9a2d-7b3d668de855 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Calling method '.version_select at 0x7f0d1a991790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:23.100943 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-0aeb4bf5-859c-45d5-9a2d-7b3d668de855 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-413714771 not found for user b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0aeb4bf5-859c-45d5-9a2d-7b3d668de855 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Request method failure captured: Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-413714771 HTTP/1.1 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16mkvRPdVLYoNh-EoUFDnMSXL6Xqit_qlFhBku2qUurcBF60t_DdG5Towff2dr1c1A1P7mFt4dHxQqigFKccRL5OQ7WCnytgI9a0cgXPFiNu5H7j_mBl9PYJ7R5vpPCzGX5EgEMlw49MX40uO1tHSI7uUHvoqOIwNUZ74cdtOIfjhA Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/270f426e0cd04d938a87a8a2d300bd1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/270f426e0cd04d938a87a8a2d300bd1f"}]}] Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 270f426e0cd04d938a87a8a2d300bd1f Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1427348801 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1427348801-project Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: exception: Keypair tempest-keypair-non-existent-413714771 not found for user b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'tempest-keypair-non-existent-413714771'} Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-413714771 not found for user b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.103378 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-413714771 not found for user b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-413714771 not found for user b5b2e752cc4d40e4b9e4d71955153854 Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0aeb4bf5-859c-45d5-9a2d-7b3d668de855 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] Returning 404 to user: Keypair tempest-keypair-non-existent-413714771 not found for user b5b2e752cc4d40e4b9e4d71955153854 {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0aeb4bf5-859c-45d5-9a2d-7b3d668de855 tempest-KeyPairsNegativeTestJSON-1427348801 tempest-KeyPairsNegativeTestJSON-1427348801-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-413714771" status: 404 len: 144 microversion: 2.1 time: 0.020972 Oct 22 03:08:23.108902 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 556/1107] 10.222.0.25 () {58 vars in 1257 bytes} [Sat Oct 22 03:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-413714771 => generated 144 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:23.443788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:23.444440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:23.451977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:23.452650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:23.453165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:23.453953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:23.454481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:23.454986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:23.543630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:23.544464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:23.551365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:23.552048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:23.553024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:23.553767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:23.554588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:23.555945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:23.609096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:23.616938 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-877c779d-2cec-4c15-b1fa-498d2f25e543 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1379 microversion: 2.1 time: 0.177033 Oct 22 03:08:23.618231 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 552/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:23 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1379 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:23.893019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:23.893910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:23.910046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:23.920039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:23.922354 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d53d7766-ab00-442c-82bb-cb1fe5906eb2 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1468 microversion: 2.1 time: 0.384180 Oct 22 03:08:23.923123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:23.923762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:23.925446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:23.926068 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 557/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:23 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:23.926698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:23.928300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:24.243891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:24.253461 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-06d7a7c9-975a-49f1-a12e-d30952672df7 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.364384 Oct 22 03:08:24.278677 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 553/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:23 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:24.598874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-76d38e3d-8110-4ff2-8525-bd7dd77368e3 req-c07ac1ee-a38d-44c6-9bff-c0c5b21d81f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf863bc6-44d7-4aa7-af7e-a40756171b7c", "name": "network-vif-deleted", "tag": "e42f0e36-6d11-4cba-88fa-c23783ee9a83"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:24.613560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-76d38e3d-8110-4ff2-8525-bd7dd77368e3 req-c07ac1ee-a38d-44c6-9bff-c0c5b21d81f8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:24.614499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-76d38e3d-8110-4ff2-8525-bd7dd77368e3 req-c07ac1ee-a38d-44c6-9bff-c0c5b21d81f8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:24.615379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-76d38e3d-8110-4ff2-8525-bd7dd77368e3 req-c07ac1ee-a38d-44c6-9bff-c0c5b21d81f8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:24.641514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:24.642862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:24.646175 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-76d38e3d-8110-4ff2-8525-bd7dd77368e3 req-c07ac1ee-a38d-44c6-9bff-c0c5b21d81f8 service nova] Creating event network-vif-deleted:e42f0e36-6d11-4cba-88fa-c23783ee9a83 for instance bf863bc6-44d7-4aa7-af7e-a40756171b7c on n-h1-862416-2 Oct 22 03:08:24.655676 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-76d38e3d-8110-4ff2-8525-bd7dd77368e3 req-c07ac1ee-a38d-44c6-9bff-c0c5b21d81f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065507 Oct 22 03:08:24.659567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:24.660510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:24.662338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:24.662554 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 558/1111] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:24.663404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:24.665154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:24.666950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:24.816406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:24.824513 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ab47085-615e-4df9-9def-8c2432481d5f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1528 microversion: 2.1 time: 0.187665 Oct 22 03:08:24.825315 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 554/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:24 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1528 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:24.851193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:24.851887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:24.859273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:24.859936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:24.860403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:24.861159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:24.861547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:24.861973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:24.949091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:24.949699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:24.956107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:24.956689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:24.957131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:24.957831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:24.958281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:24.958703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:25.000283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:25.000964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:25.001422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:25.001852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lazy-loading 'fault' on Instance uuid bf863bc6-44d7-4aa7-af7e-a40756171b7c {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:25.004871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:25.029371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:25.037820 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dec09460-cf20-49e6-b79e-3b726084bd52 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1528 microversion: 2.1 time: 0.191072 Oct 22 03:08:25.038401 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 559/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:24 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1528 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:25.059992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1ce7fb70-6f2e-4b1b-8e7d-b677f3291c93 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:25.060194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:25.068525 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-572b817f-4397-435c-992d-640218e5c651 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1303 microversion: 2.1 time: 0.123274 Oct 22 03:08:25.069030 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 555/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:24 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:25.080502 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1ce7fb70-6f2e-4b1b-8e7d-b677f3291c93 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/32f6b823-ee95-42ba-81d0-ab54a26036ab" status: 202 len: 0 microversion: 2.1 time: 0.023675 Oct 22 03:08:25.081579 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 560/1115] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:08:25 2022] DELETE /compute/v2.1/flavors/32f6b823-ee95-42ba-81d0-ab54a26036ab => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:08:25.090435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f190f827-f008-4729-bc60-bc28e23a2c33 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:25.112185 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f190f827-f008-4729-bc60-bc28e23a2c33 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.025983 Oct 22 03:08:25.112790 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 556/1116] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:08:25 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:25.131649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:25.134456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:25.140589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:25.141076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:25.141514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:25.142211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:25.142668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:25.143099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:25.172757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:25.178519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Old instance type tempest-test_resize_flavor_-937666589, new instance type m1.heat {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 03:08:25.185734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:08:25.186009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:08:25.186486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:08:25.186893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:08:25.187303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:08:25.252547 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f8d678e-201a-4ccc-bfb7-639ed8ef113b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972/action" status: 202 len: 0 microversion: 2.1 time: 0.124785 Oct 22 03:08:25.253367 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 561/1117] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:08:25 2022] POST /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:08:25.261854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:25.262829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:25.268805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:25.269484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:25.270806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:25.271695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:25.272156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:25.272776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:25.278752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:25.279719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:25.287543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:25.288238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:25.288696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:25.289445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:25.289914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:25.290350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:25.462710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:25.478467 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59c202fb-01ef-4a72-b2c2-400e9064ac34 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1537 microversion: 2.1 time: 0.220791 Oct 22 03:08:25.480324 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 557/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:25 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:25.526948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:25.536080 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2447d5f7-ca66-49ff-86d8-4c77601bade5 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.262644 Oct 22 03:08:25.540249 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 562/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:25 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:26.094206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:26.095013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:26.102410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:26.102795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:26.103425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:26.104339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:26.105096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:26.105684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:26.146868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:26.147555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:26.148403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:26.149947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lazy-loading 'fault' on Instance uuid bf863bc6-44d7-4aa7-af7e-a40756171b7c {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:26.238719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:26.247129 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e690d3d-a715-4b45-b7ae-20587395b872 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 200 len: 1303 microversion: 2.1 time: 0.156841 Oct 22 03:08:26.267047 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 558/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:26 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:26.502617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:26.503951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:26.518600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:26.519517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:26.520855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:26.521764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:26.522387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:26.523222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:26.553114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:26.562679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:26.563553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:26.571648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:26.573229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:26.573691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:26.575100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:26.575734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:26.576178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:26.744517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:26.753237 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2c6092ff-4cb3-4dd9-ba9a-3ccda238a503 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.194881 Oct 22 03:08:26.754637 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 559/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:26 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:26.794167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:26.802307 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32a777ba-9a83-4683-8553-5196f48960dc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1537 microversion: 2.1 time: 0.303637 Oct 22 03:08:26.803039 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 563/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:26 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1537 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:27.275469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:27.276877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: bf863bc6-44d7-4aa7-af7e-a40756171b7c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:27.283578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.284063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.284554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.285263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.285711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.286322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.302476 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] HTTP exception thrown: Instance bf863bc6-44d7-4aa7-af7e-a40756171b7c could not be found. Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Request method failure captured: Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c HTTP/1.1 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU14n-k-nlWrXW4lB1dxBjg5G8XgrAAivAfxQ6-FRwtVxVtc-1Mpl5-ej5IunzynqMIyWL1oGy3vQiP1zxSlAUBZQ78xEKn2Xz-p4zR9yiARaCUz3Eq4zA3lKykjvtSFMj0BFQpzeZ3cAq_E-QWxxKq-zKtimAVdRVjozp30GapyEuq4 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7fbe2f2bb3224e83a89df6ec4e84735b Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fbe2f2bb3224e83a89df6ec4e84735b"}]}] Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7fbe2f2bb3224e83a89df6ec4e84735b Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersAdminTestJSON-1539566908-project Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3f8560b839d44c479e3016ef9e4b3ff1 Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersAdminTestJSON-1539566908-project Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance bf863bc6-44d7-4aa7-af7e-a40756171b7c could not be found. Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'bf863bc6-44d7-4aa7-af7e-a40756171b7c'} Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf863bc6-44d7-4aa7-af7e-a40756171b7c could not be found. Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf863bc6-44d7-4aa7-af7e-a40756171b7c could not be found. Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:27.304093 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf863bc6-44d7-4aa7-af7e-a40756171b7c could not be found. Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Returning 404 to user: Instance bf863bc6-44d7-4aa7-af7e-a40756171b7c could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-704045d0-415f-415b-9f5e-dd409250ec0c tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c" status: 404 len: 111 microversion: 2.1 time: 0.035735 Oct 22 03:08:27.309961 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 560/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:27 2022] GET /compute/v2.1/servers/bf863bc6-44d7-4aa7-af7e-a40756171b7c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:27.315800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:27.316536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:27.323500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.324094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.324684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.325474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.326006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.326533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.354914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:08:27.451006 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfa4457a-5898-45f2-a4e9-00819525e51b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "DELETE /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 204 len: 0 microversion: 2.1 time: 0.139116 Oct 22 03:08:27.451979 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 564/1124] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:08:27 2022] DELETE /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:08:27.459868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:27.460650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:27.472171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.473250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.473938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.475817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.476472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.477144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.587411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:27.625566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:27.634586 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79911a97-8124-449f-9e45-596b2f367b3b tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1468 microversion: 2.1 time: 0.178259 Oct 22 03:08:27.635576 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 561/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:27 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1468 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:27.779863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:27.780591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:27.787597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.788103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.788583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.789289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.789963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.790758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.833862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:27.834616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:27.847043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.855882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.856705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:27.858234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:27.858857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:27.859462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:28.116501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:28.129117 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a37ca9a-38d2-45f7-9fc0-98197acd07c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1537 microversion: 2.1 time: 0.300545 Oct 22 03:08:28.130536 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 562/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:27 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:28.131123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:28.144927 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a505a63-0798-4e2d-8c1a-edc2f88f40ec tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.370745 Oct 22 03:08:28.145875 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 565/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:27 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:28.631415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:28.632535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:28.640547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:28.641339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:28.642042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:28.642983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:28.643634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:28.644317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:28.658374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:28.659358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:28.666307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:28.667095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:28.667743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:28.668680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:28.669359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:28.669992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:28.671764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:08:28.751372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:28.785038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aeaadb76-9d47-4dd0-bcbe-88137d472c6f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 204 len: 0 microversion: 2.1 time: 0.157278 Oct 22 03:08:28.786165 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 563/1128] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:08:28 2022] DELETE /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:08:28.903668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-484489563", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "1148142946", "adminPass": "***", "networks": [{"uuid": "bb7eb31f-2b35-44cf-b5ec-ba25a836c4a9"}], "security_groups": [{"name": "tempest-securitygroup--1512475799"}], "key_name": "tempest-keypair-1806393372", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:29.004573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:29.016230 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a64f37bc-89bd-4191-936f-7ba718a5fc0e tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1468 microversion: 2.1 time: 0.361540 Oct 22 03:08:29.017335 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 566/1129] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:28 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:29.058666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] validate_networks() for [('bb7eb31f-2b35-44cf-b5ec-ba25a836c4a9', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:08:29.170809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:29.172436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:29.185496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:29.185899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:29.188649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:29.189655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:29.190517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:29.191163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:29.511466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:08:29.511883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:08:29.512389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:08:29.512801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:08:29.513207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:08:29.522917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:29.523306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:29.524442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:29.525480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:29.525941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:29.526381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:29.544727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Getting quotas for project 71769feb32e1436285707bbdf76bf70e. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:29.550347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Getting quotas for user 069a8403cf9e414d99e83da9192f2057 and project 71769feb32e1436285707bbdf76bf70e. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:29.565024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:08:29.567735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:08:29.625372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-caba5e8b-5019-444e-8b70-c6c05efc5089 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.727202 Oct 22 03:08:29.633069 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 564/1130] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:08:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:08:29.633069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:29.633069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:29.640250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:29.640645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:29.641404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:29.642390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:29.643017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:29.643622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:29.825215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:29.833386 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25a0b260-73c8-4c9e-a276-d8bd573b78a2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.667912 Oct 22 03:08:29.833999 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 567/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:29 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:29.852438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8f45afe-fc93-440b-bfb8-de81147bb8af tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:29.852438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8f45afe-fc93-440b-bfb8-de81147bb8af tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:29.916156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:29.933817 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-350d4ec7-9129-4217-91df-756ac3a11eb0 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.304421 Oct 22 03:08:29.936323 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 565/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:29 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:29.986496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8f45afe-fc93-440b-bfb8-de81147bb8af tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:29.995406 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8f45afe-fc93-440b-bfb8-de81147bb8af tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1264 microversion: 2.1 time: 0.160312 Oct 22 03:08:29.996943 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 568/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:29 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:30.041657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:30.042302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:30.048576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:30.049125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:30.049564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:30.050285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:30.051530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:30.051989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:30.170174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8560b839d44c479e3016ef9e4b3ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe2f2bb3224e83a89df6ec4e84735b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:30.182214 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6fa6771d-0f60-4a41-9e41-c3279b3e76f8 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 200 len: 1426 microversion: 2.1 time: 0.143696 Oct 22 03:08:30.183328 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 566/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:30 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 1426 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:30.273315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-50cbbcde-5abd-43da-9904-dbeeb268a02e req-b457a032-ce8f-4e30-811f-042f46b4e6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896b7177-4fd2-47b7-866b-4f7cb6ea78aa", "name": "network-vif-deleted", "tag": "c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:30.297753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-50cbbcde-5abd-43da-9904-dbeeb268a02e req-b457a032-ce8f-4e30-811f-042f46b4e6b8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:30.298493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-50cbbcde-5abd-43da-9904-dbeeb268a02e req-b457a032-ce8f-4e30-811f-042f46b4e6b8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:30.299348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-50cbbcde-5abd-43da-9904-dbeeb268a02e req-b457a032-ce8f-4e30-811f-042f46b4e6b8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:30.320129 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-50cbbcde-5abd-43da-9904-dbeeb268a02e req-b457a032-ce8f-4e30-811f-042f46b4e6b8 service nova] Creating event network-vif-deleted:c2bb0dc3-bef9-4b04-9506-21bbdaa07b3c for instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa on n-h1-862416-2 Oct 22 03:08:30.337808 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-50cbbcde-5abd-43da-9904-dbeeb268a02e req-b457a032-ce8f-4e30-811f-042f46b4e6b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067876 Oct 22 03:08:30.339547 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 569/1135] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:30.671318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-62c7290c-c8f7-4da4-9d18-7ec4615a4aab req-e26f6c32-53f7-4804-a29a-5e801134f3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cca44ac-4e26-4617-b207-fe192de0eed2", "name": "network-vif-plugged", "status": "completed", "tag": "4033401c-5ebc-44ef-bdea-5f4ad9eb5a3e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:30.686523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-62c7290c-c8f7-4da4-9d18-7ec4615a4aab req-e26f6c32-53f7-4804-a29a-5e801134f3cb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:30.691950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-62c7290c-c8f7-4da4-9d18-7ec4615a4aab req-e26f6c32-53f7-4804-a29a-5e801134f3cb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:30.692757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-62c7290c-c8f7-4da4-9d18-7ec4615a4aab req-e26f6c32-53f7-4804-a29a-5e801134f3cb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:30.711891 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-62c7290c-c8f7-4da4-9d18-7ec4615a4aab req-e26f6c32-53f7-4804-a29a-5e801134f3cb service nova] Creating event network-vif-plugged:4033401c-5ebc-44ef-bdea-5f4ad9eb5a3e for instance 8cca44ac-4e26-4617-b207-fe192de0eed2 on n-h1-862416-2 Oct 22 03:08:30.724935 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-62c7290c-c8f7-4da4-9d18-7ec4615a4aab req-e26f6c32-53f7-4804-a29a-5e801134f3cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061657 Oct 22 03:08:30.728886 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 567/1136] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:30.871617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:30.871871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:30.885969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:30.894214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:30.894744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:30.895512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:30.895982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:30.896468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:30.961832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:30.962568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:30.969918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:30.970539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:30.970986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:30.971709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:30.972173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:30.972633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:31.212794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:31.222003 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b165fa49-501d-4c4b-9752-d390c1058124 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.265515 Oct 22 03:08:31.236688 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 568/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:30 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:31.243160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:31.243867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:31.256618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:31.257190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:31.257556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:31.259158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:31.261867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:31.262568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:31.263032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:31.281150 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad7b3e53-007c-4062-8506-66870695f599 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.420854 Oct 22 03:08:31.292905 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 570/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:30 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:31.292905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:31.292905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] [instance: 896b7177-4fd2-47b7-866b-4f7cb6ea78aa] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:31.308683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:31.309301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:31.309839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:31.310978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:31.311736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:31.312773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:31.346716 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] HTTP exception thrown: Instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa could not be found. Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Request method failure captured: Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa HTTP/1.1 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14n-k-nlWrXW4lB1dxBjg5G8XgrAAivAfxQ6-FRwtVxVtc-1Mpl5-ej5IunzynqMIyWL1oGy3vQiP1zxSlAUBZQ78xEKn2Xz-p4zR9yiARaCUz3Eq4zA3lKykjvtSFMj0BFQpzeZ3cAq_E-QWxxKq-zKtimAVdRVjozp30GapyEuq4 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7fbe2f2bb3224e83a89df6ec4e84735b Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7fbe2f2bb3224e83a89df6ec4e84735b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7fbe2f2bb3224e83a89df6ec4e84735b"}]}] Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7fbe2f2bb3224e83a89df6ec4e84735b Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersAdminTestJSON-1539566908 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersAdminTestJSON-1539566908-project Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3f8560b839d44c479e3016ef9e4b3ff1 Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersAdminTestJSON-1539566908-project Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa could not be found. Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '896b7177-4fd2-47b7-866b-4f7cb6ea78aa'} Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa could not be found. Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa could not be found. Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:31.348624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:31.353881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:31.353881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:31.353881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:31.353881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:31.353881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:31.353881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa could not be found. Oct 22 03:08:31.353881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:31.353881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] Returning 404 to user: Instance 896b7177-4fd2-47b7-866b-4f7cb6ea78aa could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:31.354750 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9aac5de8-3d3d-4035-87db-3ab504350603 tempest-ServersAdminTestJSON-1539566908 tempest-ServersAdminTestJSON-1539566908-project] 10.222.0.25 "GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa" status: 404 len: 111 microversion: 2.1 time: 0.070957 Oct 22 03:08:31.358647 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 571/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:31 2022] GET /compute/v2.1/servers/896b7177-4fd2-47b7-866b-4f7cb6ea78aa => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:31.394203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:31.405404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d322f348-9494-46ef-985f-b9a3fdff25c6 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1316 microversion: 2.1 time: 0.168378 Oct 22 03:08:31.416260 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 569/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:31 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:32.248242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:32.254500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:32.268373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:32.269630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:32.270320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:32.271327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:32.271991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:32.272653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:32.309778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:32.310606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:32.319143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:32.325290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:32.328541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:32.329422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:32.330580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:32.333529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:32.763563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:32.778596 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d69662c0-4c4d-4f8f-8368-0506c593fb80 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.471200 Oct 22 03:08:32.779685 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 570/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:32 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:32.795546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:32.797009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:32.807846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:32.810947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:32.811383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:32.812146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:32.812698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:32.813174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:32.900261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:32.909853 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b0327e1-4aca-4f0a-a075-9246a761d746 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1322 microversion: 2.1 time: 0.128986 Oct 22 03:08:32.911555 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 571/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:32 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1322 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:33.091517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8ed00960-0b70-4ed0-9d08-1b59f2bf270f req-4f965218-a3b5-4468-a7c4-5987e4c64c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51400e5d-785f-4aff-9f3a-ec73d15dc8fe", "name": "network-vif-deleted", "tag": "24f72835-b67d-4621-a0d2-606f7568d386"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:33.103940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8ed00960-0b70-4ed0-9d08-1b59f2bf270f req-4f965218-a3b5-4468-a7c4-5987e4c64c47 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:33.104842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8ed00960-0b70-4ed0-9d08-1b59f2bf270f req-4f965218-a3b5-4468-a7c4-5987e4c64c47 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:33.106045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8ed00960-0b70-4ed0-9d08-1b59f2bf270f req-4f965218-a3b5-4468-a7c4-5987e4c64c47 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:33.146683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8ed00960-0b70-4ed0-9d08-1b59f2bf270f req-4f965218-a3b5-4468-a7c4-5987e4c64c47 service nova] Creating event network-vif-deleted:24f72835-b67d-4621-a0d2-606f7568d386 for instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe on n-h2-862416-2 Oct 22 03:08:33.160650 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8ed00960-0b70-4ed0-9d08-1b59f2bf270f req-4f965218-a3b5-4468-a7c4-5987e4c64c47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074882 Oct 22 03:08:33.161729 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 572/1143] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:33.185978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:33.199433 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-faca5554-4129-4f49-beac-a9e5536cac58 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1315 microversion: 2.1 time: 0.955189 Oct 22 03:08:33.217195 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 572/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:32 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1315 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:33.610104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68ecf328-9f13-48c7-9c39-269a569d9fa3 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a413160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1146757448", "description": "tempest-description-633439298"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:33.817096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:33.820938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:33.854382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:33.866831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:33.870058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:33.878428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:33.881130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:33.884751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:34.297426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:34.308761 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6caeebba-354a-43d2-b88a-112e4300e355 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.503151 Oct 22 03:08:34.309683 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 573/1145] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:33 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:34.314612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:34.315705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:34.323162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:34.324033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:34.324652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:34.325521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:34.326159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:34.326853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:34.352837 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68ecf328-9f13-48c7-9c39-269a569d9fa3 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.016759 Oct 22 03:08:34.354147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 573/1146] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:08:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:34.359779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:34.360928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:34.381662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:34.387121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:34.387995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:34.389939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:34.390587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:34.393747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:34.558784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:34.569593 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7d918293-8c4a-43aa-bff2-9084788c8365 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.258709 Oct 22 03:08:34.584234 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 574/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:34 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:34.594441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfbc4d66-99ef-4cd5-be4f-11adf428b793 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a4c14c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1079221744", "description": "tempest-description-439581398"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:34.831328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:34.835086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:34.841428 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e731f8e-4cdd-4862-b3eb-3e3f9f340323 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1503 microversion: 2.1 time: 0.485571 Oct 22 03:08:34.848038 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 574/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:34 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1503 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:34.871611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:34.872661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:34.880194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:34.881124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:34.882292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:34.883365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:34.884318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:34.885877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:34.911807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfbc4d66-99ef-4cd5-be4f-11adf428b793 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.333213 Oct 22 03:08:34.912876 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 575/1149] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:08:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:34.938250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:08:35.084977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff40c754-538c-41e9-a6bb-379967129308 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 204 len: 0 microversion: 2.1 time: 0.217571 Oct 22 03:08:35.086992 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 575/1150] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:08:34 2022] DELETE /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:08:35.095660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:35.096543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:35.106863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:35.109009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:35.111117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:35.112081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:35.113565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:35.115069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:35.131412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1412623550", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "ead6943f-52f6-48c1-87b7-f5219297b05a"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:35.192445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] validate_networks() for [('ead6943f-52f6-48c1-87b7-f5219297b05a', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:08:35.325358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:35.335807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-84c3d3f3-8e36-42c7-ab00-a48c04eb6841 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1509 microversion: 2.1 time: 0.244582 Oct 22 03:08:35.337088 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 576/1151] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:35 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:35.342458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:35.343074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:35.352046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:35.353390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:35.353865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:35.354597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:35.355061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:35.355496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:35.522226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:35.534848 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05ecc1a3-f954-4499-a8f9-0cb06673dc4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.195808 Oct 22 03:08:35.536024 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 577/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:35 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:35.540898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-dc4d53cb-f403-4e72-ba13-f97aa80ebf10 req-72cf4060-4c8f-4ffa-88a1-c8fc935c6525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a731cdd-ed4e-48e3-b0c4-fcf6794cf976", "tag": "db134f86-5272-4df0-ae42-1a65e1637773"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:35.548645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:35.556906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc4d53cb-f403-4e72-ba13-f97aa80ebf10 req-72cf4060-4c8f-4ffa-88a1-c8fc935c6525 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:35.557675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc4d53cb-f403-4e72-ba13-f97aa80ebf10 req-72cf4060-4c8f-4ffa-88a1-c8fc935c6525 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:35.558340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc4d53cb-f403-4e72-ba13-f97aa80ebf10 req-72cf4060-4c8f-4ffa-88a1-c8fc935c6525 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:35.574160 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-dc4d53cb-f403-4e72-ba13-f97aa80ebf10 req-72cf4060-4c8f-4ffa-88a1-c8fc935c6525 service nova] Creating event network-changed:db134f86-5272-4df0-ae42-1a65e1637773 for instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 on n-h2-862416-2 Oct 22 03:08:35.580371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-dc4d53cb-f403-4e72-ba13-f97aa80ebf10 req-72cf4060-4c8f-4ffa-88a1-c8fc935c6525 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042894 Oct 22 03:08:35.581968 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 578/1153] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:35.595121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:35.596158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:35.605836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:35.606703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:35.607599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:35.608783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:35.609444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:35.610190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:35.802476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:35.811124 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c914b73c-ef54-40cf-a561-cb55768bb21a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.220377 Oct 22 03:08:35.815269 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 579/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:35 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:36.119562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:08:36.120145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:08:36.120617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:08:36.121109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:08:36.121529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:08:36.134128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.134683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.135223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.135934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.136689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.137304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.158864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Getting quotas for project e9d3c4c33e854369a3d4c7775f931f69. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:36.164903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Getting quotas for user 0f3d30df231e48babcc1d20dc8743a39 and project e9d3c4c33e854369a3d4c7775f931f69. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:36.193026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:08:36.195987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:08:36.293981 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db26cbf3-6f7e-4426-a453-76ca948f3bb0 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166723 Oct 22 03:08:36.295308 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 576/1155] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:08:36.307528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-207b69ef-d6a6-4071-93c8-32faba353954 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:36.308275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-207b69ef-d6a6-4071-93c8-32faba353954 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:36.392457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-207b69ef-d6a6-4071-93c8-32faba353954 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:36.399948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=23 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:36.407924 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-207b69ef-d6a6-4071-93c8-32faba353954 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1216 microversion: 2.1 time: 0.104838 Oct 22 03:08:36.408579 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 580/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:36 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1216 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:36.417118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:36.417741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:36.424872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.425372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.425816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.426552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.427002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.427738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.488156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2010027974", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:36.557037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:08:36.683439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:36.693685 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a5a926c-da00-4c2b-976f-1e6f39df7f71 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1509 microversion: 2.1 time: 0.284032 Oct 22 03:08:36.694274 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 581/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:36 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:36.719477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:36.721321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:36.729058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.729856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.730993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.742795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.744051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.744786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.799784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:08:36.801075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:08:36.802113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:08:36.802985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:08:36.803908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:08:36.823025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.823521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.823961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.824731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.825182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.825988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.848506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:36.855675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:36.878268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:08:36.881983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:08:36.960717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a19d4f34-fc6f-4d5e-85ee-9a20ad8bb10b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653820 Oct 22 03:08:36.962814 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 577/1158] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:08:36.969181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:36.970351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:36.971662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:36.985095 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0dc6af6c-bb01-4861-b4dc-1f573dc7d1a1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.272343 Oct 22 03:08:36.987668 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 582/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:36 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:36.992348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.993724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef864601-9516-477c-b182-fbd4042b88cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:36.994458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:36.994689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ef864601-9516-477c-b182-fbd4042b88cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:36.996513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:36.998806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:36.999498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.002665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.115758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ef864601-9516-477c-b182-fbd4042b88cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:37.124626 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef864601-9516-477c-b182-fbd4042b88cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1217 microversion: 2.1 time: 0.135688 Oct 22 03:08:37.125441 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 583/1160] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:36 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:37.180359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:37.191234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:37.192044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Searching by: {'deleted': False, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:08:37.209503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.210340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.211845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.212960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.213510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.214350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.222588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:37.239688 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-11bcb0ab-78e3-42f9-b3ff-c1df4aa09ab3 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.275493 Oct 22 03:08:37.243388 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 578/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:36 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:37.350431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:08:37.357804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:37.436740 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b59ebb69-b2e5-4e15-8d17-19456eb25402 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.261945 Oct 22 03:08:37.437742 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 584/1162] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:08:37 2022] GET /compute/v2.1/servers => generated 340 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:37.452879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:37.453490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:37.454453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:37.462897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:37.464241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Searching by: {'deleted': False, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:08:37.472732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.473131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.473252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.473678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.474295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.474447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.474900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.476344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.477672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.478762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.479516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.480165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.547819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:08:37.599900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:37.616117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.618519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.620109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.639455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:37.652360 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fbec0b13-c4e1-469d-a8d7-0214c1bc80fb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1268 microversion: 2.1 time: 0.221627 Oct 22 03:08:37.653380 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 579/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:37 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:37.659022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-24413d1e-e9e8-41ca-a23f-6f810c6b8e4a req-1a8781de-68f1-478c-abc5-dffbbf590a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cca44ac-4e26-4617-b207-fe192de0eed2", "name": "network-vif-deleted", "tag": "4033401c-5ebc-44ef-bdea-5f4ad9eb5a3e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:37.677097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-24413d1e-e9e8-41ca-a23f-6f810c6b8e4a req-1a8781de-68f1-478c-abc5-dffbbf590a44 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.678296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-24413d1e-e9e8-41ca-a23f-6f810c6b8e4a req-1a8781de-68f1-478c-abc5-dffbbf590a44 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.679123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-24413d1e-e9e8-41ca-a23f-6f810c6b8e4a req-1a8781de-68f1-478c-abc5-dffbbf590a44 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.693404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-24413d1e-e9e8-41ca-a23f-6f810c6b8e4a req-1a8781de-68f1-478c-abc5-dffbbf590a44 service nova] Creating event network-vif-deleted:4033401c-5ebc-44ef-bdea-5f4ad9eb5a3e for instance 8cca44ac-4e26-4617-b207-fe192de0eed2 on n-h1-862416-2 Oct 22 03:08:37.699688 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-24413d1e-e9e8-41ca-a23f-6f810c6b8e4a req-1a8781de-68f1-478c-abc5-dffbbf590a44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044639 Oct 22 03:08:37.701147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 580/1164] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:37.728060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:37.732916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:37.751182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.753433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.753972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.757033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.757595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.758239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.805540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:37.806086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:37.806525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:37.807037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lazy-loading 'fault' on Instance uuid 8cca44ac-4e26-4617-b207-fe192de0eed2 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:08:37.826315 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19072814-bf7a-439d-a441-af106d895274 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.377621 Oct 22 03:08:37.844514 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 585/1165] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:08:37 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:37.851089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-947f325f-2a08-4695-bf25-3aa59f531ab3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:37.852297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f455e3c732402283bd33b904abadfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd702fd8e5914ca4942861c674d30400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:37.859227 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-947f325f-2a08-4695-bf25-3aa59f531ab3 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012128 Oct 22 03:08:37.859808 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 586/1166] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:08:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:37.866888 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a06db15-05ba-4cbd-b3a1-1312cb8c612f tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 200 len: 1305 microversion: 2.1 time: 0.146280 Oct 22 03:08:37.866888 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 581/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:37 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:38.014254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:38.014877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:38.024405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.025120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.025571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.026322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.027191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.027633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.155045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:38.155761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:38.162745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.163243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.163683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.164465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.165377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.165813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.207573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:38.219575 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2fd072b-6033-4df7-9284-c70c6dd1b575 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.210108 Oct 22 03:08:38.224347 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 582/1168] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:38 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:38.264734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:38.267272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:38.268383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:38.274876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.276074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.276074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.276679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.277135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.277253 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ee654387-83fc-486f-b27f-c6203cc64de5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1213 microversion: 2.1 time: 0.126424 Oct 22 03:08:38.277567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.279597 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 587/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:38 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:38.439422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:38.448882 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2bf55c0f-7103-42fa-803a-b7e4ba824a2d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.185517 Oct 22 03:08:38.452276 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 583/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:38 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:38.682186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:38.683493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:38.693000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.693606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.694065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.696394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.697043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.697651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.784732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:38.785708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:38.786827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:38.795784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.796592 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-950bfe65-b01a-400f-9830-284dfe5bb9de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1274 microversion: 2.1 time: 0.121548 Oct 22 03:08:38.796937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.797255 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 588/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:38 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:38.797767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.798861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.799484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.800109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.830320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:08:38.900416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:38.902813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:38.921736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.922618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.923340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.924313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.924987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.925664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.945738 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] HTTP exception thrown: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Request method failure captured: Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 HTTP/1.1 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16fsp8p8aMXsiWJfj79tuA_3ZOsSlDne03RB9MwleHu4C6wnbAkUMllDvh38Hq1dwx4_h-RB9bUitHcVVmdmlj62tooMwDIo7b9wzO__uujZd1r8Tb0sSaQwjzfVJYChp04nB9MJlnhi_6JFSIMLsr8vEb14Sj6aVXwlsr0EW5Aamg Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd702fd8e5914ca4942861c674d30400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}] Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 97f455e3c732402283bd33b904abadfb Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '8cca44ac-4e26-4617-b207-fe192de0eed2'} Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:38.948279 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:38.954122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:38.954122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:38.954122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:38.954122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:38.954122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:38.954122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:38.954122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:38.956090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:38.957157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Returning 404 to user: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:38.958325 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bca03898-833b-4136-876e-9c4d6ec6ad2a tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 404 len: 111 microversion: 2.1 time: 0.077399 Oct 22 03:08:38.963823 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 589/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:38 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:38.970468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1283478106", "metadata": {"image_type": "test"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:38.973539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:38.974515 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9ce0ee2f-9fff-42f9-8b5a-ba8e9d9cfb57 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 204 len: 0 microversion: 2.1 time: 0.193978 Oct 22 03:08:38.979858 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 584/1173] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:08:38 2022] DELETE /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:08:38.983392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.985637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:38.986351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:38.987257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.987800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.988653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.989296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.989714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.993754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.994246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:38.994908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:38.995679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:38.996135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.000799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.007129 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] HTTP exception thrown: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Request method failure captured: Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2/action HTTP/1.1 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 112 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16fsp8p8aMXsiWJfj79tuA_3ZOsSlDne03RB9MwleHu4C6wnbAkUMllDvh38Hq1dwx4_h-RB9bUitHcVVmdmlj62tooMwDIo7b9wzO__uujZd1r8Tb0sSaQwjzfVJYChp04nB9MJlnhi_6JFSIMLsr8vEb14Sj6aVXwlsr0EW5Aamg Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd702fd8e5914ca4942861c674d30400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}] Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 97f455e3c732402283bd33b904abadfb Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1283478106", "metadata": {"image_type": "test"}}} Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '8cca44ac-4e26-4617-b207-fe192de0eed2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1283478106', 'metadata': {'image_type': 'test'}}}} Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 03:08:39.009386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Returning 404 to user: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c27fe27-0c3f-4739-a5c6-b1f6194bc582 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "POST /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2/action" status: 404 len: 111 microversion: 2.1 time: 0.045685 Oct 22 03:08:39.014074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 590/1174] 10.222.0.25 () {60 vars in 1279 bytes} [Sat Oct 22 03:08:38 2022] POST /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:39.026538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-763f1d89-d625-42df-bb48-3b23d02f85d8 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-515225612", "metadata": {"image_type": "test"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:39.028927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-763f1d89-d625-42df-bb48-3b23d02f85d8 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Failed to fetch instance by id tempest-invalid-235852850 {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 03:08:39.029438 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-763f1d89-d625-42df-bb48-3b23d02f85d8 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] HTTP exception thrown: Instance tempest-invalid-235852850 could not be found. Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-763f1d89-d625-42df-bb48-3b23d02f85d8 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Request method failure captured: Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/tempest-invalid-235852850/action HTTP/1.1 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 111 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16fsp8p8aMXsiWJfj79tuA_3ZOsSlDne03RB9MwleHu4C6wnbAkUMllDvh38Hq1dwx4_h-RB9bUitHcVVmdmlj62tooMwDIo7b9wzO__uujZd1r8Tb0sSaQwjzfVJYChp04nB9MJlnhi_6JFSIMLsr8vEb14Sj6aVXwlsr0EW5Aamg Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd702fd8e5914ca4942861c674d30400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}] Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 97f455e3c732402283bd33b904abadfb Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-515225612", "metadata": {"image_type": "test"}}} Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance tempest-invalid-235852850 could not be found. Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'tempest-invalid-235852850', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-515225612', 'metadata': {'image_type': 'test'}}}} Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-235852850 could not be found. Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:39.030956 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-235852850 could not be found. Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-235852850 could not be found. Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-763f1d89-d625-42df-bb48-3b23d02f85d8 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Returning 404 to user: Instance tempest-invalid-235852850 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-763f1d89-d625-42df-bb48-3b23d02f85d8 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-235852850/action" status: 404 len: 100 microversion: 2.1 time: 0.010943 Oct 22 03:08:39.034997 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 591/1175] 10.222.0.25 () {60 vars in 1246 bytes} [Sat Oct 22 03:08:39 2022] POST /compute/v2.1/servers/tempest-invalid-235852850/action => generated 100 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:39.042275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f56a4db3-8da2-4af0-aeea-c43898299112 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1230363817"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:39.044590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f56a4db3-8da2-4af0-aeea-c43898299112 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 03:08:39.045106 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f56a4db3-8da2-4af0-aeea-c43898299112 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f56a4db3-8da2-4af0-aeea-c43898299112 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Request method failure captured: Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 57 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16fsp8p8aMXsiWJfj79tuA_3ZOsSlDne03RB9MwleHu4C6wnbAkUMllDvh38Hq1dwx4_h-RB9bUitHcVVmdmlj62tooMwDIo7b9wzO__uujZd1r8Tb0sSaQwjzfVJYChp04nB9MJlnhi_6JFSIMLsr8vEb14Sj6aVXwlsr0EW5Aamg Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd702fd8e5914ca4942861c674d30400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}] Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 97f455e3c732402283bd33b904abadfb Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: {"createImage": {"name": "tempest-test-snap-1230363817"}} Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1230363817'}}} Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.046609 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f56a4db3-8da2-4af0-aeea-c43898299112 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f56a4db3-8da2-4af0-aeea-c43898299112 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009604 Oct 22 03:08:39.051500 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 592/1176] 10.222.0.25 () {60 vars in 1275 bytes} [Sat Oct 22 03:08:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:08:39.058942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7a31744-fb7c-4289-a676-96dc748f21e2 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-807351628"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:39.061331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7a31744-fb7c-4289-a676-96dc748f21e2 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 03:08:39.061979 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e7a31744-fb7c-4289-a676-96dc748f21e2 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7a31744-fb7c-4289-a676-96dc748f21e2 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Request method failure captured: Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 56 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16fsp8p8aMXsiWJfj79tuA_3ZOsSlDne03RB9MwleHu4C6wnbAkUMllDvh38Hq1dwx4_h-RB9bUitHcVVmdmlj62tooMwDIo7b9wzO__uujZd1r8Tb0sSaQwjzfVJYChp04nB9MJlnhi_6JFSIMLsr8vEb14Sj6aVXwlsr0EW5Aamg Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd702fd8e5914ca4942861c674d30400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}] Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 97f455e3c732402283bd33b904abadfb Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: {"createImage": {"name": "tempest-test-snap-807351628"}} Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-807351628'}}} Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.064360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7a31744-fb7c-4289-a676-96dc748f21e2 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7a31744-fb7c-4289-a676-96dc748f21e2 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.012218 Oct 22 03:08:39.069152 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 593/1177] 10.222.0.25 () {60 vars in 1281 bytes} [Sat Oct 22 03:08:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:08:39.078499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:39.079001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:39.085608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.086604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.087059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.087775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.088252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.088688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.103932 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] HTTP exception thrown: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Request method failure captured: Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 HTTP/1.1 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16fsp8p8aMXsiWJfj79tuA_3ZOsSlDne03RB9MwleHu4C6wnbAkUMllDvh38Hq1dwx4_h-RB9bUitHcVVmdmlj62tooMwDIo7b9wzO__uujZd1r8Tb0sSaQwjzfVJYChp04nB9MJlnhi_6JFSIMLsr8vEb14Sj6aVXwlsr0EW5Aamg Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd702fd8e5914ca4942861c674d30400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}] Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 97f455e3c732402283bd33b904abadfb Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '8cca44ac-4e26-4617-b207-fe192de0eed2'} Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:39.105547 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Returning 404 to user: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2606823c-c4d7-43d0-8a62-99daa19742c6 tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 404 len: 111 microversion: 2.1 time: 0.032401 Oct 22 03:08:39.109596 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 594/1178] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:08:39 2022] DELETE /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:08:39.115460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:39.116069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] [instance: 8cca44ac-4e26-4617-b207-fe192de0eed2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:39.123280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.123773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.124237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.129153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.129718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.130330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.146454 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] HTTP exception thrown: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Request method failure captured: Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 HTTP/1.1 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16fsp8p8aMXsiWJfj79tuA_3ZOsSlDne03RB9MwleHu4C6wnbAkUMllDvh38Hq1dwx4_h-RB9bUitHcVVmdmlj62tooMwDIo7b9wzO__uujZd1r8Tb0sSaQwjzfVJYChp04nB9MJlnhi_6JFSIMLsr8vEb14Sj6aVXwlsr0EW5Aamg Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd702fd8e5914ca4942861c674d30400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd702fd8e5914ca4942861c674d30400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd702fd8e5914ca4942861c674d30400"}]}] Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bd702fd8e5914ca4942861c674d30400 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-809885632 Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 97f455e3c732402283bd33b904abadfb Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesNegativeTestJSON-809885632-project Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '8cca44ac-4e26-4617-b207-fe192de0eed2'} Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:39.147991 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] Returning 404 to user: Instance 8cca44ac-4e26-4617-b207-fe192de0eed2 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fde3dd41-c57b-456d-a900-9ba13f7c25cd tempest-ImagesNegativeTestJSON-809885632 tempest-ImagesNegativeTestJSON-809885632-project] 10.222.0.25 "GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2" status: 404 len: 111 microversion: 2.1 time: 0.038458 Oct 22 03:08:39.153375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 595/1179] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:39 2022] GET /compute/v2.1/servers/8cca44ac-4e26-4617-b207-fe192de0eed2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:39.183628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:39.191540 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30cde871-eb95-4cb0-9b38-a67cbf48d013 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1715 microversion: 2.1 time: 0.210410 Oct 22 03:08:39.192265 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 585/1180] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:38 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1715 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:39.243336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:39.244057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:39.250431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.251003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.251513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.252308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.252828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.253602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.307653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:39.308313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:39.314237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.314721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.315160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.315855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.316342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.316770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.379102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:39.386854 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3faacd93-4f37-4689-b1bd-ca30a5897f57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1269 microversion: 2.1 time: 0.084006 Oct 22 03:08:39.387620 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 586/1181] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:39 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:39.458722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:39.468597 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13e2e348-bbe2-435b-b22a-986f8f131c85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.229512 Oct 22 03:08:39.480238 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 596/1182] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:39 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:39.480970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:39.480970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:39.484843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.485538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.486154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.487043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.487490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.487912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.621617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:39.630487 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d7b0e9f-09a1-46d4-b657-87f5c73d60a5 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.163227 Oct 22 03:08:39.631065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 587/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:39 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:39.820168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:39.820998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:39.827783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.828335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.828962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:39.829866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:39.830455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:39.830915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.034769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:40.043800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5be1e6d-36db-4382-a085-63b594cc85f1 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1316 microversion: 2.1 time: 0.227548 Oct 22 03:08:40.044782 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 597/1184] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:39 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:40.217582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:40.218224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:40.224378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:40.224867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:40.225309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.226261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:40.227331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:40.227758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.360654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:40.369091 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c4cd9d3-3d14-4b1e-a0b9-a9820b994ccc tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1715 microversion: 2.1 time: 0.155357 Oct 22 03:08:40.369657 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 588/1185] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:40 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:40.414773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:40.415735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:40.423053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:40.423838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:40.424571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.425484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:40.425953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:40.426857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.494345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:40.495083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:40.502041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:40.502888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:40.503550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.504511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:40.505191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:40.506094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.819067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:40.830649 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-def71d38-4fef-41d9-9c34-a4ee5d2fc432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1269 microversion: 2.1 time: 0.423568 Oct 22 03:08:40.832541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 598/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:40 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1269 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:40.848576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:40.850238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:40.857550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:40.858089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:40.858534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.859233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:40.859920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:40.860565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:40.933088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:40.937848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:40.943155 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4c94a9e-25b9-49d9-9e6f-5c3c62c456c1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.452902 Oct 22 03:08:40.943931 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 589/1187] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:40 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:41.068185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:41.068828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:41.082417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:41.082915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:41.083429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:41.084093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:41.084912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:41.085567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:41.163344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:41.180457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1cd5aa6e-70d3-42e1-aae3-632b06d680eb tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.342517 Oct 22 03:08:41.181734 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 599/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:40 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:41.392900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:41.393875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:41.401449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:41.402298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:41.402958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:41.403940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:41.404642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:41.405313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:41.787389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:41.799425 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fca33032-7ce2-4488-b69c-dfc5c28a63e5 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1715 microversion: 2.1 time: 0.411259 Oct 22 03:08:41.804541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 600/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:41 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1715 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:41.856653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:41.857365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:41.871345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:41.876533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:41.877430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:41.878370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:41.879026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:41.879625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:42.044612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:42.057214 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4653f195-8351-4c86-8cbd-4bba6c78d69f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1275 microversion: 2.1 time: 0.204071 Oct 22 03:08:42.059545 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 601/1190] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:41 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:42.069758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:42.071776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:42.085400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:42.087192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:42.088824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:42.090293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:42.093136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:42.093703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:42.162245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:42.187835 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c5d350f-eafe-4641-9d12-90a6eb52f5ee tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1316 microversion: 2.1 time: 1.124261 Oct 22 03:08:42.207622 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 590/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:41 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1316 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:42.213227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:42.214021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:42.222981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:42.223526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:42.224055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:42.224809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:42.225257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:42.225933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:42.598144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:42.607542 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6fb210f1-2d34-4a43-9ab4-e4bc5b13e5d8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.546812 Oct 22 03:08:42.610526 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 602/1192] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:42 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:42.627531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6060daa6-4a9a-470d-a3fa-0f3e2cff8803 req-c1a862ad-3852-4e57-a513-5857d5c42bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99", "tag": "efc6309f-f0cc-41e3-9747-15b06e774dcf"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:42.639230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6060daa6-4a9a-470d-a3fa-0f3e2cff8803 req-c1a862ad-3852-4e57-a513-5857d5c42bcd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:42.640266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6060daa6-4a9a-470d-a3fa-0f3e2cff8803 req-c1a862ad-3852-4e57-a513-5857d5c42bcd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:42.640928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6060daa6-4a9a-470d-a3fa-0f3e2cff8803 req-c1a862ad-3852-4e57-a513-5857d5c42bcd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:42.658485 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6060daa6-4a9a-470d-a3fa-0f3e2cff8803 req-c1a862ad-3852-4e57-a513-5857d5c42bcd service nova] Creating event network-changed:efc6309f-f0cc-41e3-9747-15b06e774dcf for instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 on n-h1-862416-2 Oct 22 03:08:42.667070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:42.668337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6060daa6-4a9a-470d-a3fa-0f3e2cff8803 req-c1a862ad-3852-4e57-a513-5857d5c42bcd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046129 Oct 22 03:08:42.669080 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 603/1193] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:42.677057 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2b71b57a-2747-433f-bc7c-08b2adbb31fd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.471029 Oct 22 03:08:42.690090 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 591/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:42 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:42.831844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:42.832601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:42.845218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:42.845958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:42.846566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:42.847588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:42.848234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:42.850972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.029397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:43.044286 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7eb50b72-cb9a-4aca-8e03-9e40678f41cd tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1647 microversion: 2.1 time: 0.216874 Oct 22 03:08:43.071628 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 604/1195] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:42 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1647 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:43.085013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:43.085633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:43.104198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.105006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.105620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.106336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.106794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.107215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.204417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:43.215911 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-caddc946-e848-4bcd-bee9-8007d21a39cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1275 microversion: 2.1 time: 0.132574 Oct 22 03:08:43.216160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:43.228289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:43.228490 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 592/1196] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:43 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:43.228604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.228604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.228604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.228604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.228902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.229317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.368035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a8512b47-1e2c-4755-a2f8-c107fea1a424 req-e09871a9-772e-426a-a0e0-cfc342858f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13afade-1045-400e-aac6-329fd672f06e", "name": "network-vif-deleted", "tag": "19530e8d-ac69-49aa-ad40-def3b85e64e9"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:43.382513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a8512b47-1e2c-4755-a2f8-c107fea1a424 req-e09871a9-772e-426a-a0e0-cfc342858f4a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.384130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a8512b47-1e2c-4755-a2f8-c107fea1a424 req-e09871a9-772e-426a-a0e0-cfc342858f4a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.385142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a8512b47-1e2c-4755-a2f8-c107fea1a424 req-e09871a9-772e-426a-a0e0-cfc342858f4a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.402940 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a8512b47-1e2c-4755-a2f8-c107fea1a424 req-e09871a9-772e-426a-a0e0-cfc342858f4a service nova] Creating event network-vif-deleted:19530e8d-ac69-49aa-ad40-def3b85e64e9 for instance c13afade-1045-400e-aac6-329fd672f06e on n-h1-862416-2 Oct 22 03:08:43.410971 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a8512b47-1e2c-4755-a2f8-c107fea1a424 req-e09871a9-772e-426a-a0e0-cfc342858f4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048082 Oct 22 03:08:43.412184 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 593/1197] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:43.611108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:43.621401 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-260e92c3-2ff8-45a0-b278-2d9d15216bbc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1316 microversion: 2.1 time: 0.409545 Oct 22 03:08:43.622840 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 605/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:43 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:43.643093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:43.643814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:43.661223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.661979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.662690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.663787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.665331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.665976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.702521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:43.703431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:43.714523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.715022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.715469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:43.726015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:43.729051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:43.729592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:44.003786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:44.013814 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2665e072-3958-4dfd-9671-14ae9e13c9e4 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.315063 Oct 22 03:08:44.014421 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 606/1199] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:43 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:44.088421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:44.094940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:44.095549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:44.105672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:44.106073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:44.106515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:44.107232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:44.107690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:44.108116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:44.119243 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-55387abf-c806-4a1c-8210-cd42a22b5a1c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.481258 Oct 22 03:08:44.123067 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 594/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:43 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:44.151929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:44.161319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6e1a57f6-86ad-4ece-9731-f797e5f33345 req-755fd3f6-45a5-4a99-88e1-80a5f1bc4a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a731cdd-ed4e-48e3-b0c4-fcf6794cf976", "name": "network-vif-plugged", "status": "completed", "tag": "db134f86-5272-4df0-ae42-1a65e1637773"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:44.180148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6e1a57f6-86ad-4ece-9731-f797e5f33345 req-755fd3f6-45a5-4a99-88e1-80a5f1bc4a08 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:44.180677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6e1a57f6-86ad-4ece-9731-f797e5f33345 req-755fd3f6-45a5-4a99-88e1-80a5f1bc4a08 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:44.181113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6e1a57f6-86ad-4ece-9731-f797e5f33345 req-755fd3f6-45a5-4a99-88e1-80a5f1bc4a08 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:44.216392 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6e1a57f6-86ad-4ece-9731-f797e5f33345 req-755fd3f6-45a5-4a99-88e1-80a5f1bc4a08 service nova] Creating event network-vif-plugged:db134f86-5272-4df0-ae42-1a65e1637773 for instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 on n-h2-862416-2 Oct 22 03:08:44.230736 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6e1a57f6-86ad-4ece-9731-f797e5f33345 req-755fd3f6-45a5-4a99-88e1-80a5f1bc4a08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072590 Oct 22 03:08:44.232829 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 595/1201] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:44.242553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55a10ac9e3547a0b1260d744a5181b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd606804daa7f4672aefaa9cb47d6498c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:44.256156 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1baa83dd-b56a-4960-8103-ddbdaaff948b tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 200 len: 1647 microversion: 2.1 time: 0.164030 Oct 22 03:08:44.257201 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 607/1202] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:44 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 1647 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:44.259601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:44.260676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:44.282089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:44.282853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:44.283456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:44.285422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:44.286061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:44.286666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:44.651687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:44.652428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:44.664690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:44.665555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:44.666181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:44.677268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:44.677995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:44.678596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:44.750737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:44.760655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68314b9b-cb9b-4133-8d75-2ec6f10d7cbc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1317 microversion: 2.1 time: 0.525050 Oct 22 03:08:44.768115 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 596/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:44 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:44.992550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:45.002238 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc365b5e-9707-489b-89fe-243dcb5a65df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1316 microversion: 2.1 time: 0.355418 Oct 22 03:08:45.003360 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 608/1204] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:44 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:45.040275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:45.040534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:45.047903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.049567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.050533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.051345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.056372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.060200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.147926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:45.148878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:45.156146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.156799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.157332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.158192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.158739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.159258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.393829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:45.407743 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90c7516e-d820-429e-af82-d24d3c6264de tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.372628 Oct 22 03:08:45.409620 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 597/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:45 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:45.416123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:45.416906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] [instance: c13afade-1045-400e-aac6-329fd672f06e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:45.426338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.426902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.427412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.428311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.428836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.430124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.453442 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] HTTP exception thrown: Instance c13afade-1045-400e-aac6-329fd672f06e could not be found. Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Request method failure captured: Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e HTTP/1.1 Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1596hgdvBwDlMn9q8Ny0AH-i3TDYEdMQHrk32tUzcfFUq569HijwQHsak9q0QeglSNxvdZ6t6al1geIf0vAIRjcfsj-3KIK3rFjdjVI3JUPVFLrh-Wb4mJJtS2gYLezCCViXpsq_miKo2QG35OftH5CQDRTPvroiQ8Hm8p5xegC7_Q Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: d606804daa7f4672aefaa9cb47d6498c Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestManualDisk-132623782 Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d606804daa7f4672aefaa9cb47d6498c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d606804daa7f4672aefaa9cb47d6498c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d606804daa7f4672aefaa9cb47d6498c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d606804daa7f4672aefaa9cb47d6498c"}]}] Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestManualDisk-132623782 Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: d606804daa7f4672aefaa9cb47d6498c Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestManualDisk-132623782 Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestManualDisk-132623782-project Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d55a10ac9e3547a0b1260d744a5181b9 Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestManualDisk-132623782-project Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance c13afade-1045-400e-aac6-329fd672f06e could not be found. Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'c13afade-1045-400e-aac6-329fd672f06e'} Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13afade-1045-400e-aac6-329fd672f06e could not be found. Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13afade-1045-400e-aac6-329fd672f06e could not be found. Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:45.455456 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:45.460443 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:45.460443 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:45.460443 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:45.460443 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:45.460443 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:45.460443 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13afade-1045-400e-aac6-329fd672f06e could not be found. Oct 22 03:08:45.460443 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:45.460443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Returning 404 to user: Instance c13afade-1045-400e-aac6-329fd672f06e could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:45.461517 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b232840-414b-4904-a212-b1e1e943a545 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e" status: 404 len: 111 microversion: 2.1 time: 0.050143 Oct 22 03:08:45.465260 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 598/1206] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:45 2022] GET /compute/v2.1/servers/c13afade-1045-400e-aac6-329fd672f06e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:45.472272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d84e9723-07fd-456f-8e45-06a2e42c97f1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] Calling method '.version_select at 0x7f0d1a413280>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:45.476046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:45.484757 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b5c72b8-738a-4a7f-bf32-1930d693f7d5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.341413 Oct 22 03:08:45.494575 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 609/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:45 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:45.503175 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d84e9723-07fd-456f-8e45-06a2e42c97f1 tempest-ServersTestManualDisk-132623782 tempest-ServersTestManualDisk-132623782-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140371243" status: 202 len: 0 microversion: 2.1 time: 0.035943 Oct 22 03:08:45.503992 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 599/1208] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:08:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140371243 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:08:45.790181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:45.790797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:45.797181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.797852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.798464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.799328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.800597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.801437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.905102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-06dda9c4-7aee-4a51-82ca-601c7f309962 req-c9749591-b0d6-4e9a-ab58-c84e20e2b4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5073feec-6b6f-4858-99ba-438ab7362ee2", "tag": "019c8c39-8fcc-45aa-8832-d36cec24789a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:45.916224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-06dda9c4-7aee-4a51-82ca-601c7f309962 req-c9749591-b0d6-4e9a-ab58-c84e20e2b4e5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:45.916711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-06dda9c4-7aee-4a51-82ca-601c7f309962 req-c9749591-b0d6-4e9a-ab58-c84e20e2b4e5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:45.917141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-06dda9c4-7aee-4a51-82ca-601c7f309962 req-c9749591-b0d6-4e9a-ab58-c84e20e2b4e5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:45.946394 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-06dda9c4-7aee-4a51-82ca-601c7f309962 req-c9749591-b0d6-4e9a-ab58-c84e20e2b4e5 service nova] Creating event network-changed:019c8c39-8fcc-45aa-8832-d36cec24789a for instance 5073feec-6b6f-4858-99ba-438ab7362ee2 on n-h1-862416-2 Oct 22 03:08:45.952637 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-06dda9c4-7aee-4a51-82ca-601c7f309962 req-c9749591-b0d6-4e9a-ab58-c84e20e2b4e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051144 Oct 22 03:08:45.953426 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 600/1209] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:46.029399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:46.030208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:46.037960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:46.038622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:46.039456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:46.040328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:46.040885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:46.041406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:46.167737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:46.176001 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1302e5bd-7c95-4ced-9c01-bb8469467b30 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1317 microversion: 2.1 time: 0.390339 Oct 22 03:08:46.176618 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 610/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:45 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:46.435241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:46.435921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:46.443377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:46.452996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:46.454062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:46.455088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:46.455829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:46.456489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:46.697419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:46.711404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-638c9460-868a-4258-b283-141887fff0c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1316 microversion: 2.1 time: 0.687427 Oct 22 03:08:46.724234 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 601/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:46 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:46.725100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:46.726797 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23040d0d-1598-43b8-bf24-6979b527c7cc tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1390 microversion: 2.1 time: 0.298318 Oct 22 03:08:46.731893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:46.732408 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 611/1212] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:46 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1390 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:46.733700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:46.743601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:46.744083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:46.744550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:46.745258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:46.745804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:46.747160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:46.842722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:46.865276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=38 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:46.967263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:46.978769 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-55f66942-0b2c-40b0-b6f9-bc32f63957cd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.262753 Oct 22 03:08:46.979377 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 602/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:46 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:47.199303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:47.199959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:47.207791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:47.208589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:47.209028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:47.209912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:47.210377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:47.210960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:47.443261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:47.458268 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f4b0894-2d84-4d19-a718-22325cd40e2f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1317 microversion: 2.1 time: 0.262904 Oct 22 03:08:47.458864 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 612/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:47 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:47.739785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:47.739785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:47.748010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:47.748528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:47.748960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:47.749666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:47.750542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:47.751177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:47.758712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:47.759593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:47.769305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:47.770346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:47.773077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:47.774978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:47.775588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:47.776496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:47.777114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:47.777559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:47.938845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:47.949930 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3cfaef56-99b5-4225-a6a4-8227c8d9db71 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1316 microversion: 2.1 time: 0.214688 Oct 22 03:08:47.951225 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 603/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:47 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:48.004963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:48.006073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:48.018301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.019144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.019693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.020633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.021327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.022004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.217164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:48.232608 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b360aa35-79c8-4031-84a8-1d3302f387a8 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1589 microversion: 2.1 time: 0.480499 Oct 22 03:08:48.233843 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 613/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:47 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1589 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:48.259866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:48.260806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:48.268045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.268836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.269445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.270638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.271381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.272390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.310131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:48.322517 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35b3f0af-7381-44c7-b464-eba0ba99fe39 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.323413 Oct 22 03:08:48.324948 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 604/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:47 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:48.364004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-67513227-1f43-4b84-a070-d256f9baa9cb req-4aca060f-3af1-43ee-85b6-615137a21083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99", "name": "network-vif-plugged", "status": "completed", "tag": "efc6309f-f0cc-41e3-9747-15b06e774dcf"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:48.374582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-67513227-1f43-4b84-a070-d256f9baa9cb req-4aca060f-3af1-43ee-85b6-615137a21083 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.375399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-67513227-1f43-4b84-a070-d256f9baa9cb req-4aca060f-3af1-43ee-85b6-615137a21083 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.376032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-67513227-1f43-4b84-a070-d256f9baa9cb req-4aca060f-3af1-43ee-85b6-615137a21083 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.391943 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-67513227-1f43-4b84-a070-d256f9baa9cb req-4aca060f-3af1-43ee-85b6-615137a21083 service nova] Creating event network-vif-plugged:efc6309f-f0cc-41e3-9747-15b06e774dcf for instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 on n-h1-862416-2 Oct 22 03:08:48.397533 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-67513227-1f43-4b84-a070-d256f9baa9cb req-4aca060f-3af1-43ee-85b6-615137a21083 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037232 Oct 22 03:08:48.399450 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 605/1218] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:48.405550 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7198b0b-e365-4070-9a7b-361213ca14e0 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150858 Oct 22 03:08:48.413617 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 614/1219] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:08:48 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:48.485762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:48.487853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:48.495289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.496126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.498227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.499274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.500489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.501153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.975040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:48.975757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:48.982967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.983728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.984358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.985272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:48.985877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:48.986450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:48.996017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:49.008557 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1f7aeae-64bb-4131-8a0d-be572e060187 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1317 microversion: 2.1 time: 0.527704 Oct 22 03:08:49.009354 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 606/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:48 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:49.347925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:49.348572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:49.361141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:49.361636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:49.362062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:49.365120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:49.367656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:49.372394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:49.463556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:49.486044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f53d20fe-061e-4184-8eb5-f525fd724c9f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1316 microversion: 2.1 time: 0.514987 Oct 22 03:08:49.489302 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 615/1221] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:48 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:49.998711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:50.014638 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37e13ce5-6506-4ca6-9af3-f64ce8bde4c6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.666590 Oct 22 03:08:50.015716 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 607/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:49 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:50.049651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:50.050295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:50.073181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:50.077910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:50.078436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:50.079209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:50.079688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:50.080134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:50.229990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:50.230732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:50.238214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:50.239053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:50.239745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:50.240748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:50.241529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:50.243160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:50.403006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:50.418983 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bbba1383-d1a1-4833-9d02-9a5eb148172a tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1589 microversion: 2.1 time: 0.194732 Oct 22 03:08:50.434471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:50.442793 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 608/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:50 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1589 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:50.444731 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1243fa78-8957-4e7b-9c38-19f7f2d345d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1317 microversion: 2.1 time: 0.408532 Oct 22 03:08:50.446152 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 616/1224] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:50 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:50.449620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a5bdee6e-ef5f-4d5a-b565-f41deb65d76a req-f9aad7ed-6a28-42e6-b592-187ac2428580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a731cdd-ed4e-48e3-b0c4-fcf6794cf976", "tag": "db134f86-5272-4df0-ae42-1a65e1637773"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:50.464637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a5bdee6e-ef5f-4d5a-b565-f41deb65d76a req-f9aad7ed-6a28-42e6-b592-187ac2428580 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:50.465931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a5bdee6e-ef5f-4d5a-b565-f41deb65d76a req-f9aad7ed-6a28-42e6-b592-187ac2428580 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:50.466527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a5bdee6e-ef5f-4d5a-b565-f41deb65d76a req-f9aad7ed-6a28-42e6-b592-187ac2428580 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:50.486272 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a5bdee6e-ef5f-4d5a-b565-f41deb65d76a req-f9aad7ed-6a28-42e6-b592-187ac2428580 service nova] Creating event network-changed:db134f86-5272-4df0-ae42-1a65e1637773 for instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 on n-h2-862416-2 Oct 22 03:08:50.495377 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a5bdee6e-ef5f-4d5a-b565-f41deb65d76a req-f9aad7ed-6a28-42e6-b592-187ac2428580 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050127 Oct 22 03:08:50.498069 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 609/1225] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:50.517535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:50.518906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:50.534197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:50.552505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:50.553515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:50.554584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:50.556712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:50.557242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:51.059118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:51.060607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:51.075032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:51.075977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:51.076771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:51.078103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:51.079029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:51.079753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:51.378997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:51.393606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:51.395410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-37eb0eec-36d2-4e2e-b780-67e1078380e2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1505 microversion: 2.1 time: 0.881711 Oct 22 03:08:51.400694 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 617/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:50 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1505 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:51.426382 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-037f6feb-e766-4b34-934c-2acdecd591b8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.388383 Oct 22 03:08:51.433574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1146757448"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:51.434435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:51.445846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 610/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:51 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:51.450861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:51.451892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:51.458631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:51.459627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:51.460309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:51.461714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:51.473697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:51.475720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:51.490455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:51.492878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:51.494021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:51.495003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:51.495683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:51.496388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:51.539906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:51.884608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:51.895637 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.network.security_group_api [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Adding security group 21013bcb-dd17-4047-9347-ce370af272a9 to port efc6309f-f0cc-41e3-9747-15b06e774dcf Oct 22 03:08:51.901856 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-185b9837-4ded-4fe5-8b39-c16e5a979503 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1317 microversion: 2.1 time: 0.435295 Oct 22 03:08:51.902448 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 611/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:51 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:52.462023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:52.463516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:52.504554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:52.508916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:52.510560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:52.511648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:52.512345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:52.512954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:52.680655 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6dd958de-438a-4e88-bdb5-a6d8aa77e48c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99/action" status: 202 len: 0 microversion: 2.1 time: 1.255721 Oct 22 03:08:52.684349 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 618/1229] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:08:51 2022] POST /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99/action => generated 0 bytes in 1257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:08:52.689446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1079221744"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:52.689990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:52.698308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:52.700671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:52.701235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:52.702197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:52.702895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:52.703559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:52.755388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:52.775347 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9bf54cca-2d79-4fde-a8a3-402c8b50b38a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.317917 Oct 22 03:08:52.776811 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 612/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:52 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:52.781658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-cc60214b-9b54-4338-b4ef-6d4f5e098b82 req-fee0f04c-a153-43ee-8447-47803d95e8dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99", "tag": "efc6309f-f0cc-41e3-9747-15b06e774dcf"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:52.793335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cc60214b-9b54-4338-b4ef-6d4f5e098b82 req-fee0f04c-a153-43ee-8447-47803d95e8dd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:52.794166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cc60214b-9b54-4338-b4ef-6d4f5e098b82 req-fee0f04c-a153-43ee-8447-47803d95e8dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:52.794830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cc60214b-9b54-4338-b4ef-6d4f5e098b82 req-fee0f04c-a153-43ee-8447-47803d95e8dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:52.808438 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-cc60214b-9b54-4338-b4ef-6d4f5e098b82 req-fee0f04c-a153-43ee-8447-47803d95e8dd service nova] Creating event network-changed:efc6309f-f0cc-41e3-9747-15b06e774dcf for instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 on n-h1-862416-2 Oct 22 03:08:52.813467 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-cc60214b-9b54-4338-b4ef-6d4f5e098b82 req-fee0f04c-a153-43ee-8447-47803d95e8dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035291 Oct 22 03:08:52.814874 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 613/1231] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:52.927725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:52.928545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:52.937825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:52.938621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:52.939287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:52.940265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:52.940926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:52.941559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:53.103223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.network.security_group_api [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Adding security group 9db77889-e0ea-4718-9d6e-73c257ef4b17 to port efc6309f-f0cc-41e3-9747-15b06e774dcf Oct 22 03:08:53.197904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:53.219598 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-adf51d98-7e5a-4320-81e8-6ab2ef8d0b86 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1317 microversion: 2.1 time: 0.295603 Oct 22 03:08:53.244625 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 614/1232] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:52 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:53.253437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b1378b0b-1bcf-4e92-90fa-5791bda5a7dc req-601c9b0b-7dcb-435f-a3c7-d5b073f9ceea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5073feec-6b6f-4858-99ba-438ab7362ee2", "name": "network-vif-plugged", "status": "completed", "tag": "019c8c39-8fcc-45aa-8832-d36cec24789a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:53.268920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b1378b0b-1bcf-4e92-90fa-5791bda5a7dc req-601c9b0b-7dcb-435f-a3c7-d5b073f9ceea service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:53.270239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b1378b0b-1bcf-4e92-90fa-5791bda5a7dc req-601c9b0b-7dcb-435f-a3c7-d5b073f9ceea service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:53.270848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b1378b0b-1bcf-4e92-90fa-5791bda5a7dc req-601c9b0b-7dcb-435f-a3c7-d5b073f9ceea service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:53.286474 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b1378b0b-1bcf-4e92-90fa-5791bda5a7dc req-601c9b0b-7dcb-435f-a3c7-d5b073f9ceea service nova] Creating event network-vif-plugged:019c8c39-8fcc-45aa-8832-d36cec24789a for instance 5073feec-6b6f-4858-99ba-438ab7362ee2 on n-h1-862416-2 Oct 22 03:08:53.297558 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b1378b0b-1bcf-4e92-90fa-5791bda5a7dc req-601c9b0b-7dcb-435f-a3c7-d5b073f9ceea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049002 Oct 22 03:08:53.298386 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 615/1233] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:53.802559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:53.803252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:53.809445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:53.810304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:53.811220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:53.812055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:53.812683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:53.813265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:54.010177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:54.020096 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-624843b6-1780-4e6d-8d24-79f8782a0fa7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.222150 Oct 22 03:08:54.021503 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 616/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:53 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:54.059566 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e1bd37e-b62c-49c2-a02b-c2b47407cc35 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99/action" status: 202 len: 0 microversion: 2.1 time: 1.374048 Oct 22 03:08:54.060559 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 619/1235] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:08:52 2022] POST /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99/action => generated 0 bytes in 1376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:08:54.071442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:54.073026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:54.082294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:54.083229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:54.083831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:54.085411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:54.086846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:54.087923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:54.254331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:54.255764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:54.270286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:54.271188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:54.271984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:54.274697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:54.275388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:54.277285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:54.348053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3c193e8-9738-4deb-b99c-82eba9d292c4 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.282836 Oct 22 03:08:54.351754 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 617/1236] 10.222.0.25 () {58 vars in 1293 bytes} [Sat Oct 22 03:08:54 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99/os-security-groups => generated 1157 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:54.368143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eec0dbdc-a3cc-4e82-8794-4052efdced96 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a453790>, body: {"security_group": {"name": " tempest-securitygroup -2038231358 ", "description": "tempest-description-2144281038"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:54.567900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:54.577420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-43436466-d4dc-4261-b3f4-c0f7db93eddd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1317 microversion: 2.1 time: 0.331344 Oct 22 03:08:54.589061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 620/1237] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:54 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:54.655875 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eec0dbdc-a3cc-4e82-8794-4052efdced96 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.291439 Oct 22 03:08:54.665616 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 618/1238] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:08:54 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:54.671011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d93fdac2-9671-4180-b4c5-148149e1242c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a8d91f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:54.802297 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d93fdac2-9671-4180-b4c5-148149e1242c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198" status: 200 len: 224 microversion: 2.1 time: 0.134920 Oct 22 03:08:54.804184 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 621/1239] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:08:54 2022] GET /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198 => generated 224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:54.817469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b5967bd-0bc4-45b6-839e-35e8ccbc11b9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a3d0e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:54.837891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5ad4bf30-d222-4031-9fce-4fd55907451f req-b100aa39-d300-4a86-a19e-58e227ab404d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99", "tag": "efc6309f-f0cc-41e3-9747-15b06e774dcf"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:54.859030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5ad4bf30-d222-4031-9fce-4fd55907451f req-b100aa39-d300-4a86-a19e-58e227ab404d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:54.859532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5ad4bf30-d222-4031-9fce-4fd55907451f req-b100aa39-d300-4a86-a19e-58e227ab404d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:54.859982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5ad4bf30-d222-4031-9fce-4fd55907451f req-b100aa39-d300-4a86-a19e-58e227ab404d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:54.872797 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5ad4bf30-d222-4031-9fce-4fd55907451f req-b100aa39-d300-4a86-a19e-58e227ab404d service nova] Creating event network-changed:efc6309f-f0cc-41e3-9747-15b06e774dcf for instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 on n-h1-862416-2 Oct 22 03:08:54.903306 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5ad4bf30-d222-4031-9fce-4fd55907451f req-b100aa39-d300-4a86-a19e-58e227ab404d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067486 Oct 22 03:08:54.906300 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 622/1240] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:55.044483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:55.045392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:55.061224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:55.061742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:55.062220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:55.062931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:55.063398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:55.063829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:55.435219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:55.447612 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-770d6a02-c449-4177-8bc6-b001de4fa709 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.407654 Oct 22 03:08:55.461892 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 623/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:55 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:55.504474 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6b5967bd-0bc4-45b6-839e-35e8ccbc11b9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198" status: 202 len: 0 microversion: 2.1 time: 0.690645 Oct 22 03:08:55.505707 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 619/1242] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:08:54 2022] DELETE /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198 => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:08:55.516707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c2eca24-16c9-4fc6-936f-92cdbd4ab048 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a8d91f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:55.566013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-9c2eca24-16c9-4fc6-936f-92cdbd4ab048 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:08:55.566858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.security_group_api [None req-9c2eca24-16c9-4fc6-936f-92cdbd4ab048 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 not found {{(pid=120581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:08:55.567495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9c2eca24-16c9-4fc6-936f-92cdbd4ab048 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:08:55.567495 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-a994f83b-412e-48f3-840f-f5764d1c5afe'] Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c2eca24-16c9-4fc6-936f-92cdbd4ab048 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198 HTTP/1.1 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: exception: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-a994f83b-412e-48f3-840f-f5764d1c5afe'] Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'df439571-f3ce-4ecb-b8fc-bd7b536cb198'} Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:08:55.572271 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a994f83b-412e-48f3-840f-f5764d1c5afe'] Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a994f83b-412e-48f3-840f-f5764d1c5afe'] Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a994f83b-412e-48f3-840f-f5764d1c5afe'] Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a994f83b-412e-48f3-840f-f5764d1c5afe'] Oct 22 03:08:55.576694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:08:55.581641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c2eca24-16c9-4fc6-936f-92cdbd4ab048 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:08:55.581641 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-a994f83b-412e-48f3-840f-f5764d1c5afe'] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:55.583059 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c2eca24-16c9-4fc6-936f-92cdbd4ab048 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198" status: 404 len: 194 microversion: 2.1 time: 0.072782 Oct 22 03:08:55.584739 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 624/1243] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:08:55 2022] GET /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:55.595413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b78ff0e4-079a-4838-b84f-fbdc29e7ae7b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a44be50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-782008514", "description": "tempest-description-981463723"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:55.615961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:55.617766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:55.634753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:55.636433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:55.640788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:55.641844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:55.642570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:55.644067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:56.011679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:56.025319 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d35653eb-a54e-42b0-adc4-abe0501486b3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1466 microversion: 2.1 time: 0.411590 Oct 22 03:08:56.044246 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 625/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:55 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1466 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:08:56.135167 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b78ff0e4-079a-4838-b84f-fbdc29e7ae7b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.544566 Oct 22 03:08:56.144057 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 620/1245] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:08:55 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:56.149918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bbc559bf-6976-48c4-8558-64afb0e17b26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a5b3e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-334710099", "description": "tempest-description-1707382246"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:56.338542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:56.339519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:56.347039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:56.347834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:56.348640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:56.349630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:56.351160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:56.351823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:56.431717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bbc559bf-6976-48c4-8558-64afb0e17b26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.286411 Oct 22 03:08:56.432346 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 621/1246] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:08:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:56.446459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d989c324-7edf-42b9-8645-7efecebb3674 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a3668b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1056389725", "description": "tempest-description-1202340057"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:56.830800 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d989c324-7edf-42b9-8645-7efecebb3674 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.389069 Oct 22 03:08:56.831689 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 622/1247] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:08:56 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:08:56.839791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:56.841002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:56.865421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:56.868315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:56.869996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:56.870867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:56.872616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:56.874006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:56.912533 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2b4a585-6ff8-45d4-8dd1-c4f7c984aee5 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1617 microversion: 2.1 time: 0.854172 Oct 22 03:08:56.913176 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 626/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:56 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1617 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:56.924832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb1e292c-d3a2-4975-a9e9-d8b6e48315cb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d19fef0d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:57.132007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:57.142757 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04a76c90-3d52-4b16-848e-3d6c4f29bb81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.308391 Oct 22 03:08:57.144190 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 623/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:56 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:57.152116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5d758aa-ab60-4dd7-a32b-bcfc8c17d4b8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Action: 'create', calling method: .version_select at 0x7f0d1a44bd30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-916711922", "policies": ["affinity"]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:57.172588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c5d758aa-ab60-4dd7-a32b-bcfc8c17d4b8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:57.179622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c5d758aa-ab60-4dd7-a32b-bcfc8c17d4b8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:57.243378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c5d758aa-ab60-4dd7-a32b-bcfc8c17d4b8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:57.248837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c5d758aa-ab60-4dd7-a32b-bcfc8c17d4b8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:57.260008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:57.266008 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5d758aa-ab60-4dd7-a32b-bcfc8c17d4b8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.119185 Oct 22 03:08:57.266963 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 624/1250] 10.222.0.25 () {60 vars in 1174 bytes} [Sat Oct 22 03:08:57 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:08:57.437465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-346785633", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0568f0d6-7c50-4ece-a2eb-a575060f8d2a"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:57.510349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:08:57.643081 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb1e292c-d3a2-4975-a9e9-d8b6e48315cb tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.727899 Oct 22 03:08:57.643964 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 627/1251] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:08:56 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:57.665014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-155e792e-b175-4e3b-9780-2f3164ac2f4e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a05a5e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:57.852456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:08:57.852884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:08:57.853361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:08:57.853778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:08:57.854190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:08:57.890648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:57.891570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:57.892158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:57.893764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:57.894575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:57.895246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:57.920614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:57.929795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:57.955805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Going to run 2 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:08:57.958986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0604553f-a92d-45b8-be48-a8ace1cda572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:08:58.028510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120582) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 22 03:08:58.036493 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-155e792e-b175-4e3b-9780-2f3164ac2f4e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/632e68bb-c7c2-4d0b-972f-f56aed11ffae" status: 202 len: 0 microversion: 2.1 time: 0.376616 Oct 22 03:08:58.037397 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 628/1252] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:08:57 2022] DELETE /compute/v2.1/os-security-groups/632e68bb-c7c2-4d0b-972f-f56aed11ffae => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:08:58.106806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:58.114666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:58.144009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-136113341", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cf26895c-54d3-4fb2-acdc-7bfa0bf6e9b9"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:08:58.198437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:58.205434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:58.226068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=0604553f-a92d-45b8-be48-a8ace1cda572,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:08:58.245222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] validate_networks() for [('cf26895c-54d3-4fb2-acdc-7bfa0bf6e9b9', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:08:58.289312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:58.296190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:58.342721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:58.348944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:58.390461 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c7d07cd-7f18-414e-80ce-0f8d1cafd60e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.957615 Oct 22 03:08:58.393944 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 625/1253] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:08:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 22 03:08:58.396685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b0f5382c-c19f-489c-bf39-295651c9f3b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a3d0550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:58.424890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-b0f5382c-c19f-489c-bf39-295651c9f3b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:08:58.425577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-b0f5382c-c19f-489c-bf39-295651c9f3b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:08:58.426113 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-b0f5382c-c19f-489c-bf39-295651c9f3b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:08:58.426113 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-e3fb9042-b001-459c-838a-93ba673dc706'] Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b0f5382c-c19f-489c-bf39-295651c9f3b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-security-groups/632e68bb-c7c2-4d0b-972f-f56aed11ffae HTTP/1.1 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-e3fb9042-b001-459c-838a-93ba673dc706'] Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '632e68bb-c7c2-4d0b-972f-f56aed11ffae'} Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:08:58.433247 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3fb9042-b001-459c-838a-93ba673dc706'] Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3fb9042-b001-459c-838a-93ba673dc706'] Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3fb9042-b001-459c-838a-93ba673dc706'] Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3fb9042-b001-459c-838a-93ba673dc706'] Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b0f5382c-c19f-489c-bf39-295651c9f3b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-e3fb9042-b001-459c-838a-93ba673dc706'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b0f5382c-c19f-489c-bf39-295651c9f3b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/632e68bb-c7c2-4d0b-972f-f56aed11ffae" status: 404 len: 194 microversion: 2.1 time: 0.042277 Oct 22 03:08:58.437426 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 626/1254] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:08:58 2022] GET /compute/v2.1/os-security-groups/632e68bb-c7c2-4d0b-972f-f56aed11ffae => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:58.442962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:58.449129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:58.453649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:58.454293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:58.454739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:58.456410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:58.456823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:58.457255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:58.703120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:58.712412 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c8aa272-082a-4895-b9a7-081a571f053b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.274664 Oct 22 03:08:58.712908 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 627/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:58 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:58.717713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:58.722643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:58.723431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Searching by: {'deleted': False, 'project_id': '7e462137d650486c919790a05aa876dc'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:08:58.767274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:58.767797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:58.768314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:58.769141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:58.769710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:58.770026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:58.899119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:08:59.041759 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-891f5c19-0072-4f9a-85cf-9fe6881fb920 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.327747 Oct 22 03:08:59.050210 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 628/1256] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:08:58 2022] GET /compute/v2.1/servers => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:59.057172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5ededf92-a0f9-44a7-bfaf-3afe6649866a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a36a4c0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:59.096584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:08:59.097071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:08:59.097669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:08:59.104624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:08:59.105579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:08:59.126012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:59.127770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:59.129213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:59.133502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:59.134986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:59.137685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:59.187291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Getting quotas for project 7979873b22324dea968909a57ebd877d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:08:59.192813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:08:59.202389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Getting quotas for user 39c6c1ad05a646029048f3a61df874c4 and project 7979873b22324dea968909a57ebd877d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:08:59.218902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:08:59.221708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:08:59.303375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de76a0d6-4c19-4b13-9650-2fac9560a77c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264864 Oct 22 03:08:59.304772 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 629/1257] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:08:59.315015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f85574a0-a8e2-44f9-959b-ebfde21717c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:59.318500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f85574a0-a8e2-44f9-959b-ebfde21717c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:59.387084 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5ededf92-a0f9-44a7-bfaf-3afe6649866a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b4035837-81b4-41b4-a381-aee02b101642" status: 202 len: 0 microversion: 2.1 time: 0.335355 Oct 22 03:08:59.388699 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 629/1258] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:08:59 2022] DELETE /compute/v2.1/os-security-groups/b4035837-81b4-41b4-a381-aee02b101642 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:08:59.395244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c382169-717a-4ccd-8243-97ac4395dd70 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:59.398807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c382169-717a-4ccd-8243-97ac4395dd70 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:59.530941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c382169-717a-4ccd-8243-97ac4395dd70 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:59.541716 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c382169-717a-4ccd-8243-97ac4395dd70 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1224 microversion: 2.1 time: 0.151774 Oct 22 03:08:59.556691 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 630/1259] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:59 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1224 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:59.562201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c3dc252-a665-46ad-960d-e46123f3a5e8 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a3c8280>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:59.568012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f85574a0-a8e2-44f9-959b-ebfde21717c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:08:59.596467 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f85574a0-a8e2-44f9-959b-ebfde21717c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1218 microversion: 2.1 time: 0.290173 Oct 22 03:08:59.598436 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 630/1260] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:59 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:08:59.627787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-1c3dc252-a665-46ad-960d-e46123f3a5e8 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:08:59.628653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-1c3dc252-a665-46ad-960d-e46123f3a5e8 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group b4035837-81b4-41b4-a381-aee02b101642 not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:08:59.630183 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1c3dc252-a665-46ad-960d-e46123f3a5e8 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:08:59.630183 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-9b505308-f8c2-4905-81d9-bc0e97bc0ab7'] Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c3dc252-a665-46ad-960d-e46123f3a5e8 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-security-groups/b4035837-81b4-41b4-a381-aee02b101642 HTTP/1.1 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-9b505308-f8c2-4905-81d9-bc0e97bc0ab7'] Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'b4035837-81b4-41b4-a381-aee02b101642'} Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:08:59.635030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b505308-f8c2-4905-81d9-bc0e97bc0ab7'] Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b505308-f8c2-4905-81d9-bc0e97bc0ab7'] Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b505308-f8c2-4905-81d9-bc0e97bc0ab7'] Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b505308-f8c2-4905-81d9-bc0e97bc0ab7'] Oct 22 03:08:59.639730 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:08:59.645340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c3dc252-a665-46ad-960d-e46123f3a5e8 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:08:59.645340 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-9b505308-f8c2-4905-81d9-bc0e97bc0ab7'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:08:59.645340 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1c3dc252-a665-46ad-960d-e46123f3a5e8 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/b4035837-81b4-41b4-a381-aee02b101642" status: 404 len: 194 microversion: 2.1 time: 0.098356 Oct 22 03:08:59.645340 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 631/1261] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:08:59 2022] GET /compute/v2.1/os-security-groups/b4035837-81b4-41b4-a381-aee02b101642 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:08:59.655540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e90d119e-8161-46fa-b7bb-88146a7fe906 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a9dc670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:59.736609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:08:59.737542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:08:59.747869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:59.748478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:59.748923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:08:59.749903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:08:59.750446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:08:59.763239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:00.021714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:00.035453 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c2901aa6-f6c2-491a-8df1-a6fd5af2a189 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.303966 Oct 22 03:09:00.036195 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 632/1262] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:08:59 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:00.250074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e90d119e-8161-46fa-b7bb-88146a7fe906 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586" status: 202 len: 0 microversion: 2.1 time: 0.600299 Oct 22 03:09:00.251268 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 631/1263] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:08:59 2022] DELETE /compute/v2.1/os-security-groups/5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:09:00.264896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c841b349-c4cf-47a8-a8e7-60237e135ea9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a270550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:00.308008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-c841b349-c4cf-47a8-a8e7-60237e135ea9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:00.308853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-c841b349-c4cf-47a8-a8e7-60237e135ea9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:09:00.315655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c841b349-c4cf-47a8-a8e7-60237e135ea9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:00.315655 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-a38b9ff9-f0e8-4ef9-9de7-d3190bffd6ac'] Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c841b349-c4cf-47a8-a8e7-60237e135ea9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-security-groups/5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 HTTP/1.1 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-a38b9ff9-f0e8-4ef9-9de7-d3190bffd6ac'] Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586'} Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:00.318082 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a38b9ff9-f0e8-4ef9-9de7-d3190bffd6ac'] Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a38b9ff9-f0e8-4ef9-9de7-d3190bffd6ac'] Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a38b9ff9-f0e8-4ef9-9de7-d3190bffd6ac'] Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a38b9ff9-f0e8-4ef9-9de7-d3190bffd6ac'] Oct 22 03:09:00.323536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:00.329656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c841b349-c4cf-47a8-a8e7-60237e135ea9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:00.329656 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-a38b9ff9-f0e8-4ef9-9de7-d3190bffd6ac'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:00.330990 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c841b349-c4cf-47a8-a8e7-60237e135ea9 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586" status: 404 len: 194 microversion: 2.1 time: 0.074733 Oct 22 03:09:00.342693 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 633/1264] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:09:00 2022] GET /compute/v2.1/os-security-groups/5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:00.352318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ec1fbe5-9451-40d2-ab47-e8f3c2ea1322 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a4bba60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:00.569703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:00.570492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:00.585721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:00.586216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:00.586654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:00.587379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:00.587835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:00.588286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:00.694420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:00.712754 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27784e58-6470-45a2-9ed3-accb6707ff6f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1220 microversion: 2.1 time: 0.146919 Oct 22 03:09:00.713347 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 634/1265] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:00 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:00.729057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:00.729959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:00.737247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:00.737744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:00.740692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:00.743178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:00.743674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:00.744120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:00.865599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:00.875102 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-655a2adc-29c8-4d1e-9380-cfd43c9f489f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1270 microversion: 2.1 time: 0.160692 Oct 22 03:09:00.888644 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 635/1266] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:00 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:01.061048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:01.062237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:01.089695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:01.090212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:01.090689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:01.091397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:01.091860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:01.092318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:01.277701 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ec1fbe5-9451-40d2-ab47-e8f3c2ea1322 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.929916 Oct 22 03:09:01.291681 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 632/1267] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:09:00 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:01.297071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-915f0682-adfe-4ae9-98db-5d67f7b53b36 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a1e1700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-127187879", "description": "tempest-description-299480133"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:01.442588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:01.457100 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-619c96c2-1e51-44bb-a545-ac2b994d0e8a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.400639 Oct 22 03:09:01.458172 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 636/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:01 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:01.685440 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-915f0682-adfe-4ae9-98db-5d67f7b53b36 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.392157 Oct 22 03:09:01.687101 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 633/1269] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:09:01 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:01.701120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7121a0d8-47a5-49db-8d10-6530b5d79c4e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a45a3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-959585586", "description": "tempest-description-1809677699"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:01.742298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:01.742936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:01.758290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:01.760663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:01.762893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:01.763675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:01.764147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:01.767018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:01.853444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:02.047311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:02.066006 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e188d644-3313-4036-98a1-bbd33d684278 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1276 microversion: 2.1 time: 0.328238 Oct 22 03:09:02.066906 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 634/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:01 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:02.096605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:02.097272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:02.107839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:02.108625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:02.109283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:02.110603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:02.111347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:02.112329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:02.254104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:02.271052 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42452f7a-573e-40e2-beba-b5565c9746f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1276 microversion: 2.1 time: 0.182839 Oct 22 03:09:02.271683 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 635/1271] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:02 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:02.469028 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7121a0d8-47a5-49db-8d10-6530b5d79c4e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.772856 Oct 22 03:09:02.470162 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 637/1272] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:09:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:02.488895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:02.489802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:02.511638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:02.512145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:02.512606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:02.516948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:02.520744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:02.523950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:02.686699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-254928421", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "ead6943f-52f6-48c1-87b7-f5219297b05a"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:02.775620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] validate_networks() for [('ead6943f-52f6-48c1-87b7-f5219297b05a', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:09:03.069062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:03.080642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1229af93-b332-4878-a01a-6186b5565edf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1542 microversion: 2.1 time: 0.598833 Oct 22 03:09:03.081496 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 636/1273] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:02 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1542 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:03.102867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:03.103849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:03.118413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:03.119256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:03.120284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:03.130228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:03.131197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:03.140821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:03.360153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:03.376412 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bdab9130-9bf7-41c5-b135-0b83984dc79f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1282 microversion: 2.1 time: 0.290224 Oct 22 03:09:03.377648 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 637/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:03 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1282 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:03.393627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:03.394628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:03.406088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:03.408882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:03.409592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:03.413934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:03.415074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:03.416312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:03.842703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:03.859517 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5ed24d9-5bdf-4381-b80b-7aa85bfea33c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 0.478558 Oct 22 03:09:03.860540 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 638/1275] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:03 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:04.104963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:04.105582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:04.121422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.121948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.122469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.123073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.123818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.124446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.344131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:09:04.345658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:09:04.346306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:09:04.346947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:09:04.348841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:09:04.376545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.379025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.380363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.384866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.386465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.388587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.430945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Getting quotas for project e9d3c4c33e854369a3d4c7775f931f69. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:04.437121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Getting quotas for user 0f3d30df231e48babcc1d20dc8743a39 and project e9d3c4c33e854369a3d4c7775f931f69. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:04.458101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:04.459988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:09:04.462614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:09:04.545834 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4e846eed-4321-48f8-85c8-83af1ebd363a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.863183 Oct 22 03:09:04.547362 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 638/1276] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:09:04.555795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:04.557361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:04.568017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.568966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.569742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.570848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.571525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.572345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.680325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:04.691697 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b8272a5f-ec8c-42d6-b262-bc01c2914b20 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1282 microversion: 2.1 time: 0.139971 Oct 22 03:09:04.693868 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 639/1277] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:04 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:04.699666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d5f3ceb4-f35c-4239-8889-7f1c64574b9d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:04.700541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d5f3ceb4-f35c-4239-8889-7f1c64574b9d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:04.713617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:04.734427 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e1cef11-4fc8-4d77-a672-751ea203560b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1541 microversion: 2.1 time: 0.633674 Oct 22 03:09:04.736182 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 639/1278] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:04 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1541 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:04.806000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d5f3ceb4-f35c-4239-8889-7f1c64574b9d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:04.815045 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d5f3ceb4-f35c-4239-8889-7f1c64574b9d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1215 microversion: 2.1 time: 0.119784 Oct 22 03:09:04.825039 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 640/1279] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:04 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:04.847591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c2454a66-40be-405f-8c35-69159b9c5655 req-2ac1d34c-d8ed-4021-9111-97325bab7d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "name": "network-vif-unplugged", "status": "completed", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:04.864032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c2454a66-40be-405f-8c35-69159b9c5655 req-2ac1d34c-d8ed-4021-9111-97325bab7d66 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.864844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c2454a66-40be-405f-8c35-69159b9c5655 req-2ac1d34c-d8ed-4021-9111-97325bab7d66 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.865693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c2454a66-40be-405f-8c35-69159b9c5655 req-2ac1d34c-d8ed-4021-9111-97325bab7d66 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.884355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:04.885332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:04.900127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.902420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.904407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.906683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:04.907264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:04.908769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:04.912495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c2454a66-40be-405f-8c35-69159b9c5655 req-2ac1d34c-d8ed-4021-9111-97325bab7d66 service nova] Creating event network-vif-unplugged:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h1-862416-2 Oct 22 03:09:04.926770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-c2454a66-40be-405f-8c35-69159b9c5655 req-2ac1d34c-d8ed-4021-9111-97325bab7d66 service nova] Instance a00104d4-606d-4ef1-b356-427e224a6972 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:09:04.954579 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c2454a66-40be-405f-8c35-69159b9c5655 req-2ac1d34c-d8ed-4021-9111-97325bab7d66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111402 Oct 22 03:09:04.959525 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 640/1280] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:05.198032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:05.211489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2bc072e9-a949-4f8c-a118-c2f0ec4cc753 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 0.331469 Oct 22 03:09:05.216545 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 641/1281] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:04 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:05.720147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:05.721836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:05.736441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:05.736944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:05.737384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:05.745636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:05.746655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:05.747469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:05.763057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:05.764341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:05.772166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:05.780924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:05.781386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:05.782151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:05.782615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:05.783047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:06.322686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:06.337904 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-76f21f83-9e32-47cb-8ec9-6840d7d7ccab tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1541 microversion: 2.1 time: 0.578599 Oct 22 03:09:06.338656 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 642/1282] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:05 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1541 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:06.354972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:06.355626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:06.371865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:06.372664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:06.373981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:06.374992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:06.375926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:06.376749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:06.384740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:06.396847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d398b5d-2809-4796-bffa-82f5407cf073 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.684985 Oct 22 03:09:06.397457 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 641/1283] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:05 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:06.412196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:06.412864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:06.444591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:06.445471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:06.445938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:06.446698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:06.447175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:06.447611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:06.795673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:06.824003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:06.829309 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6aefdd35-ffb6-475d-bc36-1118dfaa8c69 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1267 microversion: 2.1 time: 0.489745 Oct 22 03:09:06.832008 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 643/1284] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:06 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1267 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:06.842903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-aa14734b-8c37-4285-a51d-084a3659d914 req-1bcffc7f-3390-4674-9d74-261d6c05bccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0604553f-a92d-45b8-be48-a8ace1cda572", "tag": "cef21c3e-36a3-4720-a377-1756fa253fa4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:06.857632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aa14734b-8c37-4285-a51d-084a3659d914 req-1bcffc7f-3390-4674-9d74-261d6c05bccc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:06.858367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aa14734b-8c37-4285-a51d-084a3659d914 req-1bcffc7f-3390-4674-9d74-261d6c05bccc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:06.859009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aa14734b-8c37-4285-a51d-084a3659d914 req-1bcffc7f-3390-4674-9d74-261d6c05bccc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:06.872379 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-aa14734b-8c37-4285-a51d-084a3659d914 req-1bcffc7f-3390-4674-9d74-261d6c05bccc service nova] Creating event network-changed:cef21c3e-36a3-4720-a377-1756fa253fa4 for instance 0604553f-a92d-45b8-be48-a8ace1cda572 on n-h1-862416-2 Oct 22 03:09:06.887120 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-aa14734b-8c37-4285-a51d-084a3659d914 req-1bcffc7f-3390-4674-9d74-261d6c05bccc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053881 Oct 22 03:09:06.887670 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 644/1285] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:07.098917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:07.107800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2df88fd5-e678-4cc4-96ef-e4be042aa65b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 0.704615 Oct 22 03:09:07.128125 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 642/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:06 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:07.141702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fc7bab84-859a-4dfa-a13a-38306dd446a1 req-0d819e41-bfdd-477d-8a44-64d2ddbfa8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:07.158510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fc7bab84-859a-4dfa-a13a-38306dd446a1 req-0d819e41-bfdd-477d-8a44-64d2ddbfa8eb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:07.159590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fc7bab84-859a-4dfa-a13a-38306dd446a1 req-0d819e41-bfdd-477d-8a44-64d2ddbfa8eb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:07.160261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fc7bab84-859a-4dfa-a13a-38306dd446a1 req-0d819e41-bfdd-477d-8a44-64d2ddbfa8eb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:07.178406 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fc7bab84-859a-4dfa-a13a-38306dd446a1 req-0d819e41-bfdd-477d-8a44-64d2ddbfa8eb service nova] Creating event network-changed:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h1-862416-2 Oct 22 03:09:07.187240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-fc7bab84-859a-4dfa-a13a-38306dd446a1 req-0d819e41-bfdd-477d-8a44-64d2ddbfa8eb service nova] Instance a00104d4-606d-4ef1-b356-427e224a6972 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:09:07.206362 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fc7bab84-859a-4dfa-a13a-38306dd446a1 req-0d819e41-bfdd-477d-8a44-64d2ddbfa8eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069059 Oct 22 03:09:07.207316 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 645/1287] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:07.368163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:07.369577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:07.381079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:07.382824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:07.384038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:07.385533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:07.387224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:07.389096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:07.428479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:07.429903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:07.442799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:07.444201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:07.445505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:07.446460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:07.447157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:07.447805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:07.957448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:07.968023 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db9cdda9-b3ec-4dd2-b400-89840e186c00 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.545637 Oct 22 03:09:07.968631 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 646/1288] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:07 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:07.982217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:07.982861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:07.987087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:08.001409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:08.001912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:08.002354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:08.015089 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-14ba027f-f0b0-472e-91d5-89239a674891 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1541 microversion: 2.1 time: 0.649562 Oct 22 03:09:08.016881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:08.017596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:08.018410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:08.035967 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 643/1289] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:07 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1541 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:08.136851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:08.137616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:08.149995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:08.154997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:08.155853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:08.157118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:08.158945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:08.159642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:08.270611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:08.282139 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-05153259-c879-40ea-9fbf-af159753b893 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1273 microversion: 2.1 time: 0.310647 Oct 22 03:09:08.282901 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 647/1290] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:07 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:08.953330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fa06628e-dd32-4237-8611-1a323267639a req-fd44b835-a4e7-42ac-a1fe-562b1417e120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e02fea-8912-4cd6-bf02-eb3f39255b04", "tag": "eb7d1572-7f08-4d8e-8228-edab5d49e086"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:08.974063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fa06628e-dd32-4237-8611-1a323267639a req-fd44b835-a4e7-42ac-a1fe-562b1417e120 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:08.975246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fa06628e-dd32-4237-8611-1a323267639a req-fd44b835-a4e7-42ac-a1fe-562b1417e120 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:08.977019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fa06628e-dd32-4237-8611-1a323267639a req-fd44b835-a4e7-42ac-a1fe-562b1417e120 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:08.994254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fa06628e-dd32-4237-8611-1a323267639a req-fd44b835-a4e7-42ac-a1fe-562b1417e120 service nova] Creating event network-changed:eb7d1572-7f08-4d8e-8228-edab5d49e086 for instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 on n-h1-862416-2 Oct 22 03:09:09.001428 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fa06628e-dd32-4237-8611-1a323267639a req-fd44b835-a4e7-42ac-a1fe-562b1417e120 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051624 Oct 22 03:09:09.006098 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 648/1291] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:09:09.013002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:09.013743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:09.022244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:09.024393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:09.024393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:09.025001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:09.025084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:09.025609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:09.169223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:09.196344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:09.205375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f44360f-b747-4af8-896e-4f49a8e2e03a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 1.074090 Oct 22 03:09:09.209371 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 644/1292] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:08 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:09.218236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:09.218839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:09.251548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:09.252402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:09.253020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:09.255031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:09.256522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:09.257190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:09.594594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:09.701957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:09.710028 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e140fbc3-4ff7-455f-a6fc-d36d0c6eeeac tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1541 microversion: 2.1 time: 0.499460 Oct 22 03:09:09.711565 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 645/1293] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:09 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1541 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:09.716380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:09.717162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:09.724297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:09.724968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:09.726566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:09.727891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:09.728579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:09.729163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:09.853733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:09.867014 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fbbaf9d5-b0b0-422f-8274-ea8ae62e407f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.857913 Oct 22 03:09:09.879991 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 649/1294] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:09 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:09.983380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5916c994-3bb4-42da-b9cc-ff062141396c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Action: 'create', calling method: .version_select at 0x7f0d1a366b80>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:10.031405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5916c994-3bb4-42da-b9cc-ff062141396c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Getting quotas for project 1ff330333049401abf8a6814eab89f10. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:10.047832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5916c994-3bb4-42da-b9cc-ff062141396c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Getting quotas for user c72f687868bf492b8c56a28cef7def90 and project 1ff330333049401abf8a6814eab89f10. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:10.096694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:10.112320 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9ba6c5a7-78de-4e02-92af-bb299619e20c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.397637 Oct 22 03:09:10.125691 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 646/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:09 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:10.144031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-93d667cc-0e9c-4743-ad07-d54a27a5a97a req-40f3f700-7bf0-45be-9d40-b1f6079a0bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d997135c-ef2e-48e2-abe5-adb37c06211b", "tag": "9755bdc9-dfff-43fd-81c6-5df2835dba8d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:10.172491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-93d667cc-0e9c-4743-ad07-d54a27a5a97a req-40f3f700-7bf0-45be-9d40-b1f6079a0bb5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.174047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-93d667cc-0e9c-4743-ad07-d54a27a5a97a req-40f3f700-7bf0-45be-9d40-b1f6079a0bb5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.176339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-93d667cc-0e9c-4743-ad07-d54a27a5a97a req-40f3f700-7bf0-45be-9d40-b1f6079a0bb5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:10.196138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5916c994-3bb4-42da-b9cc-ff062141396c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Getting quotas for project 1ff330333049401abf8a6814eab89f10. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:10.201670 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-93d667cc-0e9c-4743-ad07-d54a27a5a97a req-40f3f700-7bf0-45be-9d40-b1f6079a0bb5 service nova] Creating event network-changed:9755bdc9-dfff-43fd-81c6-5df2835dba8d for instance d997135c-ef2e-48e2-abe5-adb37c06211b on n-h1-862416-2 Oct 22 03:09:10.208177 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-93d667cc-0e9c-4743-ad07-d54a27a5a97a req-40f3f700-7bf0-45be-9d40-b1f6079a0bb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073602 Oct 22 03:09:10.209059 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 647/1296] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:10.222530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5916c994-3bb4-42da-b9cc-ff062141396c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Getting quotas for user c72f687868bf492b8c56a28cef7def90 and project 1ff330333049401abf8a6814eab89f10. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:10.234924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:10.236311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:10.246977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.248134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.249013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:10.250019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.250625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.251204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:10.251884 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5916c994-3bb4-42da-b9cc-ff062141396c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.370002 Oct 22 03:09:10.253415 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 650/1297] 10.222.0.25 () {62 vars in 1214 bytes} [Sat Oct 22 03:09:09 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:09:10.285390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-237864e6-c284-4d73-a05d-bc49ea72a06c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:10.323431 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-237864e6-c284-4d73-a05d-bc49ea72a06c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.061698 Oct 22 03:09:10.324362 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 651/1298] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Oct 22 03:09:10 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:09:10.334837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72398970-6e13-47aa-9ddd-d7ea5ce32d55 tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:10.355038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72398970-6e13-47aa-9ddd-d7ea5ce32d55 tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/7934960c-391f-4ca5-b0f1-3b5af1898898" status: 200 len: 235 microversion: 2.64 time: 0.023157 Oct 22 03:09:10.361382 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 652/1299] 10.222.0.25 () {60 vars in 1304 bytes} [Sat Oct 22 03:09:10 2022] GET /compute/v2.1/os-server-groups/7934960c-391f-4ca5-b0f1-3b5af1898898 => generated 235 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:09:10.366481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c597f212-9523-42d0-9b47-0ccf98080e54"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:10.368870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:10.375159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.375651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.376088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:10.376834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.377917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.378351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:10.441302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:10.452257 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aea2a398-82d1-414c-85f6-14fef70f7d0e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 0.222689 Oct 22 03:09:10.454165 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 648/1300] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:10 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:10.459315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ad2c8db-e3f4-4005-bcee-a8577617d65c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:10.518792 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ad2c8db-e3f4-4005-bcee-a8577617d65c tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/7934960c-391f-4ca5-b0f1-3b5af1898898" status: 204 len: 0 microversion: 2.64 time: 0.062844 Oct 22 03:09:10.520323 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 649/1301] 10.222.0.25 () {60 vars in 1307 bytes} [Sat Oct 22 03:09:10 2022] DELETE /compute/v2.1/os-server-groups/7934960c-391f-4ca5-b0f1-3b5af1898898 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:09:10.534919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65daff72-45e3-42f4-b92a-9f05485a86c7 tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:10.551343 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-65daff72-45e3-42f4-b92a-9f05485a86c7 tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] HTTP exception thrown: Instance group 7934960c-391f-4ca5-b0f1-3b5af1898898 could not be found. Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65daff72-45e3-42f4-b92a-9f05485a86c7 tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Request method failure captured: Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-server-groups/7934960c-391f-4ca5-b0f1-3b5af1898898 HTTP/1.1 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17VDjwtKyo20eaKiLLjv5EnDHh1TzwkirS9XBX_AL8MwODvijtQfuI9pAPMDVU4jR_PLyVTngFryNPLRffN29fUFeM30x3piH0IoOwXnYSPOG1FlZQqBcZqgLVT9x9ZN04-IxMSCzqwNYurH_AZvFtpCN5PXIwjC55qlOrz1tolyIU Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.64 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1ff330333049401abf8a6814eab89f10 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerGroup264TestJSON-1140003417 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff330333049401abf8a6814eab89f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff330333049401abf8a6814eab89f10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff330333049401abf8a6814eab89f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff330333049401abf8a6814eab89f10"}]}] Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerGroup264TestJSON-1140003417 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1ff330333049401abf8a6814eab89f10 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1140003417 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerGroup264TestJSON-1140003417-project Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: c72f687868bf492b8c56a28cef7def90 Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerGroup264TestJSON-1140003417-project Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance group 7934960c-391f-4ca5-b0f1-3b5af1898898 could not be found. Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '7934960c-391f-4ca5-b0f1-3b5af1898898'} Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7934960c-391f-4ca5-b0f1-3b5af1898898 could not be found. Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7934960c-391f-4ca5-b0f1-3b5af1898898 could not be found. Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:10.555881 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:10.560995 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:10.560995 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:10.560995 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:10.560995 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:10.560995 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7934960c-391f-4ca5-b0f1-3b5af1898898 could not be found. Oct 22 03:09:10.560995 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:10.571812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65daff72-45e3-42f4-b92a-9f05485a86c7 tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] Returning 404 to user: Instance group 7934960c-391f-4ca5-b0f1-3b5af1898898 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:10.575748 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65daff72-45e3-42f4-b92a-9f05485a86c7 tempest-ServerGroup264TestJSON-1140003417 tempest-ServerGroup264TestJSON-1140003417-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/7934960c-391f-4ca5-b0f1-3b5af1898898" status: 404 len: 117 microversion: 2.64 time: 0.047787 Oct 22 03:09:10.576970 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 650/1302] 10.222.0.25 () {60 vars in 1307 bytes} [Sat Oct 22 03:09:10 2022] DELETE /compute/v2.1/os-server-groups/7934960c-391f-4ca5-b0f1-3b5af1898898 => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:09:10.741909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:10.742952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:10.754145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.757054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.757750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:10.758602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.760245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.762190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:10.849071 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2552f9fe-3318-403c-89ab-c9b999c607f9 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "POST /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486558 Oct 22 03:09:10.853414 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 653/1303] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:09:10 2022] POST /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:10.908621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:10.909563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:10.933618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.933618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.933618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:10.933618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:10.933618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:10.935133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:11.308116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:11.328465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d8909a7-7f77-49cd-a4a7-15ff687dcc6e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1473 microversion: 2.1 time: 0.591516 Oct 22 03:09:11.332357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:11.337228 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 651/1304] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:10 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1473 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:11.355284 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4bc75fc1-66e8-4238-9605-34774ee3ef71 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.453595 Oct 22 03:09:11.355880 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 654/1305] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:10 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:11.366513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:11.367074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b7d39fbf-289c-4153-a87c-c36f849e4d7a req-594606ad-e703-4db9-9506-d0d160963d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9b80a9-6a56-4de1-be88-76587cf41d65", "tag": "da8183e0-57d3-4f44-a170-1bb785a4b4cc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:11.373030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:11.395544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7d39fbf-289c-4153-a87c-c36f849e4d7a req-594606ad-e703-4db9-9506-d0d160963d2b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:11.396028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7d39fbf-289c-4153-a87c-c36f849e4d7a req-594606ad-e703-4db9-9506-d0d160963d2b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:11.396509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7d39fbf-289c-4153-a87c-c36f849e4d7a req-594606ad-e703-4db9-9506-d0d160963d2b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:11.401651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:11.402153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:11.402593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:11.403312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:11.403765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:11.404189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:11.427362 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b7d39fbf-289c-4153-a87c-c36f849e4d7a req-594606ad-e703-4db9-9506-d0d160963d2b service nova] Creating event network-changed:da8183e0-57d3-4f44-a170-1bb785a4b4cc for instance ec9b80a9-6a56-4de1-be88-76587cf41d65 on n-h2-862416-2 Oct 22 03:09:11.439777 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b7d39fbf-289c-4153-a87c-c36f849e4d7a req-594606ad-e703-4db9-9506-d0d160963d2b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096092 Oct 22 03:09:11.446217 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 652/1306] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:11.484670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:11.485585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:11.505855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:11.506628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:11.509504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:11.513175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:11.513944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:11.524812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:11.755340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:11.764607 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c73174ae-8869-4ef4-8541-13a538c20a19 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.407628 Oct 22 03:09:11.765761 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 655/1307] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:11 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:11.783167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:11.793583 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0793336e-f34c-4e52-816a-bda998e85455 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 0.316369 Oct 22 03:09:11.801561 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 653/1308] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:11 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:12.362483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:12.363437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:12.382804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:12.383021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:12.383486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:12.383578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:12.383704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:12.384633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:12.385478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:12.386067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:12.393692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:12.394200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:12.394654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:12.395379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:12.395837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:12.396307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:12.601662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:12.613083 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af31e18f-cefe-41b0-9b27-97bdc7fb74a8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1473 microversion: 2.1 time: 0.254336 Oct 22 03:09:12.626510 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 656/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:12 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:12.654851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:12.660623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:12.666968 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9aa5d3c3-e85a-49e5-9c6c-9256669ef41f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.288370 Oct 22 03:09:12.668655 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 654/1310] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:12 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:12.787761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:12.789847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:12.808758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:12.809266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:12.809727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:12.810478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:12.810941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:12.811370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:12.821271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:12.821885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:12.836531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:12.837740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:12.841376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:12.842355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:12.845342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:12.846526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:13.258719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:13.278042 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1b31c33-ee5c-4c1d-beb2-cfe5d59ee561 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.493857 Oct 22 03:09:13.279051 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 657/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:12 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:13.441623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-864d8afb-0437-4bd7-96c9-94709061e6bc req-468225be-2d05-47b6-b5de-bcb9630be8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0604553f-a92d-45b8-be48-a8ace1cda572", "name": "network-vif-plugged", "status": "completed", "tag": "cef21c3e-36a3-4720-a377-1756fa253fa4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:13.454239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-864d8afb-0437-4bd7-96c9-94709061e6bc req-468225be-2d05-47b6-b5de-bcb9630be8d3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:13.455067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-864d8afb-0437-4bd7-96c9-94709061e6bc req-468225be-2d05-47b6-b5de-bcb9630be8d3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:13.455953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-864d8afb-0437-4bd7-96c9-94709061e6bc req-468225be-2d05-47b6-b5de-bcb9630be8d3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:13.479966 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-864d8afb-0437-4bd7-96c9-94709061e6bc req-468225be-2d05-47b6-b5de-bcb9630be8d3 service nova] Creating event network-vif-plugged:cef21c3e-36a3-4720-a377-1756fa253fa4 for instance 0604553f-a92d-45b8-be48-a8ace1cda572 on n-h1-862416-2 Oct 22 03:09:13.501839 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-864d8afb-0437-4bd7-96c9-94709061e6bc req-468225be-2d05-47b6-b5de-bcb9630be8d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052831 Oct 22 03:09:13.502796 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 658/1312] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:13.639276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:13.639969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:13.653950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:13.654801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:13.656010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:13.657267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:13.658049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:13.658730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:13.945168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:13.965301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f47b76f5-bf0f-4869-97c2-fe057496c3b7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 1.149929 Oct 22 03:09:13.969247 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 655/1313] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:12 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:13.982869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:13.983772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:13.993310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:13.994155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:13.995225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:13.996320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:13.997004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:13.997657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.011185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:14.023961 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac67f6b4-7d3d-4757-a76c-b4da5a87dfb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1470 microversion: 2.1 time: 0.388929 Oct 22 03:09:14.030205 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 659/1314] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:13 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:14.054603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:14.055252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:14.062995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:14.063918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:14.066689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.068079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:14.068580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:14.069005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.119878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:14.120586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:14.121176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.122059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:14.122690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:14.123270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.161057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:14.169751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for user 7bf9da8e55124a7aae0938bb828b8f8a and project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:14.364036 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9444215b-c84f-47c9-ad7d-da7bc0df5714 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972/action" status: 202 len: 0 microversion: 2.1 time: 0.313530 Oct 22 03:09:14.365362 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 660/1315] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:09:14 2022] POST /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:09:14.382619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:14.383948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:14.394255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:14.395789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:14.396691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.398632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:14.399629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:14.400529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.442131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:14.493129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:14.501850 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3defadb-9a3c-4bea-b5d4-990af36c158f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.531197 Oct 22 03:09:14.505558 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 656/1316] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:13 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:14.510643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:14.521278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:14.531444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:14.535882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:14.536561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.537455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:14.542425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:14.543090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:14.644266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:14.655997 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9942e570-286a-4c54-957c-14844ea4a2dd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.288699 Oct 22 03:09:14.657787 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 661/1317] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:14 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:14.773344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:14.789610 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7e9c081a-350f-4997-968e-597703a63a3b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1469 microversion: 2.1 time: 0.282722 Oct 22 03:09:14.790476 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 657/1318] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:14 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:14.990676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:15.002212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:15.017174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.017812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.018347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:15.021080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.021667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.022191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:15.430888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:15.443138 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ebd3c6ec-ca42-49dd-b43d-f29835192089 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 0.456144 Oct 22 03:09:15.445199 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 662/1319] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:14 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:15.523680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2522c282-1091-4fee-9b85-7bc12fcdae07 req-ccc8da90-57d8-41ac-8a2b-2cd007d72a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e02fea-8912-4cd6-bf02-eb3f39255b04", "name": "network-vif-plugged", "status": "completed", "tag": "eb7d1572-7f08-4d8e-8228-edab5d49e086"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:15.535660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:15.536562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:15.543988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.544854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.545882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:15.546814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.547444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.548809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:15.566429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2522c282-1091-4fee-9b85-7bc12fcdae07 req-ccc8da90-57d8-41ac-8a2b-2cd007d72a1f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.566988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2522c282-1091-4fee-9b85-7bc12fcdae07 req-ccc8da90-57d8-41ac-8a2b-2cd007d72a1f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.568581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2522c282-1091-4fee-9b85-7bc12fcdae07 req-ccc8da90-57d8-41ac-8a2b-2cd007d72a1f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:15.617451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2522c282-1091-4fee-9b85-7bc12fcdae07 req-ccc8da90-57d8-41ac-8a2b-2cd007d72a1f service nova] Creating event network-vif-plugged:eb7d1572-7f08-4d8e-8228-edab5d49e086 for instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 on n-h1-862416-2 Oct 22 03:09:15.624625 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2522c282-1091-4fee-9b85-7bc12fcdae07 req-ccc8da90-57d8-41ac-8a2b-2cd007d72a1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105274 Oct 22 03:09:15.628473 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 658/1320] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:15.685190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:15.686648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:15.694068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.694864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.695552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:15.696493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.697288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.697883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:15.915949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:15.923724 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e4af6b0-2d58-4703-8a23-3fc36c30b2bc tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.245966 Oct 22 03:09:15.932445 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 659/1321] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:15 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:15.937468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:15.938247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:15.953092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.953826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.954427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:15.955319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:15.955935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:15.956602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:16.406307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:16.418469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18a9a249-089d-4886-9828-57f7fc0b5f57 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1469 microversion: 2.1 time: 0.484619 Oct 22 03:09:16.422061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 660/1322] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:15 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:16.472512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:16.473163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:16.484329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:16.484830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:16.485272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:16.486133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:16.486440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:16.486865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:16.667784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:16.686136 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d86209eb-89a7-4331-b598-cd3ee308730a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 1.151290 Oct 22 03:09:16.689245 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 663/1323] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:15 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:16.938113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:16.958918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:16.959552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:16.967387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9ff37652-9026-4a5c-8233-70c181bb4c48 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 0.498488 Oct 22 03:09:16.970115 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 661/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:16 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:16.981426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:16.986125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:16.986585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:16.993694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:16.994189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:16.995592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:17.237260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:17.253116 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-183b9031-b9cf-4ab5-9095-cae3cf069901 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.297917 Oct 22 03:09:17.264718 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 664/1325] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:16 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:17.452496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:17.453307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:17.465479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:17.465973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:17.466404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:17.467105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:17.467844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:17.468459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:17.681300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:17.690312 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57910ec0-628f-42cb-8441-d6bf1b71d3c2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1469 microversion: 2.1 time: 0.243947 Oct 22 03:09:17.691578 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 662/1326] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:17 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1469 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:17.714649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:17.716109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:17.719817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:17.724897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:17.725946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:17.726972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:17.728252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:17.729018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:17.729641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:17.994471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:17.995187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:17.999610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:18.011540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:18.013321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:18.014321 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-476aae8d-fda8-4aec-968c-c2357f5b991e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.304220 Oct 22 03:09:18.016135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:18.020683 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 665/1327] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:17 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:18.021561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:18.022150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:18.026658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:18.282677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:18.283514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:18.290354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:18.291094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:18.291720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:18.292450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:18.293065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:18.293654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:18.363242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:18.373457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc13aa03-cd3c-4d5f-a564-0414683a6412 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1318 microversion: 2.1 time: 0.383433 Oct 22 03:09:18.389017 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 663/1328] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:17 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:18.445576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:18.453598 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5b1bae0b-b0c2-4cfc-ba7b-602b00bd296c tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.174690 Oct 22 03:09:18.454719 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 666/1329] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:18 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:18.716663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:18.718079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:18.742617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:18.743786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:18.745483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:18.747444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:18.759261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:18.762598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:18.997892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:19.011003 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf014a96-2e9d-4995-aeaf-8dd1ff24eafc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1469 microversion: 2.1 time: 0.299288 Oct 22 03:09:19.013281 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 664/1330] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:18 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1469 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:19.045098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:19.045700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:19.053361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.054736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.055342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.056252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.056872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.057462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.219826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:19.229582 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4d164be7-b18f-44b5-93ca-0c53483c2b07 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.189023 Oct 22 03:09:19.230396 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 667/1331] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:19 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:19.304930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5fa75c0b-edbb-4aa2-9add-5016b9fc7185 req-a21cfed7-0b03-48ad-98fd-ae654e7dd0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "name": "network-vif-plugged", "status": "completed", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:19.314586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5fa75c0b-edbb-4aa2-9add-5016b9fc7185 req-a21cfed7-0b03-48ad-98fd-ae654e7dd0bb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.315062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5fa75c0b-edbb-4aa2-9add-5016b9fc7185 req-a21cfed7-0b03-48ad-98fd-ae654e7dd0bb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.315488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5fa75c0b-edbb-4aa2-9add-5016b9fc7185 req-a21cfed7-0b03-48ad-98fd-ae654e7dd0bb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.330630 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5fa75c0b-edbb-4aa2-9add-5016b9fc7185 req-a21cfed7-0b03-48ad-98fd-ae654e7dd0bb service nova] Creating event network-vif-plugged:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h1-862416-2 Oct 22 03:09:19.337464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-5fa75c0b-edbb-4aa2-9add-5016b9fc7185 req-a21cfed7-0b03-48ad-98fd-ae654e7dd0bb service nova] Instance a00104d4-606d-4ef1-b356-427e224a6972 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:09:19.351719 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5fa75c0b-edbb-4aa2-9add-5016b9fc7185 req-a21cfed7-0b03-48ad-98fd-ae654e7dd0bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050784 Oct 22 03:09:19.353317 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 665/1332] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:19.397262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:19.397616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:19.404722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.405196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.405805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.407105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.407718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.408324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.478556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:19.481269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:19.487483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.488190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.488648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.489559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.490058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.490492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.575948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:19.587194 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-56bc4df4-95c0-4640-82b6-406e9fdc5a6e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1467 microversion: 2.1 time: 0.194134 Oct 22 03:09:19.592960 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 668/1333] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:19 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1467 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:19.610812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:19.611429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0604553f-a92d-45b8-be48-a8ace1cda572] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:19.618710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.619188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.619627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.620413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.620872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.621300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.655176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:19.663930 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0b2d5e1f-192d-438a-9f2a-e1fe1669cd6e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.190135 Oct 22 03:09:19.665093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 666/1334] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:19 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:19.784032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:19.792634 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8fc7f6e3-e293-4954-aa36-8dd7cd1769bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572" status: 200 len: 1467 microversion: 2.1 time: 0.185683 Oct 22 03:09:19.793762 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 669/1335] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:19 2022] GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572 => generated 1467 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:19.815684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:19.821121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:19.825768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Searching by: {'reservation_id': 'r-lo40d0yt', 'deleted': False, 'project_id': '7e462137d650486c919790a05aa876dc'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:09:19.834294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.835347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.836073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.836847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:19.837472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:19.838078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:19.989927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:09:20.034702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:20.035604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:20.042411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.042902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.043440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.044152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.044630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.045223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.062335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:20.069708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.070921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.071523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.240317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=48 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:20.251798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:20.260173 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be768f6f-3be7-4a1b-b169-a2a645bb2c0f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1469 microversion: 2.1 time: 0.229192 Oct 22 03:09:20.260789 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 670/1336] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:20 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:20.267281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:20.267889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:20.274486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.275202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.275836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.276612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.277075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.277502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.301619 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e00f063-1c30-47ff-ab39-5ca0452ed1a4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-lo40d0yt" status: 200 len: 2927 microversion: 2.1 time: 0.489702 Oct 22 03:09:20.304257 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 667/1337] 10.222.0.25 () {58 vars in 1197 bytes} [Sat Oct 22 03:09:19 2022] GET /compute/v2.1/servers/detail?reservation_id=r-lo40d0yt => generated 2927 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:20.329033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a9cfc9a-ba95-440e-ae7c-81cfc172b9be tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:20.346996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.compute.server_groups [None req-8a9cfc9a-ba95-440e-ae7c-81cfc172b9be tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Querying cell 8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) for 2 instances {{(pid=120581) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 03:09:20.347895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9cfc9a-ba95-440e-ae7c-81cfc172b9be tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.349757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9cfc9a-ba95-440e-ae7c-81cfc172b9be tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.351025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9cfc9a-ba95-440e-ae7c-81cfc172b9be tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.391870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a9cfc9a-ba95-440e-ae7c-81cfc172b9be tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/0568f0d6-7c50-4ece-a2eb-a575060f8d2a" status: 200 len: 265 microversion: 2.1 time: 0.067544 Oct 22 03:09:20.393214 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 668/1338] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:09:20 2022] GET /compute/v2.1/os-server-groups/0568f0d6-7c50-4ece-a2eb-a575060f8d2a => generated 265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:09:20.407019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:20.407842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] [instance: 0604553f-a92d-45b8-be48-a8ace1cda572] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:20.421674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.422274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.422778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.423565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.424328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.424963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.467869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:20.480906 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a336a474-3036-4c5b-bf76-bb52f2156cfa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.216361 Oct 22 03:09:20.481537 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 671/1339] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:20 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:20.690607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:20.691218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:20.699145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.699626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.701763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.703780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.704265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.704698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.743618 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d35bcd1-9b1d-4491-be58-f036bb10924c tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572" status: 200 len: 1618 microversion: 2.1 time: 0.340317 Oct 22 03:09:20.744931 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 669/1340] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:20 2022] GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572 => generated 1618 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:20.774571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:20.775487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:20.782189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.782926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.783534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:20.784439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:20.785202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:20.785783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:21.022109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:21.034557 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9f3e88df-61c5-497a-8821-bdb923e54383 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.348792 Oct 22 03:09:21.035835 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 672/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:20 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:21.283346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:21.284795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:21.293518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:21.294373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:21.295030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:21.296187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:21.296901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:21.297542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:21.380050 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c9660b9-427f-4601-a536-b85323ef272b tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 200 len: 1618 microversion: 2.1 time: 0.612311 Oct 22 03:09:21.399388 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 670/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:20 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 1618 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:21.411591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-752a8b48-b164-480b-b5b9-eae479c39d26 req-b333dd6c-9657-4f67-aad4-5dba06e1f78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9b80a9-6a56-4de1-be88-76587cf41d65", "name": "network-vif-plugged", "status": "completed", "tag": "da8183e0-57d3-4f44-a170-1bb785a4b4cc"}, {"server_uuid": "d997135c-ef2e-48e2-abe5-adb37c06211b", "name": "network-vif-plugged", "status": "completed", "tag": "9755bdc9-dfff-43fd-81c6-5df2835dba8d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:21.431311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-752a8b48-b164-480b-b5b9-eae479c39d26 req-b333dd6c-9657-4f67-aad4-5dba06e1f78b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:21.432593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-752a8b48-b164-480b-b5b9-eae479c39d26 req-b333dd6c-9657-4f67-aad4-5dba06e1f78b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:21.433390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-752a8b48-b164-480b-b5b9-eae479c39d26 req-b333dd6c-9657-4f67-aad4-5dba06e1f78b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:21.451609 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-752a8b48-b164-480b-b5b9-eae479c39d26 req-b333dd6c-9657-4f67-aad4-5dba06e1f78b service nova] Creating event network-vif-plugged:da8183e0-57d3-4f44-a170-1bb785a4b4cc for instance ec9b80a9-6a56-4de1-be88-76587cf41d65 on n-h2-862416-2 Oct 22 03:09:21.452134 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-752a8b48-b164-480b-b5b9-eae479c39d26 req-b333dd6c-9657-4f67-aad4-5dba06e1f78b service nova] Creating event network-vif-plugged:9755bdc9-dfff-43fd-81c6-5df2835dba8d for instance d997135c-ef2e-48e2-abe5-adb37c06211b on n-h1-862416-2 Oct 22 03:09:21.465459 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-752a8b48-b164-480b-b5b9-eae479c39d26 req-b333dd6c-9657-4f67-aad4-5dba06e1f78b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064301 Oct 22 03:09:21.466133 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 671/1343] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:21.472367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6a129a3-e94e-4094-bf9f-bd10b79a6dd0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Action: 'create', calling method: .version_select at 0x7f0d1a991430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-883682997", "policies": ["anti-affinity"]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:21.479597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:21.505284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b6a129a3-e94e-4094-bf9f-bd10b79a6dd0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:21.528201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b6a129a3-e94e-4094-bf9f-bd10b79a6dd0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:21.657975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b6a129a3-e94e-4094-bf9f-bd10b79a6dd0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:21.663786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b6a129a3-e94e-4094-bf9f-bd10b79a6dd0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:21.681320 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6a129a3-e94e-4094-bf9f-bd10b79a6dd0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.213688 Oct 22 03:09:21.682383 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 672/1344] 10.222.0.25 () {60 vars in 1174 bytes} [Sat Oct 22 03:09:21 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:21.696404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:21.698264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:21.706031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:21.706519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:21.706952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:21.707969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:21.708452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:21.708875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:21.726044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:21.745901 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-969916f5-7732-4913-8c66-96d75d720b75 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1535 microversion: 2.1 time: 0.466510 Oct 22 03:09:21.747127 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 673/1345] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:21 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1535 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:21.849856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2038444364", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "41c97a5f-7ff2-46d3-b0e2-e5d7273a72ba"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:21.934039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:09:22.226977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:22.230391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:22.238644 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-78bf658a-a189-494e-8889-0a88d5b545bf tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.555096 Oct 22 03:09:22.239234 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 673/1346] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:21 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:22.245121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:22.245936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:22.265494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.266237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.266840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.267720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.268355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.268934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.418569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:09:22.419964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:09:22.420727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:09:22.421223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:09:22.421848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:09:22.454635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.455838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.456415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.457229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.457771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.458249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.487057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:22.493338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:22.510545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Going to run 2 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:09:22.513160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:09:22.536684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:22.549880 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f7938e7-faad-4af8-b429-412a8d360705 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1315 microversion: 2.1 time: 0.308851 Oct 22 03:09:22.568842 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 674/1347] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:22 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:22.593198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:22.599839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:22.639674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-73b3d2d9-f0a4-4935-b071-009d2827deea req-20f29750-f7a9-4133-b604-ffc4d6eab18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "name": "network-vif-unplugged", "status": "completed", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:22.651881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:22.657890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:22.660083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73b3d2d9-f0a4-4935-b071-009d2827deea req-20f29750-f7a9-4133-b604-ffc4d6eab18c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.660602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73b3d2d9-f0a4-4935-b071-009d2827deea req-20f29750-f7a9-4133-b604-ffc4d6eab18c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.661070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73b3d2d9-f0a4-4935-b071-009d2827deea req-20f29750-f7a9-4133-b604-ffc4d6eab18c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.676432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:09:22.701700 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-73b3d2d9-f0a4-4935-b071-009d2827deea req-20f29750-f7a9-4133-b604-ffc4d6eab18c service nova] Creating event network-vif-unplugged:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h2-862416-2 Oct 22 03:09:22.709488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-73b3d2d9-f0a4-4935-b071-009d2827deea req-20f29750-f7a9-4133-b604-ffc4d6eab18c service nova] Instance a00104d4-606d-4ef1-b356-427e224a6972 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:09:22.735274 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-73b3d2d9-f0a4-4935-b071-009d2827deea req-20f29750-f7a9-4133-b604-ffc4d6eab18c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099095 Oct 22 03:09:22.736335 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 675/1348] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:22.752114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:22.758285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:22.771621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:22.772856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:22.786098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.786591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.787029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.789001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.789569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.789932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.824731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:22.833405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:22.877049 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6586cd8-9999-4316-977a-db7be726c896 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.031434 Oct 22 03:09:22.881169 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 674/1349] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 22 03:09:22.887214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:22.893151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:22.894160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Searching by: {'deleted': False, 'project_id': '7e462137d650486c919790a05aa876dc'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:09:22.918317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.922795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.923926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.924903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:22.925475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:22.926008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:22.981916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:09:23.016467 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84290cad-cae4-4457-bf78-8ae6ebedf5cb tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.133289 Oct 22 03:09:23.017931 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 675/1350] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:09:22 2022] GET /compute/v2.1/servers => generated 1664 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:23.039544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a12ff6b7-4864-4efd-88dc-bada9f890252 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:23.040904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a12ff6b7-4864-4efd-88dc-bada9f890252 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:23.083554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:23.093541 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de0f2711-8864-4963-a756-53bb94fbe311 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1535 microversion: 2.1 time: 0.326178 Oct 22 03:09:23.094668 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 676/1351] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:22 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1535 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:23.262798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:23.263511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:23.279887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:23.280411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:23.280847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:23.281551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:23.282000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:23.282629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:23.293930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a12ff6b7-4864-4efd-88dc-bada9f890252 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:23.303706 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a12ff6b7-4864-4efd-88dc-bada9f890252 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1219 microversion: 2.1 time: 0.277290 Oct 22 03:09:23.306026 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 676/1352] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:23 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1219 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:23.574729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:23.581716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:23.599487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:23.607241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:23.607803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:23.608617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:23.609146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:23.609588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:23.752202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:23.762775 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-29e4c7fd-c255-4fb4-9b4f-c7e3b05a2f25 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1324 microversion: 2.1 time: 0.503780 Oct 22 03:09:23.782609 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 677/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:23 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1324 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:24.128133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:24.129129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:24.148831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.149404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.156032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:24.159075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.159643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.160160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:24.335327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:24.343344 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c723d282-83ba-4443-85d0-ce21e0a33539 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1535 microversion: 2.1 time: 0.229141 Oct 22 03:09:24.344170 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 678/1354] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:24 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1535 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:24.349317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:24.349948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:24.356944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.357433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.357895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:24.358563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.359307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.359697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:24.370126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:24.380422 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d99f9ba4-cfb4-4c71-9cf1-1d7662fd7d8d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1503 microversion: 2.1 time: 0.809706 Oct 22 03:09:24.381571 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 677/1355] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:23 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1503 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:24.406425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-127187879"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:24.407409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:24.417735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.418626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.419369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:24.420402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.420879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.421353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:24.467834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:24.476517 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-06d0c52a-cd25-44de-aca1-5c3549db1b54 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1223 microversion: 2.1 time: 0.130751 Oct 22 03:09:24.477422 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 679/1356] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:24 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:24.715447 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.network.security_group_api [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Adding security group b4966a27-1025-4368-9045-6a0f738a73cb to port da8183e0-57d3-4f44-a170-1bb785a4b4cc Oct 22 03:09:24.783255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a4270f2c-286a-4bc1-9bfe-cb298e38c80a req-0a3ffb52-9358-4c87-aa92-722e805b8d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:24.795879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a4270f2c-286a-4bc1-9bfe-cb298e38c80a req-0a3ffb52-9358-4c87-aa92-722e805b8d4e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.797770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a4270f2c-286a-4bc1-9bfe-cb298e38c80a req-0a3ffb52-9358-4c87-aa92-722e805b8d4e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.798405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a4270f2c-286a-4bc1-9bfe-cb298e38c80a req-0a3ffb52-9358-4c87-aa92-722e805b8d4e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:24.814238 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a4270f2c-286a-4bc1-9bfe-cb298e38c80a req-0a3ffb52-9358-4c87-aa92-722e805b8d4e service nova] Creating event network-changed:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h2-862416-2 Oct 22 03:09:24.821230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-a4270f2c-286a-4bc1-9bfe-cb298e38c80a req-0a3ffb52-9358-4c87-aa92-722e805b8d4e service nova] Instance a00104d4-606d-4ef1-b356-427e224a6972 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:09:24.833837 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a4270f2c-286a-4bc1-9bfe-cb298e38c80a req-0a3ffb52-9358-4c87-aa92-722e805b8d4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054294 Oct 22 03:09:24.835782 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 680/1357] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:09:24.842443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:24.843312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:24.851091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.851856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.852554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:24.853492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:24.854104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:24.854864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.107540 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-838c45f0-1e9f-423e-a394-9303c80a2667 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65/action" status: 202 len: 0 microversion: 2.1 time: 0.707281 Oct 22 03:09:25.108224 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 678/1358] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:09:24 2022] POST /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:09:25.110351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:25.123014 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35559e17-212e-4f29-af29-1ec64bf95500 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.284419 Oct 22 03:09:25.124330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d4be532-0c28-435b-94e3-3edbe22fae96 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a0b5430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:25.134208 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 681/1359] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:24 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:25.160595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5281f324-2435-42d0-9ef9-dbeb0ca2ae88 req-159ce48f-eb84-4207-a8bc-d3cef37678f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9b80a9-6a56-4de1-be88-76587cf41d65", "tag": "da8183e0-57d3-4f44-a170-1bb785a4b4cc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:25.177283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5281f324-2435-42d0-9ef9-dbeb0ca2ae88 req-159ce48f-eb84-4207-a8bc-d3cef37678f3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.179943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5281f324-2435-42d0-9ef9-dbeb0ca2ae88 req-159ce48f-eb84-4207-a8bc-d3cef37678f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.180662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5281f324-2435-42d0-9ef9-dbeb0ca2ae88 req-159ce48f-eb84-4207-a8bc-d3cef37678f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.195994 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5281f324-2435-42d0-9ef9-dbeb0ca2ae88 req-159ce48f-eb84-4207-a8bc-d3cef37678f3 service nova] Creating event network-changed:da8183e0-57d3-4f44-a170-1bb785a4b4cc for instance ec9b80a9-6a56-4de1-be88-76587cf41d65 on n-h2-862416-2 Oct 22 03:09:25.202547 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5281f324-2435-42d0-9ef9-dbeb0ca2ae88 req-159ce48f-eb84-4207-a8bc-d3cef37678f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052444 Oct 22 03:09:25.203715 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 682/1360] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:25.212199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:25.213148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:25.221169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.221940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.222674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.223556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.224168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.224780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.393991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-7d4be532-0c28-435b-94e3-3edbe22fae96 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b4966a27-1025-4368-9045-6a0f738a73cb in use.", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:25.394803 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-7d4be532-0c28-435b-94e3-3edbe22fae96 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security Group b4966a27-1025-4368-9045-6a0f738a73cb in use. Oct 22 03:09:25.394803 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-3760c10a-8095-4ab5-bcbd-bee435ae63c7'] Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d4be532-0c28-435b-94e3-3edbe22fae96 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-security-groups/b4966a27-1025-4368-9045-6a0f738a73cb HTTP/1.1 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: exception: Security Group b4966a27-1025-4368-9045-6a0f738a73cb in use. Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-3760c10a-8095-4ab5-bcbd-bee435ae63c7'] Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'b4966a27-1025-4368-9045-6a0f738a73cb'} Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:25.397068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b4966a27-1025-4368-9045-6a0f738a73cb in use. Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3760c10a-8095-4ab5-bcbd-bee435ae63c7'] Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b4966a27-1025-4368-9045-6a0f738a73cb in use. Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3760c10a-8095-4ab5-bcbd-bee435ae63c7'] Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b4966a27-1025-4368-9045-6a0f738a73cb in use. Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3760c10a-8095-4ab5-bcbd-bee435ae63c7'] Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b4966a27-1025-4368-9045-6a0f738a73cb in use. Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3760c10a-8095-4ab5-bcbd-bee435ae63c7'] Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d4be532-0c28-435b-94e3-3edbe22fae96 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 400 to user: Security Group b4966a27-1025-4368-9045-6a0f738a73cb in use. Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-3760c10a-8095-4ab5-bcbd-bee435ae63c7'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:25.401429 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d4be532-0c28-435b-94e3-3edbe22fae96 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b4966a27-1025-4368-9045-6a0f738a73cb" status: 400 len: 185 microversion: 2.1 time: 0.285992 Oct 22 03:09:25.404284 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 679/1361] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:25 2022] DELETE /compute/v2.1/os-security-groups/b4966a27-1025-4368-9045-6a0f738a73cb => generated 185 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:09:25.409017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:25.414818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:25.431113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.431612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.432053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.436727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.437218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.442404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.653227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:25.657943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid a218e3e3-6082-4b65-8edb-b406c7cd582f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:09:25.684620 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e16096e-2929-4a12-99c6-e589e68192a3 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 2344 microversion: 2.25 time: 0.279522 Oct 22 03:09:25.697799 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 680/1362] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:09:25 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 2344 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:09:25.714042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:25.715528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:25.720786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:25.726504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.727252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.727990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.730727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.731340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.732004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.791172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:25.799194 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7991c59c-f38d-4b8d-a58f-78113ed70ad5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.593949 Oct 22 03:09:25.802610 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 683/1363] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:25 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:25.821172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:25.823965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:25.835734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.836532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.837228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.843483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.844809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.845469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.933596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:25.943300 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c6468f4f-067b-4e25-9e94-18ccefd524e6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1535 microversion: 2.1 time: 0.242918 Oct 22 03:09:25.944536 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 681/1364] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:25 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1535 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:25.949799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:25.950591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:25.957984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.958812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.959411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:25.960914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:25.961537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:25.962191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.009261 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-17c5a45f-9117-4bc8-8060-53a0c4edaf86 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65/action" status: 202 len: 0 microversion: 2.1 time: 0.204551 Oct 22 03:09:26.012979 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 684/1365] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:09:25 2022] POST /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:09:26.017282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-02c669a3-1c88-48c7-b529-d72236c6653c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:26.033968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02c669a3-1c88-48c7-b529-d72236c6653c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.034567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02c669a3-1c88-48c7-b529-d72236c6653c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.035296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02c669a3-1c88-48c7-b529-d72236c6653c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.036276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02c669a3-1c88-48c7-b529-d72236c6653c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.036931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02c669a3-1c88-48c7-b529-d72236c6653c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.037565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02c669a3-1c88-48c7-b529-d72236c6653c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.046905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:26.056172 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-292b6344-d646-4411-986d-8c7d01a7dd46 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1215 microversion: 2.1 time: 0.110214 Oct 22 03:09:26.057758 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 682/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:25 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:26.063618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-995b3a6f-0e6c-4405-9242-7632edaf695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1798481513", "metadata": {"": ""}}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:26.065984 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-02c669a3-1c88-48c7-b529-d72236c6653c tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054746 Oct 22 03:09:26.066736 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 685/1367] 10.222.0.25 () {60 vars in 1217 bytes} [Sat Oct 22 03:09:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:09:26.072090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:26.073139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:26.080419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.080976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.081480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.082307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.082999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.083761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-995b3a6f-0e6c-4405-9242-7632edaf695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action HTTP/1.1 Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 107 Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1798481513", "metadata": {"": ""}}} Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd997135c-ef2e-48e2-abe5-adb37c06211b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1798481513', 'metadata': {'': ''}}}} Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'': ''} Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:26.088681 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-995b3a6f-0e6c-4405-9242-7632edaf695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:26.093392 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-995b3a6f-0e6c-4405-9242-7632edaf695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action" status: 400 len: 170 microversion: 2.1 time: 0.031349 Oct 22 03:09:26.094822 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 683/1368] 10.222.0.25 () {60 vars in 1279 bytes} [Sat Oct 22 03:09:26 2022] POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action => generated 170 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:09:26.098870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:26.099482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:26.108462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.108957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.109396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.110109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.110562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.110987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.286442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:26.294885 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d916a161-9faa-45bc-9d8b-9134d916266c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.199528 Oct 22 03:09:26.304921 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 684/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:26 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:26.322130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:26.323142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:26.331433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.331931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.332417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.333189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.333649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.334077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.567468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:26.579756 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2991ce08-ae11-41c5-adb3-e7a2cede2eb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.262709 Oct 22 03:09:26.580548 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 685/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:26 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:26.608514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d49f07f-f320-46f1-bf8e-7b8b22e057f8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-817435298", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d49f07f-f320-46f1-bf8e-7b8b22e057f8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action HTTP/1.1 Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 618 Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-817435298", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd997135c-ef2e-48e2-abe5-adb37c06211b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-817435298', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:09:26.614407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:26.617616 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:26.620121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d49f07f-f320-46f1-bf8e-7b8b22e057f8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:26.620121 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d49f07f-f320-46f1-bf8e-7b8b22e057f8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action" status: 400 len: 938 microversion: 2.1 time: 0.016175 Oct 22 03:09:26.620121 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 686/1371] 10.222.0.25 () {60 vars in 1279 bytes} [Sat Oct 22 03:09:26 2022] POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:09:26.633270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:26.633911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:26.643429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.643919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.644460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:26.645168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:26.645627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:26.646125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.026271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:27.035944 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfa2993c-0f4e-45b9-92f9-e64e2998af1b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1573 microversion: 2.1 time: 0.967864 Oct 22 03:09:27.037241 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 686/1372] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:26 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1573 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:27.044109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:27.044962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:27.051631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.052465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.053058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.054105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.054730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.057507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.065357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:27.082283 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-adc79e0f-6598-4bdc-ae21-ff0e03767f55 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.452930 Oct 22 03:09:27.083624 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 687/1373] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:26 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:27.090078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:27.091052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:27.097746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.098661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.099513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.101219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.101990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.102690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.179486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:27.191407 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8eb54a2b-30f2-4ef2-ab16-d2db45b5d93f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1215 microversion: 2.1 time: 0.105983 Oct 22 03:09:27.200264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 688/1374] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:27 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:27.200264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:27.200264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:27.214968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.215471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.216916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.219169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.219169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.219169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.397453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:27.406460 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a06f7f9-38a0-4af9-9809-8fc1d9f8695c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.211934 Oct 22 03:09:27.412433 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 689/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:27 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:27.437894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-75c293c0-92eb-4d5d-9948-de049bbdf854 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-75c293c0-92eb-4d5d-9948-de049bbdf854 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action HTTP/1.1 Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 285 Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd997135c-ef2e-48e2-abe5-adb37c06211b', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:27.443102 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:09:27.447511 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:27.452234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-75c293c0-92eb-4d5d-9948-de049bbdf854 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:27.453762 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-75c293c0-92eb-4d5d-9948-de049bbdf854 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action" status: 400 len: 619 microversion: 2.1 time: 0.021358 Oct 22 03:09:27.456434 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 690/1376] 10.222.0.25 () {60 vars in 1279 bytes} [Sat Oct 22 03:09:27 2022] POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:09:27.470680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:27.472010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:27.477326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:27.482542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.483244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.483866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.484781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.485423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.486074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-688016a4-1f6a-4ab1-8272-6a04df3cad40 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1535 microversion: 2.1 time: 0.446714 Oct 22 03:09:27.486411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.486890 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 687/1377] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:27 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1535 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:27.657501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:27.668730 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a94650c-bb54-4bf9-87bd-c22052f3cb2d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.202733 Oct 22 03:09:27.680779 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 691/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:27 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:27.693562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:27.694234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:27.702053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.703245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.704011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:27.705107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:27.705720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:27.706322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.065829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:28.067239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:28.074626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.075664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.076225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.077469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.079817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.080969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.138410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:28.149044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fdf6c954-6461-4a95-8f85-42532795fe35 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.459282 Oct 22 03:09:28.151176 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 688/1379] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:27 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:28.174932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-14996571"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:28.183915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:28.197312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.197808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.198247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.198962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.199415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.199843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.360131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:28.383627 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6fd8952d-2793-4047-b6a5-6a24d366511a tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1573 microversion: 2.1 time: 0.320286 Oct 22 03:09:28.389481 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 692/1380] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:28 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1573 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:28.395170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:28.396016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:28.405806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.407352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.407968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.408924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.409867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.410640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.578619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:28.593318 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d05492a3-7401-4574-a53b-afa27cc438bc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1215 microversion: 2.1 time: 0.199372 Oct 22 03:09:28.593651 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 693/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:28 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:28.607530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:28.608162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:28.620341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.623325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.623802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.624554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.625459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.626050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.627220 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-198c7ad6-f34b-43b2-8638-2842240fd569 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action" status: 202 len: 0 microversion: 2.1 time: 0.456324 Oct 22 03:09:28.634314 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 689/1382] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:09:28 2022] POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 22 03:09:28.646079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2140879114"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:28.651978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:28.659971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.660805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.661412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.662291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.663530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.664341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.732180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:28.751348 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Cannot 'createImage' instance d997135c-ef2e-48e2-abe5-adb37c06211b while it is in task_state image_snapshot_pending Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action HTTP/1.1 Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 85 Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2140879114"}} Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: exception: Cannot 'createImage' instance d997135c-ef2e-48e2-abe5-adb37c06211b while it is in task_state image_snapshot_pending Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd997135c-ef2e-48e2-abe5-adb37c06211b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2140879114'}}} Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d997135c-ef2e-48e2-abe5-adb37c06211b in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:09:28.755248 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance d997135c-ef2e-48e2-abe5-adb37c06211b while it is in task_state image_snapshot_pending Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance d997135c-ef2e-48e2-abe5-adb37c06211b while it is in task_state image_snapshot_pending Oct 22 03:09:28.760624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:28.762569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 409 to user: Cannot 'createImage' instance d997135c-ef2e-48e2-abe5-adb37c06211b while it is in task_state image_snapshot_pending {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:28.763885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4c829ae-ba4d-4965-b977-ccb56ff716fe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action" status: 409 len: 167 microversion: 2.1 time: 0.127569 Oct 22 03:09:28.765200 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 690/1383] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:09:28 2022] POST /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b/action => generated 167 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:09:28.776708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bdb0a40d-ee8f-4f10-bf19-c625755bac52 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '.version_select at 0x7f0d1e5c7940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:28.841061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:28.849574 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a94b5f1-9942-4b48-9058-c8df3549aa8e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1535 microversion: 2.1 time: 0.253484 Oct 22 03:09:28.868116 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 694/1384] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:28 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1535 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:28.952591 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bdb0a40d-ee8f-4f10-bf19-c625755bac52 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/images/651b52e8-8742-404a-936e-ac2c8c6dbb7c" status: 204 len: 0 microversion: 2.1 time: 0.183256 Oct 22 03:09:28.953613 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 691/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:28 2022] DELETE /compute/v2.1/images/651b52e8-8742-404a-936e-ac2c8c6dbb7c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:09:28.962570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:28.963553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:28.970879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.971572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.972185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:28.973414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:28.974060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:28.974674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.125569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:29.158021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0898f9f-bd65-4362-9031-ed1368b7d172", "device": "/dev/xvdb"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:29.161228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:29.162104 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ef319e8-29ef-42fe-ba73-282fcbd8e326 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1531 microversion: 2.1 time: 0.203790 Oct 22 03:09:29.173265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.173265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.173265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.173588 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 695/1386] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:28 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1531 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:29.173693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.173693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.173693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.410865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:29.411497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:29.418646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.419129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.419566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.420295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.420753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.421180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.573360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:29.582275 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59d4836b-4556-4157-a13c-9bfbb9ed2b74 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1573 microversion: 2.1 time: 0.175284 Oct 22 03:09:29.582883 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 696/1387] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:29 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:29.621571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:29.622192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:29.629033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.629520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.630587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.631922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.632726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.633671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.743351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:29.774881 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e18d42f7-8214-4ca4-9a41-4b0454d691e0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1215 microversion: 2.1 time: 0.157974 Oct 22 03:09:29.780310 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 697/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:29 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:29.815012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-99aa2f17-785a-4531-956a-447c0ab71d0f req-ebbeb93b-b594-41ce-8ca4-c20b377695d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7", "tag": "2b132016-09b7-49d3-ad51-b002e76cf74e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:29.863835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-99aa2f17-785a-4531-956a-447c0ab71d0f req-ebbeb93b-b594-41ce-8ca4-c20b377695d2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.864618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-99aa2f17-785a-4531-956a-447c0ab71d0f req-ebbeb93b-b594-41ce-8ca4-c20b377695d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.865239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-99aa2f17-785a-4531-956a-447c0ab71d0f req-ebbeb93b-b594-41ce-8ca4-c20b377695d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.878712 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-99aa2f17-785a-4531-956a-447c0ab71d0f req-ebbeb93b-b594-41ce-8ca4-c20b377695d2 service nova] Creating event network-changed:2b132016-09b7-49d3-ad51-b002e76cf74e for instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 on n-h1-862416-2 Oct 22 03:09:29.885497 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-99aa2f17-785a-4531-956a-447c0ab71d0f req-ebbeb93b-b594-41ce-8ca4-c20b377695d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077370 Oct 22 03:09:29.886389 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 698/1389] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:09:29.892308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:29.894000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:29.902267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.902978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.903582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:29.904675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:29.905319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:29.905937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:30.333126 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a679e8a9-e979-4292-9a01-6671946de276 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "POST /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.178483 Oct 22 03:09:30.335078 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 692/1390] 10.222.0.25 () {62 vars in 1364 bytes} [Sat Oct 22 03:09:29 2022] POST /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 194 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:09:30.368349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:30.382691 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2fa93650-fb0f-4a37-a16d-21d0dcb9c88c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1535 microversion: 2.1 time: 0.493782 Oct 22 03:09:30.386985 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 699/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:29 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1535 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:30.393387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:30.400564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:30.413390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:30.416895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:30.419181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:30.422354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:30.424572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:30.425313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:30.639765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1184285423", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:30.753650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] validate_networks() for [('02c73e7e-bb7c-4f81-ba1b-cfee515000b3', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:09:30.799184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:30.804850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:30.812661 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b0eb99c8-9f9a-41a5-bbf4-5e25ac58084d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1537 microversion: 2.1 time: 0.424240 Oct 22 03:09:30.813813 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 700/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:30 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1537 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:30.819665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:30.820689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:30.829519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:30.830399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:30.831055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:30.832018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:30.832813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:30.833500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:31.174836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:31.186274 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cd150848-c434-47d6-888a-bac03328e39b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1573 microversion: 2.1 time: 0.371117 Oct 22 03:09:31.186995 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 701/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:30 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1573 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:31.211139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:31.212035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:31.220541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:31.221046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:31.221491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:31.222522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:31.222970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:31.223491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:31.299320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:31.309446 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f3edbca-2d35-4a80-bb08-2bbfa2ccf2a6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1271 microversion: 2.1 time: 0.111789 Oct 22 03:09:31.310367 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 702/1394] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:31 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:31.468578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "242411f8-3b22-4775-a9bd-2d895526607a"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:31.471156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:31.505447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:31.509624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:31.510437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:31.513836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:31.515818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:31.516600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:31.675155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:31.863933 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] HTTP exception thrown: Volume 242411f8-3b22-4775-a9bd-2d895526607a could not be found. Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Request method failure captured: Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments/c597f212-9523-42d0-9b47-0ccf98080e54 HTTP/1.1 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 74 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU15NMzQINzs-ecLxrwEpRnhh-RYcnfZdROSZ9BDTPrLEi9C0NV0R1W8iqepzR33uIKi0GKHAp6BokdCSWQvFb9YUIZLyWPEP-6W7bwlax75c_rjSkMUr3KihlDTxJiA0lnUbilPSHNQ7k_Mnayet6VDD_o39_dC9jAqBfCVvvT0FT6g Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 30099f50cef646f590571f1fc2a2a2b6 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesAdminNegativeTest-961014168 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30099f50cef646f590571f1fc2a2a2b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30099f50cef646f590571f1fc2a2a2b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30099f50cef646f590571f1fc2a2a2b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30099f50cef646f590571f1fc2a2a2b6"}]}] Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesAdminNegativeTest-961014168 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 30099f50cef646f590571f1fc2a2a2b6 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-961014168 Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesAdminNegativeTest-961014168-project-admin Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92264d694b7f4fcb97647141aa91592c Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesAdminNegativeTest-961014168-project-admin Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: {"volumeAttachment": {"volumeId": "242411f8-3b22-4775-a9bd-2d895526607a"}} Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: exception: Volume 242411f8-3b22-4775-a9bd-2d895526607a could not be found. Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': '593d2c59-795e-4dc7-8200-56b449d7b066', 'id': 'c597f212-9523-42d0-9b47-0ccf98080e54', 'body': {'volumeAttachment': {'volumeId': '242411f8-3b22-4775-a9bd-2d895526607a'}}} Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 242411f8-3b22-4775-a9bd-2d895526607a could not be found. (HTTP 404) (Request-ID: req-f8d9e6f6-ae6d-409f-8d10-16d658f93309) Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:09:31.869000 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 242411f8-3b22-4775-a9bd-2d895526607a could not be found. Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 242411f8-3b22-4775-a9bd-2d895526607a could not be found. Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 242411f8-3b22-4775-a9bd-2d895526607a could not be found. Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Returning 400 to user: Volume 242411f8-3b22-4775-a9bd-2d895526607a could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2560f1e5-b43a-47b8-8f39-b56bbee4d363 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments/c597f212-9523-42d0-9b47-0ccf98080e54" status: 400 len: 107 microversion: 2.1 time: 0.559531 Oct 22 03:09:31.873150 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 703/1395] 10.222.0.25 () {60 vars in 1433 bytes} [Sat Oct 22 03:09:31 2022] PUT /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments/c597f212-9523-42d0-9b47-0ccf98080e54 => generated 107 bytes in 561 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:09:31.889589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:31.892414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:31.906378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:31.909176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:31.910061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:31.913755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:31.914510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:31.915190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.203551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:09:32.205752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:09:32.212161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:09:32.213828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:09:32.217069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:09:32.248163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:32.252749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:32.255995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.257813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:32.261278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:32.262180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.327725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Getting quotas for project 91dd8fc4c5e847d0a2e6bcfa5a47beaf. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:32.342728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Getting quotas for user 92bf4559db1f49418a803fa31df435d1 and project 91dd8fc4c5e847d0a2e6bcfa5a47beaf. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:32.369064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:09:32.375353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:09:32.430191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:32.449579 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2a30f6d2-2d49-41f8-9682-575334412a23 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1528 microversion: 2.1 time: 0.567205 Oct 22 03:09:32.450612 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 704/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:31 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1528 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:32.455432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:32.456039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:32.479331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:32.479922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:32.480276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.485017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:32.485498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:32.485937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.521243 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-66e478e3-8f60-4b89-8edd-da6d3c351ab5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184302 Oct 22 03:09:32.542978 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 693/1397] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:09:32.556653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:32.557162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:32.571856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:32.578851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:32.579395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.580167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:32.580676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:32.581116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.806522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:32.833898 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8171303d-e7d6-4b5d-a839-41295c68f2a0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1519 microversion: 2.1 time: 0.381166 Oct 22 03:09:32.846350 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 705/1398] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:32 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1519 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:32.865147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:32.867392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:32.880580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:32.881097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:32.883757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.886905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:32.888236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:32.890973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:32.925913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lazy-loading 'services' on Instance uuid 593d2c59-795e-4dc7-8200-56b449d7b066 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:09:32.963344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=13 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:33.299061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=24 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:33.523646 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e352b92-a321-45fa-bdd5-fc6041ad2497 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments/c597f212-9523-42d0-9b47-0ccf98080e54" status: 202 len: 0 microversion: 2.1 time: 0.979060 Oct 22 03:09:33.525217 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 694/1399] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:09:32 2022] DELETE /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments/c597f212-9523-42d0-9b47-0ccf98080e54 => generated 0 bytes in 982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:09:33.539194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:33.541387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:33.565315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:33.565818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:33.566260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:33.566980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:33.570334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:33.570782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:33.599551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:33.634331 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ad35a7f-e3f4-4879-bb1c-6cbfe0d8ac40 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1573 microversion: 2.1 time: 0.786453 Oct 22 03:09:33.636149 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 706/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:32 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1573 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:33.665664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:33.666513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:33.686863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:33.687480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:33.687930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:33.690070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:33.690561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:33.694215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.097163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:34.106328 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efb5050c-97e3-4b6e-95c2-dc8a009f0e2c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.579467 Oct 22 03:09:34.113582 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 695/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:33 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:34.129929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:34.130793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:34.140044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.140814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.141645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.142535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.143155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.143897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.471085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:34.480539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b0784a15-bd21-4bed-9424-87c87116f438 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1276 microversion: 2.1 time: 0.365519 Oct 22 03:09:34.496851 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 696/1402] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:34 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1276 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:34.505030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:34.505483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:34.519187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.519687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.520131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.520872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.521334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.528365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.588046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:34.590246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:09:34.603268 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d236759a-bd1e-4363-9763-8d0f1c073716 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1528 microversion: 2.1 time: 0.965823 Oct 22 03:09:34.619874 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 707/1403] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:33 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1528 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:34.625256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-564befbd-6729-4479-a7a4-d852e1c34092 req-b49fb998-2a48-4d65-9f62-2413739ccfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "name": "network-vif-plugged", "status": "completed", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:34.663011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-564befbd-6729-4479-a7a4-d852e1c34092 req-b49fb998-2a48-4d65-9f62-2413739ccfa6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.665803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-564befbd-6729-4479-a7a4-d852e1c34092 req-b49fb998-2a48-4d65-9f62-2413739ccfa6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.666442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-564befbd-6729-4479-a7a4-d852e1c34092 req-b49fb998-2a48-4d65-9f62-2413739ccfa6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.698538 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-564befbd-6729-4479-a7a4-d852e1c34092 req-b49fb998-2a48-4d65-9f62-2413739ccfa6 service nova] Creating event network-vif-plugged:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h2-862416-2 Oct 22 03:09:34.704346 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-564befbd-6729-4479-a7a4-d852e1c34092 req-b49fb998-2a48-4d65-9f62-2413739ccfa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082820 Oct 22 03:09:34.715935 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 708/1404] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:34.722367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:34.726154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:34.741344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.742665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.743332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.749355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.752795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.753527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.826148 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84b0ac9e-c054-4ccc-9b2e-e0f5257b9114 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108063 Oct 22 03:09:34.828974 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c7455aa3-376f-45c9-b662-e82bed2d11dd tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 204 len: 0 microversion: 2.1 time: 0.330459 Oct 22 03:09:34.829792 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 697/1405] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:09:34 2022] DELETE /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:09:34.832097 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 709/1406] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:09:34 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:34.839875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:34.840522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:34.844743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-faeffeb0-9870-4270-8cca-9e4a4c94f0d3 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:34.846610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.847297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.848047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.849119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.851077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.852266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.858010 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-faeffeb0-9870-4270-8cca-9e4a4c94f0d3 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] HTTP exception thrown: Flavor 32f6b823-ee95-42ba-81d0-ab54a26036ab could not be found. Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-faeffeb0-9870-4270-8cca-9e4a4c94f0d3 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Request method failure captured: Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/flavors/32f6b823-ee95-42ba-81d0-ab54a26036ab HTTP/1.1 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14Zamy5Ho-BKJdYI0-SVfe7UYdLVQtyqYGIHPTssS6WMJCLoshqVYkX4IuHg8UjLR77lXEa7pbpxeLD7Wxm4KFeNPYlZcMFOxvtN7fTKWpWq8Z1phfrAu84s4saw98MQ3a2Nu9UsT3OU597OH-E-eAxiUgdv311_Z3vp6Rd_41iH50 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 02e2d6ef5d9242119570da553c434958 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-MigrationsAdminTest-150818177 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02e2d6ef5d9242119570da553c434958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02e2d6ef5d9242119570da553c434958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02e2d6ef5d9242119570da553c434958"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02e2d6ef5d9242119570da553c434958"}]}] Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-MigrationsAdminTest-150818177 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 02e2d6ef5d9242119570da553c434958 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-MigrationsAdminTest-150818177 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-MigrationsAdminTest-150818177-project-admin Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0d9d3f9802454ad8a186ba287fc19510 Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-MigrationsAdminTest-150818177-project-admin Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: exception: Flavor 32f6b823-ee95-42ba-81d0-ab54a26036ab could not be found. Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '32f6b823-ee95-42ba-81d0-ab54a26036ab'} Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 32f6b823-ee95-42ba-81d0-ab54a26036ab could not be found. Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 32f6b823-ee95-42ba-81d0-ab54a26036ab could not be found. Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:34.860636 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:34.865504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:34.865504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:34.865504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:34.865504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:34.865504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:34.865504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:34.865504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 32f6b823-ee95-42ba-81d0-ab54a26036ab could not be found. Oct 22 03:09:34.865504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:34.868048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-faeffeb0-9870-4270-8cca-9e4a4c94f0d3 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Returning 404 to user: Flavor 32f6b823-ee95-42ba-81d0-ab54a26036ab could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:34.873738 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-faeffeb0-9870-4270-8cca-9e4a4c94f0d3 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/32f6b823-ee95-42ba-81d0-ab54a26036ab" status: 404 len: 109 microversion: 2.1 time: 0.042556 Oct 22 03:09:34.874490 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 698/1407] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:09:34 2022] DELETE /compute/v2.1/flavors/32f6b823-ee95-42ba-81d0-ab54a26036ab => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:34.897268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:34.898405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:34.904598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:34.917425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.918291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.919002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:34.922249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:34.923018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:34.923695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:35.253086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:35.263544 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f507a2af-a14a-4587-a017-8e9e155febf3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1525 microversion: 2.1 time: 0.386980 Oct 22 03:09:35.264386 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 699/1408] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:34 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1525 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:35.272533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1333243849", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:35.386372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:35.387886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:09:35.398292 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ec0c6f9-654e-4cb3-9842-3d4f75b8b5df tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1578 microversion: 2.1 time: 0.565035 Oct 22 03:09:35.399448 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 710/1409] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:34 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1578 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:35.418648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:35.419486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:35.431092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:35.431650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:35.432580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:35.435486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:35.436804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:35.437856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:35.754819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:35.767612 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ed2afed1-15d8-488a-b9c1-1fea55a68a41 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.356492 Oct 22 03:09:35.768197 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 711/1410] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:35 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:35.781720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e28064c2-2f34-40aa-8d43-7ab003a8cfcb req-85823a07-3476-4c90-9e22-b72788516415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f7dfb6-6cb2-4676-8f9a-9417da51949b", "tag": "cbc7d4e8-ebaa-44de-afd3-0efb89571401"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:35.794062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e28064c2-2f34-40aa-8d43-7ab003a8cfcb req-85823a07-3476-4c90-9e22-b72788516415 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:35.795241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e28064c2-2f34-40aa-8d43-7ab003a8cfcb req-85823a07-3476-4c90-9e22-b72788516415 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:35.796752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e28064c2-2f34-40aa-8d43-7ab003a8cfcb req-85823a07-3476-4c90-9e22-b72788516415 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:35.810381 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e28064c2-2f34-40aa-8d43-7ab003a8cfcb req-85823a07-3476-4c90-9e22-b72788516415 service nova] Creating event network-changed:cbc7d4e8-ebaa-44de-afd3-0efb89571401 for instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b on n-h2-862416-2 Oct 22 03:09:35.817359 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e28064c2-2f34-40aa-8d43-7ab003a8cfcb req-85823a07-3476-4c90-9e22-b72788516415 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047674 Oct 22 03:09:35.818263 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 712/1411] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:35.824775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:35.825917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:35.834974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:35.835652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:35.836098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:35.836998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:35.837465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:35.837924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:35.900473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:09:35.901272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:09:35.901965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:09:35.902587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:09:35.903229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:09:35.919709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:35.920563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:35.921217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:35.923991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:35.924758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:35.925440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:35.947921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:35.958980 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e97595a-8a3b-439b-bbd0-4d440be662d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1282 microversion: 2.1 time: 0.138274 Oct 22 03:09:35.973369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 713/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:35 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1282 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:35.973646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:35.982386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Getting quotas for user 7bf9da8e55124a7aae0938bb828b8f8a and project a10e488b35c54f6f9a5f4ede2520083f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:35.987600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:35.990387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:35.999801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.000939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.001566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.003146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.005025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.005627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.011810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:09:36.016266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:09:36.053259 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-596f39b6-974d-4e8f-b02e-841b14feef80 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073351 Oct 22 03:09:36.054580 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 714/1413] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:09:35 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:36.125239 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c698336-f00d-4d27-9259-883fa9c38dc1 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859577 Oct 22 03:09:36.126458 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 700/1414] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:09:36.137826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0bf07517-398b-460a-a3c8-ef142a11944e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:36.138455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0bf07517-398b-460a-a3c8-ef142a11944e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:36.245644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0bf07517-398b-460a-a3c8-ef142a11944e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:36.253759 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0bf07517-398b-460a-a3c8-ef142a11944e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1213 microversion: 2.1 time: 0.119965 Oct 22 03:09:36.258599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 715/1415] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:36 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:36.290606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:36.291221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:36.301317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.304623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.306645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.307824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.314201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.314745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.429979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:36.431562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:36.447016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.449386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.450109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.451799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.455623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.456834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.620511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:36.631540 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d74f2989-b6ef-41af-b63f-751de8e579d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1525 microversion: 2.1 time: 0.345441 Oct 22 03:09:36.635600 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 701/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:36 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1525 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:36.712677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:36.721865 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4328bcde-667b-43b1-927c-ba12c1aee439 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1571 microversion: 2.1 time: 0.297331 Oct 22 03:09:36.727694 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 716/1417] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:36 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1571 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:36.755649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-959585586"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:36.756765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:36.774333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.777437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.778126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.782869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.790933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.792660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.793744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:36.794379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:36.809074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.809718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.810184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:36.812121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:36.813765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:36.814413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.014673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:37.026029 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-11496a1c-8c04-4acc-b026-41c955780a05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.237386 Oct 22 03:09:37.026661 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 717/1418] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:36 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:37.038544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:37.041144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:37.051850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:37.052384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:37.053487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.054318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:37.054882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:37.055314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.214365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:37.224303 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9ee145a1-5891-4748-875e-8934d72638da tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.193737 Oct 22 03:09:37.224995 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 718/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:37 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:37.240835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:37.250334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:37.258498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:37.259405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:37.259969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.260834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:37.261402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:37.261938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.299251 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65dedd47-ccd8-4c46-8fc1-7f9b8c709682 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065722 Oct 22 03:09:37.300327 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 719/1420] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:09:37 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:37.305908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:37.306681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:37.313076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:37.313712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:37.314260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.315075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:37.315635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:37.316170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.321455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:37.373697 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.network.security_group_api [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Adding security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 to port da8183e0-57d3-4f44-a170-1bb785a4b4cc Oct 22 03:09:37.388428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:37.396245 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c4f76577-a363-471d-8435-3ba81f1eaa0b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1217 microversion: 2.1 time: 0.094666 Oct 22 03:09:37.397721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 720/1421] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:37 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:37.663454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:37.664821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:37.671389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:37.672182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:37.672773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.673618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:37.674196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:37.674856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:37.816282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:37.825143 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77d99a5a-02f5-4bbb-ad4a-f3b1d945e23b tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1525 microversion: 2.1 time: 0.165964 Oct 22 03:09:37.838773 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 721/1422] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:37 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:38.003537 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f450db21-e46f-47d1-a430-49a37299cb26 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65/action" status: 202 len: 0 microversion: 2.1 time: 1.255955 Oct 22 03:09:38.009355 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 702/1423] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:09:36 2022] POST /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65/action => generated 0 bytes in 1263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:09:38.015975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-300b4d47-51ef-405a-9041-b143572c05ac req-2167178b-5419-445c-81b5-e696f7200e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9b80a9-6a56-4de1-be88-76587cf41d65", "tag": "da8183e0-57d3-4f44-a170-1bb785a4b4cc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:38.016612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93a34c52-b8c4-4e0e-9d47-017150ac617b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a0738b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:38.034303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-300b4d47-51ef-405a-9041-b143572c05ac req-2167178b-5419-445c-81b5-e696f7200e4e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.035530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-300b4d47-51ef-405a-9041-b143572c05ac req-2167178b-5419-445c-81b5-e696f7200e4e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.036606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-300b4d47-51ef-405a-9041-b143572c05ac req-2167178b-5419-445c-81b5-e696f7200e4e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.058192 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-300b4d47-51ef-405a-9041-b143572c05ac req-2167178b-5419-445c-81b5-e696f7200e4e service nova] Creating event network-changed:da8183e0-57d3-4f44-a170-1bb785a4b4cc for instance ec9b80a9-6a56-4de1-be88-76587cf41d65 on n-h2-862416-2 Oct 22 03:09:38.076800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-300b4d47-51ef-405a-9041-b143572c05ac req-2167178b-5419-445c-81b5-e696f7200e4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053243 Oct 22 03:09:38.082037 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 703/1424] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:38.095296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:38.097461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:38.111640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.113042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.113690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.114672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.115333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.116077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.233381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-93a34c52-b8c4-4e0e-9d47-017150ac617b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 in use.", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:38.234539 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-93a34c52-b8c4-4e0e-9d47-017150ac617b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security Group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 in use. Oct 22 03:09:38.234539 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-c0c029b4-dcd2-4195-abbc-bd469fa9a0b8'] Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93a34c52-b8c4-4e0e-9d47-017150ac617b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-security-groups/b2a5844d-1a7f-40e5-9d16-21b2f8081a89 HTTP/1.1 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: exception: Security Group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 in use. Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-c0c029b4-dcd2-4195-abbc-bd469fa9a0b8'] Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'b2a5844d-1a7f-40e5-9d16-21b2f8081a89'} Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:38.238551 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 in use. Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0c029b4-dcd2-4195-abbc-bd469fa9a0b8'] Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 in use. Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0c029b4-dcd2-4195-abbc-bd469fa9a0b8'] Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 in use. Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0c029b4-dcd2-4195-abbc-bd469fa9a0b8'] Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 in use. Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0c029b4-dcd2-4195-abbc-bd469fa9a0b8'] Oct 22 03:09:38.246314 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:38.261542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93a34c52-b8c4-4e0e-9d47-017150ac617b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 400 to user: Security Group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 in use. Oct 22 03:09:38.261542 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-c0c029b4-dcd2-4195-abbc-bd469fa9a0b8'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:38.267818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93a34c52-b8c4-4e0e-9d47-017150ac617b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b2a5844d-1a7f-40e5-9d16-21b2f8081a89" status: 400 len: 185 microversion: 2.1 time: 0.256994 Oct 22 03:09:38.283276 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 722/1425] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:38 2022] DELETE /compute/v2.1/os-security-groups/b2a5844d-1a7f-40e5-9d16-21b2f8081a89 => generated 185 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:09:38.299239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:38.300058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:38.310701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.311603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.312349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.313294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.313970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.314622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.399861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:38.411415 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6675a3bf-3eb9-4557-a2f5-bbe3659e2554 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.326001 Oct 22 03:09:38.413713 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 704/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:38 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:38.419263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:38.419947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:38.426026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.426769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.427363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.428820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.429438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.430185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.472887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:09:38.542323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:38.552529 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac014f24-ad94-49d7-bfb6-eca93cf85dc6 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.267824 Oct 22 03:09:38.555209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:38.565043 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 723/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:38 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:38.581071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:38.589138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:38.597906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.598785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.599932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.601201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.601902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.602736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.626762 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e81ad94e-f3e1-4e78-98ec-d69d5611de89 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 204 len: 0 microversion: 2.1 time: 0.211419 Oct 22 03:09:38.627965 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 705/1428] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:09:38 2022] DELETE /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:09:38.641990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:38.642880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:38.655965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.657083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.658232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.660176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.661880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.667263 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ccdd154-06af-4ccc-bf70-98c5e749eb61 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099453 Oct 22 03:09:38.668049 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 724/1429] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:09:38 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:38.668316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.681509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:38.682532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:38.692967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.695985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.697098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.699826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.700588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.701586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.764497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:38.780764 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-79589f16-159d-4120-aaff-56adee718e72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1217 microversion: 2.1 time: 0.146175 Oct 22 03:09:38.781635 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 706/1430] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:38 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:38.858495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:38.859489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:38.875506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.878426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.878426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.879550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.880372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.882817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.931435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:38.932321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:38.933384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:38.933844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lazy-loading 'fault' on Instance uuid d997135c-ef2e-48e2-abe5-adb37c06211b {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:09:38.937077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:38.950272 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d1708b5a-2eee-4251-b2c7-fd65ce690ef5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1645 microversion: 2.1 time: 0.275373 Oct 22 03:09:38.966358 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 725/1431] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:38 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1645 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:38.983845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:38.993012 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f05b2a84-4f04-4982-bc1b-1472ee94ca2a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 200 len: 1314 microversion: 2.1 time: 0.145974 Oct 22 03:09:38.993826 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 707/1432] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:38 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:39.072906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-dd1f04e5-2e3e-4a08-afda-ae4b5e9ab104 req-147110e9-9b18-44dd-b42b-db03e17b1ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7", "name": "network-vif-plugged", "status": "completed", "tag": "2b132016-09b7-49d3-ad51-b002e76cf74e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:39.087117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dd1f04e5-2e3e-4a08-afda-ae4b5e9ab104 req-147110e9-9b18-44dd-b42b-db03e17b1ba7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.087601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dd1f04e5-2e3e-4a08-afda-ae4b5e9ab104 req-147110e9-9b18-44dd-b42b-db03e17b1ba7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.088394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dd1f04e5-2e3e-4a08-afda-ae4b5e9ab104 req-147110e9-9b18-44dd-b42b-db03e17b1ba7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.101577 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-dd1f04e5-2e3e-4a08-afda-ae4b5e9ab104 req-147110e9-9b18-44dd-b42b-db03e17b1ba7 service nova] Creating event network-vif-plugged:2b132016-09b7-49d3-ad51-b002e76cf74e for instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 on n-h1-862416-2 Oct 22 03:09:39.106481 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-dd1f04e5-2e3e-4a08-afda-ae4b5e9ab104 req-147110e9-9b18-44dd-b42b-db03e17b1ba7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038169 Oct 22 03:09:39.107082 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 726/1433] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:39.438447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:39.439281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:39.446564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.447200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.447647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.448415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.448912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.449349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.581681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:39.582412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:39.586621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:39.589980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.590671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.591104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.591822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.592301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.592849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.595454 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b74621a6-d6ce-4fb5-a17b-9325f7add99c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.161024 Oct 22 03:09:39.596118 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 708/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:39 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:39.679569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:39.682175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:39.689370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.690079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.690531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.691238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.691697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.692123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.723458 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-52357c1a-ab3b-4a24-8000-292d330c0325 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047967 Oct 22 03:09:39.724470 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 709/1435] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:09:39 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:09:39.746082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:39.754011 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b67b88b-a530-49b3-a066-158461d13d41 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.176633 Oct 22 03:09:39.754665 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 727/1436] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:39 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:39.804153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:39.804777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:39.810724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.811200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.811628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.812343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.812792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.813217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.877810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:39.886455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9cfa2861-1695-4ffe-b819-2e400efaf0ff tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1217 microversion: 2.1 time: 0.086738 Oct 22 03:09:39.887024 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 710/1437] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:39 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:39.977362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:39.977983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:39.984030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.984568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.985013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:39.985716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:39.986178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:39.986612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.016831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:40.017564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:40.023915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.024446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.024893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.025601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.026056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.026480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.040973 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b HTTP/1.1 Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd997135c-ef2e-48e2-abe5-adb37c06211b'} Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:40.042637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a606aa98-8df4-449f-b14c-14b98b93c55e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 404 len: 111 microversion: 2.1 time: 0.031081 Oct 22 03:09:40.047081 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 711/1438] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:40 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:09:40.059240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31569144-6d8e-4e2a-abff-ba04f80d8a62 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'create', calling method: .version_select at 0x7f0d1e50f3a0>, body: {"keypair": {"name": "tempest-keypair-974800254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnUQixR7rG3g1Z3ewVVLhcPXOcQAHQ/an7xBYjfMoVOFaH9bhMwcG1iVH8+z4w/+FbJXJEDp1jbeDcfZOS1H0oxEeSXxeg4uKNAZp2yKKPlKdHFbBzX/gPHEZM3x/agBQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:40.075068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-31569144-6d8e-4e2a-abff-ba04f80d8a62 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Getting quotas for project 7979873b22324dea968909a57ebd877d. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:40.081486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-31569144-6d8e-4e2a-abff-ba04f80d8a62 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Getting quotas for user 39c6c1ad05a646029048f3a61df874c4 and project 7979873b22324dea968909a57ebd877d. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:40.113343 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31569144-6d8e-4e2a-abff-ba04f80d8a62 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058246 Oct 22 03:09:40.116833 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 712/1439] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:09:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:40.121512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d72df85f-7dc4-4437-baba-2cc7e5d318ce req-77be8121-bac9-491e-a0f2-cc1060891972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d997135c-ef2e-48e2-abe5-adb37c06211b", "name": "network-vif-deleted", "tag": "9755bdc9-dfff-43fd-81c6-5df2835dba8d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:40.139481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d72df85f-7dc4-4437-baba-2cc7e5d318ce req-77be8121-bac9-491e-a0f2-cc1060891972 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.140189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d72df85f-7dc4-4437-baba-2cc7e5d318ce req-77be8121-bac9-491e-a0f2-cc1060891972 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.140723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d72df85f-7dc4-4437-baba-2cc7e5d318ce req-77be8121-bac9-491e-a0f2-cc1060891972 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.163514 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d72df85f-7dc4-4437-baba-2cc7e5d318ce req-77be8121-bac9-491e-a0f2-cc1060891972 service nova] Creating event network-vif-deleted:9755bdc9-dfff-43fd-81c6-5df2835dba8d for instance d997135c-ef2e-48e2-abe5-adb37c06211b on n-h1-862416-2 Oct 22 03:09:40.170184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d72df85f-7dc4-4437-baba-2cc7e5d318ce req-77be8121-bac9-491e-a0f2-cc1060891972 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052126 Oct 22 03:09:40.170811 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 713/1440] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:40.170952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:40.179196 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92965f94-3d05-420d-aca6-c7f31ac20604 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1645 microversion: 2.1 time: 0.206035 Oct 22 03:09:40.179767 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 728/1441] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:39 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1645 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:40.622773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:40.623699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:40.641301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.644251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.645161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.645900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.649146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.649619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.739795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:40.742699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:40.750376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.762967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.769983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.771266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.772823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.773541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.832444 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d5e173f5-1c53-43fe-94dd-109fcce3903c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097827 Oct 22 03:09:40.837293 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 729/1442] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:09:40 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:40.843635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:40.849697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:40.852064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:40.861987 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5e960d6-3aea-4123-a3ea-5cd97f89a0ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.244131 Oct 22 03:09:40.862465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.863154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.864071 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 714/1443] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:40 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:40.864728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.866004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.869667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.870335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.910725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:40.911449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:40.921770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.922273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.922717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:40.923438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:40.923899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:40.929928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:41.083395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:41.105536 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-41c2fcc4-b7b8-4004-9ae0-5833f63b6477 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1217 microversion: 2.1 time: 0.196273 Oct 22 03:09:41.108341 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 715/1444] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:40 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:41.204046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:41.206543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:41.224363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:41.225978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:41.227536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:41.228541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:41.229237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:41.230068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:41.612244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:41.624449 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba93eda9-8cbd-4678-808c-cfa66a50a526 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1645 microversion: 2.1 time: 0.425400 Oct 22 03:09:41.625992 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 716/1445] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:41 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1645 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:41.770103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:41.782176 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bc5422ea-bca2-4d15-9cfe-d50ea281cc8c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.943524 Oct 22 03:09:41.783237 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 730/1446] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:40 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:41.858036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:41.873981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:41.891103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:41.891103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:41.895062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:41.895877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:41.896029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:41.901753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:41.902265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:41.902714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:41.913650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:41.914178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:41.917390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:41.918164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:41.920936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:41.921649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:41.965299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b383275-3994-4981-82b9-6af1a35b8546 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116757 Oct 22 03:09:41.966597 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 717/1447] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:09:41 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:09:42.131086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:42.136087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:42.145385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:42.156078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:42.156758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:42.160085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:42.163498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:42.164285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:42.279162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:42.291626 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abc29568-e1a8-40c8-b61c-8bbf9af25d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1265 microversion: 2.1 time: 0.164425 Oct 22 03:09:42.292248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 718/1448] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:42 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:42.305273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1511055948", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "32dc83c8-2538-4967-ab2c-78b44d3e44cf"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:42.351920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:42.368666 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-00d11ca2-e0ab-4508-89f2-12e4cd4ae467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.483677 Oct 22 03:09:42.374984 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 731/1449] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:41 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:42.405681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] validate_networks() for [('32dc83c8-2538-4967-ab2c-78b44d3e44cf', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:09:42.648539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:42.649351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:42.661452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:42.663637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:42.664397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:42.666930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:42.667651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:42.670751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:42.813085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:42.824788 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c7602c3b-8aae-4f7a-b1a6-de8a519e0cf7 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1467 microversion: 2.1 time: 0.181181 Oct 22 03:09:42.826424 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 732/1450] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:42 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1467 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:42.840261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:42.841021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:42.854535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:42.855202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:42.858054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:42.858951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:42.859527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:42.862360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:43.278450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:43.297008 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2053a12f-96bb-411f-b665-4d4768047a9b tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.469056 Oct 22 03:09:43.298623 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 733/1451] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:42 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:43.316803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1eb9545c-60cc-4b76-985d-7930259fc2a5 req-6ca6d38b-e2c2-4565-9595-b926e374428c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9b80a9-6a56-4de1-be88-76587cf41d65", "name": "network-vif-deleted", "tag": "da8183e0-57d3-4f44-a170-1bb785a4b4cc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:43.343347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:43.346796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1eb9545c-60cc-4b76-985d-7930259fc2a5 req-6ca6d38b-e2c2-4565-9595-b926e374428c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:43.354389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1eb9545c-60cc-4b76-985d-7930259fc2a5 req-6ca6d38b-e2c2-4565-9595-b926e374428c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:43.357472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1eb9545c-60cc-4b76-985d-7930259fc2a5 req-6ca6d38b-e2c2-4565-9595-b926e374428c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:43.389912 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1eb9545c-60cc-4b76-985d-7930259fc2a5 req-6ca6d38b-e2c2-4565-9595-b926e374428c service nova] Creating event network-vif-deleted:da8183e0-57d3-4f44-a170-1bb785a4b4cc for instance ec9b80a9-6a56-4de1-be88-76587cf41d65 on n-h2-862416-2 Oct 22 03:09:43.395825 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1eb9545c-60cc-4b76-985d-7930259fc2a5 req-6ca6d38b-e2c2-4565-9595-b926e374428c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095276 Oct 22 03:09:43.403563 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 734/1452] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:43.409424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:43.413688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:43.425814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:43.426301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:43.434645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:43.436111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:43.436801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:43.437395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:43.578763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:43.598108 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3c7ab16-c7ec-4ba4-b526-e735891f47dd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1271 microversion: 2.1 time: 0.192973 Oct 22 03:09:43.598708 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 735/1453] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:43 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:43.604255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:43.609734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:43.626897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:43.627404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:43.631923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:43.633220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:43.633878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:43.634500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.024195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:09:44.024792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:09:44.025518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:09:44.026032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:09:44.027067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:09:44.037301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:44.037855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.038197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.038886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.040037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.041045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.041694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.045309 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-776e0a9c-1fcd-4244-8431-d526eff8542e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.445031 Oct 22 03:09:44.045904 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 736/1454] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:43 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:44.050920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-20633748-6532-40b0-a0b2-f431961d0331 req-c18d87e6-dc36-47e7-b114-f02d1999169d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f7dfb6-6cb2-4676-8f9a-9417da51949b", "name": "network-vif-plugged", "status": "completed", "tag": "cbc7d4e8-ebaa-44de-afd3-0efb89571401"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:44.063699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-20633748-6532-40b0-a0b2-f431961d0331 req-c18d87e6-dc36-47e7-b114-f02d1999169d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.064491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-20633748-6532-40b0-a0b2-f431961d0331 req-c18d87e6-dc36-47e7-b114-f02d1999169d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.064930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-20633748-6532-40b0-a0b2-f431961d0331 req-c18d87e6-dc36-47e7-b114-f02d1999169d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.067762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Getting quotas for project 302763f239654e49a981355dd63bc6f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:44.077233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Getting quotas for user ebe78fc7afed43e496e0be24a021dffa and project 302763f239654e49a981355dd63bc6f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:44.082819 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-20633748-6532-40b0-a0b2-f431961d0331 req-c18d87e6-dc36-47e7-b114-f02d1999169d service nova] Creating event network-vif-plugged:cbc7d4e8-ebaa-44de-afd3-0efb89571401 for instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b on n-h2-862416-2 Oct 22 03:09:44.088757 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-20633748-6532-40b0-a0b2-f431961d0331 req-c18d87e6-dc36-47e7-b114-f02d1999169d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041386 Oct 22 03:09:44.089731 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 737/1455] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:44.092300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:09:44.094688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:09:44.094863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:44.095745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:44.102775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.103477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.104078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.104992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.105600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.106383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.151775 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f277f34d-e60a-45eb-8574-d12b926cd74c tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858013 Oct 22 03:09:44.152326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.153426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.153874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.154385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lazy-loading 'fault' on Instance uuid ec9b80a9-6a56-4de1-be88-76587cf41d65 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:09:44.156384 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 719/1456] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:09:44.168953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a4f02ae-229d-484d-abcf-3214b0a9f09e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:44.169766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6a4f02ae-229d-484d-abcf-3214b0a9f09e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:44.223708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:44.238313 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0536770-8af9-4c1c-87e1-70708cc474de tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 200 len: 1472 microversion: 2.1 time: 0.147310 Oct 22 03:09:44.239550 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 738/1457] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:44 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 1472 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:44.246639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1983676656", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:44.274595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6a4f02ae-229d-484d-abcf-3214b0a9f09e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:44.284533 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a4f02ae-229d-484d-abcf-3214b0a9f09e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1218 microversion: 2.1 time: 0.120496 Oct 22 03:09:44.285149 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 720/1458] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:44 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:44.325539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:44.326105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] validate_networks() for [('cf26895c-54d3-4fb2-acdc-7bfa0bf6e9b9', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:09:44.326330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:44.341979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.344616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.345340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.346867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.348826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.351361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.696974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:44.707540 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8808ef31-52ea-485d-adbf-d56dcc568fd5 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.388282 Oct 22 03:09:44.725162 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 721/1459] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:44 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:44.738321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:44.743388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:44.753328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.753841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.754271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:44.763535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:44.764032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:44.764554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.172462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:45.185493 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1af58251-ec78-4ca5-b849-3d0cd766a425 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.457120 Oct 22 03:09:45.186750 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 722/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:44 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:45.191839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:45.193934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:45.201404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.202215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.202999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.204192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.204980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.205613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.231408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:09:45.232532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:09:45.233253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:09:45.233864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:09:45.234712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:09:45.249842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.250423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.250960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.251929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.252991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.254260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.285532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Getting quotas for project 7979873b22324dea968909a57ebd877d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:45.292659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Getting quotas for user 39c6c1ad05a646029048f3a61df874c4 and project 7979873b22324dea968909a57ebd877d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:45.317074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:09:45.320047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:09:45.376164 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1b6a340-a32e-4368-891d-82717ff5e457 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.135143 Oct 22 03:09:45.380389 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 739/1461] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:09:45.386974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:45.387997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:45.396241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.396878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.397392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.398466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.399007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.399687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.404455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:45.416436 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 HTTP/1.1 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ec9b80a9-6a56-4de1-be88-76587cf41d65'} Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:45.418554 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:45.422968 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:45.422968 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:45.422968 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:45.422968 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:45.422968 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:45.422968 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:45.422968 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:45.424772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:45.425845 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3d404ca9-b18d-41a4-861c-60fb06293c15 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 404 len: 111 microversion: 2.1 time: 0.043394 Oct 22 03:09:45.426920 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 740/1462] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:45 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:45.433094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:45.433997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:45.440843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.441411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.441921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.442627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.443086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.452430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.481593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:45.492802 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2d4aab9-e506-4046-b1ef-4fe13ffdd83c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1319 microversion: 2.1 time: 0.304479 Oct 22 03:09:45.494089 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 723/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:45 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:45.516840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9bda6a3-791a-48bc-8856-3afb1f6fadb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:45.517566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e9bda6a3-791a-48bc-8856-3afb1f6fadb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:45.526333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:45.558564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:45.570520 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a351e73-c1d9-4cee-b9ef-49c4c21d63a1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1270 microversion: 2.1 time: 0.141613 Oct 22 03:09:45.571202 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 741/1464] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:45 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:45.583104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5d1e56a8-effb-4f46-ac28-87e4eee91de4 req-2057b215-36ab-4a75-abe2-32278aca8a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78da2a1b-d11a-4846-8fc3-3de9ac83b8b4", "tag": "06dc17ec-b427-43ae-94ee-6e9085767966"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:45.593842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5d1e56a8-effb-4f46-ac28-87e4eee91de4 req-2057b215-36ab-4a75-abe2-32278aca8a4b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.594322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5d1e56a8-effb-4f46-ac28-87e4eee91de4 req-2057b215-36ab-4a75-abe2-32278aca8a4b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.594733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5d1e56a8-effb-4f46-ac28-87e4eee91de4 req-2057b215-36ab-4a75-abe2-32278aca8a4b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.608001 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5d1e56a8-effb-4f46-ac28-87e4eee91de4 req-2057b215-36ab-4a75-abe2-32278aca8a4b service nova] Creating event network-changed:06dc17ec-b427-43ae-94ee-6e9085767966 for instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 on n-h2-862416-2 Oct 22 03:09:45.613398 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5d1e56a8-effb-4f46-ac28-87e4eee91de4 req-2057b215-36ab-4a75-abe2-32278aca8a4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040854 Oct 22 03:09:45.614196 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 742/1465] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:45.620162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-94319339-ff2a-472a-966c-96be09d3f31f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1ab225e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:45.638405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e9bda6a3-791a-48bc-8856-3afb1f6fadb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:45.648025 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9bda6a3-791a-48bc-8856-3afb1f6fadb1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1225 microversion: 2.1 time: 0.145736 Oct 22 03:09:45.648671 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 724/1466] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:45 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:45.736364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:45.736985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:45.744491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.744990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.745488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.746702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:45.747189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:45.747684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:45.918217 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-94319339-ff2a-472a-966c-96be09d3f31f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b4966a27-1025-4368-9045-6a0f738a73cb" status: 202 len: 0 microversion: 2.1 time: 0.302453 Oct 22 03:09:45.919389 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 743/1467] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:45 2022] DELETE /compute/v2.1/os-security-groups/b4966a27-1025-4368-9045-6a0f738a73cb => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:09:45.929131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-56d2611d-3282-481e-b948-b32e6e9982cd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a45a820>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:46.125177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:46.138513 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ace071d3-0716-42ef-90d8-e0656fca8b25 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.407137 Oct 22 03:09:46.152525 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 725/1468] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:45 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:46.211202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:46.211859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:46.218656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.219106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.219565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.220314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.221088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.221762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.260010 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-56d2611d-3282-481e-b948-b32e6e9982cd tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b2a5844d-1a7f-40e5-9d16-21b2f8081a89" status: 202 len: 0 microversion: 2.1 time: 0.335986 Oct 22 03:09:46.269442 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 744/1469] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:45 2022] DELETE /compute/v2.1/os-security-groups/b2a5844d-1a7f-40e5-9d16-21b2f8081a89 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:09:46.291163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f6ef7040-2327-445b-a9b5-7d1e0f069353 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'create', calling method: .version_select at 0x7f0d1a0b5430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-606795968", "description": "tempest-description-1057668536"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:46.471476 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f6ef7040-2327-445b-a9b5-7d1e0f069353 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.197956 Oct 22 03:09:46.472078 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 745/1470] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:09:46 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:46.485764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-75e58fdb-39eb-4bab-a211-6557a95d940d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Action: 'update', calling method: .version_select at 0x7f0d1a408d30>, body: {"security_group": {"name": "tempest-sg-hth-970136030", "description": "tempest-description-hth-1379961404"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:46.558687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:46.567647 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e50f45c7-cc00-4b69-82c6-e16bc20af5bf tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.361113 Oct 22 03:09:46.569915 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 726/1471] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:46 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:46.575805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:46.576449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:46.594335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.594830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.595457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.601648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.602391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.602928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.633634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:46.689135 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-75e58fdb-39eb-4bab-a211-6557a95d940d tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/b3fb2df3-4a2d-4294-b205-8c0071c55be0" status: 200 len: 217 microversion: 2.1 time: 0.207123 Oct 22 03:09:46.699037 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 746/1472] 10.222.0.25 () {60 vars in 1290 bytes} [Sat Oct 22 03:09:46 2022] PUT /compute/v2.1/os-security-groups/b3fb2df3-4a2d-4294-b205-8c0071c55be0 => generated 217 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:46.699037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:46.699037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:46.712865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.713659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.714101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.714821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.715279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.717180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.797472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:46.806801 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fc57fb5d-c219-423c-8f90-7d9710d3e523 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1276 microversion: 2.1 time: 0.115447 Oct 22 03:09:46.807747 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 747/1473] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:46 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:46.814190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:46.814820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:46.823527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.824015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.824483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.825223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.826038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.826477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.894696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:46.903309 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f4a2c82-c685-4295-8533-a819784b6366 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1468 microversion: 2.1 time: 0.331905 Oct 22 03:09:46.903885 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 727/1474] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:46 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1468 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:46.910338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e44bc71-74a7-4705-9695-fa495de4fc6b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1e4a98b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:46.910932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:46.925325 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b1d19d1-6cc5-412c-9a03-bc3b6586ccdb tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1277 microversion: 2.1 time: 0.116003 Oct 22 03:09:46.926369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 748/1475] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:46 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:46.932581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:46.933265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:46.939782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.940392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.940905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:46.941704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:46.942174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:46.942603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.018222 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e44bc71-74a7-4705-9695-fa495de4fc6b tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/b3fb2df3-4a2d-4294-b205-8c0071c55be0" status: 200 len: 217 microversion: 2.1 time: 0.112317 Oct 22 03:09:47.019500 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 728/1476] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:09:46 2022] GET /compute/v2.1/os-security-groups/b3fb2df3-4a2d-4294-b205-8c0071c55be0 => generated 217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:47.036021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c38faa8-6fb6-4e80-a3af-874f182883a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1e503c10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.092288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:47.101635 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6212b07f-d3b2-435f-be1b-ef0e89eaa325 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7" status: 200 len: 1467 microversion: 2.1 time: 0.173995 Oct 22 03:09:47.104258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 749/1477] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:46 2022] GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 => generated 1467 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:47.125735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.132351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:47.133545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Searching by: {'reservation_id': 'r-dm6r3jzq', 'deleted': False, 'project_id': '7e462137d650486c919790a05aa876dc'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:09:47.139655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.140242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.140780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.141587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.142147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.142650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.253249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:09:47.326788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:47.333984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.334982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.335424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.462425 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eba2ab65-2751-47f4-a7af-09da77ddf8d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-dm6r3jzq" status: 200 len: 2928 microversion: 2.1 time: 0.340595 Oct 22 03:09:47.482934 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 750/1478] 10.222.0.25 () {58 vars in 1197 bytes} [Sat Oct 22 03:09:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-dm6r3jzq => generated 2928 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:47.488754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.489380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:47.497286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.497787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.498234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.498959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.499419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.500002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.569270 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1c38faa8-6fb6-4e80-a3af-874f182883a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b3fb2df3-4a2d-4294-b205-8c0071c55be0" status: 202 len: 0 microversion: 2.1 time: 0.537986 Oct 22 03:09:47.569861 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 729/1479] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:47 2022] DELETE /compute/v2.1/os-security-groups/b3fb2df3-4a2d-4294-b205-8c0071c55be0 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:09:47.575614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c562d2ee-e863-4f82-a270-6e44284c13ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.602467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.compute.server_groups [None req-c562d2ee-e863-4f82-a270-6e44284c13ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Querying cell 8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) for 2 instances {{(pid=120581) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 03:09:47.603213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c562d2ee-e863-4f82-a270-6e44284c13ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.603848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c562d2ee-e863-4f82-a270-6e44284c13ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.604184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c562d2ee-e863-4f82-a270-6e44284c13ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.650377 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c562d2ee-e863-4f82-a270-6e44284c13ea tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/41c97a5f-7ff2-46d3-b0e2-e5d7273a72ba" status: 200 len: 270 microversion: 2.1 time: 0.078873 Oct 22 03:09:47.650985 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 730/1480] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:09:47 2022] GET /compute/v2.1/os-server-groups/41c97a5f-7ff2-46d3-b0e2-e5d7273a72ba => generated 270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:47.660312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.660951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:47.673021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.673525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.673966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.676598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:47.677102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.678121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.678592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.687247 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37500db6-affe-4fa8-881f-7a1675dc817a tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.202356 Oct 22 03:09:47.688142 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 751/1481] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:47 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:47.693384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.694230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:47.700990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.701834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.703185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.704103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.704806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.705376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.710911 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 HTTP/1.1 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ec9b80a9-6a56-4de1-be88-76587cf41d65'} Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:09:47.713028 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69db00af-4d8f-4a5a-922b-b756ff9c6b7e tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 404 len: 111 microversion: 2.1 time: 0.059848 Oct 22 03:09:47.718532 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 731/1482] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:09:47 2022] DELETE /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:47.720695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-624688eb-6977-45c0-b531-00b39f68d670 req-e4d563be-6054-41fc-b0ed-2df62bde11eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:47.729762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-624688eb-6977-45c0-b531-00b39f68d670 req-e4d563be-6054-41fc-b0ed-2df62bde11eb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.730073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-624688eb-6977-45c0-b531-00b39f68d670 req-e4d563be-6054-41fc-b0ed-2df62bde11eb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.730503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-624688eb-6977-45c0-b531-00b39f68d670 req-e4d563be-6054-41fc-b0ed-2df62bde11eb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.742638 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-624688eb-6977-45c0-b531-00b39f68d670 req-e4d563be-6054-41fc-b0ed-2df62bde11eb service nova] Creating event network-changed:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h2-862416-2 Oct 22 03:09:47.747925 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-624688eb-6977-45c0-b531-00b39f68d670 req-e4d563be-6054-41fc-b0ed-2df62bde11eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031476 Oct 22 03:09:47.749135 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 732/1483] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:47.754903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.756509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] [instance: 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:47.767815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.768592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.769217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.770107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.770904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.771601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.866829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:47.875059 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e04a6d5-a922-43ed-becf-eda5df83ffe3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.185694 Oct 22 03:09:47.875632 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 752/1484] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:47 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:47.880380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.881350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: ec9b80a9-6a56-4de1-be88-76587cf41d65] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:47.888392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.889133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.890239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.891247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.891765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.892192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.910321 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 HTTP/1.1 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ec9b80a9-6a56-4de1-be88-76587cf41d65'} Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:47.912548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Instance ec9b80a9-6a56-4de1-be88-76587cf41d65 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:47.917020 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-810abe78-580b-425b-a43c-4e92c7ccef07 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65" status: 404 len: 111 microversion: 2.1 time: 0.037345 Oct 22 03:09:47.917946 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 753/1485] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:47 2022] GET /compute/v2.1/servers/ec9b80a9-6a56-4de1-be88-76587cf41d65 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:47.922634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:47.923239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:47.930051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.930679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.931153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:47.931933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:47.932487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:47.933093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.078495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:48.087706 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-adc57dbc-4373-4921-afd6-965c1518b4d6 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1318 microversion: 2.1 time: 0.168721 Oct 22 03:09:48.097420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11868374-1124-486c-a662-6e86f6cc027d tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7" status: 200 len: 1618 microversion: 2.1 time: 0.346364 Oct 22 03:09:48.108306 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 754/1486] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:47 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:48.108306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-611c42ca-844b-4443-af54-5e676a71777f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a3f0a60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.109283 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 733/1487] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:47 2022] GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 => generated 1618 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:48.114466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.115786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:48.135805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-611c42ca-844b-4443-af54-5e676a71777f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:48.136548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-611c42ca-844b-4443-af54-5e676a71777f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:09:48.137151 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-611c42ca-844b-4443-af54-5e676a71777f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 does not exist Oct 22 03:09:48.137151 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-388bf1fb-5179-4d04-b8d0-6c855893730a'] Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-611c42ca-844b-4443-af54-5e676a71777f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-security-groups/b2a5844d-1a7f-40e5-9d16-21b2f8081a89 HTTP/1.1 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 does not exist Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-388bf1fb-5179-4d04-b8d0-6c855893730a'] Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'b2a5844d-1a7f-40e5-9d16-21b2f8081a89'} Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:48.140470 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 does not exist Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-388bf1fb-5179-4d04-b8d0-6c855893730a'] Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 does not exist Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-388bf1fb-5179-4d04-b8d0-6c855893730a'] Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 does not exist Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-388bf1fb-5179-4d04-b8d0-6c855893730a'] Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 does not exist Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-388bf1fb-5179-4d04-b8d0-6c855893730a'] Oct 22 03:09:48.147640 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.150067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.150156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-611c42ca-844b-4443-af54-5e676a71777f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group b2a5844d-1a7f-40e5-9d16-21b2f8081a89 does not exist Oct 22 03:09:48.150156 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-388bf1fb-5179-4d04-b8d0-6c855893730a'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:48.150308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.150308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.150479 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-611c42ca-844b-4443-af54-5e676a71777f tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b2a5844d-1a7f-40e5-9d16-21b2f8081a89" status: 404 len: 194 microversion: 2.1 time: 0.042272 Oct 22 03:09:48.150559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.150559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.150707 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 755/1488] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:48 2022] DELETE /compute/v2.1/os-security-groups/b2a5844d-1a7f-40e5-9d16-21b2f8081a89 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:48.150795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.150878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.150878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:48.158550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.159129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.160588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.161622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.161816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.162511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.304724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18e3918d-2805-49b9-b1da-c75fa18b5edd tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 200 len: 1619 microversion: 2.1 time: 0.160167 Oct 22 03:09:48.305632 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 756/1489] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:48 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 1619 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:48.310312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5480f7f-60aa-49d7-906d-5843ca60ead2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a3f0af0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.335478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-c5480f7f-60aa-49d7-906d-5843ca60ead2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b4966a27-1025-4368-9045-6a0f738a73cb does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:48.336044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-c5480f7f-60aa-49d7-906d-5843ca60ead2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group b4966a27-1025-4368-9045-6a0f738a73cb not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:09:48.336761 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c5480f7f-60aa-49d7-906d-5843ca60ead2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group b4966a27-1025-4368-9045-6a0f738a73cb does not exist Oct 22 03:09:48.336761 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-608c1344-83f4-4d8f-9922-798ee0ea8f07'] Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5480f7f-60aa-49d7-906d-5843ca60ead2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-security-groups/b4966a27-1025-4368-9045-6a0f738a73cb HTTP/1.1 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group b4966a27-1025-4368-9045-6a0f738a73cb does not exist Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-608c1344-83f4-4d8f-9922-798ee0ea8f07'] Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'b4966a27-1025-4368-9045-6a0f738a73cb'} Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:48.338831 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b4966a27-1025-4368-9045-6a0f738a73cb does not exist Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-608c1344-83f4-4d8f-9922-798ee0ea8f07'] Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b4966a27-1025-4368-9045-6a0f738a73cb does not exist Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-608c1344-83f4-4d8f-9922-798ee0ea8f07'] Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b4966a27-1025-4368-9045-6a0f738a73cb does not exist Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-608c1344-83f4-4d8f-9922-798ee0ea8f07'] Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b4966a27-1025-4368-9045-6a0f738a73cb does not exist Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-608c1344-83f4-4d8f-9922-798ee0ea8f07'] Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5480f7f-60aa-49d7-906d-5843ca60ead2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group b4966a27-1025-4368-9045-6a0f738a73cb does not exist Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-608c1344-83f4-4d8f-9922-798ee0ea8f07'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:48.343284 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5480f7f-60aa-49d7-906d-5843ca60ead2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b4966a27-1025-4368-9045-6a0f738a73cb" status: 404 len: 194 microversion: 2.1 time: 0.033674 Oct 22 03:09:48.346870 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 757/1490] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:48 2022] DELETE /compute/v2.1/os-security-groups/b4966a27-1025-4368-9045-6a0f738a73cb => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:48.350135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ce798e5-a89b-46b8-af44-f54ede604b80 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a462af0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.375985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-8ce798e5-a89b-46b8-af44-f54ede604b80 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:48.376624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-8ce798e5-a89b-46b8-af44-f54ede604b80 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:09:48.377152 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-8ce798e5-a89b-46b8-af44-f54ede604b80 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:48.377152 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-b88141e4-4d24-41ba-afd5-748e624128e7'] Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ce798e5-a89b-46b8-af44-f54ede604b80 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-security-groups/5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 HTTP/1.1 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-b88141e4-4d24-41ba-afd5-748e624128e7'] Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586'} Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:48.379395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b88141e4-4d24-41ba-afd5-748e624128e7'] Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b88141e4-4d24-41ba-afd5-748e624128e7'] Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b88141e4-4d24-41ba-afd5-748e624128e7'] Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b88141e4-4d24-41ba-afd5-748e624128e7'] Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ce798e5-a89b-46b8-af44-f54ede604b80 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group 5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 does not exist Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-b88141e4-4d24-41ba-afd5-748e624128e7'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ce798e5-a89b-46b8-af44-f54ede604b80 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586" status: 404 len: 194 microversion: 2.1 time: 0.035432 Oct 22 03:09:48.384137 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 758/1491] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:48 2022] DELETE /compute/v2.1/os-security-groups/5f4e00d9-4ccd-46ad-a3b9-4bec60b9d586 => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:48.387825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-831618828", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "5073feec-6b6f-4858-99ba-438ab7362ee2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:48.444619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:09:48.507779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:48.516164 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea3e9f7e-8819-4fb0-ba84-65b2c614f7ba tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1283 microversion: 2.1 time: 0.405291 Oct 22 03:09:48.516514 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 734/1492] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:48 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1283 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:48.521208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-286d5e53-09b2-4ab3-b7f2-b47d358ed003 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d19a465e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.576789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-286d5e53-09b2-4ab3-b7f2-b47d358ed003 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:48.577447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.security_group_api [None req-286d5e53-09b2-4ab3-b7f2-b47d358ed003 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group b4035837-81b4-41b4-a381-aee02b101642 not found {{(pid=120581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:09:48.578026 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-286d5e53-09b2-4ab3-b7f2-b47d358ed003 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:09:48.578026 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-08b51e70-ab30-4ae8-be17-e9060dda7391'] Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-286d5e53-09b2-4ab3-b7f2-b47d358ed003 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-security-groups/b4035837-81b4-41b4-a381-aee02b101642 HTTP/1.1 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: exception: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-08b51e70-ab30-4ae8-be17-e9060dda7391'] Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'b4035837-81b4-41b4-a381-aee02b101642'} Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:48.580360 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08b51e70-ab30-4ae8-be17-e9060dda7391'] Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08b51e70-ab30-4ae8-be17-e9060dda7391'] Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08b51e70-ab30-4ae8-be17-e9060dda7391'] Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08b51e70-ab30-4ae8-be17-e9060dda7391'] Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-286d5e53-09b2-4ab3-b7f2-b47d358ed003 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group b4035837-81b4-41b4-a381-aee02b101642 does not exist Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-08b51e70-ab30-4ae8-be17-e9060dda7391'] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-286d5e53-09b2-4ab3-b7f2-b47d358ed003 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b4035837-81b4-41b4-a381-aee02b101642" status: 404 len: 194 microversion: 2.1 time: 0.064678 Oct 22 03:09:48.585799 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 735/1493] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:48 2022] DELETE /compute/v2.1/os-security-groups/b4035837-81b4-41b4-a381-aee02b101642 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:48.593318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65e5dbf8-14fe-459f-b4e7-a1478ef6f6b6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d19a46dc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.659388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-65e5dbf8-14fe-459f-b4e7-a1478ef6f6b6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:48.660106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.security_group_api [None req-65e5dbf8-14fe-459f-b4e7-a1478ef6f6b6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae not found {{(pid=120581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:09:48.661265 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-65e5dbf8-14fe-459f-b4e7-a1478ef6f6b6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:09:48.661265 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-11f5f466-6195-41c9-abcc-e18316940b07'] Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65e5dbf8-14fe-459f-b4e7-a1478ef6f6b6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-security-groups/632e68bb-c7c2-4d0b-972f-f56aed11ffae HTTP/1.1 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: exception: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-11f5f466-6195-41c9-abcc-e18316940b07'] Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '632e68bb-c7c2-4d0b-972f-f56aed11ffae'} Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:48.664715 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11f5f466-6195-41c9-abcc-e18316940b07'] Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11f5f466-6195-41c9-abcc-e18316940b07'] Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11f5f466-6195-41c9-abcc-e18316940b07'] Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11f5f466-6195-41c9-abcc-e18316940b07'] Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65e5dbf8-14fe-459f-b4e7-a1478ef6f6b6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group 632e68bb-c7c2-4d0b-972f-f56aed11ffae does not exist Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-11f5f466-6195-41c9-abcc-e18316940b07'] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65e5dbf8-14fe-459f-b4e7-a1478ef6f6b6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/632e68bb-c7c2-4d0b-972f-f56aed11ffae" status: 404 len: 194 microversion: 2.1 time: 0.080290 Oct 22 03:09:48.669951 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 736/1494] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:48 2022] DELETE /compute/v2.1/os-security-groups/632e68bb-c7c2-4d0b-972f-f56aed11ffae => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:09:48.679199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ee6785e8-d71d-4093-9b68-afbc88e733a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d19a46c10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.702471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:09:48.702982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:09:48.703474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:09:48.703914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:09:48.704372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:09:48.714549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.715044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.715483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.716233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.716717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.717146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.734228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:09:48.739725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:09:48.746295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-ee6785e8-d71d-4093-9b68-afbc88e733a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:09:48.747271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.security_group_api [None req-ee6785e8-d71d-4093-9b68-afbc88e733a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Neutron security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 not found {{(pid=120581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:09:48.748392 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ee6785e8-d71d-4093-9b68-afbc88e733a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:09:48.748392 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-d943fcb2-90d5-41a3-8242-a9fa70d996d7'] Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ee6785e8-d71d-4093-9b68-afbc88e733a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198 HTTP/1.1 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: exception: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-d943fcb2-90d5-41a3-8242-a9fa70d996d7'] Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'df439571-f3ce-4ecb-b8fc-bd7b536cb198'} Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:09:48.750448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d943fcb2-90d5-41a3-8242-a9fa70d996d7'] Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d943fcb2-90d5-41a3-8242-a9fa70d996d7'] Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d943fcb2-90d5-41a3-8242-a9fa70d996d7'] Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d943fcb2-90d5-41a3-8242-a9fa70d996d7'] Oct 22 03:09:48.755137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:48.764002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:09:48.764002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:09:48.764191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ee6785e8-d71d-4093-9b68-afbc88e733a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Security group df439571-f3ce-4ecb-b8fc-bd7b536cb198 does not exist Oct 22 03:09:48.764191 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-d943fcb2-90d5-41a3-8242-a9fa70d996d7'] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:48.764191 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ee6785e8-d71d-4093-9b68-afbc88e733a5 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198" status: 404 len: 194 microversion: 2.1 time: 0.087929 Oct 22 03:09:48.764191 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 737/1495] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:48 2022] DELETE /compute/v2.1/os-security-groups/df439571-f3ce-4ecb-b8fc-bd7b536cb198 => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:48.769058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.770035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:48.789774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.796461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.796461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.796461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.796461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.796461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.815701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2612f78-f490-48f0-95f9-e38059b7f9aa tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.431948 Oct 22 03:09:48.816563 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 759/1496] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:09:48.824918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:48.825767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:48.833219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.833720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.834735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.835455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:48.835910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:48.836378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:48.864495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:09:48.983853 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6f20d607-c52f-44e3-ac6d-950235dfe8b2 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 204 len: 0 microversion: 2.1 time: 0.165778 Oct 22 03:09:48.984480 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 760/1497] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:09:48 2022] DELETE /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:09:48.995566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad1fc270-e94e-4f88-98dd-081e49979432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:49.001266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ad1fc270-e94e-4f88-98dd-081e49979432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:49.096340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ad1fc270-e94e-4f88-98dd-081e49979432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:49.104423 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad1fc270-e94e-4f88-98dd-081e49979432 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1216 microversion: 2.1 time: 0.118611 Oct 22 03:09:49.105542 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 761/1498] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:48 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:49.110188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:49.110790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:49.118997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.119762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.120441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.121360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.122008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.122645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.135886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:49.148226 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-43f0d828-b1c9-4ed5-b2e7-144fe21d11de tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.384067 Oct 22 03:09:49.166374 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 738/1499] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:48 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:49.175135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:49.176064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:49.183535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.184382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.185060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.186159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.186817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.187449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.329991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:49.338938 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3516efb-a942-4ab5-818e-756c96bda317 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.232170 Oct 22 03:09:49.340227 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 762/1500] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:49 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:49.345152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:49.346051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:49.352990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.353873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.354535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.355466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.356143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.356836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.457751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:49.475225 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dfa8f55b-f3f6-4c87-9d7e-5946a8da1363 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1649 microversion: 2.1 time: 0.306871 Oct 22 03:09:49.475352 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 739/1501] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:49 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1649 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:49.531094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:49.541599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:49.542571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:49.545559 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97e28441-5c9b-4d3d-b7f1-95f0d58783d7 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1318 microversion: 2.1 time: 0.203824 Oct 22 03:09:49.560801 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 763/1502] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:49 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:49.564630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.565236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.565747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.566463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.566920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.567474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.733864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:49.742230 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2c4f3bf2-94d2-41f3-8cc2-c10230514a17 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.207204 Oct 22 03:09:49.743041 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 740/1503] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:49 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:49.770687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-3305ac3f-a199-469c-8695-ebd747e9d3a5 req-a37bd32e-c436-4bd6-90b5-ecbd90744ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1eecd3-ae18-4f16-87e9-04f47f3d7272", "tag": "1a713d54-9d07-4a3d-addc-61b67a2d57a3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:49.781074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3305ac3f-a199-469c-8695-ebd747e9d3a5 req-a37bd32e-c436-4bd6-90b5-ecbd90744ad2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:49.781552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3305ac3f-a199-469c-8695-ebd747e9d3a5 req-a37bd32e-c436-4bd6-90b5-ecbd90744ad2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:49.781993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3305ac3f-a199-469c-8695-ebd747e9d3a5 req-a37bd32e-c436-4bd6-90b5-ecbd90744ad2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:49.792813 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-3305ac3f-a199-469c-8695-ebd747e9d3a5 req-a37bd32e-c436-4bd6-90b5-ecbd90744ad2 service nova] Creating event network-changed:1a713d54-9d07-4a3d-addc-61b67a2d57a3 for instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 on n-h1-862416-2 Oct 22 03:09:49.797572 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-3305ac3f-a199-469c-8695-ebd747e9d3a5 req-a37bd32e-c436-4bd6-90b5-ecbd90744ad2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030567 Oct 22 03:09:49.798163 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 764/1504] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:50.129832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:50.131870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:50.149602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.154510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.155037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.155792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.160920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.161491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.177204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:50.178995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:50.195785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.196316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.206687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.208469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.210330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.212784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.316801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:50.329606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63099f64-5890-44b1-b7ec-bd766bf5118e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1220 microversion: 2.1 time: 0.203996 Oct 22 03:09:50.348531 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 741/1505] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:50 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1220 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:50.365856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:50.366904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:50.374102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.374876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.375441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.376453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.377067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.377659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.679587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:50.683877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:50.689727 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-66841427-56d5-49c8-be9d-350f72048129 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.518157 Oct 22 03:09:50.691276 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 765/1506] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:50 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:50.704116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:50.704763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:50.713628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.714397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.715375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.716595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.717235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.717932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.844934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:50.859456 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33f7f55a-4d0f-4d2e-8626-08ffc9529107 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.499031 Oct 22 03:09:50.860177 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 742/1507] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:50 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:50.865269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:50.866039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:50.873011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.873690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.875157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:50.876048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:50.876695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:50.877449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.125656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3d30df231e48babcc1d20dc8743a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9d3c4c33e854369a3d4c7775f931f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:51.138372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3381f5ab-1536-40f0-ab3b-2abdc5c0db52 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 200 len: 1649 microversion: 2.1 time: 0.445048 Oct 22 03:09:51.139500 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 766/1508] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:50 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 1649 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:51.147158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:51.148041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:51.155681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.156523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.157205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.158158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.158846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.159507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.195152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:51.209541 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f6ee0c6-7362-43ee-912c-188eba1ce2d4 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1318 microversion: 2.1 time: 0.347259 Oct 22 03:09:51.211005 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 743/1509] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:50 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:51.354642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:51.355411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:51.367426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.368021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.368765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.369714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.372515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.374611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.567295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:51.583423 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-008fd13d-2f6c-4c4f-85d6-56ede4effee7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1276 microversion: 2.1 time: 0.232682 Oct 22 03:09:51.584830 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 744/1510] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:51 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:51.595075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:51.613892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:51.614422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:51.636463 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d26544b7-600d-49c9-bd54-817020c94323 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.494453 Oct 22 03:09:51.637392 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 767/1511] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:51 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:51.638182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.638746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.639351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.640071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.640725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.641323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.790381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0a7e87e3-8279-4e6f-9557-c6b420cfda15 req-c7450fa2-f3a9-437e-9b7b-03533110480d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99", "name": "network-vif-deleted", "tag": "efc6309f-f0cc-41e3-9747-15b06e774dcf"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:51.812861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0a7e87e3-8279-4e6f-9557-c6b420cfda15 req-c7450fa2-f3a9-437e-9b7b-03533110480d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.813351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0a7e87e3-8279-4e6f-9557-c6b420cfda15 req-c7450fa2-f3a9-437e-9b7b-03533110480d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.813777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0a7e87e3-8279-4e6f-9557-c6b420cfda15 req-c7450fa2-f3a9-437e-9b7b-03533110480d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.830204 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0a7e87e3-8279-4e6f-9557-c6b420cfda15 req-c7450fa2-f3a9-437e-9b7b-03533110480d service nova] Creating event network-vif-deleted:efc6309f-f0cc-41e3-9747-15b06e774dcf for instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 on n-h1-862416-2 Oct 22 03:09:51.837171 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0a7e87e3-8279-4e6f-9557-c6b420cfda15 req-c7450fa2-f3a9-437e-9b7b-03533110480d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128119 Oct 22 03:09:51.838263 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 768/1512] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:09:51.843655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:51.844572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:51.852014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.852799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.866257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:51.867259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:51.867790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:51.869885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:52.065608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid a218e3e3-6082-4b65-8edb-b406c7cd582f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:09:52.101648 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93212f68-2abd-4f56-977f-6b11caab96ec tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 2422 microversion: 2.25 time: 0.514779 Oct 22 03:09:52.102565 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 745/1513] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:09:51 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 2422 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:09:52.117779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:52.118806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:52.125364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:52.126137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:52.128813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:52.129847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:52.130557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:52.134932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:52.164778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:52.177291 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20e4e13c-d243-46c7-a7f9-dbdf7c977a11 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.335669 Oct 22 03:09:52.180591 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 769/1514] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:51 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:52.191827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862416-2", "block_migration": "auto"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:52.199601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:52.213989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:52.214800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:52.217245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:52.219030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:52.221103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:52.222219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:52.260307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'flavor' on Instance uuid a218e3e3-6082-4b65-8edb-b406c7cd582f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:09:52.276109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Going to try to live migrate instance to n-h1-862416-2 {{(pid=120582) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:09:52.291044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:52.924343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:52.935958 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39d9f4b6-36ac-4538-859d-1f64fba3938a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.831755 Oct 22 03:09:52.936889 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 746/1515] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:52 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:52.943285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:52.943915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] [instance: a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:52.950119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:52.950926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:52.951541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:52.952474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:52.952937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:52.953687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:52.968455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] HTTP exception thrown: Instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 could not be found. Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Request method failure captured: Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 HTTP/1.1 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16xTQT4Pwjz9TGwLzv5jXP6wezPEbabTi0WiVkXJ5smobrY-kuJ9QKzSu7qV4KAhkRrPUNwD3PWTK-Il_rBr2ZDNuPpl5fSIMNnpiLx_j2OBkJq25xDRgxYhtAQyeay2OSCHkoHMh_hclo9BmWcjxmz4HxS-Zb3V3re40kJSokLRBI Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9d3c4c33e854369a3d4c7775f931f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9d3c4c33e854369a3d4c7775f931f69"}]}] Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e9d3c4c33e854369a3d4c7775f931f69 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1360777932 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0f3d30df231e48babcc1d20dc8743a39 Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupsTestJSON-1360777932-project Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 could not be found. Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99'} Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 could not be found. Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 could not be found. Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:52.970016 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:52.975690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:52.975690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:52.975690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:52.975690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:52.975690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:52.975690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 could not be found. Oct 22 03:09:52.975690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:52.977081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Returning 404 to user: Instance a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:52.977951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5aef544c-e0cb-41b8-abc9-439429074ee6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99" status: 404 len: 111 microversion: 2.1 time: 0.039771 Oct 22 03:09:52.979363 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 747/1516] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:52 2022] GET /compute/v2.1/servers/a2b2a37e-49b7-4bf4-bfb6-2ac27cc69b99 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:52.987434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:52.988535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:52.996160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:52.997382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:52.998017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:52.998896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:52.999769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:53.000676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:53.144882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:53.153427 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96328807-dfe3-458f-88c7-04a5f5e8dafc tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1318 microversion: 2.1 time: 0.173139 Oct 22 03:09:53.154007 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 748/1517] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:52 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:53.158574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:53.159390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:53.166045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:53.166532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:53.166972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:53.167776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:53.168266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:53.168700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:53.304950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:53.312599 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-77a6853f-6b16-47f1-bab6-8ac45d8d70ce tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.157608 Oct 22 03:09:53.313173 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 749/1518] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:53 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:53.317554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:53.318797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:53.324300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:53.324785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:53.325224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:53.325911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:53.326371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:53.326799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:53.453560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:53.457099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:53.462851 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0949466a-bb5a-4d6a-b238-ec14440fede1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.148729 Oct 22 03:09:53.463435 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 750/1519] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:53 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:53.467842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-15225dcd-c9ef-41e8-8b76-656fb5906458 req-83b86798-ddeb-4253-b240-f095ec1244ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e341b78-1feb-458c-9b12-042b60a97b81", "tag": "489d3c18-0fea-44fe-a23b-f6be79f1bb71"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:53.478375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-15225dcd-c9ef-41e8-8b76-656fb5906458 req-83b86798-ddeb-4253-b240-f095ec1244ce service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:53.478859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-15225dcd-c9ef-41e8-8b76-656fb5906458 req-83b86798-ddeb-4253-b240-f095ec1244ce service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:53.479304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-15225dcd-c9ef-41e8-8b76-656fb5906458 req-83b86798-ddeb-4253-b240-f095ec1244ce service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:53.489993 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-15225dcd-c9ef-41e8-8b76-656fb5906458 req-83b86798-ddeb-4253-b240-f095ec1244ce service nova] Creating event network-changed:489d3c18-0fea-44fe-a23b-f6be79f1bb71 for instance 9e341b78-1feb-458c-9b12-042b60a97b81 on n-h1-862416-2 Oct 22 03:09:53.494749 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-15225dcd-c9ef-41e8-8b76-656fb5906458 req-83b86798-ddeb-4253-b240-f095ec1244ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030174 Oct 22 03:09:53.495323 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 751/1520] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:53.500198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aac8ee36-0c47-4c71-a5bc-552712c82fb6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1a9984c0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:53.675588 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aac8ee36-0c47-4c71-a5bc-552712c82fb6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/9db77889-e0ea-4718-9d6e-73c257ef4b17" status: 202 len: 0 microversion: 2.1 time: 0.178989 Oct 22 03:09:53.676308 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 752/1521] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:53 2022] DELETE /compute/v2.1/os-security-groups/9db77889-e0ea-4718-9d6e-73c257ef4b17 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:09:53.682411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:53.683162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:53.689357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:53.689835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:53.690269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:53.690960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:53.691583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:53.692164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:53.822250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:53.829916 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8680f24-57c2-4fad-a9de-3841c983cce7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.152394 Oct 22 03:09:53.830482 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 753/1522] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:53 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:53.835518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f6d19e4-4fcd-4b27-acbc-c7c0477f16c6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] Calling method '.version_select at 0x7f0d1e4ac430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:54.053159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:54.063510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f6d19e4-4fcd-4b27-acbc-c7c0477f16c6 tempest-SecurityGroupsTestJSON-1360777932 tempest-SecurityGroupsTestJSON-1360777932-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/21013bcb-dd17-4047-9347-ce370af272a9" status: 202 len: 0 microversion: 2.1 time: 0.231995 Oct 22 03:09:54.064434 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 754/1523] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:09:53 2022] DELETE /compute/v2.1/os-security-groups/21013bcb-dd17-4047-9347-ce370af272a9 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:09:54.078037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:54.078631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:54.092107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:54.097656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:54.098204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:54.098987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:54.099489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:54.099929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:54.405705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:54.416413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0046f816-639c-427c-9ada-ac9b372408e3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.350832 Oct 22 03:09:54.417747 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 755/1524] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:54 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:54.440320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:54.441491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:54.449139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:54.449712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:54.450380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:54.451301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:54.451941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:54.452576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:54.712679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:54.728015 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96c3de6b-e3f5-428a-acdd-adaeacb73d98 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1318 microversion: 2.1 time: 0.294268 Oct 22 03:09:54.728798 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 756/1525] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:54 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:54.733648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4139d89e-ca0a-4e2f-b4d9-7146eca9a1e9 req-97adb760-21b5-4fd7-a477-62386f9ad506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78da2a1b-d11a-4846-8fc3-3de9ac83b8b4", "name": "network-vif-plugged", "status": "completed", "tag": "06dc17ec-b427-43ae-94ee-6e9085767966"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:54.743982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4139d89e-ca0a-4e2f-b4d9-7146eca9a1e9 req-97adb760-21b5-4fd7-a477-62386f9ad506 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:54.744891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4139d89e-ca0a-4e2f-b4d9-7146eca9a1e9 req-97adb760-21b5-4fd7-a477-62386f9ad506 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:54.751040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4139d89e-ca0a-4e2f-b4d9-7146eca9a1e9 req-97adb760-21b5-4fd7-a477-62386f9ad506 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:54.769315 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4139d89e-ca0a-4e2f-b4d9-7146eca9a1e9 req-97adb760-21b5-4fd7-a477-62386f9ad506 service nova] Creating event network-vif-plugged:06dc17ec-b427-43ae-94ee-6e9085767966 for instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 on n-h2-862416-2 Oct 22 03:09:54.778902 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4139d89e-ca0a-4e2f-b4d9-7146eca9a1e9 req-97adb760-21b5-4fd7-a477-62386f9ad506 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048641 Oct 22 03:09:54.779833 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 757/1526] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:54.789467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:54.790555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:54.798193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:54.798686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:54.799579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:54.800927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:54.801391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:54.801817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:55.071050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:55.079649 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6cc561c9-b287-4341-aa14-45177c0d2efd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.298314 Oct 22 03:09:55.080631 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 758/1527] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:54 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:55.086518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:55.087433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:55.102641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:55.103251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:55.103700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:55.104453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:55.104975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:55.105614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:55.285665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:55.298430 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a70599ac-8f80-4879-a261-cb401bff3a8a tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.216553 Oct 22 03:09:55.299235 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 759/1528] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:55 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:55.305490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:55.306218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:55.314768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:55.315381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:55.315902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:55.316926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:55.318856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:55.318998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:55.484278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:55.492795 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-331912b0-7184-4199-970e-09f0840061a7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.191686 Oct 22 03:09:55.493690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 760/1529] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:55 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:55.498537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:55.499257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:55.506387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:55.507294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:55.507955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:55.508955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:55.509656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:55.510157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:55.643987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=26 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:55.662478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:55.670798 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c56f5fd-9427-4ea9-ac81-8ff264b18c81 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.175752 Oct 22 03:09:55.671707 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 761/1530] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:55 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:55.756555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:55.757193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:55.765556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:55.766325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:55.766958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:55.767982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:55.768632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:55.778194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.029930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:56.039771 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65f8dc01-f430-4484-bc16-c67e52043493 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1318 microversion: 2.1 time: 0.292144 Oct 22 03:09:56.041042 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 762/1531] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:55 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:56.106221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:56.106756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:56.113240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.113724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.114166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.114982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.115453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.115884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.272766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:56.282216 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45a96452-9aa3-4d11-a0f4-71ac7c753e38 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.180171 Oct 22 03:09:56.282807 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 763/1532] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:56 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:09:56.322360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:56.322975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:56.334144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.334651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.335088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.335827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.336281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.336717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.506879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:56.517932 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-70ebc155-3d07-4b01-a6eb-5b0653455ca1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.199738 Oct 22 03:09:56.519250 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 764/1533] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:56 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:56.525433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:56.526051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:56.533169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.533945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.534548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.535495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.535982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.536492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.711658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:56.720463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c66ad45-1ab8-4366-a7cd-1be631e2f980 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1324 microversion: 2.1 time: 0.199916 Oct 22 03:09:56.721798 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 765/1534] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:56 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1324 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:56.727805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:56.728643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:56.734790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.735482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.736070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.736958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.737623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.738197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:56.907438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:56.916382 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ecdbdfb-4269-446f-b695-d114484b871a tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.193177 Oct 22 03:09:56.917734 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 766/1535] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:56 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:56.965883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3aca2ae6-574a-452c-88e6-64fdb433b554 req-89ec3237-8116-49f5-838a-723330e59ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1eecd3-ae18-4f16-87e9-04f47f3d7272", "name": "network-vif-plugged", "status": "completed", "tag": "1a713d54-9d07-4a3d-addc-61b67a2d57a3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:56.983080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3aca2ae6-574a-452c-88e6-64fdb433b554 req-89ec3237-8116-49f5-838a-723330e59ce4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:56.983937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3aca2ae6-574a-452c-88e6-64fdb433b554 req-89ec3237-8116-49f5-838a-723330e59ce4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:56.984556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3aca2ae6-574a-452c-88e6-64fdb433b554 req-89ec3237-8116-49f5-838a-723330e59ce4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.003335 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3aca2ae6-574a-452c-88e6-64fdb433b554 req-89ec3237-8116-49f5-838a-723330e59ce4 service nova] Creating event network-vif-plugged:1a713d54-9d07-4a3d-addc-61b67a2d57a3 for instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 on n-h1-862416-2 Oct 22 03:09:57.011886 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3aca2ae6-574a-452c-88e6-64fdb433b554 req-89ec3237-8116-49f5-838a-723330e59ce4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051870 Oct 22 03:09:57.014345 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 767/1536] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:57.073170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:57.074364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:57.082143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.082839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.085281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.086192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.086756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.087924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.290138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:57.300457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b6f743e-b243-40f3-9599-ac779b468a31 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1318 microversion: 2.1 time: 0.234425 Oct 22 03:09:57.301056 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 768/1537] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:57 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:57.307410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:57.308020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:57.316304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.316801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.317716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.318784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.319201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.320862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.458244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:57.466964 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01de59da-5d72-49eb-b96c-81417798c747 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.164914 Oct 22 03:09:57.467922 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 769/1538] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:57 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:57.542768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:57.544733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:57.551302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.551780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.552233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.553958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.554904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.555358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.581819 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-525f7eac-4c3d-4faf-8d1b-a13d9b3abcb5 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/action" status: 202 len: 0 microversion: 2.25 time: 5.399826 Oct 22 03:09:57.582511 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 770/1539] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:09:52 2022] POST /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/action => generated 0 bytes in 5401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:09:57.592995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:57.594293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:57.604236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.605124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.605837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.606776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.607451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.607985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.723588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:57.732891 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b10d52f7-4097-4da6-9be9-5ac938f42545 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.193892 Oct 22 03:09:57.733477 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 770/1540] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:57 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:57.752854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1ec96e5c-01a7-4635-9886-2da1a4ed3237 req-1a2ab972-ceed-4e47-9b34-cded13050291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dccbfe0-f44a-4f63-b22f-c942ff438cfb", "tag": "2dfdf0e8-a84f-4fde-b2ed-33ab6ed779ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:57.763583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1ec96e5c-01a7-4635-9886-2da1a4ed3237 req-1a2ab972-ceed-4e47-9b34-cded13050291 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.764065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1ec96e5c-01a7-4635-9886-2da1a4ed3237 req-1a2ab972-ceed-4e47-9b34-cded13050291 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.764521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1ec96e5c-01a7-4635-9886-2da1a4ed3237 req-1a2ab972-ceed-4e47-9b34-cded13050291 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.776486 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1ec96e5c-01a7-4635-9886-2da1a4ed3237 req-1a2ab972-ceed-4e47-9b34-cded13050291 service nova] Creating event network-changed:2dfdf0e8-a84f-4fde-b2ed-33ab6ed779ac for instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb on n-h2-862416-2 Oct 22 03:09:57.781519 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1ec96e5c-01a7-4635-9886-2da1a4ed3237 req-1a2ab972-ceed-4e47-9b34-cded13050291 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033043 Oct 22 03:09:57.782622 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 771/1541] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:09:57.788553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:57.789305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:57.795774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.796661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.797393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.798244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.798815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.799641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.805741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:57.958289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:57.967066 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-596c32f0-2b0e-4417-8708-ce8e88cdc8ba tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1519 microversion: 2.1 time: 0.183272 Oct 22 03:09:57.967641 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 772/1542] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:57 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:57.972069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:57.972889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:57.980247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.980925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.981356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:57.982051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:57.982525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:57.982951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.007632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:58.031152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:58.041746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:58.067558 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e87e9845-6ab3-4001-a02b-a5649fd7aa3a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.475638 Oct 22 03:09:58.069343 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 771/1543] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:09:57 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:09:58.115236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8058fab0-cf6b-4012-8bf4-5d706d3e623c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1758355838", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8058fab0-cf6b-4012-8bf4-5d706d3e623c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Request method failure captured: Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 243 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17pkbQNKardSFUGYUky7JWEc5F1rA_49YZC_JphBc3SoJ_LWKJcVDZCfixxu8yWmwkrpyujLzjwqNOQpRM3bCh6wtl9U93M9ZyW4uPNIsZmJL05QJhsxGyy3eW8PEasHujnZwmaG1ppBDcFBIRd_Vy4A0waVGmKbKAp2Y8To-vlBY0 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}] Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92bf4559db1f49418a803fa31df435d1 Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1758355838", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1758355838', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '02c73e7e-bb7c-4f81-ba1b-cfee515000b3'}]}}} Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:58.135324 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.139726 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.144466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8058fab0-cf6b-4012-8bf4-5d706d3e623c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:58.145622 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8058fab0-cf6b-4012-8bf4-5d706d3e623c tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.035939 Oct 22 03:09:58.147319 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 772/1544] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:58 2022] POST /compute/v2.1/servers => generated 175 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:09:58.164061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7fb52e52-bc09-41f2-a6d7-0320df0b4942 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:58.164613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7fb52e52-bc09-41f2-a6d7-0320df0b4942 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 1ce9fc50-29b8-4d0b-82a6-10e522014775] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:58.171981 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-7fb52e52-bc09-41f2-a6d7-0320df0b4942 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] HTTP exception thrown: Instance 1ce9fc50-29b8-4d0b-82a6-10e522014775 could not be found. Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7fb52e52-bc09-41f2-a6d7-0320df0b4942 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Request method failure captured: Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/1ce9fc50-29b8-4d0b-82a6-10e522014775/metadata HTTP/1.1 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17pkbQNKardSFUGYUky7JWEc5F1rA_49YZC_JphBc3SoJ_LWKJcVDZCfixxu8yWmwkrpyujLzjwqNOQpRM3bCh6wtl9U93M9ZyW4uPNIsZmJL05QJhsxGyy3eW8PEasHujnZwmaG1ppBDcFBIRd_Vy4A0waVGmKbKAp2Y8To-vlBY0 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}] Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92bf4559db1f49418a803fa31df435d1 Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 1ce9fc50-29b8-4d0b-82a6-10e522014775 could not be found. Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': '1ce9fc50-29b8-4d0b-82a6-10e522014775'} Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce9fc50-29b8-4d0b-82a6-10e522014775 could not be found. Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce9fc50-29b8-4d0b-82a6-10e522014775 could not be found. Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.174127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.178977 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:58.178977 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:58.178977 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce9fc50-29b8-4d0b-82a6-10e522014775 could not be found. Oct 22 03:09:58.178977 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.178977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7fb52e52-bc09-41f2-a6d7-0320df0b4942 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Returning 404 to user: Instance 1ce9fc50-29b8-4d0b-82a6-10e522014775 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:58.178977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7fb52e52-bc09-41f2-a6d7-0320df0b4942 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/1ce9fc50-29b8-4d0b-82a6-10e522014775/metadata" status: 404 len: 111 microversion: 2.1 time: 0.021346 Oct 22 03:09:58.178977 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 773/1545] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:09:58 2022] GET /compute/v2.1/servers/1ce9fc50-29b8-4d0b-82a6-10e522014775/metadata => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:58.241236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:58.246014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2ca2595-e54d-429d-a71d-d7c859fb4b07 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1095389129", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:58.250077 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0af99341-d5f2-4a12-9a4b-0c57cb8c504e tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.281253 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2ca2595-e54d-429d-a71d-d7c859fb4b07 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Request method failure captured: Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 499 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17pkbQNKardSFUGYUky7JWEc5F1rA_49YZC_JphBc3SoJ_LWKJcVDZCfixxu8yWmwkrpyujLzjwqNOQpRM3bCh6wtl9U93M9ZyW4uPNIsZmJL05QJhsxGyy3eW8PEasHujnZwmaG1ppBDcFBIRd_Vy4A0waVGmKbKAp2Y8To-vlBY0 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}] Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92bf4559db1f49418a803fa31df435d1 Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1095389129", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1095389129', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '02c73e7e-bb7c-4f81-ba1b-cfee515000b3'}]}}} Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 03:09:58.250804 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2ca2595-e54d-429d-a71d-d7c859fb4b07 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:58.254469 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2ca2595-e54d-429d-a71d-d7c859fb4b07 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.011430 Oct 22 03:09:58.264046 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 773/1546] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:57 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:58.272437 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 774/1547] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:58 2022] POST /compute/v2.1/servers => generated 687 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:09:58.311256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a773664f-a121-43ef-abca-1f20a146cfe3 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1834164016", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a773664f-a121-43ef-abca-1f20a146cfe3 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Request method failure captured: Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 500 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17pkbQNKardSFUGYUky7JWEc5F1rA_49YZC_JphBc3SoJ_LWKJcVDZCfixxu8yWmwkrpyujLzjwqNOQpRM3bCh6wtl9U93M9ZyW4uPNIsZmJL05QJhsxGyy3eW8PEasHujnZwmaG1ppBDcFBIRd_Vy4A0waVGmKbKAp2Y8To-vlBY0 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}] Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 92bf4559db1f49418a803fa31df435d1 Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1834164016", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1834164016', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '02c73e7e-bb7c-4f81-ba1b-cfee515000b3'}]}}} Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 03:09:58.315900 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a773664f-a121-43ef-abca-1f20a146cfe3 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:58.320055 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a773664f-a121-43ef-abca-1f20a146cfe3 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.011369 Oct 22 03:09:58.323805 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 774/1548] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:09:58.331686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:58.332609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:58.342589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.343497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.344197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.345293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.346124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.347329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.398507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fe19049-14a2-4689-a362-959943a5ba7d tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1449936027", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fe19049-14a2-4689-a362-959943a5ba7d tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Request method failure captured: Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 754 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17pkbQNKardSFUGYUky7JWEc5F1rA_49YZC_JphBc3SoJ_LWKJcVDZCfixxu8yWmwkrpyujLzjwqNOQpRM3bCh6wtl9U93M9ZyW4uPNIsZmJL05QJhsxGyy3eW8PEasHujnZwmaG1ppBDcFBIRd_Vy4A0waVGmKbKAp2Y8To-vlBY0 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}] Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 92bf4559db1f49418a803fa31df435d1 Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1449936027", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1449936027', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '02c73e7e-bb7c-4f81-ba1b-cfee515000b3'}]}}} Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:09:58.403770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:09:58.406770 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:09:58.413235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.413235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.414754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fe19049-14a2-4689-a362-959943a5ba7d tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:58.416836 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1fe19049-14a2-4689-a362-959943a5ba7d tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023836 Oct 22 03:09:58.417982 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 775/1549] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:09:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 22 03:09:58.493210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8523b7b6-75b6-4e9b-bfbb-c64dd695ee89 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1985323324", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8523b7b6-75b6-4e9b-bfbb-c64dd695ee89 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Request method failure captured: Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 1266 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17pkbQNKardSFUGYUky7JWEc5F1rA_49YZC_JphBc3SoJ_LWKJcVDZCfixxu8yWmwkrpyujLzjwqNOQpRM3bCh6wtl9U93M9ZyW4uPNIsZmJL05QJhsxGyy3eW8PEasHujnZwmaG1ppBDcFBIRd_Vy4A0waVGmKbKAp2Y8To-vlBY0 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}] Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 92bf4559db1f49418a803fa31df435d1 Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1985323324", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "02c73e7e-bb7c-4f81-ba1b-cfee515000b3"}]}} Oct 22 03:09:58.506654 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1985323324', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '02c73e7e-bb7c-4f81-ba1b-cfee515000b3'}]}}} Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.514075 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:09:58.515230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:09:58.517072 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 22 03:09:58.517072 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.517072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8523b7b6-75b6-4e9b-bfbb-c64dd695ee89 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:58.517072 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8523b7b6-75b6-4e9b-bfbb-c64dd695ee89 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.020333 Oct 22 03:09:58.517072 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 776/1550] 10.222.0.25 () {60 vars in 1148 bytes} [Sat Oct 22 03:09:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 22 03:09:58.527493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:58.528586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:58.538457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.539260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.539913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.540862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.541664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.542339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.640288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:58.672452 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-710523c9-d024-4e49-ba37-ef5c1863ff23 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1318 microversion: 2.1 time: 0.346054 Oct 22 03:09:58.673504 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 775/1551] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:58 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:58.681433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b4ee7a3-4131-45da-838f-7ec9d4cf4d2e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:58.682479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8b4ee7a3-4131-45da-838f-7ec9d4cf4d2e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:58.703994 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-8b4ee7a3-4131-45da-838f-7ec9d4cf4d2e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] HTTP exception thrown: Instance 0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d could not be found. Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b4ee7a3-4131-45da-838f-7ec9d4cf4d2e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Request method failure captured: Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d/metadata/test2 HTTP/1.1 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17pkbQNKardSFUGYUky7JWEc5F1rA_49YZC_JphBc3SoJ_LWKJcVDZCfixxu8yWmwkrpyujLzjwqNOQpRM3bCh6wtl9U93M9ZyW4uPNIsZmJL05QJhsxGyy3eW8PEasHujnZwmaG1ppBDcFBIRd_Vy4A0waVGmKbKAp2Y8To-vlBY0 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}] Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92bf4559db1f49418a803fa31df435d1 Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d could not be found. Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': '0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d', 'id': 'test2'} Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d could not be found. Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d could not be found. Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:09:58.706689 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:09:58.712098 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:09:58.712098 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:09:58.712098 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d could not be found. Oct 22 03:09:58.712098 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:09:58.713342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b4ee7a3-4131-45da-838f-7ec9d4cf4d2e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Returning 404 to user: Instance 0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:09:58.714683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b4ee7a3-4131-45da-838f-7ec9d4cf4d2e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.039476 Oct 22 03:09:58.724855 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 776/1552] 10.222.0.25 () {58 vars in 1281 bytes} [Sat Oct 22 03:09:58 2022] GET /compute/v2.1/servers/0e2c8ffa-e49c-4fcb-b17a-1faa36bf8f1d/metadata/test2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:09:58.727103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:58.731610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:58.732332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:58.741419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.741925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.742366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.743086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.743545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.744003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.779723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:09:58.867514 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c6a0b495-e2a6-4404-8519-3b74e55a34a2 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 204 len: 0 microversion: 2.1 time: 0.139525 Oct 22 03:09:58.871301 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 777/1553] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:09:58 2022] DELETE /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:09:58.874589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:58.874839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:58.881028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.881912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.882519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.883512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.883976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.884915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.939736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:58.953816 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91475416-be90-45f2-af14-31a18c075af0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.443393 Oct 22 03:09:58.956194 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 777/1554] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:58 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:58.964372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:58.966119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:58.974075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.975848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.976571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:58.978322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:58.979007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:58.979827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:59.044646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:59.053281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2977eea7-1e77-4049-9916-bf9e070179ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.183550 Oct 22 03:09:59.053890 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 778/1555] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:58 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:59.096645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:59.097386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:59.103418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=18 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:09:59.105526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:59.106014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:59.106454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:59.107160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:59.107679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:59.108110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:59.253188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:59.287425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:59.292460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:59.293715 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b48ca78-039b-42ce-a6d5-c30ae6dfc3d5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.201121 Oct 22 03:09:59.294292 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 779/1556] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:09:59 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:09:59.299061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:59.299678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:59.315833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:59.319849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:59.320360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:59.321684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:59.322153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:59.322581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:59.370160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:59.384797 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-626de6f3-dbe9-48fa-8d11-47477cc8b2d7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1525 microversion: 2.1 time: 0.425687 Oct 22 03:09:59.385407 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 778/1557] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:58 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1525 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:59.698320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:59.699079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:59.706927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:59.708291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:59.709922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:59.711694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:59.712469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:59.713124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:59.799016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:59.816993 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e14f9907-99db-4faf-8cfc-e02790b48c1b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.521431 Oct 22 03:09:59.817597 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 780/1558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:59 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:59.939213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:09:59.950361 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ebabc720-e236-4150-a3dd-10e2e8da1456 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1508 microversion: 2.1 time: 0.255972 Oct 22 03:09:59.952357 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 779/1559] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:59 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:09:59.979382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:09:59.983098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:09:59.997398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:59.997901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:59.998557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:09:59.999061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:09:59.999517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:09:59.999945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:00.078079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:00.078989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:00.087499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:00.088263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:00.088959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:00.090030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:00.090716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:00.091370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:00.265610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:00.273999 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a2e95123-26c8-4e57-b615-d77eb1688ee5 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.200293 Oct 22 03:10:00.276053 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 780/1560] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:00 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:00.323680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:00.331593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:00.338354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:00.339226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:00.339906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:00.340889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:00.341890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:00.353263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:00.358563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:00.367893 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e15e75a0-3b81-496f-8721-273be714980b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.393269 Oct 22 03:10:00.368503 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 781/1561] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:09:59 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:00.408544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:00.409377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:00.428404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:00.428865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:00.429319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:00.435412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:00.435872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:00.436368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:00.590544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:00.605074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:00.606386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:00.607764 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-99708c55-6075-4c19-8585-d0ad53a880b9 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.290244 Oct 22 03:10:00.610072 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 781/1562] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:00 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:00.658910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:00.667826 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73e44b97-73e0-445b-8341-fd09bcbc43c7 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1525 microversion: 2.1 time: 0.263492 Oct 22 03:10:00.668473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 782/1563] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:00 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1525 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:00.846201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:00.847426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:00.857532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:00.858338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:00.859040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:00.859949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:00.860634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:00.861119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.004143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8c56e565-72cd-4d8b-a0a7-e5e90d07aeda req-fd111f82-d78a-4d25-9225-b001b1fce111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e341b78-1feb-458c-9b12-042b60a97b81", "name": "network-vif-plugged", "status": "completed", "tag": "489d3c18-0fea-44fe-a23b-f6be79f1bb71"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:01.031952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8c56e565-72cd-4d8b-a0a7-e5e90d07aeda req-fd111f82-d78a-4d25-9225-b001b1fce111 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.033300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8c56e565-72cd-4d8b-a0a7-e5e90d07aeda req-fd111f82-d78a-4d25-9225-b001b1fce111 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.035094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8c56e565-72cd-4d8b-a0a7-e5e90d07aeda req-fd111f82-d78a-4d25-9225-b001b1fce111 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.063978 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8c56e565-72cd-4d8b-a0a7-e5e90d07aeda req-fd111f82-d78a-4d25-9225-b001b1fce111 service nova] Creating event network-vif-plugged:489d3c18-0fea-44fe-a23b-f6be79f1bb71 for instance 9e341b78-1feb-458c-9b12-042b60a97b81 on n-h1-862416-2 Oct 22 03:10:01.081268 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8c56e565-72cd-4d8b-a0a7-e5e90d07aeda req-fd111f82-d78a-4d25-9225-b001b1fce111 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076982 Oct 22 03:10:01.082236 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 783/1564] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:01.088137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:01.097555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42530a93-f94a-454c-81ea-177a31df8d72 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.256577 Oct 22 03:10:01.116569 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 782/1565] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:00 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:01.299365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:01.301085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:01.308983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.309561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.310066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.310843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.311364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.311877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.335167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:01.401035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:01.402024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:01.411323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:01.418013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.419254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.420308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.421249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.421903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.422521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.593704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:01.604571 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a1b4fbb-3532-4246-9859-537b406f31ef tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1325 microversion: 2.1 time: 0.309611 Oct 22 03:10:01.608264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 784/1566] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:01 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1325 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:01.637752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:01.638422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:01.653878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.654640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.655504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.656453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.657107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.657723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.775319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:01.787459 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e0218ee-ea72-4095-b9db-06d3ed09f200 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.392560 Oct 22 03:10:01.788569 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 783/1567] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:01 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:01.794373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:01.799092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:01.808157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.808865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.809213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.809935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:01.810429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:01.810860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:01.875853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:01.885510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:01.887111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:01.888322 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-324755d7-f5a9-4841-bcf0-1fa8d35e61ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.257740 Oct 22 03:10:01.889176 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 785/1568] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:01 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:01.970104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:01.979773 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1731266d-ff69-41a4-a67f-47d7c31b450e tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1525 microversion: 2.1 time: 0.190055 Oct 22 03:10:01.980515 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 784/1569] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:01 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1525 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:02.123251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:02.124657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:02.133899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.134478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.135085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.135812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.136372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.136962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.314872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:02.323581 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b3533c97-bd0a-487b-9740-486476217d4d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.204381 Oct 22 03:10:02.336612 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 786/1570] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:02 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:02.631301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:02.632012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:02.640721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.649383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.650006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.650948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.651566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.652006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.683047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5dbfde96-b740-4f3d-95d5-6b23d72402a5"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:02.685664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:02.691990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.692591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.693172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.693979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.694515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.695061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.753097 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] HTTP exception thrown: Volume 4e4feedc-d292-4722-9aae-944b49c9f221 could not be found. Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Request method failure captured: Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272/os-volume_attachments/4e4feedc-d292-4722-9aae-944b49c9f221 HTTP/1.1 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 74 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU15NMzQINzs-ecLxrwEpRnhh-RYcnfZdROSZ9BDTPrLEi9C0NV0R1W8iqepzR33uIKi0GKHAp6BokdCSWQvFb9YUIZLyWPEP-6W7bwlax75c_rjSkMUr3KihlDTxJiA0lnUbilPSHNQ7k_Mnayet6VDD_o39_dC9jAqBfCVvvT0FT6g Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 30099f50cef646f590571f1fc2a2a2b6 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesAdminNegativeTest-961014168 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30099f50cef646f590571f1fc2a2a2b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30099f50cef646f590571f1fc2a2a2b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30099f50cef646f590571f1fc2a2a2b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30099f50cef646f590571f1fc2a2a2b6"}]}] Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesAdminNegativeTest-961014168 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 30099f50cef646f590571f1fc2a2a2b6 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-961014168 Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesAdminNegativeTest-961014168-project-admin Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92264d694b7f4fcb97647141aa91592c Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesAdminNegativeTest-961014168-project-admin Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: {"volumeAttachment": {"volumeId": "5dbfde96-b740-4f3d-95d5-6b23d72402a5"}} Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: exception: Volume 4e4feedc-d292-4722-9aae-944b49c9f221 could not be found. Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': 'cb1eecd3-ae18-4f16-87e9-04f47f3d7272', 'id': '4e4feedc-d292-4722-9aae-944b49c9f221', 'body': {'volumeAttachment': {'volumeId': '5dbfde96-b740-4f3d-95d5-6b23d72402a5'}}} Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e4feedc-d292-4722-9aae-944b49c9f221 could not be found. (HTTP 404) (Request-ID: req-578e1def-9101-4e65-9e56-3a494c2f6522) Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:10:02.756154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e4feedc-d292-4722-9aae-944b49c9f221 could not be found. Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e4feedc-d292-4722-9aae-944b49c9f221 could not be found. Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e4feedc-d292-4722-9aae-944b49c9f221 could not be found. Oct 22 03:10:02.761101 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:02.767950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] Returning 404 to user: Volume 4e4feedc-d292-4722-9aae-944b49c9f221 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:02.767950 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d99397eb-01df-40e3-b80e-de59351dd752 tempest-VolumesAdminNegativeTest-961014168 tempest-VolumesAdminNegativeTest-961014168-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272/os-volume_attachments/4e4feedc-d292-4722-9aae-944b49c9f221" status: 404 len: 109 microversion: 2.1 time: 0.095366 Oct 22 03:10:02.767950 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 787/1571] 10.222.0.25 () {60 vars in 1433 bytes} [Sat Oct 22 03:10:02 2022] PUT /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272/os-volume_attachments/4e4feedc-d292-4722-9aae-944b49c9f221 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:10:02.814891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:02.815926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:02.829732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.831968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.832805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.835014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.835720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.836404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.894415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:02.914535 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-acf3680d-e640-4648-8c11-452ef7f030db tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1520 microversion: 2.1 time: 0.286901 Oct 22 03:10:02.916108 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 785/1572] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:02 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:02.932438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:02.934294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:02.953131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.954593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.955281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:02.956336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:02.957007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:02.962021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:03.091068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:03.114147 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5002d0b2-fb6c-4fa8-9b5b-a13635c79a53 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.306316 Oct 22 03:10:03.116650 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 788/1573] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:02 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:03.122808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:03.123944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:03.156474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:03.156676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:03.157316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:03.157961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:03.159458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:03.160072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:03.160939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:03.171000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:03.174181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:03.175977 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b1c90f1-c1fb-4056-b525-d2658b8a3049 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.258583 Oct 22 03:10:03.176820 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 786/1574] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:02 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:03.182612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:03.183563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:03.190640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:03.191424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:03.192085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:03.198192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:03.198972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:03.199819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:03.646825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:03.665717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6f98a608-8cb8-4646-a26a-3d8fe16f094c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1520 microversion: 2.1 time: 0.540370 Oct 22 03:10:03.666372 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 789/1575] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:03 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:03.965443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a131c4d1-3842-4165-be2a-c50531fb1ef1 req-cda82551-b021-4cfc-9c3b-8ee1e837e4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "name": "network-vif-plugged", "status": "completed", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:03.998391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a131c4d1-3842-4165-be2a-c50531fb1ef1 req-cda82551-b021-4cfc-9c3b-8ee1e837e4d8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.002453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a131c4d1-3842-4165-be2a-c50531fb1ef1 req-cda82551-b021-4cfc-9c3b-8ee1e837e4d8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.003300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a131c4d1-3842-4165-be2a-c50531fb1ef1 req-cda82551-b021-4cfc-9c3b-8ee1e837e4d8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.038322 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a131c4d1-3842-4165-be2a-c50531fb1ef1 req-cda82551-b021-4cfc-9c3b-8ee1e837e4d8 service nova] Creating event network-vif-plugged:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h2-862416-2 Oct 22 03:10:04.053442 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a131c4d1-3842-4165-be2a-c50531fb1ef1 req-cda82551-b021-4cfc-9c3b-8ee1e837e4d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382775 Oct 22 03:10:04.056589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:04.058035 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 790/1576] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:04.070855 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-455c02ca-4ff9-4cdb-9619-c5828abb6814 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1525 microversion: 2.1 time: 0.890919 Oct 22 03:10:04.071046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:04.071759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:04.072636 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 787/1577] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:03 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1525 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:04.080614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-220419958"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:04.086711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.087207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.087651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.088547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:04.093872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.099713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.100815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.105052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.105518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.105995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.106635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.113429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.113965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.388266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:04.398727 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a8274617-3f3d-47b3-ba91-b9c670b5ffe7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.339408 Oct 22 03:10:04.402012 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 791/1578] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:04 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:04.409037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:04.409654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:04.422545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.423456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.424858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.425809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.426436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.427031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.506708 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b103806-9111-4577-9b52-b2f009e310a6 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81/action" status: 202 len: 0 microversion: 2.1 time: 0.432338 Oct 22 03:10:04.507375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 788/1579] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:10:04 2022] POST /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 03:10:04.531199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:04.531893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:04.546190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.556977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.557720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.558828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:04.559443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:04.560039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:04.669983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:04.680983 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5ff28c6-8ec8-4111-895e-2df4bd384c43 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.277589 Oct 22 03:10:04.681594 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 792/1580] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:04 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:04.689827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f987b90-316a-472a-8201-108068b991a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '.version_select at 0x7f0d1a08f040>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:04.911093 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f987b90-316a-472a-8201-108068b991a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/images/b1499cde-02fa-4f24-92a0-37e6db935597" status: 204 len: 0 microversion: 2.1 time: 0.228442 Oct 22 03:10:04.911772 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 793/1581] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:04 2022] DELETE /compute/v2.1/images/b1499cde-02fa-4f24-92a0-37e6db935597 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:10:04.928940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35cef93a-fee6-4b16-8835-eae4dcd7972c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '.version_select at 0x7f0d1a473c10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:04.968969 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-35cef93a-fee6-4b16-8835-eae4dcd7972c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Image not found. Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35cef93a-fee6-4b16-8835-eae4dcd7972c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/images/b1499cde-02fa-4f24-92a0-37e6db935597 HTTP/1.1 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: exception: Image not found. Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'b1499cde-02fa-4f24-92a0-37e6db935597'} Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b1499cde-02fa-4f24-92a0-37e6db935597 Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:10:04.986596 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b1499cde-02fa-4f24-92a0-37e6db935597 could not be found. Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:10:04.991991 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:04.996984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35cef93a-fee6-4b16-8835-eae4dcd7972c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Image not found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:04.998256 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35cef93a-fee6-4b16-8835-eae4dcd7972c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/images/b1499cde-02fa-4f24-92a0-37e6db935597" status: 404 len: 62 microversion: 2.1 time: 0.081589 Oct 22 03:10:04.999475 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 794/1582] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:10:04 2022] GET /compute/v2.1/images/b1499cde-02fa-4f24-92a0-37e6db935597 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:10:05.010957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:05.011839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:05.030917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:05.032578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:05.033228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:05.034178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:05.034830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:05.035431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:05.288100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:05.301157 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-57c924c7-25c0-4bc6-ad3b-1b302e8e3886 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1532 microversion: 2.1 time: 0.297234 Oct 22 03:10:05.301763 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 795/1583] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:05 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1532 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:05.316906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:05.322721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:05.327939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:05.328837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:05.330489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:05.333477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47b580fb-c847-411c-ae13-3ad3938d0e6b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.820260 Oct 22 03:10:05.335706 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 789/1584] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:04 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:05.337891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:05.338387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:05.338829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:05.339540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:05.340143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:05.340695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:05.423489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:05.425517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:05.434337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:05.435131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:05.435756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:05.436860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:05.437482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:05.438076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:05.474994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:05.541420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:05.552902 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-16a23e40-8c72-48d1-b7dc-050e9c293609 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1525 microversion: 2.1 time: 0.249403 Oct 22 03:10:05.553821 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 796/1585] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:05 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1525 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:05.710783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:05.712063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:05.721172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:05.722013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:05.722667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:05.723621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:05.724967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:05.726298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:05.771818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:05.795480 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abbab26d-4701-4627-9fea-a7b4aac193f7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1313 microversion: 2.1 time: 0.376809 Oct 22 03:10:05.797611 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 790/1586] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:05 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:06.001570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:06.016028 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e033cd2-b3a3-42fe-8ac3-8ef1c7e1276e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.315254 Oct 22 03:10:06.016674 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 797/1587] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:05 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:06.208160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2bcdd4fe-b4e0-4bf6-834f-4a5d2d7384e6 req-a1e1b2ef-76df-45cf-ae41-fc28cbc70205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78da2a1b-d11a-4846-8fc3-3de9ac83b8b4", "name": "network-vif-deleted", "tag": "06dc17ec-b427-43ae-94ee-6e9085767966"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:06.235756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2bcdd4fe-b4e0-4bf6-834f-4a5d2d7384e6 req-a1e1b2ef-76df-45cf-ae41-fc28cbc70205 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.236792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2bcdd4fe-b4e0-4bf6-834f-4a5d2d7384e6 req-a1e1b2ef-76df-45cf-ae41-fc28cbc70205 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.237471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2bcdd4fe-b4e0-4bf6-834f-4a5d2d7384e6 req-a1e1b2ef-76df-45cf-ae41-fc28cbc70205 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.255033 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2bcdd4fe-b4e0-4bf6-834f-4a5d2d7384e6 req-a1e1b2ef-76df-45cf-ae41-fc28cbc70205 service nova] Creating event network-vif-deleted:06dc17ec-b427-43ae-94ee-6e9085767966 for instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 on n-h2-862416-2 Oct 22 03:10:06.273213 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2bcdd4fe-b4e0-4bf6-834f-4a5d2d7384e6 req-a1e1b2ef-76df-45cf-ae41-fc28cbc70205 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058655 Oct 22 03:10:06.275497 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 791/1588] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:06.330599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:06.332247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:06.376145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:06.377118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:06.378004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.378528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.378964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.379673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.380150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.387053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.389893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.392830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.393502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.397987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.398988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.399556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.642564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:06.657411 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e78128d4-cabf-4b73-ae6f-010085ea05c7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1538 microversion: 2.1 time: 0.334395 Oct 22 03:10:06.658342 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 798/1589] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:06 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1538 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:06.666814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:06.670372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:06.682321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.685728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.686870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.688944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.689667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.692051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.763906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.764762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.765362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.770690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lazy-loading 'fault' on Instance uuid 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:06.839761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bf4559db1f49418a803fa31df435d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91dd8fc4c5e847d0a2e6bcfa5a47beaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:06.854383 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cf0b90c1-baae-4e4b-8c5e-30bcdfa20327 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 200 len: 1314 microversion: 2.1 time: 0.193527 Oct 22 03:10:06.856938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 799/1590] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:06 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:06.876500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:06.877297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:06.889292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.890046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.890645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:06.891516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:06.892144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:06.892859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.175494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:07.189027 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af94c02a-0649-4604-95f3-bc9336211001 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1463 microversion: 2.1 time: 0.330575 Oct 22 03:10:07.207499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 800/1591] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:06 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1463 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:07.214074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:07.215006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:07.222762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.223604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.224419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.225710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.226350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.226975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.253212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:07.274774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:07.279701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:07.281341 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2236fee8-940d-4dff-a69d-1e79ac0ac911 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.924582 Oct 22 03:10:07.285036 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 792/1592] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:06 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:07.294878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:07.298715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:07.313224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.314081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.315138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.319120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.319878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.320506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.415823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:07.428177 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3505fef7-a46c-42c3-8d47-a862ccf0c568 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.218345 Oct 22 03:10:07.430100 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 801/1593] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:07 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:07.441975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:07.443343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:07.458631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.459657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.460278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.461487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.462099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.462683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.511402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:10:07.620149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:07.731179 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2f451685-5426-42e2-a769-2cc973ba258e tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 204 len: 0 microversion: 2.1 time: 0.299543 Oct 22 03:10:07.732500 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 802/1594] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:07 2022] DELETE /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:10:07.742283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:07.743652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:07.754311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.755324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.756603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.758318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.759269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.760152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.795348 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-09a97e86-fb94-4474-ae2f-c305fadb5657 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1614 microversion: 2.1 time: 0.506249 Oct 22 03:10:07.796059 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 793/1595] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:07 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1614 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:07.806464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:07.807761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:07.824884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.827410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.828570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:07.829556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:07.830188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:07.830781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.063719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:08.076573 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-70b2a296-9047-4c35-b592-ff1ad35ddf4d tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1514 microversion: 2.1 time: 0.279105 Oct 22 03:10:08.078087 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 794/1596] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:07 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:08.085381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-398ce3c8-94e1-4b44-b37f-48faa039a508 req-56b020d4-4b85-443a-8076-056c8bb4af6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dccbfe0-f44a-4f63-b22f-c942ff438cfb", "name": "network-vif-plugged", "status": "completed", "tag": "2dfdf0e8-a84f-4fde-b2ed-33ab6ed779ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:08.102177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-398ce3c8-94e1-4b44-b37f-48faa039a508 req-56b020d4-4b85-443a-8076-056c8bb4af6c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.103083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-398ce3c8-94e1-4b44-b37f-48faa039a508 req-56b020d4-4b85-443a-8076-056c8bb4af6c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.103682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-398ce3c8-94e1-4b44-b37f-48faa039a508 req-56b020d4-4b85-443a-8076-056c8bb4af6c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.116337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-398ce3c8-94e1-4b44-b37f-48faa039a508 req-56b020d4-4b85-443a-8076-056c8bb4af6c service nova] Creating event network-vif-plugged:2dfdf0e8-a84f-4fde-b2ed-33ab6ed779ac for instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb on n-h2-862416-2 Oct 22 03:10:08.123516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-398ce3c8-94e1-4b44-b37f-48faa039a508 req-56b020d4-4b85-443a-8076-056c8bb4af6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044041 Oct 22 03:10:08.125181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 795/1597] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:08.131414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:08.132336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:08.139848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.140704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.141321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.142262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.143033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.144334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.185078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0d9d3f9802454ad8a186ba287fc19510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e2d6ef5d9242119570da553c434958', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:08.186045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] flavor_id is None. Assuming migration. {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 22 03:10:08.187210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 03:10:08.242491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:08.257483 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4558d48b-1a0a-4c11-ab75-9cc2af3a8e84 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1533 microversion: 2.1 time: 0.523261 Oct 22 03:10:08.273553 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 803/1598] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:07 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1533 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:08.283341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:08.284188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] [instance: 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:08.291070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.292344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.292888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.294607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.295179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.296380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.316278 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] HTTP exception thrown: Instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 could not be found. Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Request method failure captured: Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 HTTP/1.1 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17pkbQNKardSFUGYUky7JWEc5F1rA_49YZC_JphBc3SoJ_LWKJcVDZCfixxu8yWmwkrpyujLzjwqNOQpRM3bCh6wtl9U93M9ZyW4uPNIsZmJL05QJhsxGyy3eW8PEasHujnZwmaG1ppBDcFBIRd_Vy4A0waVGmKbKAp2Y8To-vlBY0 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91dd8fc4c5e847d0a2e6bcfa5a47beaf"}]}] Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 91dd8fc4c5e847d0a2e6bcfa5a47beaf Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-806384111 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92bf4559db1f49418a803fa31df435d1 Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-806384111-project Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 could not be found. Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '78da2a1b-d11a-4846-8fc3-3de9ac83b8b4'} Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 could not be found. Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 could not be found. Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:08.319694 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 could not be found. Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] Returning 404 to user: Instance 78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:08.325585 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-278e5706-da21-4892-8d8a-93d1db969c68 tempest-ServerMetadataNegativeTestJSON-806384111 tempest-ServerMetadataNegativeTestJSON-806384111-project] 10.222.0.25 "GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4" status: 404 len: 111 microversion: 2.1 time: 0.048098 Oct 22 03:10:08.327101 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 804/1599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:08 2022] GET /compute/v2.1/servers/78da2a1b-d11a-4846-8fc3-3de9ac83b8b4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:08.331983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:08.332736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:08.340057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.340725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.341279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.342096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.343215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.343925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.619886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:08.639029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:08.641512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:08.643381 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd28855e-ad5f-434f-96ba-d813f448323d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.315185 Oct 22 03:10:08.644465 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 805/1600] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:08 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:08.669381 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c51366af-6c33-4296-aef4-a1ef7ef08553 tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2/action" status: 202 len: 0 microversion: 2.1 time: 0.542706 Oct 22 03:10:08.674090 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 796/1601] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:10:08 2022] POST /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:10:08.674245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:08.674976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:08.680274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:08.681285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:08.687684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.688851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.689866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.690675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.691556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.692174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.693562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.698157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.698815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.699589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:08.704631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:08.705315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:08.919397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:08.930859 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1abf9f04-f644-470e-8e23-6bee39d9066b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1472 microversion: 2.1 time: 0.255267 Oct 22 03:10:08.947258 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 797/1602] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:08 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:09.004933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:09.015537 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b34ac121-a936-4b85-9293-2d1559facf20 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1316 microversion: 2.1 time: 0.347229 Oct 22 03:10:09.033920 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 806/1603] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:08 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:09.106237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:09.106869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:09.118191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:09.118945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:09.119551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:09.120907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:09.121538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:09.122123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:09.286185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:09.286936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:09.295059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:09.295772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:09.296236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:09.297500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:09.297500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:09.297966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:09.728821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:09.740127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32f86861-67c5-45f0-87d4-afa44d52d59d tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1520 microversion: 2.1 time: 0.455186 Oct 22 03:10:09.741181 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 807/1604] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:09 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:09.746099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:09.747547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:09.761861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:09.762372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:09.765381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:09.769038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:09.772062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:09.773288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:09.949581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:09.965282 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-61599d06-c9e3-4e99-8f78-880e1f847fe0 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1514 microversion: 2.1 time: 0.866163 Oct 22 03:10:09.966189 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 798/1605] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:09 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1514 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:09.970861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:09.971380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:09.988747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:09.989584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:09.990221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:09.991121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:09.991748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:09.993630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.057238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:10:10.141089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:10.156600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:10.160253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:10.165491 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-742df73d-0413-4de0-bc14-c9dfb1e0a52c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.423066 Oct 22 03:10:10.172277 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 808/1606] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:09 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:10.172277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:10.179799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:10.190244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:10.192960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:10.193655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.194583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:10.196809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:10.199421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.298753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a27239b6-d212-425b-a0c1-1e770da1e2a1 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 204 len: 0 microversion: 2.1 time: 0.331163 Oct 22 03:10:10.299404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 799/1607] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:09 2022] DELETE /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:10:10.316745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:10.320802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:10.338693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:10.342502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:10.342669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.343534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:10.345108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:10.345805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.653587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:10.664994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:10.665988 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf4fa780-65e6-4664-a8bf-d582a8c932c1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1466 microversion: 2.1 time: 0.365306 Oct 22 03:10:10.666897 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 800/1608] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:10 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1466 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:10.675527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:10.675694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:10.685612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:10.686102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:10.686539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.687251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:10.687706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:10.688181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.691054 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f54746be-5c93-422d-9ae8-9f6721327203 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1472 microversion: 2.1 time: 0.523545 Oct 22 03:10:10.691712 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 809/1609] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:10 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1472 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:10.697240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:10.697863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:10.714636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:10.715582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:10.716452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.717344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:10.717975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:10.718571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:10.940039 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bba96eb0-a36a-443e-80a5-3c6dc9ac9a42 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1617 microversion: 2.1 time: 0.247304 Oct 22 03:10:10.942181 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 810/1610] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:10 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1617 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:11.014889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:11.016938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:11.032599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.033476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.039444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.041262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.042108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.043029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.202654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:11.212956 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-12e711d0-9678-4a9c-abea-b05677e9c34f tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1472 microversion: 2.1 time: 0.205130 Oct 22 03:10:11.220526 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 811/1611] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:11 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:11.236511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d204f606-566e-460e-a9b8-e33bb8b997c1 req-57cd3fe4-2fbf-46e9-850a-f031ca4fa48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1eecd3-ae18-4f16-87e9-04f47f3d7272", "name": "network-vif-deleted", "tag": "1a713d54-9d07-4a3d-addc-61b67a2d57a3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:11.257182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d204f606-566e-460e-a9b8-e33bb8b997c1 req-57cd3fe4-2fbf-46e9-850a-f031ca4fa48f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.265871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d204f606-566e-460e-a9b8-e33bb8b997c1 req-57cd3fe4-2fbf-46e9-850a-f031ca4fa48f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.266952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d204f606-566e-460e-a9b8-e33bb8b997c1 req-57cd3fe4-2fbf-46e9-850a-f031ca4fa48f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.300835 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d204f606-566e-460e-a9b8-e33bb8b997c1 req-57cd3fe4-2fbf-46e9-850a-f031ca4fa48f service nova] Creating event network-vif-deleted:1a713d54-9d07-4a3d-addc-61b67a2d57a3 for instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 on n-h1-862416-2 Oct 22 03:10:11.305936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:11.315140 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0d925e86-b5fe-41aa-80f7-ef003af4e5dc tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1526 microversion: 2.1 time: 0.647185 Oct 22 03:10:11.315738 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 801/1612] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:10 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1526 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:11.316303 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d204f606-566e-460e-a9b8-e33bb8b997c1 req-57cd3fe4-2fbf-46e9-850a-f031ca4fa48f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091285 Oct 22 03:10:11.318636 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 812/1613] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:11.332296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1020457659", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["5073feec-6b6f-4858-99ba-438ab7362ee2"]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:11.336507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:11.337171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:11.348359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.350180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.352044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.353970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.354564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.355334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.441084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:10:11.681376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:11.697533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:11.704779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:11.716450 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-823cb555-c3bd-49e4-a149-5630d7354f81 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.397289 Oct 22 03:10:11.730997 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 802/1614] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:11 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:11.730997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-37f15fcf-2f18-4053-894e-6aede34fc110 req-0704208c-136f-4548-a87a-8b54616d5929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e341b78-1feb-458c-9b12-042b60a97b81", "name": "network-vif-plugged", "status": "completed", "tag": "489d3c18-0fea-44fe-a23b-f6be79f1bb71"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:11.757917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-37f15fcf-2f18-4053-894e-6aede34fc110 req-0704208c-136f-4548-a87a-8b54616d5929 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.772929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-37f15fcf-2f18-4053-894e-6aede34fc110 req-0704208c-136f-4548-a87a-8b54616d5929 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.773388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-37f15fcf-2f18-4053-894e-6aede34fc110 req-0704208c-136f-4548-a87a-8b54616d5929 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.808054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-37f15fcf-2f18-4053-894e-6aede34fc110 req-0704208c-136f-4548-a87a-8b54616d5929 service nova] Creating event network-vif-plugged:489d3c18-0fea-44fe-a23b-f6be79f1bb71 for instance 9e341b78-1feb-458c-9b12-042b60a97b81 on n-h1-862416-2 Oct 22 03:10:11.858949 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-37f15fcf-2f18-4053-894e-6aede34fc110 req-0704208c-136f-4548-a87a-8b54616d5929 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135690 Oct 22 03:10:11.859618 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 803/1615] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:11.886073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:11.887273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:11.907892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.913408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.918073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.920151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.920941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.921895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.958107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:10:11.958733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:10:11.959477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:10:11.959994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:10:11.960560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:10:11.980616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.985170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.988541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:11.991229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:11.994412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:11.995262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:12.032514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:10:12.051340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:10:12.073983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:12.090132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:10:12.093039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:10:12.227258 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-211c11c1-eeaf-45ef-b69c-82b80c0d142c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906366 Oct 22 03:10:12.237433 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 813/1616] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:10:12.252251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:12.253166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:12.265358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:12.268083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:12.272593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:12.273538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:12.275872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:12.276641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:12.358564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:12.359359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:12.360135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:12.360854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lazy-loading 'fault' on Instance uuid cb1eecd3-ae18-4f16-87e9-04f47f3d7272 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:12.452604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:12.461336 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ff0e1d1-daa0-44ec-bbe4-f2cc06efb205 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1308 microversion: 2.1 time: 0.220211 Oct 22 03:10:12.462117 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 814/1617] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:12 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:12.466620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-70e95d5f-93c7-4779-b58e-010f0f5d265b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:12.481851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-70e95d5f-93c7-4779-b58e-010f0f5d265b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:12.627067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:12.639755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f7d20216-142a-4ef0-8aab-b5180eaf0b2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1472 microversion: 2.1 time: 0.764624 Oct 22 03:10:12.646316 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 804/1618] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:11 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1472 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:12.659666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:12.660945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:12.676086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:12.683217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:12.687168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:12.688186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:12.688850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:12.689469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:13.308185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-70e95d5f-93c7-4779-b58e-010f0f5d265b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:13.320321 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-70e95d5f-93c7-4779-b58e-010f0f5d265b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1217 microversion: 2.1 time: 0.854537 Oct 22 03:10:13.321114 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 815/1619] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:12 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1217 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:13.334552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:13.335171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:13.351216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:13.351710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:13.352140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:13.356733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:13.358308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:13.360344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:13.365342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:13.369228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:13.375280 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33ec07d2-ed32-43a9-80cc-01e130db06ec tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1526 microversion: 2.1 time: 0.727636 Oct 22 03:10:13.378708 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 805/1620] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:12 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1526 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:13.485101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:13.485717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:13.497021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:13.497515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:13.498045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:13.498777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:13.499277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:13.499709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:13.591489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:13.591993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:13.592466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:13.596148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lazy-loading 'fault' on Instance uuid cb1eecd3-ae18-4f16-87e9-04f47f3d7272 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:13.830874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:13.851054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f2d3416-8bf4-439b-83f8-54c5a726a394 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 200 len: 1308 microversion: 2.1 time: 0.369351 Oct 22 03:10:13.857549 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 806/1621] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:13 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:13.868178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:13.869133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:13.879238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:13.879827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:13.880648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:13.881598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:13.882318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:13.882969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:13.960525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:13.973614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:13.977000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:13.979685 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-48bf9944-4130-4956-a491-eae7bd241c86 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.656027 Oct 22 03:10:13.995186 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 816/1622] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:13 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:14.010605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-aca8c628-6788-445f-9cb4-d2a5350227bb req-255c35e4-d598-413a-8cbc-60247f9b8474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e341b78-1feb-458c-9b12-042b60a97b81", "name": "network-vif-unplugged", "status": "completed", "tag": "489d3c18-0fea-44fe-a23b-f6be79f1bb71"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:14.041664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aca8c628-6788-445f-9cb4-d2a5350227bb req-255c35e4-d598-413a-8cbc-60247f9b8474 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:14.043892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aca8c628-6788-445f-9cb4-d2a5350227bb req-255c35e4-d598-413a-8cbc-60247f9b8474 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:14.046180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aca8c628-6788-445f-9cb4-d2a5350227bb req-255c35e4-d598-413a-8cbc-60247f9b8474 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:14.067273 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-aca8c628-6788-445f-9cb4-d2a5350227bb req-255c35e4-d598-413a-8cbc-60247f9b8474 service nova] Creating event network-vif-unplugged:489d3c18-0fea-44fe-a23b-f6be79f1bb71 for instance 9e341b78-1feb-458c-9b12-042b60a97b81 on n-h1-862416-2 Oct 22 03:10:14.073313 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-aca8c628-6788-445f-9cb4-d2a5350227bb req-255c35e4-d598-413a-8cbc-60247f9b8474 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076823 Oct 22 03:10:14.074684 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 817/1623] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:14.348068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:14.349732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:14.366931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:14.367799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:14.368599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:14.369788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:14.370497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:14.371091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:14.733122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:14.735027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:14.741974 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a286608-39e1-489f-ba2a-4c65e442a285 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1472 microversion: 2.1 time: 0.882996 Oct 22 03:10:14.743314 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 807/1624] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:13 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1472 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:14.748623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:14.749429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:14.759024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:14.759255 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3c62d38-964a-48a9-91bf-7aed91a02c33 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1269 microversion: 2.1 time: 0.418965 Oct 22 03:10:14.759936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:14.760262 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 818/1625] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:14 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1269 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:14.761055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:14.761920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:14.762523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:14.763313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:14.765186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-be7be13a-f83e-411c-b1ad-4e98c0f234c4 req-4be0a7a7-3b63-4973-a663-0ceaaf41b8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e341b78-1feb-458c-9b12-042b60a97b81", "name": "network-vif-deleted", "tag": "489d3c18-0fea-44fe-a23b-f6be79f1bb71"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:14.787684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be7be13a-f83e-411c-b1ad-4e98c0f234c4 req-4be0a7a7-3b63-4973-a663-0ceaaf41b8f3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:14.791942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be7be13a-f83e-411c-b1ad-4e98c0f234c4 req-4be0a7a7-3b63-4973-a663-0ceaaf41b8f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:14.792484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be7be13a-f83e-411c-b1ad-4e98c0f234c4 req-4be0a7a7-3b63-4973-a663-0ceaaf41b8f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:14.820357 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-be7be13a-f83e-411c-b1ad-4e98c0f234c4 req-4be0a7a7-3b63-4973-a663-0ceaaf41b8f3 service nova] Creating event network-vif-deleted:489d3c18-0fea-44fe-a23b-f6be79f1bb71 for instance 9e341b78-1feb-458c-9b12-042b60a97b81 on n-h1-862416-2 Oct 22 03:10:14.833914 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-be7be13a-f83e-411c-b1ad-4e98c0f234c4 req-4be0a7a7-3b63-4973-a663-0ceaaf41b8f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070609 Oct 22 03:10:14.836579 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 819/1626] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:14.883349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:14.884378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: cb1eecd3-ae18-4f16-87e9-04f47f3d7272] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:14.890924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:14.891597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:14.892355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:14.893518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:14.893918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:14.894666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:14.915600 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] HTTP exception thrown: Instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 could not be found. Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Request method failure captured: Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 HTTP/1.1 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU15EvF7g1zEFnsumEiRh1CCitMvfrw7D_BlRjELkZyAy73cqU-dJZyM8ObSepXghqoj8vfI3o4U_6khBvOQBV7YOH3erlgwU_PsVKUmv8neFobI_VjSjC7iYZhUvoYvZVJ6GZJ6hOQ8alRheuUStHDf5I3Zjj-rbVhEFGjTfcI7itkM Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 302763f239654e49a981355dd63bc6f7 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesAdminNegativeTest-704975395 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_302763f239654e49a981355dd63bc6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/302763f239654e49a981355dd63bc6f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/302763f239654e49a981355dd63bc6f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/302763f239654e49a981355dd63bc6f7"}]}] Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesAdminNegativeTest-704975395 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 302763f239654e49a981355dd63bc6f7 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-704975395 Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesAdminNegativeTest-704975395-project Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ebe78fc7afed43e496e0be24a021dffa Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesAdminNegativeTest-704975395-project Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 could not be found. Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'cb1eecd3-ae18-4f16-87e9-04f47f3d7272'} Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 could not be found. Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 could not be found. Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:14.917422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:14.922019 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:14.922019 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:14.922019 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:14.922019 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:14.922019 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:14.922019 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 could not be found. Oct 22 03:10:14.922019 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:14.924055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Returning 404 to user: Instance cb1eecd3-ae18-4f16-87e9-04f47f3d7272 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:14.925218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a248d72b-eeb2-4c0c-8a13-e780c07c72ae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272" status: 404 len: 111 microversion: 2.1 time: 0.046552 Oct 22 03:10:14.926333 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 820/1627] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:14 2022] GET /compute/v2.1/servers/cb1eecd3-ae18-4f16-87e9-04f47f3d7272 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:10:14.959092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:14.967902 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-04a25c4a-cda0-4884-9af4-5bbd7dc14cb8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1484 microversion: 2.1 time: 0.222974 Oct 22 03:10:14.983977 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 808/1628] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:14 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1484 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:15.013748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:15.014373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:15.041637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:15.051780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:15.054449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:15.055439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:15.057741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:15.058507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:15.616723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:15.626995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:15.628488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:15.639364 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6466ec0e-b8f0-4ea8-8797-1cbc0379d8bc tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.621768 Oct 22 03:10:15.640018 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 821/1629] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:15 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:15.798880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:15.800749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:15.808229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:15.808677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:15.835235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:15.840648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:15.841501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:15.842230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:15.843050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:15.844919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:15.845943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:15.846747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:15.849098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:15.850148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:15.851204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:15.855181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:16.163678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:16.177668 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-572b3ba2-19ce-404e-a300-deff67c71771 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1275 microversion: 2.1 time: 0.392730 Oct 22 03:10:16.178262 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 809/1630] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:15 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1275 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:16.196808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:16.197346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:16.209109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:16.209604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:16.210041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:16.210759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:16.211206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:16.221237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:16.302869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:16.312658 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-709c183f-8150-4805-8dff-7be569042290 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.524183 Oct 22 03:10:16.324251 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 822/1631] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:15 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:16.384848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:16.392621 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6eeca3e-d176-4ec5-959c-5dcf1e80d4d7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1310 microversion: 2.1 time: 0.213336 Oct 22 03:10:16.398636 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 810/1632] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:16 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1310 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:16.668550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:16.669237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:16.689135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:16.689918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:16.693581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:16.694684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:16.695496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:16.696107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:16.738961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:16.983426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:16.994963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:16.996819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:16.999440 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ff88ed8-2dbd-4e1f-a399-52cca739c9e4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.335642 Oct 22 03:10:17.000666 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 823/1633] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:16 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:17.204681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:17.205403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:17.219036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:17.219705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:17.220680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:17.222109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:17.222799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:17.223455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:17.345292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:17.346004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:17.359777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:17.360558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:17.361390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:17.362179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:17.370107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:17.372280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:17.487485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:17.502071 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-62865d2b-1785-405a-8c76-f092fdf8ac8e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1275 microversion: 2.1 time: 0.301362 Oct 22 03:10:17.509770 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 811/1634] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:17 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1275 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:17.529238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:17.530082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:17.550745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:17.555261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:17.556041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:17.557055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:17.568010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:17.568920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:17.672263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:17.675904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:17.676582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:17.680062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lazy-loading 'fault' on Instance uuid 9e341b78-1feb-458c-9b12-042b60a97b81 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:17.781002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:17.807399 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4e84a9d5-d634-499d-8631-56701e601a45 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.463182 Oct 22 03:10:17.822052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:17.822175 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 824/1635] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:17 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:17.830213 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c42480dd-b74b-42a6-b5f7-96c308bf0678 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 200 len: 1315 microversion: 2.1 time: 0.317317 Oct 22 03:10:17.831177 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 812/1636] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:17 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:18.028153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:18.028877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:18.040973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:18.047807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:18.049737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:18.050635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:18.051348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:18.054107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:18.123881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-809ecdb2-e8fa-463d-a004-72cbf710a4ff req-da82212b-4822-449e-95e8-6ea4873e5ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a218e3e3-6082-4b65-8edb-b406c7cd582f", "name": "network-vif-unplugged", "status": "completed", "tag": "b0191679-9c81-4ff7-8391-549473bf995c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:18.142691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-809ecdb2-e8fa-463d-a004-72cbf710a4ff req-da82212b-4822-449e-95e8-6ea4873e5ddb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:18.145253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-809ecdb2-e8fa-463d-a004-72cbf710a4ff req-da82212b-4822-449e-95e8-6ea4873e5ddb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:18.148704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-809ecdb2-e8fa-463d-a004-72cbf710a4ff req-da82212b-4822-449e-95e8-6ea4873e5ddb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:18.209406 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-809ecdb2-e8fa-463d-a004-72cbf710a4ff req-da82212b-4822-449e-95e8-6ea4873e5ddb service nova] Creating event network-vif-unplugged:b0191679-9c81-4ff7-8391-549473bf995c for instance a218e3e3-6082-4b65-8edb-b406c7cd582f on n-h2-862416-2 Oct 22 03:10:18.225360 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-809ecdb2-e8fa-463d-a004-72cbf710a4ff req-da82212b-4822-449e-95e8-6ea4873e5ddb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103783 Oct 22 03:10:18.228231 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 813/1637] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:10:18.528239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:18.529454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:18.548309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:18.549711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:18.551855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:18.553105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:18.554982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:18.558001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:18.589548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:18.606118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:18.612475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:18.616188 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d90509be-c891-4846-acc6-c6df96ee23a3 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.592437 Oct 22 03:10:18.633145 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 825/1638] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:18 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:18.836605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:18.837701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:18.853575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:18.854082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:18.857769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:18.861744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:18.862531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:18.866531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:19.094986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:19.107741 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a88f267c-c043-4d8b-a9e1-b8f3f5afec2b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.276107 Oct 22 03:10:19.109390 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 826/1639] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:18 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:19.114906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:19.115848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:19.123060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:19.123915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:19.124656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:19.125634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:19.126319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:19.127098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:19.157662 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 HTTP/1.1 Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '9e341b78-1feb-458c-9b12-042b60a97b81'} Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:19.161716 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:19.167186 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:19.167186 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:19.167186 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:19.167186 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:19.167186 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:19.167186 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:19.167186 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:19.167186 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:19.169732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:19.172369 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bca25c50-9ba0-446d-b0cd-6bc9803f4abe tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 404 len: 111 microversion: 2.1 time: 0.061439 Oct 22 03:10:19.175905 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 827/1640] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:19 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:19.404512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1266152606", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:19.412139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:19.424637 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7bac16b5-d3fa-44ed-84ee-a270c85f8185 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1275 microversion: 2.1 time: 0.900603 Oct 22 03:10:19.429474 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 814/1641] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:18 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1275 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:19.531952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] validate_networks() for [('cf26895c-54d3-4fb2-acdc-7bfa0bf6e9b9', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:10:19.649921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:19.650536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:19.665695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:19.666196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:19.666639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:19.672958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:19.673459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:19.673919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:20.296883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:10:20.297491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:10:20.299380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:10:20.300524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:10:20.301222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:10:20.318689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:20.320071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:20.320580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:20.322182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:20.322793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:20.323413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:20.391834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Getting quotas for project 7979873b22324dea968909a57ebd877d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:10:20.405497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:20.411494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Getting quotas for user 39c6c1ad05a646029048f3a61df874c4 and project 7979873b22324dea968909a57ebd877d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:10:20.415112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:20.423246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:20.425556 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a898d0ef-65c4-4f08-be6c-944a3eb8bbcd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.781459 Oct 22 03:10:20.437230 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 815/1642] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:19 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:10:20.441989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:20.443592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:20.465710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:10:20.467508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:20.468014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:20.468477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:20.469193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:20.469651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:20.470074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:20.477545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:10:20.590556 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-edb371d5-95a9-4651-a8c1-6fb23732c322 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.190321 Oct 22 03:10:20.599283 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 828/1643] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:10:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:10:20.609332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:20.610312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:20.627556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:20.628416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:20.629049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:20.630131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:20.631515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:20.632308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:20.917243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:20.931200 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-594badc7-7a18-4937-8a34-adf79ee3dea3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.330457 Oct 22 03:10:20.933661 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 829/1644] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:20 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:20.946725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2a9ee6f2-3815-420c-b257-ad555d0f8dd7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:20.948727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2a9ee6f2-3815-420c-b257-ad555d0f8dd7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:21.070279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a9ee6f2-3815-420c-b257-ad555d0f8dd7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:21.080749 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2a9ee6f2-3815-420c-b257-ad555d0f8dd7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1225 microversion: 2.1 time: 0.145916 Oct 22 03:10:21.089795 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 830/1645] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:20 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:21.094743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:21.095490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:21.108772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:21.109554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:21.110184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:21.111107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:21.111861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:21.112656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:21.173993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:10:21.359657 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a23b5f94-fe05-4f8c-9191-cc2a7f361899 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 204 len: 0 microversion: 2.1 time: 0.268304 Oct 22 03:10:21.361775 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 831/1646] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:21 2022] DELETE /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:10:21.379284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:21.381476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:21.397864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:21.399069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:21.400055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:21.401321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:21.402135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:21.402854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:21.668952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:21.706216 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e350bc0d-c297-4afe-81ea-3362c0910601 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 1.264376 Oct 22 03:10:21.710121 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 816/1647] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:20 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:21.733230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:21.733906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:21.747237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:21.747764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:21.759768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:21.761821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:21.765254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:21.766087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:21.766825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:21.779021 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-059afd95-4f0d-4bb9-9fda-7c86041f3c19 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1683 microversion: 2.1 time: 0.411416 Oct 22 03:10:21.780531 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 832/1648] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:21 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1683 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:22.017553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-307322209", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": "none"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:22.125510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:10:22.126258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:10:22.126964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:10:22.128107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:10:22.128804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:10:22.141654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.142379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.143051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.144404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.145061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.146917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.169167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Getting quotas for project e0d52ab3a1a94b57aaf1516648901c71. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:10:22.175253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Getting quotas for user 33b584dfb29e4db39f7a9108a5b1f80a and project e0d52ab3a1a94b57aaf1516648901c71. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:10:22.191698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:10:22.196709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:10:22.267688 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6e76757-5246-4e18-863d-2ed87a0e5a1b tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.457274 Oct 22 03:10:22.276386 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 833/1649] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 22 03:10:22.283506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:22.284369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:22.294052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.294811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.295468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.296496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.297177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.297812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.545814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:22.556437 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6fd92db-2aab-4a69-96ff-071231a4a314 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.277332 Oct 22 03:10:22.558107 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 834/1650] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:22 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:22.576436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:22.576986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:22.587600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.588722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.589457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.590421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.591031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.591636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.663223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:22.663607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:22.673043 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bcb72f39-c6bf-4154-8513-82ba818187ff tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1277 microversion: 2.1 time: 0.113144 Oct 22 03:10:22.674499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 835/1651] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:22 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:22.675707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:22.679195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:22.680420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48899cdb-1ab3-4712-9d02-3e3df15ec01a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.969022 Oct 22 03:10:22.681452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 817/1652] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:21 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:22.682058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05087de3-76da-4110-8a24-92e90a13b724 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:22.682743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-05087de3-76da-4110-8a24-92e90a13b724 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:22.734305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:22.735224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:22.750457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.753546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.755229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.758217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.759047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.760897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.764347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-05087de3-76da-4110-8a24-92e90a13b724 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:22.774000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-05087de3-76da-4110-8a24-92e90a13b724 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:22.776008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-05087de3-76da-4110-8a24-92e90a13b724 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:22.778068 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-05087de3-76da-4110-8a24-92e90a13b724 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1277 microversion: 2.54 time: 0.101180 Oct 22 03:10:22.799995 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 836/1653] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:22 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:22.811823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-152ebfc1-da2d-43b2-8c90-66fc26ab7ac5 req-7fe207e6-85a6-430c-9340-46cc6011ce91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a218e3e3-6082-4b65-8edb-b406c7cd582f", "tag": "b0191679-9c81-4ff7-8391-549473bf995c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:22.842036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-152ebfc1-da2d-43b2-8c90-66fc26ab7ac5 req-7fe207e6-85a6-430c-9340-46cc6011ce91 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.842526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-152ebfc1-da2d-43b2-8c90-66fc26ab7ac5 req-7fe207e6-85a6-430c-9340-46cc6011ce91 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.842960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-152ebfc1-da2d-43b2-8c90-66fc26ab7ac5 req-7fe207e6-85a6-430c-9340-46cc6011ce91 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.876106 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-152ebfc1-da2d-43b2-8c90-66fc26ab7ac5 req-7fe207e6-85a6-430c-9340-46cc6011ce91 service nova] Creating event network-changed:b0191679-9c81-4ff7-8391-549473bf995c for instance a218e3e3-6082-4b65-8edb-b406c7cd582f on n-h2-862416-2 Oct 22 03:10:22.882751 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-152ebfc1-da2d-43b2-8c90-66fc26ab7ac5 req-7fe207e6-85a6-430c-9340-46cc6011ce91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081332 Oct 22 03:10:22.884058 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 837/1654] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:22.890327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:22.891356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:22.900471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.901267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.902694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:22.903864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:22.904593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:22.905249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:23.171936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:23.184039 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3128e21b-a75e-4a50-8cfc-8f6c0624b057 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1683 microversion: 2.1 time: 0.298441 Oct 22 03:10:23.188903 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 838/1655] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:22 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1683 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:23.580931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:23.581614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:23.585289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:23.590099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:23.590601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:23.591048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:23.591769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:23.592248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:23.592673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:23.753516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:23.763948 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b448b28a-ae36-4f42-87aa-542a486002d9 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.186847 Oct 22 03:10:23.764630 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 839/1656] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:23 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:23.772102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:23.772896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:23.779873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:23.780613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:23.781184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:23.782358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:23.782770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:23.783236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:23.816394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:23.826748 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-974445e8-de90-4e5c-bf21-9fd61dbeb274 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 1.099104 Oct 22 03:10:23.827909 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 818/1657] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:22 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:23.846230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:23.847202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:23.857519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:23.857724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:23.858343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:23.859240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:23.859710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:23.860114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.028751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:24.064086 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bdf94c7c-cf89-44fd-be72-c4f949d3a6fa tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1283 microversion: 2.1 time: 0.234540 Oct 22 03:10:24.071820 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 819/1658] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:23 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1283 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:24.081385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:24.081995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:24.090002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.090497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.090934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.092129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.092696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.093128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.267413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:24.288055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:24.293932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:24.295314 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15b0cad7-b5c1-4bc6-a20e-a3e381c1d48d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1329 microversion: 2.54 time: 0.222390 Oct 22 03:10:24.309677 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 820/1659] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:24 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1329 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:24.324869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:24.337368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:24.339617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:24.339919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:24.343502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:24.347002 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-970d9b5d-c205-464c-aa70-c14f71af59a0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.581116 Oct 22 03:10:24.348937 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 840/1660] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:23 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:24.360355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:24.360981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:24.373944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.374766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.375212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.376758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.377236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.377387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.377743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.378411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.379495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.381091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.382865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.383787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.443105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:10:24.504383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:24.588994 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab4f4590-178d-415e-a5cf-895221fc0660 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 204 len: 0 microversion: 2.1 time: 0.266266 Oct 22 03:10:24.591545 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 821/1661] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:24 2022] DELETE /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:10:24.610461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:24.612265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:24.621805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.624437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.625391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.626479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.628067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.628774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.894147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:24.916552 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c707102e-180b-430e-b7d8-da294795d94b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1713 microversion: 2.1 time: 0.317255 Oct 22 03:10:24.919827 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 822/1662] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:24 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1713 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:24.931733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:24.933061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:24.942189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.943788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.944321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:24.945381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:24.945744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:24.946156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.202156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:25.217841 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0959b70d-7c2e-4608-9aee-a100f9b0cb83 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1683 microversion: 2.1 time: 0.865397 Oct 22 03:10:25.223545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:25.235621 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 841/1663] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:24 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1683 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:25.240084 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c6d4a670-6fab-4be0-8935-1327e04b3a89 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.318785 Oct 22 03:10:25.244676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:25.246392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:25.251336 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 823/1664] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:24 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:25.260626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-054dd719-0ea8-4afd-bd46-f4bcdc112f1e req-f7e74e11-0bf7-4135-9fcc-9ac173553b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea729a44-09fe-4297-a04f-c433bbefa3a2", "tag": "bd6ed333-9ffb-4a1b-a196-43fdbfe8753e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:25.269900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:25.273115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-054dd719-0ea8-4afd-bd46-f4bcdc112f1e req-f7e74e11-0bf7-4135-9fcc-9ac173553b21 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.273818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-054dd719-0ea8-4afd-bd46-f4bcdc112f1e req-f7e74e11-0bf7-4135-9fcc-9ac173553b21 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.274401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-054dd719-0ea8-4afd-bd46-f4bcdc112f1e req-f7e74e11-0bf7-4135-9fcc-9ac173553b21 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.277085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.277591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.278036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.278758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.279219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.279654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.290012 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-054dd719-0ea8-4afd-bd46-f4bcdc112f1e req-f7e74e11-0bf7-4135-9fcc-9ac173553b21 service nova] Creating event network-changed:bd6ed333-9ffb-4a1b-a196-43fdbfe8753e for instance ea729a44-09fe-4297-a04f-c433bbefa3a2 on n-h2-862416-2 Oct 22 03:10:25.295363 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-054dd719-0ea8-4afd-bd46-f4bcdc112f1e req-f7e74e11-0bf7-4135-9fcc-9ac173553b21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042169 Oct 22 03:10:25.300637 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 824/1665] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:25.306369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:25.307301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:25.314230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.314792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.315492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.316391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.317601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.318295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.516932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:25.525449 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-09aa94cb-6e5f-4da6-9e40-48b36ba447ae tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1325 microversion: 2.1 time: 0.223145 Oct 22 03:10:25.526145 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 825/1666] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:25 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:25.530678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:25.531436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:25.539166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.539657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.540087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.540841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.541299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.541853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.616132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:25.625228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:25.626767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:25.627911 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-17d6c844-4d0c-4e7e-b0e9-d26da548730c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1335 microversion: 2.54 time: 0.100757 Oct 22 03:10:25.628517 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 826/1667] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:25 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:25.671430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:25.675158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:25.681865 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1627bd6-0e0e-4efb-a92e-7deaddacf688 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.444036 Oct 22 03:10:25.683226 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 842/1668] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:25 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:25.777362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:25.782741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:25.796897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.797734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.798276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.799086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.799642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.800357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.946808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:25.947577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:25.956975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.959650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.960425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:25.961621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:25.962497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:25.963150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.120428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.143753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.145669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.147310 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e969decf-bb30-4197-8ab1-7db9e1fe3d58 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.517871 Oct 22 03:10:26.147923 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 827/1669] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:25 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:26.245299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:26.247011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:26.256986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.257782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.258050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.258950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.259572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.261357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.417942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.429254 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0db48c7a-cdd7-4cff-af65-38276b30ebe1 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1616 microversion: 2.1 time: 0.189804 Oct 22 03:10:26.440235 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 828/1670] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:26 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1616 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:26.440235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:26.440235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:26.448498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.448498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.448498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.448498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.448498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.449082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.449548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.455537 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65f878ab-9950-47dd-ab1d-661cd33e9b80 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1713 microversion: 2.1 time: 0.512618 Oct 22 03:10:26.485532 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 843/1671] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:25 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1713 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:26.552258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:26.554586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:26.568770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.569612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.570531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.571796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.572811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.573524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.783993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.792829 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e427142b-72f8-42dd-85d1-41f57d8ef0d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.361012 Oct 22 03:10:26.793580 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 829/1672] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:26 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:26.814390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:26.815215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:26.822183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.822680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.823113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.823813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.824287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.824714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.926984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.940309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.945000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.946443 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4af10bb-1c0a-42f3-832f-cf99d059e4ea tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1335 microversion: 2.54 time: 0.136594 Oct 22 03:10:26.947541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 830/1673] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:26 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1335 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:26.952885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:26.954210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:26.955446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:26.964671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.965424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.965962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.966811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:26.967392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:26.968251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:26.968497 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e2aaec6-2792-4ed1-9338-2f280e770974 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1325 microversion: 2.1 time: 0.421251 Oct 22 03:10:26.969460 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 844/1674] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:26 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:26.983526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-62258516-6ef4-4701-8a21-44784d0af155 req-1ae32e3f-a24b-44d5-86ff-b0e69e1a64dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593d2c59-795e-4dc7-8200-56b449d7b066", "name": "network-vif-deleted", "tag": "1073dea1-b453-42fd-b459-d11d3ff92c57"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:27.017055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-62258516-6ef4-4701-8a21-44784d0af155 req-1ae32e3f-a24b-44d5-86ff-b0e69e1a64dd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:27.017804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-62258516-6ef4-4701-8a21-44784d0af155 req-1ae32e3f-a24b-44d5-86ff-b0e69e1a64dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:27.019636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-62258516-6ef4-4701-8a21-44784d0af155 req-1ae32e3f-a24b-44d5-86ff-b0e69e1a64dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:27.054442 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-62258516-6ef4-4701-8a21-44784d0af155 req-1ae32e3f-a24b-44d5-86ff-b0e69e1a64dd service nova] Creating event network-vif-deleted:1073dea1-b453-42fd-b459-d11d3ff92c57 for instance 593d2c59-795e-4dc7-8200-56b449d7b066 on n-h2-862416-2 Oct 22 03:10:27.059951 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-62258516-6ef4-4701-8a21-44784d0af155 req-1ae32e3f-a24b-44d5-86ff-b0e69e1a64dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087997 Oct 22 03:10:27.061196 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 845/1675] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:27.179828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:27.181155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:27.196918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:27.197427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:27.200187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:27.202829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:27.203337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:27.204822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:27.766300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:27.834701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:27.856242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:27.858251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:27.866082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a0e40e3-b6af-4765-8d23-8e33bb9aef35 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.916851 Oct 22 03:10:27.868025 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be4ab9fb-741d-4603-95c7-6bd511a2c72c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.691901 Oct 22 03:10:27.868503 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 831/1676] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:26 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:27.876901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:27.881230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:27.888866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:27.892414 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 846/1677] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:27 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:27.892815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:27.893272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:27.894006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:27.894471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:27.894916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:27.907941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:27.910405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:27.927555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:27.928725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:27.929419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:27.930409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:27.931035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:27.933889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:27.980247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:27.980755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:27.981205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:27.981667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lazy-loading 'fault' on Instance uuid 593d2c59-795e-4dc7-8200-56b449d7b066 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:28.046676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:28.068562 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2f7ff30b-54d2-4957-9ede-dd846b40daae tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1332 microversion: 2.1 time: 0.198766 Oct 22 03:10:28.080233 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 832/1678] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:27 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1332 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:28.092600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:28.093898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:28.106523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:28.107409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:28.108280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:28.109522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:28.117635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:28.118493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:28.657540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:28.667149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-61649719-e139-422f-808b-dd7029ce04d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.596420 Oct 22 03:10:28.667959 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 833/1679] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:28 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:28.672583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:28.673196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:28.681285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:28.682090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:28.682932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:28.683996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:28.684991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:28.685784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:28.765129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:28.775353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:28.776847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:28.778263 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-112cc8b8-ca37-4c20-9463-19b0aea0210a tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1356 microversion: 2.54 time: 0.109525 Oct 22 03:10:28.778920 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 834/1680] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:28 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:28.783450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:28.784056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:28.794858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:28.795552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:28.796188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:28.797096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:28.797722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:28.798313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:28.824833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:28.837275 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd0746e1-b36f-4209-88ec-9ecab5d322b2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1713 microversion: 2.1 time: 0.943068 Oct 22 03:10:28.838290 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 847/1681] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:27 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1713 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:28.843734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f6ec38da-d12d-4491-a504-2bbb69e2edae req-44b6ed88-5678-4266-aa75-3775ab0c9ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394f4c47-2f26-4209-b094-bcf52da83af0", "tag": "bb4934b7-142c-4b3f-aa2e-8b689dcb8892"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:28.862257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f6ec38da-d12d-4491-a504-2bbb69e2edae req-44b6ed88-5678-4266-aa75-3775ab0c9ee5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:28.862733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f6ec38da-d12d-4491-a504-2bbb69e2edae req-44b6ed88-5678-4266-aa75-3775ab0c9ee5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:28.863160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f6ec38da-d12d-4491-a504-2bbb69e2edae req-44b6ed88-5678-4266-aa75-3775ab0c9ee5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:28.881984 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f6ec38da-d12d-4491-a504-2bbb69e2edae req-44b6ed88-5678-4266-aa75-3775ab0c9ee5 service nova] Creating event network-changed:bb4934b7-142c-4b3f-aa2e-8b689dcb8892 for instance 394f4c47-2f26-4209-b094-bcf52da83af0 on n-h1-862416-2 Oct 22 03:10:28.888110 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f6ec38da-d12d-4491-a504-2bbb69e2edae req-44b6ed88-5678-4266-aa75-3775ab0c9ee5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048177 Oct 22 03:10:28.889278 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 848/1682] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:28.899794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-310e4ea5-4f29-4eb5-bc8b-03178463aecd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Action: 'create', calling method: .version_select at 0x7f0d1a0e05e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1127453781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElTtaXIv6D/DQ/oiyma9k0JYbKvmBBwNXMXaWFuEfVzbgSuwauqfcdep4vFMio+X5kWzKz4YuFmCzKKhJwMI7nEkCVPnVDNJe1z8wMVr516yEzH49ZKcY9NgexscQGdfA=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:28.921683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-310e4ea5-4f29-4eb5-bc8b-03178463aecd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Getting quotas for project e0d52ab3a1a94b57aaf1516648901c71. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:10:28.932194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-310e4ea5-4f29-4eb5-bc8b-03178463aecd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Getting quotas for user 33b584dfb29e4db39f7a9108a5b1f80a and project e0d52ab3a1a94b57aaf1516648901c71. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:10:28.968883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:28.981704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-310e4ea5-4f29-4eb5-bc8b-03178463aecd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.090918 Oct 22 03:10:28.982207 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9462d8ae-c822-410e-8fb1-97018c3c8817 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1325 microversion: 2.1 time: 0.202244 Oct 22 03:10:28.998899 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 835/1684] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:28 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1325 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:28.999109 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 849/1684] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:10:28 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 03:10:28.999109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:28.999109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:28.999375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:28.999375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:28.999375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:28.999676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.000328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.001241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.001868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.002467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.006871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.007405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.007843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.008583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.009140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.009569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.161824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:29.170494 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0b019f5b-43e1-4a3d-b567-c34964b1a7f6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.186680 Oct 22 03:10:29.171165 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 836/1685] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:28 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:29.181533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1127453781", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:29.187015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:29.195005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.195561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.196236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.197775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.198403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.199880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.288530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:29.302860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:10:29.303300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:10:29.303782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:10:29.304194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:10:29.304642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:10:29.398195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:29.408291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:29.410065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:29.411655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30c8c66f-5da7-4e72-8085-1b41651451c2 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.427517 Oct 22 03:10:29.425861 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 850/1686] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:28 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:29.427291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:29.436944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.437471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.438134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.438548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:29.439173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:29.440553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.441106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.442256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.446764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.447256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.449374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.450337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.450820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.451257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.491079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a4cdaea-9187-4b13-b04e-2b1694233038 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "POST /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0/action" status: 202 len: 1139 microversion: 2.54 time: 0.317938 Oct 22 03:10:29.507760 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 837/1687] 10.222.0.25 () {62 vars in 1320 bytes} [Sat Oct 22 03:10:29 2022] POST /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0/action => generated 1139 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 03:10:29.507950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.508270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.508703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.509162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lazy-loading 'fault' on Instance uuid 593d2c59-795e-4dc7-8200-56b449d7b066 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:29.515677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:29.518264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:29.532587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.540734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.541234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.541994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.542466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.542893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.615280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:29.617632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:29.624162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:29.625645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:29.626311 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-987224a1-7fa2-46c1-bf67-ba2a91342303 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1332 microversion: 2.1 time: 0.198362 Oct 22 03:10:29.627095 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5db7ed3c-3c62-40bf-800a-35608e14f9fe tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.115644 Oct 22 03:10:29.628039 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 838/1688] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:29 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:10:29.642949 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 851/1689] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:29 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1332 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:29.692610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:29.693618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:29.701495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.702367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.702645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.703459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.704293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.704794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.878387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:29.882643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:29.895825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.899363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.900042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:29.901800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:29.902740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:29.903930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.014153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.025042 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a34d7cd-e817-421d-aaf9-b7d7bed37551 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1645 microversion: 2.1 time: 0.164152 Oct 22 03:10:30.026351 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 852/1690] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:29 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1645 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:30.033554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4e8eb639-34b9-49a6-9c87-617ab4bf00e3 req-6830dcbc-49bc-4b10-b265-e6b66a43c978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a731cdd-ed4e-48e3-b0c4-fcf6794cf976", "name": "network-vif-deleted", "tag": "db134f86-5272-4df0-ae42-1a65e1637773"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:30.047557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4e8eb639-34b9-49a6-9c87-617ab4bf00e3 req-6830dcbc-49bc-4b10-b265-e6b66a43c978 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.048364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4e8eb639-34b9-49a6-9c87-617ab4bf00e3 req-6830dcbc-49bc-4b10-b265-e6b66a43c978 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.049569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4e8eb639-34b9-49a6-9c87-617ab4bf00e3 req-6830dcbc-49bc-4b10-b265-e6b66a43c978 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.067781 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4e8eb639-34b9-49a6-9c87-617ab4bf00e3 req-6830dcbc-49bc-4b10-b265-e6b66a43c978 service nova] Creating event network-vif-deleted:db134f86-5272-4df0-ae42-1a65e1637773 for instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 on n-h2-862416-2 Oct 22 03:10:30.076016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.076572 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4e8eb639-34b9-49a6-9c87-617ab4bf00e3 req-6830dcbc-49bc-4b10-b265-e6b66a43c978 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047989 Oct 22 03:10:30.081646 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 853/1691] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:30.087604 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f35d30ec-39f1-45d1-9c1e-dc7ea8336c05 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.399831 Oct 22 03:10:30.089437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:30.090144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:30.098272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.099635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.100305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.101738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.102060 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 839/1692] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:29 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:30.102429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.103088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.195176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:30.195793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:30.209140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.209638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.210082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.210802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.211268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.213465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.332236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.341195 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3750142-8c32-49f4-bf23-75ff2d75f7c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1325 microversion: 2.1 time: 0.257699 Oct 22 03:10:30.341788 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 854/1693] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:30 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1325 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:30.445099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:30.446140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:30.453023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.453767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.454441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.455443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.456101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.456999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.543221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.554902 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15ea01b9-1e7a-413d-b2a0-0a13797dc04f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.363673 Oct 22 03:10:30.572516 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 840/1694] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:30 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:30.617517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.628461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.630706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.631924 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6fa2e2c2-ff8f-43fe-92e1-26e017e4f0cb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.193922 Oct 22 03:10:30.632767 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 855/1695] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:30 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:30.654683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:30.655575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:30.655726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:30.656602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:30.663031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.663523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.663963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.664704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.665157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.666054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.669677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.672392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.673043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.674480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.675766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.676190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.725694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:30.726198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:30.726638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:30.727095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lazy-loading 'fault' on Instance uuid 593d2c59-795e-4dc7-8200-56b449d7b066 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:30.806775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.827101 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e73ada9-c04a-4540-8965-51adedb88bb2 tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1332 microversion: 2.1 time: 0.176101 Oct 22 03:10:30.846373 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 841/1696] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:30 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1332 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:30.853538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.865015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.866725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:30.868223 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-31ea0f09-58f7-46f0-9612-feff3bd35b50 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.216436 Oct 22 03:10:30.870625 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 856/1697] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:30 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:31.055179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:31.056022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:31.071274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.073428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.074382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.076059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.076646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.077006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.115676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:31.116457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:31.130546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.131063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.131971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.133602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.135131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.138852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.206363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:31.237375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35c4e5ef-455d-44eb-80f8-8bfaa9e3590c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1349 microversion: 2.1 time: 0.187704 Oct 22 03:10:31.262675 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 842/1698] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:31 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1349 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:31.365942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:31.366944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:31.375704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:31.385703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.386810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.388510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e743a16c-6380-471e-983d-c5741d767edf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.277445 Oct 22 03:10:31.389011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.389915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.391089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.393334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.402251 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 857/1699] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:31 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:31.583036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:31.583987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:31.594207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.597753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.599898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.601815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.603521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.610566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.722636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:31.737860 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f286cc4-74e5-4234-847f-dde98b3096d0 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1325 microversion: 2.1 time: 0.375168 Oct 22 03:10:31.756562 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 843/1700] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:31 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1325 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:31.768871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:31.769855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:31.779234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.779983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.780773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.781735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:31.782517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:31.783265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:31.965167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:31.978554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:31.980043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:31.981275 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05bb557b-7f07-489f-904a-0a40b1c972b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.221225 Oct 22 03:10:31.982049 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 844/1701] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:31 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:32.000644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:32.001377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:32.009086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.009602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.010055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.010836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.011434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.012363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.026068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:32.038734 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3f6ace4e-6e74-492a-883a-43ca6582b800 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.459931 Oct 22 03:10:32.039934 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 858/1702] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:31 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:32.048529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:32.054925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:32.062649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.063403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.064159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.065119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lazy-loading 'fault' on Instance uuid 593d2c59-795e-4dc7-8200-56b449d7b066 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:32.067744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.069036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.069490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.071167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.072490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.074125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.151579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe78fc7afed43e496e0be24a021dffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302763f239654e49a981355dd63bc6f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:32.158197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:32.169970 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d24eda2b-7949-4ce0-9e8c-21bbf4241d8a tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 200 len: 1332 microversion: 2.1 time: 0.181776 Oct 22 03:10:32.171545 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 845/1703] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:31 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 1332 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:32.201852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:32.219915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:32.225290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:32.227265 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-600f48e8-95a9-459b-9c71-f9e16db0ac1c tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.186174 Oct 22 03:10:32.228057 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 859/1704] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:32 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:32.265705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:32.266624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:32.275709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.276542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.277167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.278105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.278734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.279335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.324139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.325390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.326011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.329597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lazy-loading 'fault' on Instance uuid 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:32.384314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:32.397739 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f74a7ef6-719c-47de-84e1-8554cf4d1688 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1354 microversion: 2.1 time: 0.136861 Oct 22 03:10:32.402542 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 846/1705] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:32 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:32.423377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:32.424311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:32.431528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.432401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.433054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.434312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.434983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.435633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.620631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:32.630822 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a90b3057-c40c-411a-be8b-bc50fb09e5f5 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.212441 Oct 22 03:10:32.632640 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 860/1706] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:32 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:32.768487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:32.769449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:32.781242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.781828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.785071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:32.786447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:32.786631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:32.787182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.012668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:33.013926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:33.021697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:33.025123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.028471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.029692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.032523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.033376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.035480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.036266 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8cba9c67-3084-4303-93d7-6a5bcd5a2117 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1325 microversion: 2.1 time: 0.269237 Oct 22 03:10:33.050152 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 847/1707] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:32 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1325 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:33.064594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:33.065207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:33.073772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.074569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.075086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.075819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.076489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.076934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.418908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:33.450557 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15079de7-0863-4cbd-b6ea-84241b13d134 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1477 microversion: 2.1 time: 0.387856 Oct 22 03:10:33.457374 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 848/1708] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:33 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:33.481435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:33.482088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] [instance: 593d2c59-795e-4dc7-8200-56b449d7b066] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:33.499322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.499814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.500536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.501425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.502036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.503551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.552078 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] HTTP exception thrown: Instance 593d2c59-795e-4dc7-8200-56b449d7b066 could not be found. Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Request method failure captured: Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 HTTP/1.1 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU15EvF7g1zEFnsumEiRh1CCitMvfrw7D_BlRjELkZyAy73cqU-dJZyM8ObSepXghqoj8vfI3o4U_6khBvOQBV7YOH3erlgwU_PsVKUmv8neFobI_VjSjC7iYZhUvoYvZVJ6GZJ6hOQ8alRheuUStHDf5I3Zjj-rbVhEFGjTfcI7itkM Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 302763f239654e49a981355dd63bc6f7 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesAdminNegativeTest-704975395 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_302763f239654e49a981355dd63bc6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/302763f239654e49a981355dd63bc6f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/302763f239654e49a981355dd63bc6f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/302763f239654e49a981355dd63bc6f7"}]}] Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesAdminNegativeTest-704975395 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 302763f239654e49a981355dd63bc6f7 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-704975395 Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesAdminNegativeTest-704975395-project Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: ebe78fc7afed43e496e0be24a021dffa Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesAdminNegativeTest-704975395-project Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 593d2c59-795e-4dc7-8200-56b449d7b066 could not be found. Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '593d2c59-795e-4dc7-8200-56b449d7b066'} Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 593d2c59-795e-4dc7-8200-56b449d7b066 could not be found. Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 593d2c59-795e-4dc7-8200-56b449d7b066 could not be found. Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:33.553801 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 593d2c59-795e-4dc7-8200-56b449d7b066 could not be found. Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Returning 404 to user: Instance 593d2c59-795e-4dc7-8200-56b449d7b066 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:33.559027 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-82701685-2063-45a3-a4d3-d4ddd5bb1d3b tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066" status: 404 len: 111 microversion: 2.1 time: 0.096220 Oct 22 03:10:33.563311 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 849/1709] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:33 2022] GET /compute/v2.1/servers/593d2c59-795e-4dc7-8200-56b449d7b066 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:33.579982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:33.583120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:33.594901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.595395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.595902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.601096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.602261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.602717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.616572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:33.638205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:33.642183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:33.643415 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d06f9ae-3ad1-4153-9040-55f8e2b53fd7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.638011 Oct 22 03:10:33.643991 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 861/1710] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:33 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:10:33.684190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:33.685297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:33.702972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.703677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.705066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.709044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.709746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.710481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.728720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:33.846537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:33.849451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:33.849970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:33.854642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lazy-loading 'fault' on Instance uuid 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:33.861190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:33.880444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:33.891844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:33.902347 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad24083d-de93-431c-a792-5989007b3dc4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.329498 Oct 22 03:10:33.903155 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 850/1711] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:33 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:33.917042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aaef0d27-da3f-49b3-8455-057d362f25fe tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] Calling method '.version_select at 0x7f0d19927a60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:33.998303 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aaef0d27-da3f-49b3-8455-057d362f25fe tempest-VolumesAdminNegativeTest-704975395 tempest-VolumesAdminNegativeTest-704975395-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869459367" status: 202 len: 0 microversion: 2.1 time: 0.084807 Oct 22 03:10:33.998980 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 851/1712] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:10:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869459367 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:10:34.022382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:34.023149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:34.044880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069a8403cf9e414d99e83da9192f2057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71769feb32e1436285707bbdf76bf70e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:34.058050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:34.058595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:34.059094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:34.059849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:34.060389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:34.060868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:34.065856 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18cdc27a-27c4-454f-b2a7-1b39bd520f9f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 200 len: 1354 microversion: 2.1 time: 0.415742 Oct 22 03:10:34.066468 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 862/1713] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:33 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 1354 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:34.085054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:34.085677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:34.114811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:34.115313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:34.115762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:34.116518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:34.116981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:34.117412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:34.771893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:34.777375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:34.793604 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6eeb3431-a69f-4738-bc25-62d1572e1219 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.790831 Oct 22 03:10:34.796481 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 852/1714] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:33 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:34.817214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:34.820000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:34.841773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:34.844681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:34.847380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:34.848443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:34.849170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:34.856058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:34.859675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:34.872427 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8af35785-07a6-484e-8243-980aee17a2c3 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1325 microversion: 2.1 time: 0.804495 Oct 22 03:10:34.876258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 863/1715] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:34 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1325 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:34.888816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:34.889792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:34.900164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:34.902174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:34.904778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:34.905716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:34.907734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:34.909527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.114452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:35.133026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:35.134774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:35.136397 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-763a6e16-e5dd-4855-962b-452afb775502 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.261558 Oct 22 03:10:35.137800 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 864/1716] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:34 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:35.145814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-49c09805-1ebb-4a7e-8718-ea1c07c79c7b req-7747e3cd-e5f7-486f-9154-ff432107634b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394f4c47-2f26-4209-b094-bcf52da83af0", "name": "network-vif-plugged", "status": "completed", "tag": "bb4934b7-142c-4b3f-aa2e-8b689dcb8892"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:35.160122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-49c09805-1ebb-4a7e-8718-ea1c07c79c7b req-7747e3cd-e5f7-486f-9154-ff432107634b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.161536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-49c09805-1ebb-4a7e-8718-ea1c07c79c7b req-7747e3cd-e5f7-486f-9154-ff432107634b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.162720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-49c09805-1ebb-4a7e-8718-ea1c07c79c7b req-7747e3cd-e5f7-486f-9154-ff432107634b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.187237 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-49c09805-1ebb-4a7e-8718-ea1c07c79c7b req-7747e3cd-e5f7-486f-9154-ff432107634b service nova] Creating event network-vif-plugged:bb4934b7-142c-4b3f-aa2e-8b689dcb8892 for instance 394f4c47-2f26-4209-b094-bcf52da83af0 on n-h1-862416-2 Oct 22 03:10:35.194921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-49c09805-1ebb-4a7e-8718-ea1c07c79c7b req-7747e3cd-e5f7-486f-9154-ff432107634b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053342 Oct 22 03:10:35.197360 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 865/1717] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:35.212724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:35.234041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:35.242147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:35.247525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.248790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.250557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.252323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.253152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.253755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.257981 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ded84f7-54c2-4e9e-ad64-94d1cd723f48 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1476 microversion: 2.1 time: 0.459926 Oct 22 03:10:35.258592 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 853/1718] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:34 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1476 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:35.269469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:35.270353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:35.276686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.277178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.277953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.279402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.280162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.280791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.296879 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] HTTP exception thrown: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Request method failure captured: Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 HTTP/1.1 Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14XG3g6ex_I0bzHbluuT4E46CxzHRwXpfXEFdcJ-Rf9q_J4dlsTyaqdnXFhfwpbabjagblc9eUzDOn2LA6bNJgrgMFtc6uTVg8Coq75qhZBUJn7W1BmsMhrZvIdsV2M_DXq50OTCc-9WvxNXdnJ-oyn3zuQ2hl2APAzzIa9mXVjgXw Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71769feb32e1436285707bbdf76bf70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}] Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 069a8403cf9e414d99e83da9192f2057 Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1a731cdd-ed4e-48e3-b0c4-fcf6794cf976'} Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:35.298955 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:35.304431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.305907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Returning 404 to user: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:35.306783 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a14b2832-b83a-4464-a798-b78136c96bdd tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 404 len: 111 microversion: 2.1 time: 0.046751 Oct 22 03:10:35.310770 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 854/1719] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:35 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:35.316035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:35.316587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:35.323422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.323921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.324414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.325121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.325574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.326007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.343315 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] HTTP exception thrown: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Request method failure captured: Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe HTTP/1.1 Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14XG3g6ex_I0bzHbluuT4E46CxzHRwXpfXEFdcJ-Rf9q_J4dlsTyaqdnXFhfwpbabjagblc9eUzDOn2LA6bNJgrgMFtc6uTVg8Coq75qhZBUJn7W1BmsMhrZvIdsV2M_DXq50OTCc-9WvxNXdnJ-oyn3zuQ2hl2APAzzIa9mXVjgXw Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71769feb32e1436285707bbdf76bf70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}] Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 069a8403cf9e414d99e83da9192f2057 Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '51400e5d-785f-4aff-9f3a-ec73d15dc8fe'} Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:35.344944 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Returning 404 to user: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:35.350103 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48c31bed-a9c9-4583-8576-01fe56c83f9d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 404 len: 111 microversion: 2.1 time: 0.034352 Oct 22 03:10:35.351242 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 855/1720] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:35 2022] DELETE /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:35.355688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:35.356628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:35.370866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.371272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.372364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.373165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.373674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.374122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.389577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:35.396055 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] HTTP exception thrown: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.403996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Request method failure captured: Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe HTTP/1.1 Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14XG3g6ex_I0bzHbluuT4E46CxzHRwXpfXEFdcJ-Rf9q_J4dlsTyaqdnXFhfwpbabjagblc9eUzDOn2LA6bNJgrgMFtc6uTVg8Coq75qhZBUJn7W1BmsMhrZvIdsV2M_DXq50OTCc-9WvxNXdnJ-oyn3zuQ2hl2APAzzIa9mXVjgXw Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71769feb32e1436285707bbdf76bf70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}] Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 069a8403cf9e414d99e83da9192f2057 Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '51400e5d-785f-4aff-9f3a-ec73d15dc8fe'} Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.406322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Returning 404 to user: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-296f1f8f-d0d8-48a5-8139-5850bb8593a2 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 404 len: 111 microversion: 2.1 time: 0.056060 Oct 22 03:10:35.411732 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 856/1721] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:35 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:35.414275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:35.421410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d45ee098-5297-4d00-97c1-e8bd7e63939b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '.version_select at 0x7f0d1e503b80>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:35.422376 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1f7644dd-6592-4e0a-b3c4-ae507ee01d54 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.219835 Oct 22 03:10:35.425863 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 866/1722] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:35 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:35.456516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d45ee098-5297-4d00-97c1-e8bd7e63939b tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806393372" status: 202 len: 0 microversion: 2.1 time: 0.041279 Oct 22 03:10:35.458022 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 857/1723] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:10:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806393372 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:10:35.659478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e5aaf2f3-dee3-443a-878b-0524178abcd5 req-5df3d9a7-636a-4aa5-acad-d4e43c3584f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "name": "network-vif-unplugged", "status": "completed", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:35.671708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e5aaf2f3-dee3-443a-878b-0524178abcd5 req-5df3d9a7-636a-4aa5-acad-d4e43c3584f1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.675215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e5aaf2f3-dee3-443a-878b-0524178abcd5 req-5df3d9a7-636a-4aa5-acad-d4e43c3584f1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.679290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e5aaf2f3-dee3-443a-878b-0524178abcd5 req-5df3d9a7-636a-4aa5-acad-d4e43c3584f1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.696053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e5aaf2f3-dee3-443a-878b-0524178abcd5 req-5df3d9a7-636a-4aa5-acad-d4e43c3584f1 service nova] Creating event network-vif-unplugged:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h1-862416-2 Oct 22 03:10:35.704189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-e5aaf2f3-dee3-443a-878b-0524178abcd5 req-5df3d9a7-636a-4aa5-acad-d4e43c3584f1 service nova] Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:10:35.719511 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e5aaf2f3-dee3-443a-878b-0524178abcd5 req-5df3d9a7-636a-4aa5-acad-d4e43c3584f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063431 Oct 22 03:10:35.721271 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 867/1724] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:35.824202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:35.825008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:35.836704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.837621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.838138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.839072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.839778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.840439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.898665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:35.900226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:35.908263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.909001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.909508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:35.911192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:35.911757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:35.912345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:36.185764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.203362 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc1c7033-8271-4b53-a8f5-63789c6afe6d tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.382836 Oct 22 03:10:36.205052 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 858/1725] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:35 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:36.211592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:36.213375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:36.221816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:36.224379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:36.225767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:36.227384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:36.228138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:36.228863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:36.339204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.351911 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c32fc9f8-012b-4d85-9a93-95ad5882c876 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1325 microversion: 2.1 time: 0.456408 Oct 22 03:10:36.353281 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 868/1726] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:35 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1325 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:36.362456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:36.367095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:36.376227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:36.377292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:36.377981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:36.379127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:36.380598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:36.381709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:36.667546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.682541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.685054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.686615 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d07bb47-0d01-4a28-8099-d3d7446275dd tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.480190 Oct 22 03:10:36.700274 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 859/1727] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:36 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:36.700274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:36.700274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:36.721195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:36.732393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:36.733595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:36.734676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:36.735455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:36.736433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:36.876154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.892605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.898356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.900033 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7bb14372-6f1a-472b-8569-8791c52fc39e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.210100 Oct 22 03:10:36.923291 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 860/1728] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:36 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:36.931816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:36.946986 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61c8372c-4e27-4635-a00b-edc5f6682996 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1476 microversion: 2.1 time: 0.589660 Oct 22 03:10:36.978089 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 869/1729] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:36 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1476 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:37.221123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-854ae154-d8ca-4b05-a032-9ba4e9c74be3 req-de7c90be-4350-4d93-8e74-eaab8d2be5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea729a44-09fe-4297-a04f-c433bbefa3a2", "name": "network-vif-plugged", "status": "completed", "tag": "bd6ed333-9ffb-4a1b-a196-43fdbfe8753e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:37.231291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:37.232241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:37.242488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.243431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.244110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.245197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.245924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.246576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.250290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-854ae154-d8ca-4b05-a032-9ba4e9c74be3 req-de7c90be-4350-4d93-8e74-eaab8d2be5cb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.251283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-854ae154-d8ca-4b05-a032-9ba4e9c74be3 req-de7c90be-4350-4d93-8e74-eaab8d2be5cb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.251735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-854ae154-d8ca-4b05-a032-9ba4e9c74be3 req-de7c90be-4350-4d93-8e74-eaab8d2be5cb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.267470 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-854ae154-d8ca-4b05-a032-9ba4e9c74be3 req-de7c90be-4350-4d93-8e74-eaab8d2be5cb service nova] Creating event network-vif-plugged:bd6ed333-9ffb-4a1b-a196-43fdbfe8753e for instance ea729a44-09fe-4297-a04f-c433bbefa3a2 on n-h2-862416-2 Oct 22 03:10:37.275081 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-854ae154-d8ca-4b05-a032-9ba4e9c74be3 req-de7c90be-4350-4d93-8e74-eaab8d2be5cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059243 Oct 22 03:10:37.275710 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 861/1730] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:10:37.378524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:37.379495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:37.388480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.389327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.390114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.391193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.391986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.392542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.558096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:37.566669 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92a08dcc-5f6c-486d-97ad-8493afa6d218 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.340316 Oct 22 03:10:37.568125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 870/1731] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:37 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:37.576070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b1c7d93-6118-4f67-99bd-de422f5c0a31 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:37.605118 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b1c7d93-6118-4f67-99bd-de422f5c0a31 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1962332186" status: 202 len: 0 microversion: 2.1 time: 0.034117 Oct 22 03:10:37.606205 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 871/1732] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:10:37 2022] DELETE /compute/v2.1/flavors/1962332186 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:10:37.614087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6bf1fea7-a8cb-4d78-a2cf-66489dac7c65 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:37.634743 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6bf1fea7-a8cb-4d78-a2cf-66489dac7c65 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.024104 Oct 22 03:10:37.640890 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 872/1733] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:10:37 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:37.660096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa33348a-e9f6-4176-9b43-3af368d887ea tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:37.678989 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa33348a-e9f6-4176-9b43-3af368d887ea tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1148142946" status: 202 len: 0 microversion: 2.1 time: 0.022773 Oct 22 03:10:37.680069 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 873/1734] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:10:37 2022] DELETE /compute/v2.1/flavors/1148142946 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:10:37.689686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ccd86cf1-0f35-426b-9212-7bff212dc105 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:37.718495 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ccd86cf1-0f35-426b-9212-7bff212dc105 tempest-ServersWithSpecificFlavorTestJSON-1700739919 tempest-ServersWithSpecificFlavorTestJSON-1700739919-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034312 Oct 22 03:10:37.719545 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 874/1735] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:10:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:37.724629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:37.725244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:37.731471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.732730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.734278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.736561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.737063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.737483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.897350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:37.906272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:37.915997 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d5f9574-2525-47a4-8498-7c26780d44f4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1520 microversion: 2.1 time: 0.543847 Oct 22 03:10:37.916521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:37.918686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:37.920141 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-444d529d-cb25-45a2-b22c-74bf0cfe1680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.199331 Oct 22 03:10:37.932806 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 862/1736] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:37 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1520 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:37.932806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-96305b7d-fcb1-4fad-a61d-16ecb7b2f68b req-ebea72b8-2152-458a-9622-ccf3d99ca87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:37.941346 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 875/1737] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:37 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:37.949831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:37.950647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:37.953123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-96305b7d-fcb1-4fad-a61d-16ecb7b2f68b req-ebea72b8-2152-458a-9622-ccf3d99ca87b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.953625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-96305b7d-fcb1-4fad-a61d-16ecb7b2f68b req-ebea72b8-2152-458a-9622-ccf3d99ca87b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.954073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-96305b7d-fcb1-4fad-a61d-16ecb7b2f68b req-ebea72b8-2152-458a-9622-ccf3d99ca87b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.958852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.959655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.960375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.961999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:37.962771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:37.963434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:37.974163 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-96305b7d-fcb1-4fad-a61d-16ecb7b2f68b req-ebea72b8-2152-458a-9622-ccf3d99ca87b service nova] Creating event network-changed:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h1-862416-2 Oct 22 03:10:37.981951 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] HTTP exception thrown: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Request method failure captured: Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 HTTP/1.1 Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU14XG3g6ex_I0bzHbluuT4E46CxzHRwXpfXEFdcJ-Rf9q_J4dlsTyaqdnXFhfwpbabjagblc9eUzDOn2LA6bNJgrgMFtc6uTVg8Coq75qhZBUJn7W1BmsMhrZvIdsV2M_DXq50OTCc-9WvxNXdnJ-oyn3zuQ2hl2APAzzIa9mXVjgXw Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71769feb32e1436285707bbdf76bf70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}] Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 069a8403cf9e414d99e83da9192f2057 Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1a731cdd-ed4e-48e3-b0c4-fcf6794cf976'} Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:37.984245 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:37.990116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Returning 404 to user: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:37.991080 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15ca4096-ae79-43bb-8573-0c4766331102 tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 404 len: 111 microversion: 2.1 time: 0.046890 Oct 22 03:10:37.992343 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 876/1738] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:37 2022] DELETE /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:37.993768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-96305b7d-fcb1-4fad-a61d-16ecb7b2f68b req-ebea72b8-2152-458a-9622-ccf3d99ca87b service nova] Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:10:37.998900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.000674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.009044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:DELETE=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:38.011194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.012660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.014428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.015408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.016482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.016611 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-96305b7d-fcb1-4fad-a61d-16ecb7b2f68b req-ebea72b8-2152-458a-9622-ccf3d99ca87b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088810 Oct 22 03:10:38.017273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.019772 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 863/1739] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:38.026441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.027290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.033974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.034771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.035222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.036842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.037710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.038148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.090474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:10:38.126174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:38.139652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:38.142572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:38.144193 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af6eb3ed-ddfb-4ef8-a972-b81c7a6fecd8 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.149202 Oct 22 03:10:38.157134 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 877/1740] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:37 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:38.171755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.172163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.188252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.188795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.189246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.190020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.190560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.191331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.218835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:38.249641 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bf9361e6-d1b8-4a13-9af3-51c24df63962 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 204 len: 0 microversion: 2.1 time: 0.227177 Oct 22 03:10:38.253463 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 864/1741] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:38 2022] DELETE /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:10:38.257643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.258294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.268991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.270463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.271879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.272962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.273783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.274315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.294230 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] HTTP exception thrown: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Request method failure captured: Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 HTTP/1.1 Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14XG3g6ex_I0bzHbluuT4E46CxzHRwXpfXEFdcJ-Rf9q_J4dlsTyaqdnXFhfwpbabjagblc9eUzDOn2LA6bNJgrgMFtc6uTVg8Coq75qhZBUJn7W1BmsMhrZvIdsV2M_DXq50OTCc-9WvxNXdnJ-oyn3zuQ2hl2APAzzIa9mXVjgXw Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71769feb32e1436285707bbdf76bf70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}] Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 069a8403cf9e414d99e83da9192f2057 Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1a731cdd-ed4e-48e3-b0c4-fcf6794cf976'} Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:38.296538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.301800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Returning 404 to user: Instance 1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:38.303537 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7edde8a4-5128-49f3-9d9b-c16a6e8bea2f tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976" status: 404 len: 111 microversion: 2.1 time: 0.050354 Oct 22 03:10:38.306557 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 865/1742] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:38 2022] GET /compute/v2.1/servers/1a731cdd-ed4e-48e3-b0c4-fcf6794cf976 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:38.308913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.309614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.321087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.321594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.322038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.322759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.323248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.323683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.391530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:38.409010 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35ffb5f5-9c34-4826-8b25-5161961d5b11 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1476 microversion: 2.1 time: 0.243029 Oct 22 03:10:38.413820 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 878/1743] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:38 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:38.418164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.418876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.425976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.427319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.427865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.429134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.429695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.430225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.448370 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] HTTP exception thrown: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Request method failure captured: Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe HTTP/1.1 Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU14XG3g6ex_I0bzHbluuT4E46CxzHRwXpfXEFdcJ-Rf9q_J4dlsTyaqdnXFhfwpbabjagblc9eUzDOn2LA6bNJgrgMFtc6uTVg8Coq75qhZBUJn7W1BmsMhrZvIdsV2M_DXq50OTCc-9WvxNXdnJ-oyn3zuQ2hl2APAzzIa9mXVjgXw Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71769feb32e1436285707bbdf76bf70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}] Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 069a8403cf9e414d99e83da9192f2057 Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '51400e5d-785f-4aff-9f3a-ec73d15dc8fe'} Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:38.450635 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Returning 404 to user: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:38.455707 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0825f452-fee2-444b-af7c-2fd5f7213e8c tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 404 len: 111 microversion: 2.1 time: 0.042891 Oct 22 03:10:38.459668 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 879/1744] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:38 2022] DELETE /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:38.464498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.465117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] [instance: 51400e5d-785f-4aff-9f3a-ec73d15dc8fe] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.471248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.471672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.472115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.472857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.473723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.474171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.490112 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] HTTP exception thrown: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Request method failure captured: Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe HTTP/1.1 Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU14XG3g6ex_I0bzHbluuT4E46CxzHRwXpfXEFdcJ-Rf9q_J4dlsTyaqdnXFhfwpbabjagblc9eUzDOn2LA6bNJgrgMFtc6uTVg8Coq75qhZBUJn7W1BmsMhrZvIdsV2M_DXq50OTCc-9WvxNXdnJ-oyn3zuQ2hl2APAzzIa9mXVjgXw Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71769feb32e1436285707bbdf76bf70e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71769feb32e1436285707bbdf76bf70e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71769feb32e1436285707bbdf76bf70e"}]}] Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 71769feb32e1436285707bbdf76bf70e Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421 Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 069a8403cf9e414d99e83da9192f2057 Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1115611421-project Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '51400e5d-785f-4aff-9f3a-ec73d15dc8fe'} Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.491660 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] Returning 404 to user: Instance 51400e5d-785f-4aff-9f3a-ec73d15dc8fe could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5de7432e-dc46-499a-bf95-49035ad92f1d tempest-ServersWithSpecificFlavorTestJSON-1115611421 tempest-ServersWithSpecificFlavorTestJSON-1115611421-project] 10.222.0.25 "GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe" status: 404 len: 111 microversion: 2.1 time: 0.032482 Oct 22 03:10:38.496154 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 880/1745] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:38 2022] GET /compute/v2.1/servers/51400e5d-785f-4aff-9f3a-ec73d15dc8fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:38.539984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:38.548032 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c44b9442-4712-4e3e-b7a7-25e091585c28 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1526 microversion: 2.1 time: 0.243052 Oct 22 03:10:38.548952 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 866/1746] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:38 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1526 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:38.599402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.600170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.608193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.609154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.611630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.612847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.615436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.616277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.948466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=28 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:38.954728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:38.960824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:38.961564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:38.971068 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a1216b1-e4c6-410a-9110-daf85306fbf2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1317 microversion: 2.1 time: 0.379520 Oct 22 03:10:38.973516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 881/1747] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:38 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:38.974609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.975248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.976944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:38.979708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:38.980866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:38.982051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:39.178551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:39.179729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:39.188646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:39.189541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:39.190155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:39.191385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:39.192427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:39.192871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:39.310182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:39.322381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:39.323856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:39.325123 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-802233b4-ff1e-4b1a-9c14-17e79cf34766 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.153826 Oct 22 03:10:39.325881 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 882/1748] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:39 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:39.387916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:39.408861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:39.413532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:39.416760 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-80226c9f-014e-48ae-8133-f4b97342d575 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.462847 Oct 22 03:10:39.419349 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 867/1749] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:38 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:39.433747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:39.434631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:39.441368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:39.442483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:39.443743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:39.444747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:39.445373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:39.445978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:39.575352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:39.576304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:39.594434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:39.599788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:39.600820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:39.601746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:39.603484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:39.607783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:39.992106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:40.002256 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-555f20a4-ada5-405b-8bdc-74dac7810546 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1476 microversion: 2.1 time: 0.572543 Oct 22 03:10:40.022279 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 883/1750] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:39 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:40.029996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:40.030910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:40.038426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:40.039206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:40.039827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:40.040783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:40.041234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:40.041655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:40.416802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:40.429914 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a468cb03-6ff8-440d-9305-73a8f96d7fa7 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1526 microversion: 2.1 time: 0.859828 Oct 22 03:10:40.444235 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 868/1751] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:39 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1526 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:40.444235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:40.444235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:40.460061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:40.460787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:40.461241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:40.461973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:40.464616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:40.465096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:40.559152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:40.590445 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1b7760a-7b91-4044-a629-278edb894ee2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1466 microversion: 2.1 time: 0.564830 Oct 22 03:10:40.591361 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 884/1752] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:40 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1466 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:40.596006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:40.596727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:40.610943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:40.611455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:40.611907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:40.612665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:40.613127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:40.614093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:40.679073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:40.718773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:40.737601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:40.739958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:40.740915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-68d28e25-692f-4e7c-91c2-9590261fe89f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.307498 Oct 22 03:10:40.746419 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 869/1753] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:40 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:40.748526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:40.749187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:40.760478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:40.760977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:40.761426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:40.762153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:40.762615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:40.763051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:41.083218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:41.083840 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7780a6ae-08f9-4429-8759-5727fe5995a2 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1617 microversion: 2.1 time: 0.339189 Oct 22 03:10:41.095209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:41.100220 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 870/1754] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:40 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1617 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:41.101811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:41.108231 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-502d2fdb-f789-4928-a205-0400464dc078 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.510760 Oct 22 03:10:41.124239 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 885/1755] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:40 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:41.125147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:41.125147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:41.128123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:41.128662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:41.129495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:41.130255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:41.130721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:41.137984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:41.289757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-862037355", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5073feec-6b6f-4858-99ba-438ab7362ee2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:41.418232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:10:41.519407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:41.530451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a4cb3ac-dd56-4ae1-9d7c-0a0dc5ee1cf2 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1474 microversion: 2.1 time: 0.419622 Oct 22 03:10:41.549366 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 871/1756] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:41 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1474 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:41.556512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:41.557136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:41.563443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:41.563936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:41.564684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:41.566041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:41.566744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:41.567339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:41.592444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:41.662334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:41.674550 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f2a734d-fb0b-4cd3-93ae-2d0c7bf57d6e tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1484 microversion: 2.1 time: 0.121047 Oct 22 03:10:41.677583 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 872/1757] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:41 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1484 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:41.767184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:41.768297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:41.779938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:41.784405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:41.784855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:41.786121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:41.786582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:41.787008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:41.912560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:41.923768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:41.925492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:41.933175 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dcabdb34-caaa-4168-ac76-5512f400a818 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.169937 Oct 22 03:10:41.963806 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 873/1758] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:41 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:10:42.150571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:42.151618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:42.167969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.168893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.172283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.173601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.185090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.186100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.530977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:10:42.531514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:10:42.531812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:10:42.532241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:10:42.532679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:10:42.564325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.567888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.572105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.573075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.573582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.574024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.652720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:10:42.681410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Getting quotas for user 3fb696d229f74155947d6e4f89e16f5a and project 7e462137d650486c919790a05aa876dc. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:10:42.702694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:42.716618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:10:42.719848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:42.720429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:10:42.733395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:42.739738 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98dc8677-7af2-4506-b12a-30672a1eee16 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1813 microversion: 2.25 time: 0.592051 Oct 22 03:10:42.740544 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 874/1759] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:42 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1813 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:42.759564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ec13663b-65bc-43f9-9d96-d095bef6f8a7 req-6408730b-34b4-4d31-a665-50249036c65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394f4c47-2f26-4209-b094-bcf52da83af0", "name": "network-vif-deleted", "tag": "bb4934b7-142c-4b3f-aa2e-8b689dcb8892"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:42.780546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec13663b-65bc-43f9-9d96-d095bef6f8a7 req-6408730b-34b4-4d31-a665-50249036c65f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.781043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec13663b-65bc-43f9-9d96-d095bef6f8a7 req-6408730b-34b4-4d31-a665-50249036c65f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.789741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec13663b-65bc-43f9-9d96-d095bef6f8a7 req-6408730b-34b4-4d31-a665-50249036c65f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.814086 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ec13663b-65bc-43f9-9d96-d095bef6f8a7 req-6408730b-34b4-4d31-a665-50249036c65f service nova] Creating event network-vif-deleted:bb4934b7-142c-4b3f-aa2e-8b689dcb8892 for instance 394f4c47-2f26-4209-b094-bcf52da83af0 on n-h1-862416-2 Oct 22 03:10:42.814950 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2cac06e8-36f5-452b-98f5-7a3472d137b0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.529256 Oct 22 03:10:42.824591 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 886/1760] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:10:42.834307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:42.834819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ec13663b-65bc-43f9-9d96-d095bef6f8a7 req-6408730b-34b4-4d31-a665-50249036c65f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085500 Oct 22 03:10:42.835658 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 875/1761] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:42.837379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:42.849495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.859635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:42.862708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:42.875051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.876189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.879683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.882399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.883228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.890057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.894391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.895833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.897669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.898150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.902362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:42.996987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:42.997738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:42.998629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:43.000971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lazy-loading 'fault' on Instance uuid 394f4c47-2f26-4209-b094-bcf52da83af0 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:43.341304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c6c1ad05a646029048f3a61df874c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7979873b22324dea968909a57ebd877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:43.359586 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e23f04f-93a9-48c1-aa18-d1816e739489 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 200 len: 1315 microversion: 2.1 time: 0.522913 Oct 22 03:10:43.364004 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 876/1762] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:42 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:43.369361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13c280d6-06f0-4a15-ae10-5f06a03feb78 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:43.370306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-13c280d6-06f0-4a15-ae10-5f06a03feb78 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:43.474832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:43.493541 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7c87c34-2675-4c21-81b5-88d6303ead36 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1474 microversion: 2.1 time: 0.663302 Oct 22 03:10:43.494912 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 887/1763] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:42 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1474 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:43.515719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:43.522293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:43.542076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:43.543638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:43.544420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:43.545385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:43.546213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:43.546892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:43.646025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:43.664245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:43.666735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:43.669029 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98f9c3c1-db88-46a7-9a21-ac58aa81dcc5 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.172610 Oct 22 03:10:43.684832 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 888/1764] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:43 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:43.752693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13c280d6-06f0-4a15-ae10-5f06a03feb78 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:43.764458 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13c280d6-06f0-4a15-ae10-5f06a03feb78 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1216 microversion: 2.1 time: 0.397442 Oct 22 03:10:43.769085 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 877/1765] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:43 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1216 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:43.789472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:43.790092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:43.800296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:43.800771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:43.805948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:43.808817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:43.810663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:43.813237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.264506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:44.274448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:44.275909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:44.277127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19c72897-d531-480a-8708-3f4675134896 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1803 microversion: 2.25 time: 0.510893 Oct 22 03:10:44.289033 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 889/1766] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:43 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1803 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:10:44.315778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba16eea7-8c45-46be-be81-dcaa6f184876 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '.version_select at 0x7f0d1e410ca0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:44.319854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba16eea7-8c45-46be-be81-dcaa6f184876 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.320401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba16eea7-8c45-46be-be81-dcaa6f184876 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.320871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba16eea7-8c45-46be-be81-dcaa6f184876 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.339321 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba16eea7-8c45-46be-be81-dcaa6f184876 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3208 microversion: 2.25 time: 0.027205 Oct 22 03:10:44.360877 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 878/1767] 10.222.0.25 () {60 vars in 1184 bytes} [Sat Oct 22 03:10:44 2022] GET /compute/v2.1/os-migrations => generated 3208 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:44.377608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:44.378545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:44.391898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:44.393025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 394f4c47-2f26-4209-b094-bcf52da83af0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:44.403560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.407196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.410055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.411082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.412556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.413863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.416156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.416586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.418268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.419100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.421662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.422113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.466556 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Instance 394f4c47-2f26-4209-b094-bcf52da83af0 could not be found. Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 HTTP/1.1 Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 394f4c47-2f26-4209-b094-bcf52da83af0 could not be found. Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '394f4c47-2f26-4209-b094-bcf52da83af0'} Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394f4c47-2f26-4209-b094-bcf52da83af0 could not be found. Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394f4c47-2f26-4209-b094-bcf52da83af0 could not be found. Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.484992 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394f4c47-2f26-4209-b094-bcf52da83af0 could not be found. Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.492129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Instance 394f4c47-2f26-4209-b094-bcf52da83af0 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:44.499236 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e9cfa40-cf33-44d6-ad72-cc01c225f6d4 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0" status: 404 len: 111 microversion: 2.1 time: 0.111908 Oct 22 03:10:44.499936 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 879/1768] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:44 2022] GET /compute/v2.1/servers/394f4c47-2f26-4209-b094-bcf52da83af0 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:10:44.515049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5b9fc05-d38c-4e09-b45b-5eb6b872ded8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '.version_select at 0x7f0d199371f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:44.610906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c5b9fc05-d38c-4e09-b45b-5eb6b872ded8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Image not found. Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5b9fc05-d38c-4e09-b45b-5eb6b872ded8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/b1499cde-02fa-4f24-92a0-37e6db935597 HTTP/1.1 Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'b1499cde-02fa-4f24-92a0-37e6db935597'} Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b1499cde-02fa-4f24-92a0-37e6db935597 to delete Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b1499cde-02fa-4f24-92a0-37e6db935597 could not be found. Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:44.615347 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:10:44.620758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.623844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5b9fc05-d38c-4e09-b45b-5eb6b872ded8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:44.624920 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5b9fc05-d38c-4e09-b45b-5eb6b872ded8 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/images/b1499cde-02fa-4f24-92a0-37e6db935597" status: 404 len: 62 microversion: 2.1 time: 0.120834 Oct 22 03:10:44.625856 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 880/1769] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:44 2022] DELETE /compute/v2.1/images/b1499cde-02fa-4f24-92a0-37e6db935597 => generated 62 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:10:44.640884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:44.641782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:44.666513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.667028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.667474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.668228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.668694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.669130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.735222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid a218e3e3-6082-4b65-8edb-b406c7cd582f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:44.752964 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-651bd578-5676-44dc-a08a-6e5b63a706de tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 2422 microversion: 2.25 time: 0.379123 Oct 22 03:10:44.754833 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 890/1770] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:44 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 2422 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:44.760049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:44.760949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:44.767834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.768688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.769387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.770474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.771179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.771858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.789060 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 HTTP/1.1 Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '9e341b78-1feb-458c-9b12-042b60a97b81'} Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:44.791301 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:44.795747 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:44.800172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:44.805122 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c20cc63-b231-4d7b-a7dc-c2436b917d37 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 404 len: 111 microversion: 2.1 time: 0.049007 Oct 22 03:10:44.806088 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 891/1771] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:44 2022] DELETE /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:44.811713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:44.812734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:44.820392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.821231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.821894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.822821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.823512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:44.824156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:44.949177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:44.967770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:44.970689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:44.976686 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6488e015-1bd5-4a48-b029-97b617e41e66 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.169441 Oct 22 03:10:44.980749 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 892/1772] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:44 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:44.988138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:44.990210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:44.998413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:44.999496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.000762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.001669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.002299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.002985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.064408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:45.081285 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc1e8036-9963-4090-a0c9-9bf612b2ff85 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1471 microversion: 2.1 time: 0.454206 Oct 22 03:10:45.104934 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 881/1773] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:44 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1471 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:45.118863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:45.119877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:45.127039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.128017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.128738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.129944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.130678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.131334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.237568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:45.246847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-648b706c-d489-4f0f-8b22-06117fd7668e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1268 microversion: 2.1 time: 0.136104 Oct 22 03:10:45.248682 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 882/1774] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:45 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:45.256814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:45.257818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: 9e341b78-1feb-458c-9b12-042b60a97b81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:45.288728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.296132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.300513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.302020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.305652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.306329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.329493 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 HTTP/1.1 Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9e341b78-1feb-458c-9b12-042b60a97b81'} Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:45.331626 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:45.336764 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:45.336764 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:45.336764 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:45.336764 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:45.336764 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:45.336764 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:45.336764 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. Oct 22 03:10:45.336764 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:10:45.339159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Instance 9e341b78-1feb-458c-9b12-042b60a97b81 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:45.341151 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-46dd913a-d759-4a59-a668-009301ffe44f tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81" status: 404 len: 111 microversion: 2.1 time: 0.089231 Oct 22 03:10:45.342248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 883/1775] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:45 2022] GET /compute/v2.1/servers/9e341b78-1feb-458c-9b12-042b60a97b81 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:45.348098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:45.349194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:45.366187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.369463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.373728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.374692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.375156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.375591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.509228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid a218e3e3-6082-4b65-8edb-b406c7cd582f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:45.546083 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3014437-6630-49a4-b355-0b32a7956314 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 2422 microversion: 2.25 time: 0.563926 Oct 22 03:10:45.550313 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 893/1776] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:44 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 2422 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:45.558995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f83cfba-5ce2-4096-848a-8b6ad9d33be9 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '.version_select at 0x7f0d1a043ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:45.601437 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f83cfba-5ce2-4096-848a-8b6ad9d33be9 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-974800254" status: 202 len: 0 microversion: 2.1 time: 0.048120 Oct 22 03:10:45.604176 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd51667b-95e9-4f20-a62b-ea16af38710c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "POST /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2/action" status: 202 len: 0 microversion: 2.1 time: 0.254694 Oct 22 03:10:45.604708 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 894/1777] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-974800254 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:10:45.608988 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 884/1778] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:10:45 2022] POST /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:10:45.643350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:45.659347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:45.680162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.683288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.683818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.688521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.689097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.689494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.729305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:45.730187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:45.745056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.746053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.746707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.747929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:45.748602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:45.749215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:45.893916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lazy-loading 'services' on Instance uuid a218e3e3-6082-4b65-8edb-b406c7cd582f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:10:46.022398 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ffeb5b7-1813-473d-a63f-0e2f171d4ea4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments/f0898f9f-bd65-4362-9031-ed1368b7d172" status: 202 len: 0 microversion: 2.25 time: 0.297740 Oct 22 03:10:46.026671 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 885/1779] 10.222.0.25 () {60 vars in 1457 bytes} [Sat Oct 22 03:10:45 2022] DELETE /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments/f0898f9f-bd65-4362-9031-ed1368b7d172 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:10:46.034134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:46.035068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:46.042506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:46.043143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:46.043908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:46.045436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:46.046010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:46.046699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:46.263282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:46.278096 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c11cb9f-8c64-4050-b8c4-1ed1e7f23112 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.642398 Oct 22 03:10:46.279372 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 895/1780] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:45 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:46.286977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:46.291582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:46.304016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:46.304992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:46.305972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:46.307242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:46.308267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:46.308997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:46.386394 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93a80b7f-52b2-4f9a-b0e7-77e74b3169ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104545 Oct 22 03:10:46.391894 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 896/1781] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:10:46 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:10:46.403549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:46.404838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:46.412758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:46.413920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:46.414604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:46.416635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:46.417922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:46.418809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:46.580090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:46.595431 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-45b03f82-5730-4f92-8242-fdbbe8436415 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1274 microversion: 2.1 time: 0.201473 Oct 22 03:10:46.597685 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 897/1782] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:46 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:46.626734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:46.658930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:46.661024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:46.664286 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69b4f0c9-fb34-49d1-807e-bf58276ba488 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.636286 Oct 22 03:10:46.666308 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 886/1783] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:46 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:47.307230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:47.308675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:47.326728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:47.327484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:47.330303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:47.331311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:47.332072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:47.335060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:47.400579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:47.403745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:47.427543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:47.428033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:47.428501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:47.429209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:47.429664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:47.430085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:47.536142 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e4ee3e7f-d726-4c43-8788-d3dc73671e47 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140343 Oct 22 03:10:47.540599 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 887/1784] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:10:47 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:10:47.622389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:47.623186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:47.638988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:47.641100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:47.642743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:47.646539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:47.649624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:47.651359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:47.911775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:47.929524 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f024690-563e-48e9-833c-32d74c36470e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1274 microversion: 2.1 time: 0.311694 Oct 22 03:10:47.935133 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 888/1785] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:47 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:47.949329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:47.949953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:47.956913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:47.957626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:47.958160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:47.958894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:47.959462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:47.959900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.042873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:48.064041 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-934b6ca8-0e96-4a77-809e-d9b5f1860007 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.761720 Oct 22 03:10:48.066234 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 898/1786] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:47 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:48.093652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b573dc28-1e6d-45c6-91a8-befc47307521 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '.version_select at 0x7f0d1a528430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:48.154966 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-b573dc28-1e6d-45c6-91a8-befc47307521 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Image not found. Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b573dc28-1e6d-45c6-91a8-befc47307521 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/images/651b52e8-8742-404a-936e-ac2c8c6dbb7c HTTP/1.1 Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: exception: Image not found. Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '651b52e8-8742-404a-936e-ac2c8c6dbb7c'} Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 651b52e8-8742-404a-936e-ac2c8c6dbb7c to delete Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 651b52e8-8742-404a-936e-ac2c8c6dbb7c could not be found. Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:48.158187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:10:48.164995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.169789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b573dc28-1e6d-45c6-91a8-befc47307521 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Image not found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:48.171275 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b573dc28-1e6d-45c6-91a8-befc47307521 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/images/651b52e8-8742-404a-936e-ac2c8c6dbb7c" status: 404 len: 62 microversion: 2.1 time: 0.082874 Oct 22 03:10:48.173065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 899/1787] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:48 2022] DELETE /compute/v2.1/images/651b52e8-8742-404a-936e-ac2c8c6dbb7c => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:10:48.207936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:48.210842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:48.220340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:48.242745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:48.243354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.244728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.246406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:48.247380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.248191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.249697 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5fab03e0-178b-49e9-bf48-9031d45bd6ec tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.313273 Oct 22 03:10:48.249883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.250509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.253235 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 889/1788] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:47 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:48.262857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5b8ebb40-302c-4ee2-b857-ce1b89dd2220 req-9b1e96af-8789-4c82-bcce-0f21aca7af11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "name": "network-vif-plugged", "status": "completed", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:48.283597 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b HTTP/1.1 Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd997135c-ef2e-48e2-abe5-adb37c06211b'} Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:48.286261 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.291372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.298310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:48.301402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5b8ebb40-302c-4ee2-b857-ce1b89dd2220 req-9b1e96af-8789-4c82-bcce-0f21aca7af11 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.301807 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e07e89bb-1eee-4b2b-b323-4612daf75423 tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 404 len: 111 microversion: 2.1 time: 0.121524 Oct 22 03:10:48.302348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5b8ebb40-302c-4ee2-b857-ce1b89dd2220 req-9b1e96af-8789-4c82-bcce-0f21aca7af11 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.304514 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 900/1789] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:10:48 2022] DELETE /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:48.306860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5b8ebb40-302c-4ee2-b857-ce1b89dd2220 req-9b1e96af-8789-4c82-bcce-0f21aca7af11 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.317972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:48.321073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] [instance: d997135c-ef2e-48e2-abe5-adb37c06211b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:48.332419 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5b8ebb40-302c-4ee2-b857-ce1b89dd2220 req-9b1e96af-8789-4c82-bcce-0f21aca7af11 service nova] Creating event network-vif-plugged:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h1-862416-2 Oct 22 03:10:48.341357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-5b8ebb40-302c-4ee2-b857-ce1b89dd2220 req-9b1e96af-8789-4c82-bcce-0f21aca7af11 service nova] Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:10:48.342573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.343076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.345068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.348390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.349875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.352588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.373127 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5b8ebb40-302c-4ee2-b857-ce1b89dd2220 req-9b1e96af-8789-4c82-bcce-0f21aca7af11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114830 Oct 22 03:10:48.376570 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 890/1790] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:48.384067 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] HTTP exception thrown: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Request method failure captured: Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b HTTP/1.1 Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU17J0iXTDi4vrQZ3cedZVSrss_E6EDJHivWg6XPQK5CjBCrIcImbiayte5qzMfQdd4HIWL4G4mdhfxN1joZHXk-10qyxP67h3i_jsD5CyKCieNPeEJ7ODYKmbSRi58cUgclPW56fag3zTNyFG9NG9Ia_pX66O2ylIRLq4ti14cnFKfs Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7979873b22324dea968909a57ebd877d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7979873b22324dea968909a57ebd877d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7979873b22324dea968909a57ebd877d"}]}] Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7979873b22324dea968909a57ebd877d Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182 Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39c6c1ad05a646029048f3a61df874c4 Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1076548182-project Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd997135c-ef2e-48e2-abe5-adb37c06211b'} Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.389502 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:10:48.395344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.395344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:10:48.395344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:10:48.395344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:10:48.395344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:10:48.395344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:10:48.395344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. Oct 22 03:10:48.395344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:10:48.397188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] Returning 404 to user: Instance d997135c-ef2e-48e2-abe5-adb37c06211b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:10:48.398316 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e08bb82f-8dbe-445f-8b07-e7aa6921324c tempest-ImagesOneServerNegativeTestJSON-1076548182 tempest-ImagesOneServerNegativeTestJSON-1076548182-project] 10.222.0.25 "GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b" status: 404 len: 111 microversion: 2.1 time: 0.091100 Oct 22 03:10:48.400168 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 901/1791] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:48 2022] GET /compute/v2.1/servers/d997135c-ef2e-48e2-abe5-adb37c06211b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:10:48.551142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:48.556073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:48.570306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.571532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.572878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.574064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.574692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.575287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.593045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:48.616756 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f93be135-a062-4b95-9638-f6db59fd10e5 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071696 Oct 22 03:10:48.619203 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 891/1792] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:10:48 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:10:48.957845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:48.958572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:48.978606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.979417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.980166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:48.981082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:48.982310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:48.982971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:49.098277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:49.101532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:49.112792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:49.115616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:49.117702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:49.118537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:49.119726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:49.120913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:49.500441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:49.510564 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6f00a226-9a39-402f-98ea-91636b99462c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1274 microversion: 2.1 time: 0.560790 Oct 22 03:10:49.512673 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 902/1793] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:48 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1274 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:49.519205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:49.520620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:49.521480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:49.530735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:49.531566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:49.532024 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-690b27dd-0258-4296-b586-11b3a1518ed8 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.442009 Oct 22 03:10:49.532936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:49.533095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 892/1794] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:49 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:10:49.534272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:49.534997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:49.536275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:49.632549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:49.634846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:49.658194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:49.658786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:49.659239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:49.660776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:49.661584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:49.662183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:49.681161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:49.698386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:49.700518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:49.705501 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7435cf3b-a4fd-49ec-ae70-f3846e726998 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.191101 Oct 22 03:10:49.710542 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 903/1795] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:49 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:49.761981 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c39e621-33eb-439f-ae78-854e7f809643 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135031 Oct 22 03:10:49.768058 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 893/1796] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:10:49 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:10:50.538964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:50.539531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:50.559834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:50.560645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:50.561207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:50.562544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:50.563170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:50.563310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:50.563929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:50.567989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:50.575554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:50.576347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:50.577126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:50.578018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:50.587545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:50.588032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:51.044967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:51.058214 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-415f08e2-d6bb-4575-8150-6168950dbd6b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1316 microversion: 2.1 time: 0.522327 Oct 22 03:10:51.058862 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 904/1797] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:50 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:51.069552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:51.075296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:51.089460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:51.093019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:51.093719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:51.104594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:51.105556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:51.106196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:51.382598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:51.397143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:51.406409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:51.408082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1092916d-4bee-4f38-880f-4b94f0c7e6fd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.347795 Oct 22 03:10:51.414802 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 905/1798] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:51 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:51.419994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:51.422453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:51.439721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:51.444065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:51.444779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:51.445842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:51.446467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:51.447054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:51.511229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:51.587215 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20f1a6d5-e3b9-4c9b-bf6c-f1e6f6900ae4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.152074 Oct 22 03:10:51.589591 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 906/1799] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:10:51 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:10:51.711269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:51.722413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bbc556bc-8fe5-4264-819b-fd4f6ba26e49 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 1.164922 Oct 22 03:10:51.738858 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 894/1800] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:50 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:52.082785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:52.084235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:52.102462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:52.103218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:52.103426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:52.106223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:52.106707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:52.110455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:52.442272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:52.443237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:52.471781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:52.476900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:52.477540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:52.478482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:52.479131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:52.479736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:52.607442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:52.665353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:52.683353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:52.697220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:52.699405 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc9746d9-c866-4ca0-92a5-a3492a58adaf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.263725 Oct 22 03:10:52.700201 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 895/1801] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:52 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:10:52.703299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:52.720229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:52.724400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:52.735271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:52.736662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:52.737577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:52.739124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:52.741199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:52.744474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:52.835438 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50cb235c-5831-4244-a7d1-24c7b3cfd166 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131746 Oct 22 03:10:52.836513 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 896/1802] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:10:52 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:10:52.844252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:52.845567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:52.860953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:52.861751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:52.862366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:52.868270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:52.869038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:52.875746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:53.381369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:53.389884 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dbc4a783-8a3e-4cbe-befc-3afc5b4338db tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1316 microversion: 2.1 time: 1.311853 Oct 22 03:10:53.396720 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 907/1803] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:52 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1316 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:53.406807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:53.440158 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31407042-1f49-4721-ab47-8558c7bf0888 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.602182 Oct 22 03:10:53.457380 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 897/1804] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:52 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:53.714998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-c8f1f3d9-9b0f-4747-b20f-bd30759cda6e req-8ff4fa3f-6c14-4680-ae0a-b9468dff0544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d06f74-8bce-421f-8379-dc90bd333545", "tag": "e0ba3b86-8ae4-4228-803b-c5af07c92921"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:53.732514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:53.733717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c8f1f3d9-9b0f-4747-b20f-bd30759cda6e req-8ff4fa3f-6c14-4680-ae0a-b9468dff0544 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:53.734132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:53.734279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c8f1f3d9-9b0f-4747-b20f-bd30759cda6e req-8ff4fa3f-6c14-4680-ae0a-b9468dff0544 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:53.734613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c8f1f3d9-9b0f-4747-b20f-bd30759cda6e req-8ff4fa3f-6c14-4680-ae0a-b9468dff0544 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:53.750818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:53.752784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:53.753410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:53.755523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:53.756861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:53.758105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:53.762296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:10:53.766567 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-c8f1f3d9-9b0f-4747-b20f-bd30759cda6e req-8ff4fa3f-6c14-4680-ae0a-b9468dff0544 service nova] Creating event network-changed:e0ba3b86-8ae4-4228-803b-c5af07c92921 for instance 09d06f74-8bce-421f-8379-dc90bd333545 on n-h1-862416-2 Oct 22 03:10:53.785871 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-c8f1f3d9-9b0f-4747-b20f-bd30759cda6e req-8ff4fa3f-6c14-4680-ae0a-b9468dff0544 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074205 Oct 22 03:10:53.787196 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 908/1805] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:53.851832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:53.855424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:53.871300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:53.872088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:53.876906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:53.877925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:53.878563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:53.879680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:53.903727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:53.915689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:53.925668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:53.928539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b11c4320-e29c-4259-97bd-3a5537aa0034 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.201199 Oct 22 03:10:53.929456 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 898/1806] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:53 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:10:53.954107 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be7bfb9a-0bb3-40ec-a3be-ff9559ea339d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.107892 Oct 22 03:10:53.955336 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 909/1807] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:10:53 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:10:54.427997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:54.428914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:54.470817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:54.471723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:54.472194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:54.473600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:54.473600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:54.474382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:54.479002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:54.479646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:54.487546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:54.489239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:54.489944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:54.490893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:54.491545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:54.492147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:54.900688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:54.916413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cad69b1d-a494-4d0d-8f19-6cf78a325bcd tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1316 microversion: 2.1 time: 0.491784 Oct 22 03:10:54.919714 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 899/1808] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:54 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:54.966504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:54.967684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:54.982583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:54.983083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:54.983528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:54.984275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:54.985021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:54.985517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:55.128369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:55.149871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:55.155730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:55.157542 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30985eb8-0a6d-4a98-b90e-c36ba02737e4 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.197194 Oct 22 03:10:55.160014 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 900/1809] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:54 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:10:55.166953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:55.168994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:55.179665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:55.180184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:55.180669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:55.181498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:55.181967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:55.182404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:55.220363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:55.229724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dc43264a-d2ec-4e17-9ede-6da2a65b7061 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.769330 Oct 22 03:10:55.232443 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 910/1810] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:54 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:55.255914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0c404c4d-0e8b-4745-a295-bebbabdae672 req-2271367c-dd96-4ef2-86a7-6868353482ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "name": "network-vif-unplugged", "status": "completed", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:55.287275 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8750b77a-20b8-4f25-b5f7-c923c410e9ae tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.125841 Oct 22 03:10:55.291095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0c404c4d-0e8b-4745-a295-bebbabdae672 req-2271367c-dd96-4ef2-86a7-6868353482ba service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:55.292128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0c404c4d-0e8b-4745-a295-bebbabdae672 req-2271367c-dd96-4ef2-86a7-6868353482ba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:55.292854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0c404c4d-0e8b-4745-a295-bebbabdae672 req-2271367c-dd96-4ef2-86a7-6868353482ba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:55.306676 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 901/1811] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:10:55 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:55.344516 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0c404c4d-0e8b-4745-a295-bebbabdae672 req-2271367c-dd96-4ef2-86a7-6868353482ba service nova] Creating event network-vif-unplugged:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h2-862416-2 Oct 22 03:10:55.364838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-0c404c4d-0e8b-4745-a295-bebbabdae672 req-2271367c-dd96-4ef2-86a7-6868353482ba service nova] Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:10:55.432415 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0c404c4d-0e8b-4745-a295-bebbabdae672 req-2271367c-dd96-4ef2-86a7-6868353482ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193118 Oct 22 03:10:55.435456 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 911/1812] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:10:55.950549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:55.951329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:55.969860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:55.970375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:55.970815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:55.971542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:55.972150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:55.973284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:56.189181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:56.190363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:56.223047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:56.224371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:56.224371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:56.225260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:56.250832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:56.251667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:57.127478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:57.145837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:57.147327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:57.157850 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61013713-b468-44f7-bdc1-9d7fcdf649cf tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1408 microversion: 2.54 time: 0.974200 Oct 22 03:10:57.164560 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 912/1813] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:56 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1408 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:57.179993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:57.183024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:57.205891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:57.210797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:57.211517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:57.212483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:57.213119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:57.213748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:57.521063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:57.531957 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2630a2ca-ca20-451c-9e93-434bcfee314c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1316 microversion: 2.1 time: 1.590755 Oct 22 03:10:57.545741 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 902/1814] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:55 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1316 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:57.780833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:57.790193 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97453ae4-70dd-4a01-bc01-5ea9facb6fe4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.624166 Oct 22 03:10:57.790786 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 913/1815] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:57 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:58.188529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:58.189446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:58.208533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:58.209324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:58.210098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:58.211029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:58.211667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:58.212304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:58.500691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2e0de763-1489-4773-93a4-039c54b44e7e req-ba2fbf1a-7a1e-4ef4-91d3-0fc6267e4274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:10:58.530016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2e0de763-1489-4773-93a4-039c54b44e7e req-ba2fbf1a-7a1e-4ef4-91d3-0fc6267e4274 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:58.532096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2e0de763-1489-4773-93a4-039c54b44e7e req-ba2fbf1a-7a1e-4ef4-91d3-0fc6267e4274 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:58.534306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2e0de763-1489-4773-93a4-039c54b44e7e req-ba2fbf1a-7a1e-4ef4-91d3-0fc6267e4274 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:58.569735 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2e0de763-1489-4773-93a4-039c54b44e7e req-ba2fbf1a-7a1e-4ef4-91d3-0fc6267e4274 service nova] Creating event network-changed:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h2-862416-2 Oct 22 03:10:58.588408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-2e0de763-1489-4773-93a4-039c54b44e7e req-ba2fbf1a-7a1e-4ef4-91d3-0fc6267e4274 service nova] Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:10:58.617333 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2e0de763-1489-4773-93a4-039c54b44e7e req-ba2fbf1a-7a1e-4ef4-91d3-0fc6267e4274 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119664 Oct 22 03:10:58.623639 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 914/1816] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:10:58.643825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:58.645349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:58.657190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:58.669744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:58.670228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:58.670986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:58.671506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:58.671933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:58.724452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:58.734018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:58.741289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:58.742583 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f38a5d3-7d8d-4854-9eab-1ee0e62b685f tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1414 microversion: 2.54 time: 0.558165 Oct 22 03:10:58.771229 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 903/1817] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:58 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1414 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:10:58.814532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:58.815104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:58.832632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:58.835184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:58.845405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:58.848967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:58.851633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:58.853444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:59.632970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:59.643692 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a82a53c-d929-45c3-bb35-a09e86931ada tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1316 microversion: 2.1 time: 1.018036 Oct 22 03:10:59.648183 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 915/1818] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:58 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1316 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:59.677063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:10:59.687868 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87584064-c1c1-4e80-9c05-3725a97b3c84 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.877226 Oct 22 03:10:59.705751 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 904/1819] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:10:58 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:10:59.787567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:10:59.790211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:10:59.803200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:59.803978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:59.805960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:10:59.807159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:10:59.812503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:10:59.813550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:00.174562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:00.251405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:00.270804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:00.280371 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a2a3ffa7-9ffb-4a50-b2e3-5789b84cff5e tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1414 microversion: 2.54 time: 0.507396 Oct 22 03:11:00.286860 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 916/1820] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:10:59 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1414 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:00.681010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:00.682472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:00.697745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:00.700649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:00.701537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:00.704258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:00.709499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:00.711475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:00.713473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:00.714686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:00.755529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:00.758944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:00.759688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:00.766357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:00.767102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:00.768749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:01.185688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:01.194657 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e635cf5-c9bc-4bc8-bd88-c02e6d71ff3f tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1316 microversion: 2.1 time: 0.517915 Oct 22 03:11:01.215255 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 905/1821] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:00 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1316 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:01.220950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5c8abac7-f91c-4bf1-9c2e-936219431201 req-01b3c603-8ff4-4e77-a216-e1ef8c0313ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d06f74-8bce-421f-8379-dc90bd333545", "name": "network-vif-plugged", "status": "completed", "tag": "e0ba3b86-8ae4-4228-803b-c5af07c92921"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:01.235463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5c8abac7-f91c-4bf1-9c2e-936219431201 req-01b3c603-8ff4-4e77-a216-e1ef8c0313ef service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:01.236413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5c8abac7-f91c-4bf1-9c2e-936219431201 req-01b3c603-8ff4-4e77-a216-e1ef8c0313ef service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:01.237166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5c8abac7-f91c-4bf1-9c2e-936219431201 req-01b3c603-8ff4-4e77-a216-e1ef8c0313ef service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:01.250620 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5c8abac7-f91c-4bf1-9c2e-936219431201 req-01b3c603-8ff4-4e77-a216-e1ef8c0313ef service nova] Creating event network-vif-plugged:e0ba3b86-8ae4-4228-803b-c5af07c92921 for instance 09d06f74-8bce-421f-8379-dc90bd333545 on n-h1-862416-2 Oct 22 03:11:01.257552 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5c8abac7-f91c-4bf1-9c2e-936219431201 req-01b3c603-8ff4-4e77-a216-e1ef8c0313ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040359 Oct 22 03:11:01.258890 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 906/1822] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:01.315656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:01.316953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:01.335491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:01.336224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:01.336843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:01.339530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:01.340934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:01.344254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:01.499314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:01.513479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:01.518999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:01.522359 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-488a380b-b391-4e70-a250-290a510b8f57 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1399 microversion: 2.54 time: 0.211016 Oct 22 03:11:01.522547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:01.531115 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fc933f97-3d93-49dd-92c8-efdd1942d223 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.821585 Oct 22 03:11:01.531888 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 917/1823] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:00 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:01.532605 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 907/1824] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:01 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1399 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:01.577334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4ee52fc8-1b72-4b0a-b587-3ff41efa8057 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '.version_select at 0x7f0d1e5854c0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:01.660081 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4ee52fc8-1b72-4b0a-b587-3ff41efa8057 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1127453781" status: 204 len: 0 microversion: 2.54 time: 0.078223 Oct 22 03:11:01.666853 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 918/1825] 10.222.0.25 () {60 vars in 1319 bytes} [Sat Oct 22 03:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1127453781 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:11:01.681596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:01.682105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:01.702901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:01.703397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:01.703837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:01.707761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:01.708280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:01.708882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:01.747452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:01.754651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:01.897924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:01.959619 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a94e0350-ae73-435b-ba4c-ba288f904265 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "DELETE /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 204 len: 0 microversion: 2.54 time: 0.267637 Oct 22 03:11:01.978696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:01.979481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:01.983447 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 908/1826] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:11:01 2022] DELETE /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:11:02.001810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:02.003442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:02.005316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:02.006674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:02.013559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:02.018169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:02.018674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:02.198926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:02.209981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:02.229676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:02.232407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:02.237691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:02.243991 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd06ba85-a3e1-44f3-9bd4-4ffce22db721 tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1405 microversion: 2.54 time: 0.270365 Oct 22 03:11:02.248343 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 919/1827] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:01 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:02.252805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:02.254097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:02.254804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:02.255708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:02.256353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:02.256943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:02.958691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:02.959619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:02.977938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:02.978489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:02.979647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:02.982989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:02.983755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:02.986619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:03.175048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:03.187856 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dddcef8c-6a93-4e98-ad3d-084eb6a840ef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1316 microversion: 2.1 time: 0.965830 Oct 22 03:11:03.191931 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 909/1828] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:02 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1316 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:03.307260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:03.337550 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-da13381e-82f4-4b61-bd39-6c569c86c4cb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.776449 Oct 22 03:11:03.378343 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 920/1829] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:02 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:03.398486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:03.404880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:03.420313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:03.421037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:03.421671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:03.423905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:03.424767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:03.426086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:03.579914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:03.594575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:03.596487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:03.599690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f7dcd0b-ba41-4b07-a549-63b2e3df6280 tempest-FlavorsV2NegativeTest-869181838 tempest-FlavorsV2NegativeTest-869181838-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:03.600183 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-adcba4c2-35b2-40b2-81a9-6bf27d1c7add tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1405 microversion: 2.54 time: 0.220178 Oct 22 03:11:03.601588 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 921/1830] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:03 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:03.628232 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f7dcd0b-ba41-4b07-a549-63b2e3df6280 tempest-FlavorsV2NegativeTest-869181838 tempest-FlavorsV2NegativeTest-869181838-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.398987 Oct 22 03:11:03.631387 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 910/1831] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:11:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:11:04.213390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:04.214009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:04.221095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.221597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.222039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.223452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.224172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.224987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.375797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:04.375797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:04.380481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.382022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.382666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.384620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.386287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.386910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.636582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:04.645913 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4578ad79-c52f-4c8a-b618-e1c7afe8e173 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1466 microversion: 2.1 time: 0.436101 Oct 22 03:11:04.651804 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 922/1832] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:04 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1466 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:04.657374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:04.665210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:04.681550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.682132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.682655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.683451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.688808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.690001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.711269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:04.734248 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-642b1c99-8cec-4cb0-9f15-08f44f2bacb3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.365339 Oct 22 03:11:04.746651 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 911/1833] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:04 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:04.761052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:04.764117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:04.767109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.769560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.772017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.772694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lazy-loading 'fault' on Instance uuid 82be2659-c7b7-49d0-98c4-0c2ea68d76c0 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:04.773225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.774269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.774945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.776161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:04.776900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:04.777495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:04.868467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:04.881646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:04.883080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:04.888254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f6c8b09b-05db-4989-8b2e-c6b6a969d84d tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1410 microversion: 2.54 time: 0.230728 Oct 22 03:11:04.889173 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 923/1834] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:04 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1410 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:04.896733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf9edab7-00ff-454a-9524-6d288e46b8d1 tempest-FlavorsV2NegativeTest-869181838 tempest-FlavorsV2NegativeTest-869181838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-70818563", "imageRef": "c0038a1b-1e30-42cd-939d-a3efbff1ed5d", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:05.002621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-cf9edab7-00ff-454a-9524-6d288e46b8d1 tempest-FlavorsV2NegativeTest-869181838 tempest-FlavorsV2NegativeTest-869181838-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:11:05.022189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e9b0230-bea8-4a37-b53c-feccb993a0c7 tempest-ServersOnMultiNodesTest-448354637 tempest-ServersOnMultiNodesTest-448354637-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1617 microversion: 2.1 time: 0.274363 Oct 22 03:11:05.023049 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 912/1835] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:04 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1617 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:05.055264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:05.056103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:05.074343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:05.075746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:05.077528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:05.078510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:05.079845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:05.081158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:05.141014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:05.310593 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d1bdb2f9-b395-4af6-90cb-a53509dacffe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 204 len: 0 microversion: 2.1 time: 0.261029 Oct 22 03:11:05.313427 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 913/1836] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:05 2022] DELETE /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:05.330248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:05.331401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:05.341864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:05.342929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:05.343662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:05.344631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:05.345335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:05.345993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:05.498990 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-cf9edab7-00ff-454a-9524-6d288e46b8d1 tempest-FlavorsV2NegativeTest-869181838 tempest-FlavorsV2NegativeTest-869181838-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf9edab7-00ff-454a-9524-6d288e46b8d1 tempest-FlavorsV2NegativeTest-869181838 tempest-FlavorsV2NegativeTest-869181838-project] Request method failure captured: Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 141 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19Hs4fwKiI2jzk7rbduuKmzxuH-485QnkQgrCs51yzh67rXFtz0KF4InAtVlFniePEkFZF2g0mRfRqspcbnk5PCu8IJWCNhycI8A79D-9rS4ONmWwI9eNvpK4zyeFJTyYvq804lAzUgcOzPHLg6r6iSovkSVedSl5-z4smeF1cuDCQ Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 69d0e296534d4378a12afec96b3f78d7 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FlavorsV2NegativeTest-869181838 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69d0e296534d4378a12afec96b3f78d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d0e296534d4378a12afec96b3f78d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69d0e296534d4378a12afec96b3f78d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69d0e296534d4378a12afec96b3f78d7"}]}] Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FlavorsV2NegativeTest-869181838 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 69d0e296534d4378a12afec96b3f78d7 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-869181838 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FlavorsV2NegativeTest-869181838-project Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: bf6d703985714ad7bd04627a13a2a948 Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FlavorsV2NegativeTest-869181838-project Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-70818563", "imageRef": "c0038a1b-1e30-42cd-939d-a3efbff1ed5d", "flavorRef": "452"}} Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: exception: Flavor's memory is too small for requested image. Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-70818563', 'imageRef': 'c0038a1b-1e30-42cd-939d-a3efbff1ed5d', 'flavorRef': '452'}}} Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:11:05.501845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf9edab7-00ff-454a-9524-6d288e46b8d1 tempest-FlavorsV2NegativeTest-869181838 tempest-FlavorsV2NegativeTest-869181838-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cf9edab7-00ff-454a-9524-6d288e46b8d1 tempest-FlavorsV2NegativeTest-869181838 tempest-FlavorsV2NegativeTest-869181838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.613418 Oct 22 03:11:05.507793 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 924/1837] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:11:04 2022] POST /compute/v2.1/servers => generated 93 bytes in 615 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:11:05.636049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:05.648112 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ade3d2a7-b28d-4e9e-8492-a9120be5a837 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1472 microversion: 2.1 time: 0.324823 Oct 22 03:11:05.648800 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 914/1838] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:05 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:05.761011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:05.761801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:05.769713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:05.770483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:05.770929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:05.771645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:05.772361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:05.772893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:05.920017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:05.921229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:05.933814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:05.936335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:05.937603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:05.938532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:05.939030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:05.939496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:05.971102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:05.975316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:05.986257 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3921e2f2-ed0f-42e5-94d2-6606d4c9c67b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1470 microversion: 2.1 time: 0.229763 Oct 22 03:11:05.991930 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 925/1839] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:05 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:06.024475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:06.025216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:06.026229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:06.026812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lazy-loading 'fault' on Instance uuid 82be2659-c7b7-49d0-98c4-0c2ea68d76c0 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:06.107847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:06.124489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:06.130271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33b584dfb29e4db39f7a9108a5b1f80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d52ab3a1a94b57aaf1516648901c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:06.133969 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39b33bdd-4cbc-4548-ae9f-39418dee2cbd tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 200 len: 1410 microversion: 2.54 time: 0.218637 Oct 22 03:11:06.149185 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 915/1840] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:05 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 1410 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:06.675096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:06.677042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:06.689280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:06.690105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:06.691714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:06.692838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:06.693599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:06.696456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:07.015025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:07.015645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:07.029733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:07.039392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:07.045651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:07.046631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:07.049986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:07.051238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:07.521217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:07.532774 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a394ba69-f65b-45b3-9f28-ea0543d9c78e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1472 microversion: 2.1 time: 0.863945 Oct 22 03:11:07.534165 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 926/1841] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:06 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1472 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:07.540358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:07.541286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] [instance: 82be2659-c7b7-49d0-98c4-0c2ea68d76c0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:07.547437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:07.548527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:07.549206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:07.551089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:07.551886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:07.552617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:07.569741 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] HTTP exception thrown: Instance 82be2659-c7b7-49d0-98c4-0c2ea68d76c0 could not be found. Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Request method failure captured: Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 HTTP/1.1 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU18dfBpy28fJr2VSjGYIgrYXNP0oUOWnEJdOboD-OLPx-3kERPwOXQb8ZKq8BqDLJ4hYhxY7DcnV_Wv-8D7LJKsHc0AZtqMFaS5s12hjM1afCt43NRIMgNdgaO4ywbYDkbU1J9dEOmIDTUlQLfFKWE63FEjBVEnWdxtLVjaB8lZ-wt4 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.54 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e0d52ab3a1a94b57aaf1516648901c71 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerShowV254Test-1574606886 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e0d52ab3a1a94b57aaf1516648901c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0d52ab3a1a94b57aaf1516648901c71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e0d52ab3a1a94b57aaf1516648901c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0d52ab3a1a94b57aaf1516648901c71"}]}] Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerShowV254Test-1574606886 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e0d52ab3a1a94b57aaf1516648901c71 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerShowV254Test-1574606886 Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerShowV254Test-1574606886-project Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 33b584dfb29e4db39f7a9108a5b1f80a Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerShowV254Test-1574606886-project Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 82be2659-c7b7-49d0-98c4-0c2ea68d76c0 could not be found. Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '82be2659-c7b7-49d0-98c4-0c2ea68d76c0'} Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82be2659-c7b7-49d0-98c4-0c2ea68d76c0 could not be found. Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82be2659-c7b7-49d0-98c4-0c2ea68d76c0 could not be found. Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:07.572124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:07.578618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:07.578618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:07.578618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:07.578618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:07.578618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:07.578618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82be2659-c7b7-49d0-98c4-0c2ea68d76c0 could not be found. Oct 22 03:11:07.578618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:07.581024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] Returning 404 to user: Instance 82be2659-c7b7-49d0-98c4-0c2ea68d76c0 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:07.582437 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ec728ba7-ba7a-48bb-b4e8-8756365168de tempest-ServerShowV254Test-1574606886 tempest-ServerShowV254Test-1574606886-project] 10.222.0.25 "GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0" status: 404 len: 111 microversion: 2.54 time: 0.046512 Oct 22 03:11:07.583538 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 927/1842] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:07 2022] GET /compute/v2.1/servers/82be2659-c7b7-49d0-98c4-0c2ea68d76c0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:11:07.668170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:07.680920 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39f9d56e-5386-4b1a-8af9-8d8d1153b8c5 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1463 microversion: 2.1 time: 0.669976 Oct 22 03:11:07.685746 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 916/1843] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:07 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1463 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:11:07.706364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:07.708938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:07.720237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:07.723716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:07.724420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:07.725598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:07.726256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:07.730873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:08.065477 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6b72ddff-4dec-49da-a0d6-75ec2e1833ba tempest-MigrationsAdminTest-150818177 tempest-MigrationsAdminTest-150818177-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1614 microversion: 2.1 time: 0.362964 Oct 22 03:11:08.086843 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 928/1844] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:07 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1614 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:08.126885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:08.127533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:08.143844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:08.145696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:08.149838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:08.150952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:08.153042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:08.154076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:08.268779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:08.494080 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f16f7a93-5ca8-4eb4-8bc8-1780698be069 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 204 len: 0 microversion: 2.1 time: 0.374151 Oct 22 03:11:08.494689 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 917/1845] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:08 2022] DELETE /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:08.503578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:08.504596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:08.514749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:08.516005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:08.518130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:08.519923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:08.520779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:08.521715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:08.565687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:08.567259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:08.607883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:08.613711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:08.616415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:08.623698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:08.624735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:08.627942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:09.028292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:09.044800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2545f2a-f8a7-493d-9a44-1c9d5c3f84d2 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1430 microversion: 2.1 time: 0.485680 Oct 22 03:11:09.047316 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 918/1846] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:08 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1430 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:11:09.086535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8622ec91-ef57-4aa7-80d1-a5ecfc4aafdd req-3ed1e3fc-17c5-449f-9e0f-487802a83fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d06f74-8bce-421f-8379-dc90bd333545", "name": "network-vif-deleted", "tag": "e0ba3b86-8ae4-4228-803b-c5af07c92921"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:09.111714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8622ec91-ef57-4aa7-80d1-a5ecfc4aafdd req-3ed1e3fc-17c5-449f-9e0f-487802a83fec service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:09.116977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8622ec91-ef57-4aa7-80d1-a5ecfc4aafdd req-3ed1e3fc-17c5-449f-9e0f-487802a83fec service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:09.117434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8622ec91-ef57-4aa7-80d1-a5ecfc4aafdd req-3ed1e3fc-17c5-449f-9e0f-487802a83fec service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:09.172870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8622ec91-ef57-4aa7-80d1-a5ecfc4aafdd req-3ed1e3fc-17c5-449f-9e0f-487802a83fec service nova] Creating event network-vif-deleted:e0ba3b86-8ae4-4228-803b-c5af07c92921 for instance 09d06f74-8bce-421f-8379-dc90bd333545 on n-h1-862416-2 Oct 22 03:11:09.177965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:09.187679 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3e34d92-5e3a-4b9c-88d1-18e4cda2d509 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1469 microversion: 2.1 time: 0.688437 Oct 22 03:11:09.192629 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 929/1847] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:08 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1469 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:09.194228 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8622ec91-ef57-4aa7-80d1-a5ecfc4aafdd req-3ed1e3fc-17c5-449f-9e0f-487802a83fec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116620 Oct 22 03:11:09.195823 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 919/1848] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 22 03:11:09.464506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8c8cf9b-99c3-4e7a-93ec-b1c5d1fd0fdd tempest-FlavorsV261TestJSON-1108122688 tempest-FlavorsV261TestJSON-1108122688-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-238576122", "id": 543070666, "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:09.498224 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f8c8cf9b-99c3-4e7a-93ec-b1c5d1fd0fdd tempest-FlavorsV261TestJSON-1108122688 tempest-FlavorsV261TestJSON-1108122688-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.304170 Oct 22 03:11:09.500200 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 930/1849] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:11:09 2022] POST /compute/v2.1/flavors => generated 464 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:11:09.914400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a206ef0-be97-452f-a7c1-711c0643e75d tempest-FlavorsV261TestJSON-112328910 tempest-FlavorsV261TestJSON-112328910-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:09.931605 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0a206ef0-be97-452f-a7c1-711c0643e75d tempest-FlavorsV261TestJSON-112328910 tempest-FlavorsV261TestJSON-112328910-project] 10.222.0.25 "GET /compute/v2.1/flavors/543070666" status: 200 len: 464 microversion: 2.61 time: 0.415310 Oct 22 03:11:09.942699 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 920/1850] 10.222.0.25 () {60 vars in 1196 bytes} [Sat Oct 22 03:11:09 2022] GET /compute/v2.1/flavors/543070666 => generated 464 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:11:09.947777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-69e9e3df-afce-4391-b2ba-2c9f3252d75f tempest-FlavorsV261TestJSON-1108122688 tempest-FlavorsV261TestJSON-1108122688-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:10.032350 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-69e9e3df-afce-4391-b2ba-2c9f3252d75f tempest-FlavorsV261TestJSON-1108122688 tempest-FlavorsV261TestJSON-1108122688-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/543070666" status: 200 len: 465 microversion: 2.61 time: 0.088202 Oct 22 03:11:10.036090 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 931/1851] 10.222.0.25 () {62 vars in 1216 bytes} [Sat Oct 22 03:11:09 2022] PUT /compute/v2.1/flavors/543070666 => generated 465 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:11:10.054581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-79cabed9-818c-41fa-8754-ff50758e9595 tempest-FlavorsV261TestJSON-112328910 tempest-FlavorsV261TestJSON-112328910-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:10.069260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:10.071665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:10.095767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:10.096638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:10.104553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:10.109145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:10.109772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:10.111453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:10.122304 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-79cabed9-818c-41fa-8754-ff50758e9595 tempest-FlavorsV261TestJSON-112328910 tempest-FlavorsV261TestJSON-112328910-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.073657 Oct 22 03:11:10.123939 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 921/1852] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:11:10 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:10.149098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e16c97f-b82c-4ddd-8d4a-98a9d59bb52b tempest-FlavorsV261TestJSON-112328910 tempest-FlavorsV261TestJSON-112328910-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:10.177980 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4e16c97f-b82c-4ddd-8d4a-98a9d59bb52b tempest-FlavorsV261TestJSON-112328910 tempest-FlavorsV261TestJSON-112328910-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.034758 Oct 22 03:11:10.194732 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 922/1853] 10.222.0.25 () {60 vars in 1166 bytes} [Sat Oct 22 03:11:10 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:10.201430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc71a6bf-c2cf-4272-bf7f-4c9eb4bca747 tempest-FlavorsV261TestJSON-1108122688 tempest-FlavorsV261TestJSON-1108122688-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:10.234241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:10.235754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:10.236416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:10.237101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lazy-loading 'fault' on Instance uuid 09d06f74-8bce-421f-8379-dc90bd333545 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:10.247564 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc71a6bf-c2cf-4272-bf7f-4c9eb4bca747 tempest-FlavorsV261TestJSON-1108122688 tempest-FlavorsV261TestJSON-1108122688-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/543070666" status: 202 len: 0 microversion: 2.61 time: 0.050845 Oct 22 03:11:10.248524 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 923/1854] 10.222.0.25 () {60 vars in 1199 bytes} [Sat Oct 22 03:11:10 2022] DELETE /compute/v2.1/flavors/543070666 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:10.262200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:10.263155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:10.277057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:10.278016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:10.278738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:10.279659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:10.280338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:10.281032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:10.398562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:10.407169 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-09f4acc5-f486-4096-a349-15ba372b8434 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 200 len: 1306 microversion: 2.1 time: 0.341958 Oct 22 03:11:10.428877 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 932/1855] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:10 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 1306 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:11:10.453993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2a2811b-706f-4813-b2a4-6c1d93d5e932 tempest-FlavorsV261TestJSON-1108122688 tempest-FlavorsV261TestJSON-1108122688-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:10.492945 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2a2811b-706f-4813-b2a4-6c1d93d5e932 tempest-FlavorsV261TestJSON-1108122688 tempest-FlavorsV261TestJSON-1108122688-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.061740 Oct 22 03:11:10.509458 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 933/1856] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:11:10 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:11.029011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8ed2ec8e-609e-41d2-a871-cd449f5dbd64 req-563fe296-e876-4336-b032-e360504b7100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "name": "network-vif-plugged", "status": "completed", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:11.059141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8ed2ec8e-609e-41d2-a871-cd449f5dbd64 req-563fe296-e876-4336-b032-e360504b7100 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:11.061617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8ed2ec8e-609e-41d2-a871-cd449f5dbd64 req-563fe296-e876-4336-b032-e360504b7100 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:11.062288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8ed2ec8e-609e-41d2-a871-cd449f5dbd64 req-563fe296-e876-4336-b032-e360504b7100 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:11.109932 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8ed2ec8e-609e-41d2-a871-cd449f5dbd64 req-563fe296-e876-4336-b032-e360504b7100 service nova] Creating event network-vif-plugged:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h2-862416-2 Oct 22 03:11:11.119154 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8ed2ec8e-609e-41d2-a871-cd449f5dbd64 req-563fe296-e876-4336-b032-e360504b7100 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095328 Oct 22 03:11:11.122211 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 934/1857] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:11:11.325696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:11.336100 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d59031eb-16a0-4593-8400-9589da27fea3 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1469 microversion: 2.1 time: 1.080498 Oct 22 03:11:11.349336 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 924/1858] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:10 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1469 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:11.436426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:11.437134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 09d06f74-8bce-421f-8379-dc90bd333545] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:11.463753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:11.476293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:11.476664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:11.481264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:11.485828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:11.486274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:11.528103 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] HTTP exception thrown: Instance 09d06f74-8bce-421f-8379-dc90bd333545 could not be found. Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Request method failure captured: Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 HTTP/1.1 Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16zimHwY5iLTHbCvPbLZ-qkg-tcGCQiU02cSEV0smK-Tezga1WSo0_EsLTUi_4fWe2A66mM002tfCOzuPfc2FUSUEIF9XC1_dWHqBCWVr8B3OinThmDIyqA_0yZJN7JEMODItmoH0AmTLtqRRo3e9Gn5ZTWup_qOL1SXkRdUEuIs5E Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e462137d650486c919790a05aa876dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e462137d650486c919790a05aa876dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}] Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3fb696d229f74155947d6e4f89e16f5a Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 09d06f74-8bce-421f-8379-dc90bd333545 could not be found. Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '09d06f74-8bce-421f-8379-dc90bd333545'} Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d06f74-8bce-421f-8379-dc90bd333545 could not be found. Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d06f74-8bce-421f-8379-dc90bd333545 could not be found. Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:11.532105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d06f74-8bce-421f-8379-dc90bd333545 could not be found. Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Returning 404 to user: Instance 09d06f74-8bce-421f-8379-dc90bd333545 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:11.540845 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9998ea8e-938c-461e-bafa-f36974d5ad57 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545" status: 404 len: 111 microversion: 2.1 time: 0.103380 Oct 22 03:11:11.542295 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 935/1859] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:11 2022] GET /compute/v2.1/servers/09d06f74-8bce-421f-8379-dc90bd333545 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:11.544119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:11.544656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:11.556099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:11.556657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:11.557084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:11.557845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:11.568781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:11.569167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:11.639832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:11.654443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:11.828442 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8d051b9-6e8f-414e-a3ca-a86028d35286 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 204 len: 0 microversion: 2.1 time: 0.287868 Oct 22 03:11:11.839772 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 925/1860] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:11 2022] DELETE /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:11.846624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:11.847531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:11.864626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:11.865011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:11.865453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:11.870814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:11.871364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:11.871813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:12.058950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7d448f45-d493-4cf3-829a-157c56cd3a3f req-1a07e4d1-40e0-4c27-9b2c-8f5fbbc35ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8437bbf5-3258-4770-ad51-75602cbe8eb2", "name": "network-vif-deleted", "tag": "1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:12.090153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7d448f45-d493-4cf3-829a-157c56cd3a3f req-1a07e4d1-40e0-4c27-9b2c-8f5fbbc35ce0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:12.090778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7d448f45-d493-4cf3-829a-157c56cd3a3f req-1a07e4d1-40e0-4c27-9b2c-8f5fbbc35ce0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:12.091079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7d448f45-d493-4cf3-829a-157c56cd3a3f req-1a07e4d1-40e0-4c27-9b2c-8f5fbbc35ce0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:12.119658 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7d448f45-d493-4cf3-829a-157c56cd3a3f req-1a07e4d1-40e0-4c27-9b2c-8f5fbbc35ce0 service nova] Creating event network-vif-deleted:1fdba374-ee5f-4e9c-8d64-7fcd9e5cb5ac for instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 on n-h2-862416-2 Oct 22 03:11:12.130652 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7d448f45-d493-4cf3-829a-157c56cd3a3f req-1a07e4d1-40e0-4c27-9b2c-8f5fbbc35ce0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079424 Oct 22 03:11:12.131973 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 926/1861] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:12.379652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:12.381258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:12.400723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:12.401566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:12.402275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:12.403255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:12.403943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:12.404626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:12.574194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:12.583366 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d28fb5c0-769a-4e1c-a7d7-700830250bb0 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1427 microversion: 2.1 time: 0.208147 Oct 22 03:11:12.584321 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 927/1862] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:12 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1427 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:11:12.697791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:12.717103 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba590681-7d3b-4153-9c49-4091a95d09b4 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1472 microversion: 2.1 time: 0.877039 Oct 22 03:11:12.718511 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 936/1863] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:11 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1472 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:13.611437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:13.613299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:13.641771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:13.642479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:13.643072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:13.644494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:13.649938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:13.651939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:13.741982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:13.742772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:13.759113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:13.759996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:13.762772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:13.764465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:13.766644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:13.771792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:13.781270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:13.783702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:13.788920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:13.789723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lazy-loading 'fault' on Instance uuid 8437bbf5-3258-4770-ad51-75602cbe8eb2 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:13.926939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:13.942578 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e2b15028-2d71-46bb-9ba8-f4a7617e5720 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 200 len: 1303 microversion: 2.1 time: 0.336935 Oct 22 03:11:13.943192 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 928/1864] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:13 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 1303 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:14.309137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:14.325400 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-95487e10-d52e-4fc6-898e-556f022f4627 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1472 microversion: 2.1 time: 0.587200 Oct 22 03:11:14.326397 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 937/1865] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:13 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1472 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:14.969307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:14.969903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 8437bbf5-3258-4770-ad51-75602cbe8eb2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:14.991485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:14.991979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:14.992459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:14.993414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:14.994066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:14.994671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:15.026669 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] HTTP exception thrown: Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 could not be found. Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Request method failure captured: Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 HTTP/1.1 Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14X8aRx4oWjyCNI0FEvHOo_3lZFAHjkfHmQbjdefyNGUy6xwT07237PSMAR7OJREsU9UQS7rcef7-4TJ09J8-pxQnzHMdMPshroxpMfMF7YTsSGxGxMD4MctUgveBbhkWWNVfs0-RNjg_DI-Oy1sGg7vIk5YZNqZx6IByN-RaT5Jlk Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a10e488b35c54f6f9a5f4ede2520083f Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a10e488b35c54f6f9a5f4ede2520083f"}]}] Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a10e488b35c54f6f9a5f4ede2520083f Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-MigrationsAdminTest-1944439124-project Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bf9da8e55124a7aae0938bb828b8f8a Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-MigrationsAdminTest-1944439124-project Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 could not be found. Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '8437bbf5-3258-4770-ad51-75602cbe8eb2'} Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 could not be found. Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 could not be found. Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:15.028690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:15.034878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:15.034878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:15.034878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:15.034878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:15.034878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:15.034878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 could not be found. Oct 22 03:11:15.034878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:15.036449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Returning 404 to user: Instance 8437bbf5-3258-4770-ad51-75602cbe8eb2 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:15.037521 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b781f6d4-5bf1-4c80-8d12-e08a8ba0aad6 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2" status: 404 len: 111 microversion: 2.1 time: 0.072229 Oct 22 03:11:15.038267 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 929/1866] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:14 2022] GET /compute/v2.1/servers/8437bbf5-3258-4770-ad51-75602cbe8eb2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:11:15.046395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:15.047546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:15.055436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:15.060408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:15.061062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:15.070720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:15.071403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:15.072026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:15.122626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:15.302264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18d0d18b-0b00-4c93-bbf7-81726dfd09f4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 204 len: 0 microversion: 2.1 time: 0.259157 Oct 22 03:11:15.304659 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 938/1867] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:15 2022] DELETE /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:15.313469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:15.315575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:15.328160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:15.328932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:15.329573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:15.330525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:15.333516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:15.334213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:15.350695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:15.351789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:15.368062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:15.368811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:15.369482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:15.370690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:15.371464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:15.372175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:15.741686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:15.771557 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bb91ac80-1e4d-40c5-b0ca-7604c97c6e19 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1430 microversion: 2.1 time: 0.424611 Oct 22 03:11:15.773577 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 939/1868] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:15 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1430 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:11:15.879632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-76ad2755-91ab-4981-ba39-e38b0d39cd11 req-2c86202c-3448-4248-9b25-d6c3c95f10f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea729a44-09fe-4297-a04f-c433bbefa3a2", "name": "network-vif-deleted", "tag": "bd6ed333-9ffb-4a1b-a196-43fdbfe8753e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:15.898388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-76ad2755-91ab-4981-ba39-e38b0d39cd11 req-2c86202c-3448-4248-9b25-d6c3c95f10f9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:15.899323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-76ad2755-91ab-4981-ba39-e38b0d39cd11 req-2c86202c-3448-4248-9b25-d6c3c95f10f9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:15.899947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-76ad2755-91ab-4981-ba39-e38b0d39cd11 req-2c86202c-3448-4248-9b25-d6c3c95f10f9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:15.941503 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-76ad2755-91ab-4981-ba39-e38b0d39cd11 req-2c86202c-3448-4248-9b25-d6c3c95f10f9 service nova] Creating event network-vif-deleted:bd6ed333-9ffb-4a1b-a196-43fdbfe8753e for instance ea729a44-09fe-4297-a04f-c433bbefa3a2 on n-h2-862416-2 Oct 22 03:11:15.955329 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-76ad2755-91ab-4981-ba39-e38b0d39cd11 req-2c86202c-3448-4248-9b25-d6c3c95f10f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080735 Oct 22 03:11:15.955973 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 940/1869] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:11:16.541272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:16.574870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9d903fb0-9296-45fd-bd7b-32362d302f4b tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1534 microversion: 2.1 time: 1.265569 Oct 22 03:11:16.587835 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 930/1870] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:15 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1534 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:16.798192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:16.799654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:16.822702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:16.829585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:16.830298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:16.833807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:16.834618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:16.836960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:16.920388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:16.929039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:16.929587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:16.930183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lazy-loading 'fault' on Instance uuid ea729a44-09fe-4297-a04f-c433bbefa3a2 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:17.327976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:17.336949 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-476b5eea-198f-4236-9feb-e35f540e35cc tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 200 len: 1307 microversion: 2.1 time: 0.543457 Oct 22 03:11:17.340622 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 941/1871] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:16 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 1307 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:17.603072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:17.609805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:17.630045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:17.632826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:17.633569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:17.648158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:17.649627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:17.657520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:18.366722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:18.374652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: ea729a44-09fe-4297-a04f-c433bbefa3a2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:18.439874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:18.442831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:18.444492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:18.457367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:18.461874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:18.468277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:18.632332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:18.645184 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] HTTP exception thrown: Instance ea729a44-09fe-4297-a04f-c433bbefa3a2 could not be found. Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Request method failure captured: Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 HTTP/1.1 Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16zimHwY5iLTHbCvPbLZ-qkg-tcGCQiU02cSEV0smK-Tezga1WSo0_EsLTUi_4fWe2A66mM002tfCOzuPfc2FUSUEIF9XC1_dWHqBCWVr8B3OinThmDIyqA_0yZJN7JEMODItmoH0AmTLtqRRo3e9Gn5ZTWup_qOL1SXkRdUEuIs5E Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e462137d650486c919790a05aa876dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e462137d650486c919790a05aa876dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}] Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3fb696d229f74155947d6e4f89e16f5a Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ea729a44-09fe-4297-a04f-c433bbefa3a2 could not be found. Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ea729a44-09fe-4297-a04f-c433bbefa3a2'} Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea729a44-09fe-4297-a04f-c433bbefa3a2 could not be found. Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea729a44-09fe-4297-a04f-c433bbefa3a2 could not be found. Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:18.646919 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:18.651687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:18.651687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:18.651687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:18.651687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:18.651687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:18.651687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea729a44-09fe-4297-a04f-c433bbefa3a2 could not be found. Oct 22 03:11:18.651687 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:18.653352 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-632115f9-290e-497d-b0e2-fb12da47acf4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1534 microversion: 2.1 time: 1.056148 Oct 22 03:11:18.655355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Returning 404 to user: Instance ea729a44-09fe-4297-a04f-c433bbefa3a2 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:18.655825 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 931/1872] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:17 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1534 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:18.657100 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2" status: 404 len: 111 microversion: 2.1 time: 0.299354 Oct 22 03:11:18.658317 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 942/1873] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:18 2022] GET /compute/v2.1/servers/ea729a44-09fe-4297-a04f-c433bbefa3a2 => generated 111 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:18.676928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:18.678621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:18.685650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:18.686145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:18.686587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:18.687524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:18.688019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:18.688486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:18.721291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:18.854573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:18.855690 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-da2b9051-8ebd-4912-b171-a7cccbad12c6 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002109 Oct 22 03:11:18.856420 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 943/1874] 10.222.0.25 () {56 vars in 886 bytes} [Sat Oct 22 03:11:18 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 03:11:18.877705 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e950d5d-ab38-47b6-b2aa-9cfbcf536e77 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 204 len: 0 microversion: 2.1 time: 0.214566 Oct 22 03:11:18.880575 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 932/1875] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:18 2022] DELETE /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:18.891895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:18.892990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:18.902756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:18.904427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:18.905183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:18.907221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:18.908466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:18.909837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:18.998383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5d6af406-454c-4292-b9d7-d02f7f91f68b req-155d9253-3268-4dc6-ba22-98e353650c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00104d4-606d-4ef1-b356-427e224a6972", "name": "network-vif-deleted", "tag": "1e18f49e-bf84-4fe2-ab11-319a26e97ed2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:19.018275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5d6af406-454c-4292-b9d7-d02f7f91f68b req-155d9253-3268-4dc6-ba22-98e353650c60 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:19.021209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5d6af406-454c-4292-b9d7-d02f7f91f68b req-155d9253-3268-4dc6-ba22-98e353650c60 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:19.022167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5d6af406-454c-4292-b9d7-d02f7f91f68b req-155d9253-3268-4dc6-ba22-98e353650c60 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:19.051035 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5d6af406-454c-4292-b9d7-d02f7f91f68b req-155d9253-3268-4dc6-ba22-98e353650c60 service nova] Creating event network-vif-deleted:1e18f49e-bf84-4fe2-ab11-319a26e97ed2 for instance a00104d4-606d-4ef1-b356-427e224a6972 on n-h2-862416-2 Oct 22 03:11:19.061175 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5d6af406-454c-4292-b9d7-d02f7f91f68b req-155d9253-3268-4dc6-ba22-98e353650c60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067371 Oct 22 03:11:19.062232 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 933/1876] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:11:19.250592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:19.268486 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-144c915c-43fd-4d33-836d-5846949f030a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1472 microversion: 2.1 time: 0.384455 Oct 22 03:11:19.281268 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 944/1877] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:18 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:19.685911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:19.686776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:19.703121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:19.704556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:19.705795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:19.708527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:19.709677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:19.711959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:19.945208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:19.962885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e715695-a569-4139-a711-f4995744efdd tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1492 microversion: 2.1 time: 0.283392 Oct 22 03:11:19.963491 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 934/1878] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:19 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1492 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:20.065006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15c744ac-aa48-4397-bf21-c6cd020da6b4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Action: 'create', calling method: .version_select at 0x7f0d1a0e04c0>, body: {"keypair": {"name": "tempest-keypair-1889818454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdIxZHk+UgkD0E7y+odWZbttBRtTjqcWld7AAVpusKW06Un7dgJj25MBWuw8kSDD9VkuoHNcRkDfQYaStvuoZYYl6Q1tqdMlexpjHn3uK39q7DT1pt4MvMN6DDxgv1Yiw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:20.105519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-15c744ac-aa48-4397-bf21-c6cd020da6b4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Getting quotas for project 37b44f72118d44569a1d524edcd3fbba. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:11:20.134063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-15c744ac-aa48-4397-bf21-c6cd020da6b4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Getting quotas for user 27c111294f5042d3a07812a8f7cd316e and project 37b44f72118d44569a1d524edcd3fbba. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:11:20.194266 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15c744ac-aa48-4397-bf21-c6cd020da6b4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.134501 Oct 22 03:11:20.195672 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 945/1879] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:11:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 03:11:20.297066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:20.298138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:20.306709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:20.307652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:20.308574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:20.311053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:20.312613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:20.313669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:20.990109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:20.991006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:20.997319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:20.998030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:21.004916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:21.005768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:21.006246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:21.006684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:21.070601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:21.072825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:21.073546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:21.076830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lazy-loading 'fault' on Instance uuid a00104d4-606d-4ef1-b356-427e224a6972 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:21.195277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:21.205202 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b57502f2-716f-4bb6-b50d-1401a7b75c22 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 200 len: 1369 microversion: 2.1 time: 0.219192 Oct 22 03:11:21.217278 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 946/1880] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:20 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 1369 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:11:21.440630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:21.454085 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b23f8b1-03e5-4fe8-bb80-d1e417577fbe tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1472 microversion: 2.1 time: 1.158326 Oct 22 03:11:21.455189 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 935/1881] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:20 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1472 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:22.139959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-eecea996-e13a-4066-b428-95fb22f891a1 req-cf82067a-41b6-4c24-8fdf-468744bf0905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dccbfe0-f44a-4f63-b22f-c942ff438cfb", "name": "network-vif-deleted", "tag": "2dfdf0e8-a84f-4fde-b2ed-33ab6ed779ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:22.161544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eecea996-e13a-4066-b428-95fb22f891a1 req-cf82067a-41b6-4c24-8fdf-468744bf0905 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:22.172970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eecea996-e13a-4066-b428-95fb22f891a1 req-cf82067a-41b6-4c24-8fdf-468744bf0905 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:22.173631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eecea996-e13a-4066-b428-95fb22f891a1 req-cf82067a-41b6-4c24-8fdf-468744bf0905 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:22.207189 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-eecea996-e13a-4066-b428-95fb22f891a1 req-cf82067a-41b6-4c24-8fdf-468744bf0905 service nova] Creating event network-vif-deleted:2dfdf0e8-a84f-4fde-b2ed-33ab6ed779ac for instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb on n-h2-862416-2 Oct 22 03:11:22.239693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:22.240615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: a00104d4-606d-4ef1-b356-427e224a6972] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:22.253448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:22.255298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:22.265689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:22.266678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:22.267896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:22.268287 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-eecea996-e13a-4066-b428-95fb22f891a1 req-cf82067a-41b6-4c24-8fdf-468744bf0905 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126911 Oct 22 03:11:22.268807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:22.272670 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 947/1882] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:11:22.318522 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] HTTP exception thrown: Instance a00104d4-606d-4ef1-b356-427e224a6972 could not be found. Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Request method failure captured: Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 HTTP/1.1 Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14X8aRx4oWjyCNI0FEvHOo_3lZFAHjkfHmQbjdefyNGUy6xwT07237PSMAR7OJREsU9UQS7rcef7-4TJ09J8-pxQnzHMdMPshroxpMfMF7YTsSGxGxMD4MctUgveBbhkWWNVfs0-RNjg_DI-Oy1sGg7vIk5YZNqZx6IByN-RaT5Jlk Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a10e488b35c54f6f9a5f4ede2520083f Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a10e488b35c54f6f9a5f4ede2520083f"}]}] Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a10e488b35c54f6f9a5f4ede2520083f Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-MigrationsAdminTest-1944439124-project Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bf9da8e55124a7aae0938bb828b8f8a Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-MigrationsAdminTest-1944439124-project Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a00104d4-606d-4ef1-b356-427e224a6972 could not be found. Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a00104d4-606d-4ef1-b356-427e224a6972'} Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00104d4-606d-4ef1-b356-427e224a6972 could not be found. Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00104d4-606d-4ef1-b356-427e224a6972 could not be found. Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:22.320147 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00104d4-606d-4ef1-b356-427e224a6972 could not be found. Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Returning 404 to user: Instance a00104d4-606d-4ef1-b356-427e224a6972 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:22.324835 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-12de5264-cc6d-437c-9245-165b2c9bc428 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972" status: 404 len: 111 microversion: 2.1 time: 0.085971 Oct 22 03:11:22.332320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f24f737b-b8af-4537-ac5b-0aa45f590f67 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '.version_select at 0x7f0d1a043af0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:22.359057 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 936/1883] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:22 2022] GET /compute/v2.1/servers/a00104d4-606d-4ef1-b356-427e224a6972 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:11:22.389724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f24f737b-b8af-4537-ac5b-0aa45f590f67 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861753191" status: 202 len: 0 microversion: 2.1 time: 0.062815 Oct 22 03:11:22.390685 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 948/1884] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:11:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861753191 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:11:22.479697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:22.480321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:22.495962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:22.500141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:22.500638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:22.507913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:22.508391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:22.508868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:22.610911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:22.615418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:22.619163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:22.619959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lazy-loading 'fault' on Instance uuid 4dccbfe0-f44a-4f63-b22f-c942ff438cfb {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:23.230211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:23.255187 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c28a212f-fa96-4fab-a0c0-279804ad4e3b tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 200 len: 1306 microversion: 2.1 time: 0.764622 Oct 22 03:11:23.255879 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 937/1885] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:22 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 1306 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:24.290879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:24.298750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 4dccbfe0-f44a-4f63-b22f-c942ff438cfb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:24.321014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:24.327850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:24.345428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:24.346219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:24.346941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:24.360677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:24.391930 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] HTTP exception thrown: Instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb could not be found. Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Request method failure captured: Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb HTTP/1.1 Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16zimHwY5iLTHbCvPbLZ-qkg-tcGCQiU02cSEV0smK-Tezga1WSo0_EsLTUi_4fWe2A66mM002tfCOzuPfc2FUSUEIF9XC1_dWHqBCWVr8B3OinThmDIyqA_0yZJN7JEMODItmoH0AmTLtqRRo3e9Gn5ZTWup_qOL1SXkRdUEuIs5E Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e462137d650486c919790a05aa876dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e462137d650486c919790a05aa876dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}] Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3fb696d229f74155947d6e4f89e16f5a Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb could not be found. Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '4dccbfe0-f44a-4f63-b22f-c942ff438cfb'} Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb could not be found. Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb could not be found. Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:24.394808 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:24.399395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:24.399395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:24.399395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:24.399395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:24.399395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:24.399395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb could not be found. Oct 22 03:11:24.399395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:24.402003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Returning 404 to user: Instance 4dccbfe0-f44a-4f63-b22f-c942ff438cfb could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:24.404512 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43823870-3658-4e4a-8eda-eefcb065b2d0 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb" status: 404 len: 111 microversion: 2.1 time: 0.130679 Oct 22 03:11:24.405650 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 949/1886] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:24 2022] GET /compute/v2.1/servers/4dccbfe0-f44a-4f63-b22f-c942ff438cfb => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:24.415967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:24.416488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:24.446093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:24.446773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:24.447228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:24.447983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:24.448464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:24.452975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:24.549689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:24.795874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=92,nova_api:DELETE=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:24.817443 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27f8dd82-025b-48ba-b340-bc341412408c tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7" status: 204 len: 0 microversion: 2.1 time: 0.400179 Oct 22 03:11:24.818136 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 938/1887] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:24 2022] DELETE /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:24.827032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:24.827606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:24.843261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:24.843897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:24.851351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:24.852054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:24.852698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:24.853133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:24.941840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:24.946976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:25.442330 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-99f2c6fe-601b-4c50-94ab-d7c311dc5b93 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 204 len: 0 microversion: 2.1 time: 0.613042 Oct 22 03:11:25.451895 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 950/1888] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:24 2022] DELETE /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:25.476294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:25.479371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:25.541196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:25.544935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:25.551962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:25.553655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:25.556256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:25.556971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:25.670087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:26.099740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-793477681", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ffe2e914-ac1d-4e5d-905c-e0f665e4c0dc"}, {"port": "45e62a82-f51a-4e73-944b-9a9f24415d51", "tag": "port-1"}, {"port": "7898d55a-c69b-4875-a377-906a18281fe9", "tag": "port-2"}, {"uuid": "06652ee5-07c5-46ea-8467-30b7f94e6985", "tag": "net-1"}, {"uuid": "06652ee5-07c5-46ea-8467-30b7f94e6985"}, {"uuid": "3bca87c8-8b3b-4a26-94f7-19e70627d20e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3bca87c8-8b3b-4a26-94f7-19e70627d20e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7c6eceac-f105-4abc-948c-d80d15feb808", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4a215cca-5862-40e9-b8c8-0b6ef641c02b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0f04ecdd-c9f0-48c2-aed8-fda13e21958f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1785674960"}], "key_name": "tempest-keypair-1889818454", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:26.215511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:26.435837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] validate_networks() for [('ffe2e914-ac1d-4e5d-905c-e0f665e4c0dc', None, None, None, None, None), (None, None, '45e62a82-f51a-4e73-944b-9a9f24415d51', None, None, None), (None, None, '7898d55a-c69b-4875-a377-906a18281fe9', None, None, None), ('06652ee5-07c5-46ea-8467-30b7f94e6985', None, None, None, None, None), ('06652ee5-07c5-46ea-8467-30b7f94e6985', None, None, None, None, None), ('3bca87c8-8b3b-4a26-94f7-19e70627d20e', '10.2.2.100', None, None, None, None), ('3bca87c8-8b3b-4a26-94f7-19e70627d20e', '10.2.2.200', None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:11:28.204317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:28.213732 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa2dfa04-7b5a-441d-9ba2-70b50926a831 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7" status: 200 len: 1473 microversion: 2.1 time: 2.761618 Oct 22 03:11:28.222256 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 939/1889] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:25 2022] GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 => generated 1473 bytes in 2772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:28.507841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Calling method '.version_select at 0x7f0d1e56d040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:28.516759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:28.517258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:28.517706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:28.569395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:28.569922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:28.570704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:28.600844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:28.601342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:28.601788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:28.637118 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40ba3cba-bd42-40e5-9df2-f39a5e40fb17 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.413378 Oct 22 03:11:28.650345 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 940/1890] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:11:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:28.964393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-789be477-8d20-4277-99ef-4e6372e1e5c0 tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] Calling method '.version_select at 0x7f0d19fefca0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:28.968242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-789be477-8d20-4277-99ef-4e6372e1e5c0 tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '46c9d7c2c4894db48119a49a7097b83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710dfe879db6487aa4160de3bf768665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-789be477-8d20-4277-99ef-4e6372e1e5c0 tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] Request method failure captured: Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-hypervisors/n-h1-862416-2/search HTTP/1.1 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19bmMp-F3F99hKw4AxMANgetk4-neLsbgJTuvTMGwK63z8JeU3Pb8FEM2j2RISKWMImXY2iPPgi-SMTqT9hkeOZ8Llz7z0TOs3CV34yYnYND2FnVGzgiE7KvY9jPzKTPL_HJFCiZw688t831jILDhuF8dDmmywsdzg26osvjaJIyHM Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 710dfe879db6487aa4160de3bf768665 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-40627242 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_710dfe879db6487aa4160de3bf768665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/710dfe879db6487aa4160de3bf768665"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/710dfe879db6487aa4160de3bf768665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/710dfe879db6487aa4160de3bf768665"}]}] Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-40627242 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 710dfe879db6487aa4160de3bf768665 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-40627242 Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-40627242-project Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 46c9d7c2c4894db48119a49a7097b83e Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-40627242-project Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'n-h1-862416-2'} Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:28.983406 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-789be477-8d20-4277-99ef-4e6372e1e5c0 tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-789be477-8d20-4277-99ef-4e6372e1e5c0 tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-862416-2/search" status: 403 len: 117 microversion: 2.1 time: 0.333698 Oct 22 03:11:28.990700 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 941/1891] 10.222.0.25 () {58 vars in 1209 bytes} [Sat Oct 22 03:11:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-862416-2/search => generated 117 bytes in 337 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:29.007529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23085029-a75a-451a-b920-f8a7009d7b8a tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Calling method '.version_select at 0x7f0d1a3918b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:29.010285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23085029-a75a-451a-b920-f8a7009d7b8a tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:29.011081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23085029-a75a-451a-b920-f8a7009d7b8a tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:29.020909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23085029-a75a-451a-b920-f8a7009d7b8a tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:29.064916 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-23085029-a75a-451a-b920-f8a7009d7b8a tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23085029-a75a-451a-b920-f8a7009d7b8a tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Request method failure captured: Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19dAIx5WIxBnqZh6EGBr2QFMFx62Xa_nZp16LFkKrJ9ILTFzb8Aa7nVbvKvxRD6DqZgbQkhMv7xdoY_OiFsYYf1LMnd1dTSHDU3FLVPSy7j58DAB7JVpMyRPduY5Lk55T-dqsIBOSVg1fcxesqgYSyC09b7-mC0-lz1Zue7zRYmdnU Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 080d14d492984e66b96851a54cfa7168 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-306032972 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_080d14d492984e66b96851a54cfa7168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/080d14d492984e66b96851a54cfa7168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/080d14d492984e66b96851a54cfa7168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/080d14d492984e66b96851a54cfa7168"}]}] Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-306032972 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 080d14d492984e66b96851a54cfa7168 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-306032972 Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8f4e002727a9433ca01811ab8b872b8b Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 22 03:11:29.067195 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:29.075410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23085029-a75a-451a-b920-f8a7009d7b8a tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:29.077038 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23085029-a75a-451a-b920-f8a7009d7b8a tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.079985 Oct 22 03:11:29.078109 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 942/1892] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:11:28 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:29.088587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2427b319-705c-44ea-83eb-f36cfa7aa710 req-1c1ba86f-5f4b-49b3-860a-d8bb431e39af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f7dfb6-6cb2-4676-8f9a-9417da51949b", "name": "network-vif-deleted", "tag": "cbc7d4e8-ebaa-44de-afd3-0efb89571401"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:29.147441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2427b319-705c-44ea-83eb-f36cfa7aa710 req-1c1ba86f-5f4b-49b3-860a-d8bb431e39af service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:29.151146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2427b319-705c-44ea-83eb-f36cfa7aa710 req-1c1ba86f-5f4b-49b3-860a-d8bb431e39af service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:29.151992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2427b319-705c-44ea-83eb-f36cfa7aa710 req-1c1ba86f-5f4b-49b3-860a-d8bb431e39af service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:29.191370 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2427b319-705c-44ea-83eb-f36cfa7aa710 req-1c1ba86f-5f4b-49b3-860a-d8bb431e39af service nova] Creating event network-vif-deleted:cbc7d4e8-ebaa-44de-afd3-0efb89571401 for instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b on n-h2-862416-2 Oct 22 03:11:29.212773 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2427b319-705c-44ea-83eb-f36cfa7aa710 req-1c1ba86f-5f4b-49b3-860a-d8bb431e39af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131598 Oct 22 03:11:29.215754 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 943/1893] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:29.242656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Calling method '.version_select at 0x7f0d19927790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:29.247772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:29.250830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:29.251899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:29.293986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:29.294865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:29.295790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:29.319224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:29.319872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:29.320537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:29.335947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72cc24bd-f332-4fba-9865-a9477eef24f0 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.114678 Oct 22 03:11:29.337284 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 944/1894] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:11:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:29.367254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:29.372424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:29.390609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:29.404646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:29.406514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:29.415556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:29.448683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:29.463270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:29.859545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:29.885068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c9acce35-ad0a-40ea-aa6b-fb3153962786 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7" status: 200 len: 1304 microversion: 2.1 time: 0.529277 Oct 22 03:11:29.901922 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 945/1895] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:29 2022] GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 => generated 1304 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:29.915109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6e8aabf-1840-4c32-95e9-b99ecd538e5c tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] Calling method '.version_select at 0x7f0d19ffc940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:29.917531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6e8aabf-1840-4c32-95e9-b99ecd538e5c tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '46c9d7c2c4894db48119a49a7097b83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710dfe879db6487aa4160de3bf768665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6e8aabf-1840-4c32-95e9-b99ecd538e5c tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] Request method failure captured: Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19bmMp-F3F99hKw4AxMANgetk4-neLsbgJTuvTMGwK63z8JeU3Pb8FEM2j2RISKWMImXY2iPPgi-SMTqT9hkeOZ8Llz7z0TOs3CV34yYnYND2FnVGzgiE7KvY9jPzKTPL_HJFCiZw688t831jILDhuF8dDmmywsdzg26osvjaJIyHM Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 710dfe879db6487aa4160de3bf768665 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-40627242 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_710dfe879db6487aa4160de3bf768665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/710dfe879db6487aa4160de3bf768665"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/710dfe879db6487aa4160de3bf768665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/710dfe879db6487aa4160de3bf768665"}]}] Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-40627242 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 710dfe879db6487aa4160de3bf768665 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-40627242 Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-40627242-project Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 46c9d7c2c4894db48119a49a7097b83e Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-40627242-project Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1'} Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:29.920172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6e8aabf-1840-4c32-95e9-b99ecd538e5c tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6e8aabf-1840-4c32-95e9-b99ecd538e5c tempest-HypervisorAdminNegativeUnderV252Test-40627242 tempest-HypervisorAdminNegativeUnderV252Test-40627242-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018643 Oct 22 03:11:29.925182 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 946/1896] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:11:29 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:30.167562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:30.177648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-653a3682-ae0b-4524-9ac3-51adc9045f0f req-9b9d56f2-2067-4e36-b838-b90394679cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7", "name": "network-vif-deleted", "tag": "2b132016-09b7-49d3-ad51-b002e76cf74e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:30.205247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-653a3682-ae0b-4524-9ac3-51adc9045f0f req-9b9d56f2-2067-4e36-b838-b90394679cf8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:30.206603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-653a3682-ae0b-4524-9ac3-51adc9045f0f req-9b9d56f2-2067-4e36-b838-b90394679cf8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:30.216544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-653a3682-ae0b-4524-9ac3-51adc9045f0f req-9b9d56f2-2067-4e36-b838-b90394679cf8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:30.255500 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-653a3682-ae0b-4524-9ac3-51adc9045f0f req-9b9d56f2-2067-4e36-b838-b90394679cf8 service nova] Creating event network-vif-deleted:2b132016-09b7-49d3-ad51-b002e76cf74e for instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 on n-h1-862416-2 Oct 22 03:11:30.276246 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-653a3682-ae0b-4524-9ac3-51adc9045f0f req-9b9d56f2-2067-4e36-b838-b90394679cf8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.352534 Oct 22 03:11:30.276874 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 947/1897] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:30.288793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4bac726-155c-4a46-b896-125d18c62e88 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Calling method '.version_select at 0x7f0d19a468b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:30.291074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bac726-155c-4a46-b896-125d18c62e88 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:30.291761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bac726-155c-4a46-b896-125d18c62e88 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:30.292814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bac726-155c-4a46-b896-125d18c62e88 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:30.300321 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a4bac726-155c-4a46-b896-125d18c62e88 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] HTTP exception thrown: No hypervisor matching '7f7af1a3-e943-466a-b129-253c5e4dbea7' could be found. Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4bac726-155c-4a46-b896-125d18c62e88 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Request method failure captured: Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-hypervisors/7f7af1a3-e943-466a-b129-253c5e4dbea7/servers HTTP/1.1 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19dAIx5WIxBnqZh6EGBr2QFMFx62Xa_nZp16LFkKrJ9ILTFzb8Aa7nVbvKvxRD6DqZgbQkhMv7xdoY_OiFsYYf1LMnd1dTSHDU3FLVPSy7j58DAB7JVpMyRPduY5Lk55T-dqsIBOSVg1fcxesqgYSyC09b7-mC0-lz1Zue7zRYmdnU Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 080d14d492984e66b96851a54cfa7168 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-306032972 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_080d14d492984e66b96851a54cfa7168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/080d14d492984e66b96851a54cfa7168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/080d14d492984e66b96851a54cfa7168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/080d14d492984e66b96851a54cfa7168"}]}] Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-306032972 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 080d14d492984e66b96851a54cfa7168 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-306032972 Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8f4e002727a9433ca01811ab8b872b8b Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: exception: No hypervisor matching '7f7af1a3-e943-466a-b129-253c5e4dbea7' could be found. Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '7f7af1a3-e943-466a-b129-253c5e4dbea7'} Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7f7af1a3-e943-466a-b129-253c5e4dbea7' could be found. Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7f7af1a3-e943-466a-b129-253c5e4dbea7' could be found. Oct 22 03:11:30.303252 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:30.308923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4bac726-155c-4a46-b896-125d18c62e88 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] Returning 404 to user: No hypervisor matching '7f7af1a3-e943-466a-b129-253c5e4dbea7' could be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:30.310803 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4bac726-155c-4a46-b896-125d18c62e88 tempest-HypervisorAdminNegativeUnderV252Test-306032972 tempest-HypervisorAdminNegativeUnderV252Test-306032972-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/7f7af1a3-e943-466a-b129-253c5e4dbea7/servers" status: 404 len: 123 microversion: 2.1 time: 0.029755 Oct 22 03:11:30.312931 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 948/1898] 10.222.0.25 () {58 vars in 1281 bytes} [Sat Oct 22 03:11:30 2022] GET /compute/v2.1/os-hypervisors/7f7af1a3-e943-466a-b129-253c5e4dbea7/servers => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:30.475627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfc54a30-f868-4460-b577-05f045a5fbb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Action: 'create', calling method: .version_select at 0x7f0d1e523670>, body: {"keypair": {"name": "tempest-keypair-1428605690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJymsFAcqYxYmrXopmNZQiHCdY0GMJVWBUMknOLgk2LXADvk1AGtsEFixI99p4b/eDHfdSLfceObavPk/L+lUvtXhWHtIvmExhed0S8J9W59nKIomRU8DPdKXH6BypMvqA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:30.522166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-cfc54a30-f868-4460-b577-05f045a5fbb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Getting quotas for project d3d30709037b42e9839252d0b366681a. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:11:30.552539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-cfc54a30-f868-4460-b577-05f045a5fbb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Getting quotas for user 1a2620c42cb94cf6a8b3f64faa91cfeb and project d3d30709037b42e9839252d0b366681a. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:11:30.658527 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfc54a30-f868-4460-b577-05f045a5fbb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338792 Oct 22 03:11:30.664154 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 949/1899] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:11:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:30.916353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:30.917490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:30.936360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:30.937148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:30.939417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:30.944949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:30.947750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:30.951229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:31.000391 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] HTTP exception thrown: Instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 could not be found. Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Request method failure captured: Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 HTTP/1.1 Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16zimHwY5iLTHbCvPbLZ-qkg-tcGCQiU02cSEV0smK-Tezga1WSo0_EsLTUi_4fWe2A66mM002tfCOzuPfc2FUSUEIF9XC1_dWHqBCWVr8B3OinThmDIyqA_0yZJN7JEMODItmoH0AmTLtqRRo3e9Gn5ZTWup_qOL1SXkRdUEuIs5E Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e462137d650486c919790a05aa876dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e462137d650486c919790a05aa876dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}] Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3fb696d229f74155947d6e4f89e16f5a Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 could not be found. Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7'} Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 could not be found. Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 could not be found. Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:31.004642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.010210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:31.010210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:31.010210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:31.010210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:31.010210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:31.010210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 could not be found. Oct 22 03:11:31.010210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.017430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Returning 404 to user: Instance 0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:31.019915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-038bb104-70c2-499d-855e-6a2fa6382eec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7" status: 404 len: 111 microversion: 2.1 time: 0.111048 Oct 22 03:11:31.027536 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 950/1900] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:30 2022] GET /compute/v2.1/servers/0eda9dcc-ce7a-4bb7-ad40-0d35079da0d7 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:11:31.045204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:31.046271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 64f7dfb6-6cb2-4676-8f9a-9417da51949b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:31.064741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:31.068105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:31.069026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:31.072782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:31.073707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:31.075212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:31.116796 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] HTTP exception thrown: Instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b could not be found. Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Request method failure captured: Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b HTTP/1.1 Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU16zimHwY5iLTHbCvPbLZ-qkg-tcGCQiU02cSEV0smK-Tezga1WSo0_EsLTUi_4fWe2A66mM002tfCOzuPfc2FUSUEIF9XC1_dWHqBCWVr8B3OinThmDIyqA_0yZJN7JEMODItmoH0AmTLtqRRo3e9Gn5ZTWup_qOL1SXkRdUEuIs5E Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e462137d650486c919790a05aa876dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e462137d650486c919790a05aa876dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}] Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3fb696d229f74155947d6e4f89e16f5a Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b could not be found. Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '64f7dfb6-6cb2-4676-8f9a-9417da51949b'} Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b could not be found. Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b could not be found. Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:31.120603 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b could not be found. Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Returning 404 to user: Instance 64f7dfb6-6cb2-4676-8f9a-9417da51949b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:31.125217 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4e062483-7e4c-4e9d-81c2-8c0f46c1a259 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b" status: 404 len: 111 microversion: 2.1 time: 0.091671 Oct 22 03:11:31.126686 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 951/1901] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:31 2022] GET /compute/v2.1/servers/64f7dfb6-6cb2-4676-8f9a-9417da51949b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:31.141544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9aeae75a-4c37-4716-af3d-2009912897ec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:31.201097 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9aeae75a-4c37-4716-af3d-2009912897ec tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/41c97a5f-7ff2-46d3-b0e2-e5d7273a72ba" status: 204 len: 0 microversion: 2.1 time: 0.069947 Oct 22 03:11:31.202890 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 952/1902] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:11:31 2022] DELETE /compute/v2.1/os-server-groups/41c97a5f-7ff2-46d3-b0e2-e5d7273a72ba => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:31.217502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:31.220099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0604553f-a92d-45b8-be48-a8ace1cda572] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:31.260892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:31.263834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:31.264670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:31.265760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:31.268717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:31.270467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:31.340144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0604553f-a92d-45b8-be48-a8ace1cda572] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:31.541403 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4954846f-a4f0-4475-b22d-7f947c691f5a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572" status: 204 len: 0 microversion: 2.1 time: 0.331280 Oct 22 03:11:31.548041 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 953/1903] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:31 2022] DELETE /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:31.564372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:31.571348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:31.590781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:31.605466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:31.605466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:31.605466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:31.605466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:31.605466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:31.663633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:31.886812 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bcee36bd-8272-4dbf-b5e6-aaa107b41ab8 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 204 len: 0 microversion: 2.1 time: 0.335858 Oct 22 03:11:31.891061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 954/1904] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:31 2022] DELETE /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:31.904752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:31.906622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0604553f-a92d-45b8-be48-a8ace1cda572] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:31.923011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:31.923521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:31.926841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:31.928753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:31.929239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:31.941243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:32.351676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:32.367589 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e097016-24fb-4454-a6d7-acbd7b4b1d7e tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572" status: 200 len: 1473 microversion: 2.1 time: 0.473354 Oct 22 03:11:32.370758 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 955/1905] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:31 2022] GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572 => generated 1473 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:32.391934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:32.395472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:32.409696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:32.410212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:32.410682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:32.411779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:32.411970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:32.412313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:32.477284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:32.662316 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6686d5de-b0d7-4ee8-9595-33a398dc2a83 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "DELETE /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 204 len: 0 microversion: 2.1 time: 0.290177 Oct 22 03:11:32.663364 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 956/1906] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:32 2022] DELETE /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:32.671947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:32.672783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:32.689588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:32.700962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:32.701596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:32.702628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:32.704872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:32.706351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:33.174951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:33.195207 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5764c1e1-54e5-4ba7-98b2-bc71879e81e4 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1469 microversion: 2.1 time: 0.523140 Oct 22 03:11:33.198753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 957/1907] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:32 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1469 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:33.209122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-407264257", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "88c94f0e-626b-4b04-b426-00fe37fe6119"}], "block_device_mapping_v2": [{"uuid": "dd79fb37-27ee-4554-b18e-73610c5fe536", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:33.362795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] validate_networks() for [('88c94f0e-626b-4b04-b426-00fe37fe6119', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:11:35.136487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:11:35.139645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:11:35.141330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:11:35.142224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:11:35.142892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:11:35.161691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:35.163159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:35.164293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:35.170711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:35.172095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:35.173371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:35.221499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for project e33669cd6c0040cda12f8063688eacc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:11:35.236413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Getting quotas for user 2868158117ea4f7797f9931a97bcedfd and project e33669cd6c0040cda12f8063688eacc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:11:35.287339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:35.465952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:11:35.469532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd79fb37-27ee-4554-b18e-73610c5fe536',volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:11:35.834947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7e0e7a8c-241f-4ac0-99be-99fe22d66dc7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.634542 Oct 22 03:11:35.839554 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 958/1908] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:11:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2640 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:11:35.866255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:35.866884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0604553f-a92d-45b8-be48-a8ace1cda572] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:35.887826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:35.888820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:35.889614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:35.897506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:35.898541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:35.898991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:35.950535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:35.952141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:35.952785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:35.953600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lazy-loading 'fault' on Instance uuid 0604553f-a92d-45b8-be48-a8ace1cda572 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:35.958643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:36.032100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:36.052413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33057bcd-94cc-4273-a11f-3ba5be079408 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572" status: 200 len: 1308 microversion: 2.1 time: 0.209591 Oct 22 03:11:36.053630 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 959/1909] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:35 2022] GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572 => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:36.059811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:36.060744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:36.070460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:36.071679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:36.072725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:36.073715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:36.074467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:36.075130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:36.447466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:36.456623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-085a26fa-beee-4190-abd5-4416cbbba6c7 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1469 microversion: 2.1 time: 0.401641 Oct 22 03:11:36.468580 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 960/1910] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:36 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:37.047120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1144011227", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "d718c698-c689-420d-bcc1-1b58b03babf9"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:37.150748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] validate_networks() for [('d718c698-c689-420d-bcc1-1b58b03babf9', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:11:37.222520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:11:37.223084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:11:37.223638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:11:37.224165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:11:37.224717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:11:37.242208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:37.242852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:37.243446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:37.245528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:37.250558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:37.251290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:37.305834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Getting quotas for project 37b44f72118d44569a1d524edcd3fbba. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:11:37.312151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Getting quotas for user 27c111294f5042d3a07812a8f7cd316e and project 37b44f72118d44569a1d524edcd3fbba. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:11:37.712451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:11:37.717780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7c6eceac-f105-4abc-948c-d80d15feb808',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4a215cca-5862-40e9-b8c8-0b6ef641c02b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f04ecdd-c9f0-48c2-aed8-fda13e21958f',volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:11:37.919100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:11:37.920317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:11:37.921115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:11:37.922036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:11:37.922958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:11:37.943894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:37.944443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:37.944944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:37.945694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:37.948166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:37.948983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:37.979174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Getting quotas for project 1895216a97de4e25ae036b7c8af7b690. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:11:37.987525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:37.989403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Getting quotas for user 23bd65aecc4849339a5245a0e63d4a2b and project 1895216a97de4e25ae036b7c8af7b690. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:11:38.021332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:11:38.026510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:11:38.132386 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb2c46f3-f02b-41f3-8233-4e410d31e4ac tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.658893 Oct 22 03:11:38.135655 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 961/1911] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:11:38.161894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1d9cd81f-7065-4edd-8757-130b1ff92620 req-e4f89f93-fbfe-4382-8de6-4c91801e3d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0604553f-a92d-45b8-be48-a8ace1cda572", "name": "network-vif-deleted", "tag": "cef21c3e-36a3-4720-a377-1756fa253fa4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:38.196446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1d9cd81f-7065-4edd-8757-130b1ff92620 req-e4f89f93-fbfe-4382-8de6-4c91801e3d83 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:38.202795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1d9cd81f-7065-4edd-8757-130b1ff92620 req-e4f89f93-fbfe-4382-8de6-4c91801e3d83 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:38.205241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1d9cd81f-7065-4edd-8757-130b1ff92620 req-e4f89f93-fbfe-4382-8de6-4c91801e3d83 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:38.260800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1d9cd81f-7065-4edd-8757-130b1ff92620 req-e4f89f93-fbfe-4382-8de6-4c91801e3d83 service nova] Creating event network-vif-deleted:cef21c3e-36a3-4720-a377-1756fa253fa4 for instance 0604553f-a92d-45b8-be48-a8ace1cda572 on n-h1-862416-2 Oct 22 03:11:38.274314 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1d9cd81f-7065-4edd-8757-130b1ff92620 req-e4f89f93-fbfe-4382-8de6-4c91801e3d83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125746 Oct 22 03:11:38.276287 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 962/1912] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:38.288084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:38.290909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:38.300505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:38.306902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:38.307451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:38.310369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:38.311019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:38.311745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:38.501735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:38.518440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:38.523017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:38.524220 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6081ed87-6569-4316-b36a-d516912378b4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1240 microversion: 2.25 time: 0.246538 Oct 22 03:11:38.538355 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 963/1913] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:38 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1240 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:38.545406 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-143b2704-ee01-4dff-afa0-c4ff522495a8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 12.451626 Oct 22 03:11:38.546296 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 951/1914] 10.222.0.25 () {62 vars in 1189 bytes} [Sat Oct 22 03:11:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 12454 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 22 03:11:38.556821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:38.557650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 0604553f-a92d-45b8-be48-a8ace1cda572] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:38.577362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:38.579642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:38.581285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:38.583414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:38.584267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:38.584601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:38.635484 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] HTTP exception thrown: Instance 0604553f-a92d-45b8-be48-a8ace1cda572 could not be found. Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Request method failure captured: Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572 HTTP/1.1 Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16zimHwY5iLTHbCvPbLZ-qkg-tcGCQiU02cSEV0smK-Tezga1WSo0_EsLTUi_4fWe2A66mM002tfCOzuPfc2FUSUEIF9XC1_dWHqBCWVr8B3OinThmDIyqA_0yZJN7JEMODItmoH0AmTLtqRRo3e9Gn5ZTWup_qOL1SXkRdUEuIs5E Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e462137d650486c919790a05aa876dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e462137d650486c919790a05aa876dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}] Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3fb696d229f74155947d6e4f89e16f5a Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 0604553f-a92d-45b8-be48-a8ace1cda572 could not be found. Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '0604553f-a92d-45b8-be48-a8ace1cda572'} Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0604553f-a92d-45b8-be48-a8ace1cda572 could not be found. Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0604553f-a92d-45b8-be48-a8ace1cda572 could not be found. Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:38.643655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:38.649017 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:38.649017 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:38.649017 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:38.649017 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:38.649017 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:38.649017 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0604553f-a92d-45b8-be48-a8ace1cda572 could not be found. Oct 22 03:11:38.649017 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:38.650984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Returning 404 to user: Instance 0604553f-a92d-45b8-be48-a8ace1cda572 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:38.653218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-57034065-6842-417f-a577-4d4044d2acd7 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572" status: 404 len: 111 microversion: 2.1 time: 0.105744 Oct 22 03:11:38.657851 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 952/1915] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:38 2022] GET /compute/v2.1/servers/0604553f-a92d-45b8-be48-a8ace1cda572 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:38.681647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:38.682705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:38.700159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:38.706324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:38.706853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:38.708832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:38.712911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:38.714351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:38.838671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:38.839173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:38.839616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:38.840075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lazy-loading 'fault' on Instance uuid 39a5235e-8a3c-4605-b8dd-8b4d246ff46f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:38.994926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-375157841", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:39.133551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] validate_networks() for [('cd333e9d-f9b8-4605-a5a4-47471e05a78d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:11:39.203914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:39.220872 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80efbe18-5568-41ec-ba82-3da72aa6f635 tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 200 len: 1303 microversion: 2.1 time: 0.550969 Oct 22 03:11:39.222795 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 953/1916] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:38 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 1303 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:39.234267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-589a135a-1173-4dc4-826d-11c53b8ffced req-4ef0668f-ec22-4d51-8f30-758ed6c8c178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a5235e-8a3c-4605-b8dd-8b4d246ff46f", "name": "network-vif-deleted", "tag": "0c0d9fca-9ee1-400e-beab-4f911a49fd8d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:39.275945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-589a135a-1173-4dc4-826d-11c53b8ffced req-4ef0668f-ec22-4d51-8f30-758ed6c8c178 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:39.279534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-589a135a-1173-4dc4-826d-11c53b8ffced req-4ef0668f-ec22-4d51-8f30-758ed6c8c178 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:39.285618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-589a135a-1173-4dc4-826d-11c53b8ffced req-4ef0668f-ec22-4d51-8f30-758ed6c8c178 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:39.315243 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-589a135a-1173-4dc4-826d-11c53b8ffced req-4ef0668f-ec22-4d51-8f30-758ed6c8c178 service nova] Creating event network-vif-deleted:0c0d9fca-9ee1-400e-beab-4f911a49fd8d for instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f on n-h2-862416-2 Oct 22 03:11:39.325218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-589a135a-1173-4dc4-826d-11c53b8ffced req-4ef0668f-ec22-4d51-8f30-758ed6c8c178 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100730 Oct 22 03:11:39.333846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 954/1917] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:39.346522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:39.350828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:39.369584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:39.370420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:39.371364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:39.372940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:39.375767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:39.376587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:39.577149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:39.587937 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-321599e6-64f0-443c-aeb1-a2724e7c91f3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1228 microversion: 2.1 time: 0.250235 Oct 22 03:11:39.603195 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 955/1918] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:39 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1228 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:39.613124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f55e4e3b-259b-40cf-a150-691d739eaac6 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:39.613748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f55e4e3b-259b-40cf-a150-691d739eaac6 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:39.863168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f55e4e3b-259b-40cf-a150-691d739eaac6 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:39.874988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f55e4e3b-259b-40cf-a150-691d739eaac6 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:39.885149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f55e4e3b-259b-40cf-a150-691d739eaac6 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:39.886558 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f55e4e3b-259b-40cf-a150-691d739eaac6 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1285 microversion: 2.32 time: 0.282312 Oct 22 03:11:39.887633 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 956/1919] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:39 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1285 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:39.909733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:39.911058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 69e02fea-8912-4cd6-bf02-eb3f39255b04] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:39.921836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:39.927924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:39.928592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:39.929474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:39.932162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:39.932820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:39.983691 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] HTTP exception thrown: Instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 could not be found. Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Request method failure captured: Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 HTTP/1.1 Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16zimHwY5iLTHbCvPbLZ-qkg-tcGCQiU02cSEV0smK-Tezga1WSo0_EsLTUi_4fWe2A66mM002tfCOzuPfc2FUSUEIF9XC1_dWHqBCWVr8B3OinThmDIyqA_0yZJN7JEMODItmoH0AmTLtqRRo3e9Gn5ZTWup_qOL1SXkRdUEuIs5E Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e462137d650486c919790a05aa876dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e462137d650486c919790a05aa876dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}] Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3fb696d229f74155947d6e4f89e16f5a Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 could not be found. Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '69e02fea-8912-4cd6-bf02-eb3f39255b04'} Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 could not be found. Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 could not be found. Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:39.990615 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:39.995623 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:39.995623 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:39.995623 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:39.995623 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:39.995623 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:39.995623 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 could not be found. Oct 22 03:11:39.995623 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:40.026869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Returning 404 to user: Instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:40.036454 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa1af1d5-3da9-4946-880d-8f17384567bf tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04" status: 404 len: 111 microversion: 2.1 time: 0.147502 Oct 22 03:11:40.046618 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 957/1920] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:39 2022] GET /compute/v2.1/servers/69e02fea-8912-4cd6-bf02-eb3f39255b04 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:40.074776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:40.075427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:40.103837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:11:40.104871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:11:40.105736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:11:40.106442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:11:40.107017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:11:40.111244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.114055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.115321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.120178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.123163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.125062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.129308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.130194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.131039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.132005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.132655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.133603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.155874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Getting quotas for project f2a1d7beed3948dda94437d6f7b8bb42. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:11:40.164053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Getting quotas for user 5d9b091b268443498d66f34cd397c8dc and project f2a1d7beed3948dda94437d6f7b8bb42. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:11:40.183096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:11:40.186425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:11:40.303315 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4818ff38-f089-4806-8dd4-afaa69170933 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763538 Oct 22 03:11:40.304325 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 964/1921] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:11:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:11:40.315444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-64da6efa-a391-45b5-9eaf-179fa42e3467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:40.376127 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-64da6efa-a391-45b5-9eaf-179fa42e3467 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/0568f0d6-7c50-4ece-a2eb-a575060f8d2a" status: 204 len: 0 microversion: 2.1 time: 0.067420 Oct 22 03:11:40.379076 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 965/1922] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:11:40 2022] DELETE /compute/v2.1/os-server-groups/0568f0d6-7c50-4ece-a2eb-a575060f8d2a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:40.407363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:40.423506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: 39a5235e-8a3c-4605-b8dd-8b4d246ff46f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:40.436270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.436813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.437261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.438014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.438476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.438907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.525521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:40.527769 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] HTTP exception thrown: Instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f could not be found. Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Request method failure captured: Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f HTTP/1.1 Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU14X8aRx4oWjyCNI0FEvHOo_3lZFAHjkfHmQbjdefyNGUy6xwT07237PSMAR7OJREsU9UQS7rcef7-4TJ09J8-pxQnzHMdMPshroxpMfMF7YTsSGxGxMD4MctUgveBbhkWWNVfs0-RNjg_DI-Oy1sGg7vIk5YZNqZx6IByN-RaT5Jlk Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a10e488b35c54f6f9a5f4ede2520083f Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a10e488b35c54f6f9a5f4ede2520083f"}]}] Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a10e488b35c54f6f9a5f4ede2520083f Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-MigrationsAdminTest-1944439124-project Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bf9da8e55124a7aae0938bb828b8f8a Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-MigrationsAdminTest-1944439124-project Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f could not be found. Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '39a5235e-8a3c-4605-b8dd-8b4d246ff46f'} Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f could not be found. Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f could not be found. Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:40.529748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:40.536853 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:40.536853 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:40.536853 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:40.536853 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:40.536853 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:40.536853 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f could not be found. Oct 22 03:11:40.536853 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:11:40.542271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Returning 404 to user: Instance 39a5235e-8a3c-4605-b8dd-8b4d246ff46f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:40.543327 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01ee11e0-fedd-411a-97f4-d626a80fdcbb tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f" status: 404 len: 111 microversion: 2.1 time: 0.163145 Oct 22 03:11:40.543949 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 966/1923] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:40 2022] GET /compute/v2.1/servers/39a5235e-8a3c-4605-b8dd-8b4d246ff46f => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:40.547913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:40.553268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4ad9597-db1d-477a-8452-39a630e1f3ec tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:40.553890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b4ad9597-db1d-477a-8452-39a630e1f3ec tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:40.556771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:40.560535 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17b48e8d-5759-45b1-aee5-f6332c170ee6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1250 microversion: 2.25 time: 0.505319 Oct 22 03:11:40.563403 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 958/1924] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:40 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1250 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:40.584585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:40.585241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:40.605442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.617006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.617993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.619166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.620570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.621753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.710597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:40.842075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4ad9597-db1d-477a-8452-39a630e1f3ec tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:40.864263 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b4ad9597-db1d-477a-8452-39a630e1f3ec tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1216 microversion: 2.1 time: 0.311608 Oct 22 03:11:40.874593 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 967/1925] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:40 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1216 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:40.891334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:40.891887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:40.918216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.918780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.920989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.921960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:40.927535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:40.928279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:40.980720 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb6d5e0c-aa44-4060-8ca7-f69d74d2331a tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 204 len: 0 microversion: 2.1 time: 0.415742 Oct 22 03:11:40.982136 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 959/1926] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:40 2022] DELETE /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:40.990184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:40.994244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:41.022743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:41.025771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:41.026616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:41.032265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:41.035193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:41.040014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:41.091005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:11:41.291125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:41.337684 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5430e5f-57e6-450e-9ddd-5783798ab3d7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1284 microversion: 2.1 time: 0.353768 Oct 22 03:11:41.343443 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 960/1927] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:40 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1284 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:41.363764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:41.368395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:41.374688 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f7d838a7-55ef-4288-9372-a1547478bd4c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 204 len: 0 microversion: 2.1 time: 0.498396 Oct 22 03:11:41.377804 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 968/1928] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:11:40 2022] DELETE /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:11:41.398991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:41.399707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:41.420936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:41.422530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:41.425747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:41.429981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:41.431130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:41.432485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:41.434636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:41.437552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:41.438325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:41.438791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:41.445731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:41.446219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:41.951389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:41.975250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:41.977067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:41.978287 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee43222a-802c-48a0-818f-81079a1338fe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1575 microversion: 2.32 time: 0.632247 Oct 22 03:11:41.984930 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 961/1929] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:41 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1575 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:41.997584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0ca61f19-28e7-475f-8039-11a9f61454ee req-6ca096fc-fe41-4d02-937d-660f231693ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e02fea-8912-4cd6-bf02-eb3f39255b04", "name": "network-vif-deleted", "tag": "eb7d1572-7f08-4d8e-8228-edab5d49e086"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:42.018057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:42.030418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0ca61f19-28e7-475f-8039-11a9f61454ee req-6ca096fc-fe41-4d02-937d-660f231693ae service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:42.030632 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-58fc5a2e-0d8f-4cc9-9667-e09d225737a1 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1472 microversion: 2.1 time: 0.650595 Oct 22 03:11:42.030902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0ca61f19-28e7-475f-8039-11a9f61454ee req-6ca096fc-fe41-4d02-937d-660f231693ae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:42.031240 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 969/1930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:41 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1472 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:42.036014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0ca61f19-28e7-475f-8039-11a9f61454ee req-6ca096fc-fe41-4d02-937d-660f231693ae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:42.059112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:42.060624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:42.081094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:42.082020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:42.088245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:42.089953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:42.097018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:42.098846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:42.102899 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0ca61f19-28e7-475f-8039-11a9f61454ee req-6ca096fc-fe41-4d02-937d-660f231693ae service nova] Creating event network-vif-deleted:eb7d1572-7f08-4d8e-8228-edab5d49e086 for instance 69e02fea-8912-4cd6-bf02-eb3f39255b04 on n-h1-862416-2 Oct 22 03:11:42.130425 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0ca61f19-28e7-475f-8039-11a9f61454ee req-6ca096fc-fe41-4d02-937d-660f231693ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144129 Oct 22 03:11:42.131347 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 962/1931] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:42.144965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:42.145677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:42.178146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:42.178642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:42.192996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:42.200089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:42.200955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:42.208958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:42.702817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:42.713639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:42.719553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:42.729244 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0d4662d-7b2f-4964-9f01-c94574b3b2db tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1292 microversion: 2.25 time: 0.596267 Oct 22 03:11:42.732918 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 963/1932] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:42 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1292 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:42.760916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:42.761915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:42.777737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:42.778632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:42.779294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:42.781478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:42.784806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:42.785613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:43.001235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:43.029451 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e86ed896-733e-493e-bdca-0fe164f73893 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1268 microversion: 2.1 time: 0.295013 Oct 22 03:11:43.030516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 964/1933] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:42 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1268 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:43.044532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:43.045559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:43.062913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:43.064024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:43.068779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:43.069673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:43.072407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:43.073122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:43.184557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:43.216580 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a841e50-01fc-484f-ba06-0cf9ff12a93d tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1468 microversion: 2.1 time: 1.171198 Oct 22 03:11:43.228509 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 970/1934] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:42 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1468 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:43.234520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:43.239940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:43.253380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:43.264970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:43.265599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:43.266604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:43.267203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:43.267737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:43.393516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:43.416024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:43.417629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:43.418931 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f72e8b6-649e-4b35-82d3-6b6465737073 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1575 microversion: 2.32 time: 0.188440 Oct 22 03:11:43.431449 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 971/1935] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:43 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:43.436327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:43.437185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:43.455208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:43.456311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:43.457000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:43.457946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:43.458602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:43.463434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:43.485518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:43.507351 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ac5e9ca-0b71-46f7-bb3f-4b80429d5119 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1282 microversion: 2.1 time: 0.471551 Oct 22 03:11:43.508006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 965/1936] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:43 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1282 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:43.761256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:43.761873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:43.780062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:43.780976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:43.782896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:43.786475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:43.791411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:43.793263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:44.070871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:44.080172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:44.082219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:44.083856 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-94b4088d-7492-44c3-9b30-951718ae12d7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1292 microversion: 2.25 time: 0.327629 Oct 22 03:11:44.085276 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 966/1937] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:43 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1292 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:44.101153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:44.102179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:44.115489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:44.116312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:44.116940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:44.117832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:44.118455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:44.119050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:44.391493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:44.409656 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e927d96-b412-4ec1-a38b-419a6334299a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1274 microversion: 2.1 time: 0.322481 Oct 22 03:11:44.411212 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 967/1938] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:44 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1274 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:44.430523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:44.431566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:44.447465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:44.468232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:44.470818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:44.471940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:44.472630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:44.473263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:45.004867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:45.014008 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28ec6d92-5834-48c3-b6cd-7ff412bdada3 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1472 microversion: 2.1 time: 1.592964 Oct 22 03:11:45.034135 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 972/1939] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:43 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1472 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:45.040938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:45.048432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:45.066948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:45.067448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:45.070668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:45.071629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:45.072287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:45.074432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:45.654198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:45.676882 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6241e8ae-e565-40d5-9a65-794df61cc3cc tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1468 microversion: 2.1 time: 1.262783 Oct 22 03:11:45.681484 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 968/1940] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:44 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1468 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:45.689098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:45.693899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:45.710485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:45.712823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:45.713732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:45.715531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:45.716753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:45.721713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:46.589486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:46.599689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:46.613577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:46.615048 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-60613d0b-2268-496e-b5aa-32cf7e50f81b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1593 microversion: 2.32 time: 1.579505 Oct 22 03:11:46.619785 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 973/1941] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:45 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1593 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:46.630098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:46.630704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:46.654139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:46.654887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:46.655073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:46.659912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:46.660658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:46.661270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:46.973113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:46.980887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:46.985896 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6cf535e8-8187-4dcf-a0ac-f7f940a74e46 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 1.303007 Oct 22 03:11:46.991864 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 969/1942] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:45 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:47.007387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:47.008292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:47.021696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:47.026143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:47.027008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:47.028040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:47.028768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:47.031514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:47.280755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:47.335805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:47.351022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:47.352498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:47.374977 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-58140c4e-9296-43a3-b200-45ddae4bbbed tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1292 microversion: 2.25 time: 0.753230 Oct 22 03:11:47.377940 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 974/1943] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:46 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1292 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:47.403807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:47.411561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:47.430946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:47.432570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:47.453881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:47.456299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:47.462920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:47.467181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:47.627240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:47.650916 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-daf08d44-7eb3-4171-86b5-2396e4a348e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1274 microversion: 2.1 time: 0.657567 Oct 22 03:11:47.651531 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 970/1944] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:46 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1274 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:47.687852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:47.689463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:47.703912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:47.706715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:47.708515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:47.711458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:47.717714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:47.719479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:47.840858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:47.841350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:47.841787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:47.842241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lazy-loading 'fault' on Instance uuid f275fc7f-8fe1-4e0c-b717-0889031f866b {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:11:47.973159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb696d229f74155947d6e4f89e16f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e462137d650486c919790a05aa876dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:47.991736 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-29738c7a-a2f5-4cf0-ba6d-c84b6617eaef tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 200 len: 1430 microversion: 2.1 time: 0.612296 Oct 22 03:11:47.993859 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 975/1945] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:47 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 1430 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:48.007907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-39ce0d37-4431-4556-b2f7-3b886115e2bc req-459cdcf1-e439-4e06-bb4f-5021e93bea96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f275fc7f-8fe1-4e0c-b717-0889031f866b", "name": "network-vif-deleted", "tag": "acdf2dde-8d5f-421c-be80-ccc69afad608"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:48.055733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-39ce0d37-4431-4556-b2f7-3b886115e2bc req-459cdcf1-e439-4e06-bb4f-5021e93bea96 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:48.058909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-39ce0d37-4431-4556-b2f7-3b886115e2bc req-459cdcf1-e439-4e06-bb4f-5021e93bea96 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:48.059868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-39ce0d37-4431-4556-b2f7-3b886115e2bc req-459cdcf1-e439-4e06-bb4f-5021e93bea96 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:48.107462 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-39ce0d37-4431-4556-b2f7-3b886115e2bc req-459cdcf1-e439-4e06-bb4f-5021e93bea96 service nova] Creating event network-vif-deleted:acdf2dde-8d5f-421c-be80-ccc69afad608 for instance f275fc7f-8fe1-4e0c-b717-0889031f866b on n-h1-862416-2 Oct 22 03:11:48.144953 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-39ce0d37-4431-4556-b2f7-3b886115e2bc req-459cdcf1-e439-4e06-bb4f-5021e93bea96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145019 Oct 22 03:11:48.152516 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 976/1946] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:48.163490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:48.169471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:48.181129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:48.183315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:48.185783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:48.186714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:48.188767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:48.189386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:48.360259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf9da8e55124a7aae0938bb828b8f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e488b35c54f6f9a5f4ede2520083f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:48.382299 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-24dd4e30-1bfd-4f10-89ca-54871dedc26c tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 200 len: 1303 microversion: 2.1 time: 0.726183 Oct 22 03:11:48.392090 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 971/1947] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:47 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 1303 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:48.415429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:48.416359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:48.442240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:48.442997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:48.443610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:48.444576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:48.445205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:48.445810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:49.023255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:49.040165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:49.041663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:49.049715 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a7c7b65-95f8-4190-814a-eb9fd63fd174 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1593 microversion: 2.32 time: 0.888925 Oct 22 03:11:49.050569 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 977/1948] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:48 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1593 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:49.066564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6a8c08a4-b0c5-4841-91b5-31c8f70878da req-dbfc4cdf-0c72-43d2-8b56-aad443af4edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6904474-1e00-42a7-bc83-8620882fa334", "tag": "34820d5a-d397-4b8c-93a7-44afc5851778"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:49.097754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6a8c08a4-b0c5-4841-91b5-31c8f70878da req-dbfc4cdf-0c72-43d2-8b56-aad443af4edf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:49.098245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6a8c08a4-b0c5-4841-91b5-31c8f70878da req-dbfc4cdf-0c72-43d2-8b56-aad443af4edf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:49.098690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6a8c08a4-b0c5-4841-91b5-31c8f70878da req-dbfc4cdf-0c72-43d2-8b56-aad443af4edf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:49.141952 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6a8c08a4-b0c5-4841-91b5-31c8f70878da req-dbfc4cdf-0c72-43d2-8b56-aad443af4edf service nova] Creating event network-changed:34820d5a-d397-4b8c-93a7-44afc5851778 for instance d6904474-1e00-42a7-bc83-8620882fa334 on n-h2-862416-2 Oct 22 03:11:49.157567 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6a8c08a4-b0c5-4841-91b5-31c8f70878da req-dbfc4cdf-0c72-43d2-8b56-aad443af4edf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092530 Oct 22 03:11:49.159544 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 978/1949] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:49.173757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:49.179301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:49.215464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:49.218799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:49.222163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:49.236465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:49.237595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:49.240469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:49.820142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:49.835838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:49.844778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:49.847890 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a65ca1d8-82d8-456d-827b-ca025eba7414 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1292 microversion: 2.25 time: 0.685690 Oct 22 03:11:49.849469 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 979/1950] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:49 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1292 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:49.857429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:49.858277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:49.868435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:49.869543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:49.870199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:49.871237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:49.872997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:49.874370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:49.875512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:49.902153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:49.976674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:49.988662 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-745464a4-b10a-416a-b330-30fced5a6628 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 1.592525 Oct 22 03:11:49.990606 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 972/1951] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:48 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:49.995505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:49.996118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] [instance: 5073feec-6b6f-4858-99ba-438ab7362ee2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:50.004241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.004974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.005606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.006640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.007265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.007854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.051031 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] HTTP exception thrown: Instance 5073feec-6b6f-4858-99ba-438ab7362ee2 could not be found. Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Request method failure captured: Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 HTTP/1.1 Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU16zimHwY5iLTHbCvPbLZ-qkg-tcGCQiU02cSEV0smK-Tezga1WSo0_EsLTUi_4fWe2A66mM002tfCOzuPfc2FUSUEIF9XC1_dWHqBCWVr8B3OinThmDIyqA_0yZJN7JEMODItmoH0AmTLtqRRo3e9Gn5ZTWup_qOL1SXkRdUEuIs5E Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e462137d650486c919790a05aa876dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e462137d650486c919790a05aa876dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e462137d650486c919790a05aa876dc"}]}] Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7e462137d650486c919790a05aa876dc Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2094154421 Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3fb696d229f74155947d6e4f89e16f5a Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersOnMultiNodesTest-2094154421-project Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 5073feec-6b6f-4858-99ba-438ab7362ee2 could not be found. Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '5073feec-6b6f-4858-99ba-438ab7362ee2'} Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5073feec-6b6f-4858-99ba-438ab7362ee2 could not be found. Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5073feec-6b6f-4858-99ba-438ab7362ee2 could not be found. Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:50.053071 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.058648 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:50.058648 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:50.058648 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:50.058648 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:50.058648 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:50.058648 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5073feec-6b6f-4858-99ba-438ab7362ee2 could not be found. Oct 22 03:11:50.058648 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.061523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] Returning 404 to user: Instance 5073feec-6b6f-4858-99ba-438ab7362ee2 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:50.062616 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49627eb6-ab3d-433b-baed-be9ea7185135 tempest-ServersOnMultiNodesTest-2094154421 tempest-ServersOnMultiNodesTest-2094154421-project] 10.222.0.25 "GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2" status: 404 len: 111 microversion: 2.1 time: 0.070879 Oct 22 03:11:50.068983 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 973/1952] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:49 2022] GET /compute/v2.1/servers/5073feec-6b6f-4858-99ba-438ab7362ee2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:50.087701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:50.088354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] [instance: f275fc7f-8fe1-4e0c-b717-0889031f866b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:50.101740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.108895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.109377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.118480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.120412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.121685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.144433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:50.163218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] HTTP exception thrown: Instance f275fc7f-8fe1-4e0c-b717-0889031f866b could not be found. Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Request method failure captured: Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b HTTP/1.1 Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU14X8aRx4oWjyCNI0FEvHOo_3lZFAHjkfHmQbjdefyNGUy6xwT07237PSMAR7OJREsU9UQS7rcef7-4TJ09J8-pxQnzHMdMPshroxpMfMF7YTsSGxGxMD4MctUgveBbhkWWNVfs0-RNjg_DI-Oy1sGg7vIk5YZNqZx6IByN-RaT5Jlk Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a10e488b35c54f6f9a5f4ede2520083f Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a10e488b35c54f6f9a5f4ede2520083f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a10e488b35c54f6f9a5f4ede2520083f"}]}] Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a10e488b35c54f6f9a5f4ede2520083f Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-MigrationsAdminTest-1944439124 Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-MigrationsAdminTest-1944439124-project Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bf9da8e55124a7aae0938bb828b8f8a Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-MigrationsAdminTest-1944439124-project Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f275fc7f-8fe1-4e0c-b717-0889031f866b could not be found. Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f275fc7f-8fe1-4e0c-b717-0889031f866b'} Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f275fc7f-8fe1-4e0c-b717-0889031f866b could not be found. Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f275fc7f-8fe1-4e0c-b717-0889031f866b could not be found. Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:11:50.163880 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f275fc7f-8fe1-4e0c-b717-0889031f866b could not be found. Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] Returning 404 to user: Instance f275fc7f-8fe1-4e0c-b717-0889031f866b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-02d3ab7d-fd41-4871-8e0b-a0af7d486a8f tempest-MigrationsAdminTest-1944439124 tempest-MigrationsAdminTest-1944439124-project] 10.222.0.25 "GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b" status: 404 len: 111 microversion: 2.1 time: 0.094675 Oct 22 03:11:50.168600 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 974/1953] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:50 2022] GET /compute/v2.1/servers/f275fc7f-8fe1-4e0c-b717-0889031f866b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:11:50.204972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:50.206601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:50.224924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.225585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.230021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.236798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.240184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.240900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.666381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:50.682324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:50.683774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:50.685243 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c32b792e-fdf9-4d04-9a0a-d24c1d2a36fb tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1593 microversion: 2.32 time: 0.518448 Oct 22 03:11:50.704512 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 975/1954] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:50 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1593 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:50.800504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fcfeef97-4f51-4732-a3f0-747b635c2d39 req-622751d9-4c5e-4714-ab57-39bffb2c28b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5073feec-6b6f-4858-99ba-438ab7362ee2", "name": "network-vif-deleted", "tag": "019c8c39-8fcc-45aa-8832-d36cec24789a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:50.813455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fcfeef97-4f51-4732-a3f0-747b635c2d39 req-622751d9-4c5e-4714-ab57-39bffb2c28b9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.814253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fcfeef97-4f51-4732-a3f0-747b635c2d39 req-622751d9-4c5e-4714-ab57-39bffb2c28b9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.816908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fcfeef97-4f51-4732-a3f0-747b635c2d39 req-622751d9-4c5e-4714-ab57-39bffb2c28b9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.849345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=24 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:50.860529 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fcfeef97-4f51-4732-a3f0-747b635c2d39 req-622751d9-4c5e-4714-ab57-39bffb2c28b9 service nova] Creating event network-vif-deleted:019c8c39-8fcc-45aa-8832-d36cec24789a for instance 5073feec-6b6f-4858-99ba-438ab7362ee2 on n-h1-862416-2 Oct 22 03:11:50.879368 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fcfeef97-4f51-4732-a3f0-747b635c2d39 req-622751d9-4c5e-4714-ab57-39bffb2c28b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073555 Oct 22 03:11:50.883876 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 976/1955] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:11:50.902174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:50.905505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:50.921515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.922381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.923722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.925264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:50.927019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:50.928758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:50.987394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:51.009631 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d7392fab-941b-41f0-843c-89ba8d380fcf tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1316 microversion: 2.1 time: 1.155876 Oct 22 03:11:51.011244 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 980/1956] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:49 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1316 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:51.026943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:51.029457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:51.072139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:51.074026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:51.074511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:51.075271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:51.075737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:51.080864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:52.051893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:52.060924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:52.062384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:52.063513 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-935375cc-6f52-4402-82d9-6505795c8d2c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1292 microversion: 2.25 time: 1.178099 Oct 22 03:11:52.076586 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 977/1957] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:50 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1292 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:52.090370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-ffe7d9e7-147c-438c-b9c4-2d66c9ce884b req-975e945f-1575-46b5-a1ea-a5f91f2af97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9acf03a-b005-4042-b847-201ad5368653", "tag": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:52.112464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ffe7d9e7-147c-438c-b9c4-2d66c9ce884b req-975e945f-1575-46b5-a1ea-a5f91f2af97f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:52.112956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ffe7d9e7-147c-438c-b9c4-2d66c9ce884b req-975e945f-1575-46b5-a1ea-a5f91f2af97f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:52.113635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ffe7d9e7-147c-438c-b9c4-2d66c9ce884b req-975e945f-1575-46b5-a1ea-a5f91f2af97f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:52.136592 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-ffe7d9e7-147c-438c-b9c4-2d66c9ce884b req-975e945f-1575-46b5-a1ea-a5f91f2af97f service nova] Creating event network-changed:0b6c9724-a37e-45ce-9211-1d83f2f45fbf for instance e9acf03a-b005-4042-b847-201ad5368653 on n-h1-862416-2 Oct 22 03:11:52.147156 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-ffe7d9e7-147c-438c-b9c4-2d66c9ce884b req-975e945f-1575-46b5-a1ea-a5f91f2af97f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058621 Oct 22 03:11:52.148844 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 978/1958] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:52.161483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:52.162230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:52.177443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:52.177945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:52.178390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:52.179109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:52.179557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:52.179986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:52.664814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:52.674862 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d0b5419-ae98-4c56-ad8b-720e01af3a7f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 1.659675 Oct 22 03:11:52.697111 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 981/1959] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:51 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:52.705798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:52.709273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:52.727053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:52.728573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:52.730088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:52.731014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:52.738404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:52.741965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:52.796879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:52.817552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:52.820555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:52.822592 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c27f8176-a162-4dd9-a2ae-af7900086be9 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1661 microversion: 2.32 time: 0.671194 Oct 22 03:11:52.828596 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 979/1960] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:52 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1661 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:53.093776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:53.095152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:53.110106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:53.110803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:53.111873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:53.114301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:53.117015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:53.117831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:53.513483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:53.531625 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-04ff270e-1e15-459f-adff-ac372682214b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1316 microversion: 2.1 time: 0.832912 Oct 22 03:11:53.532347 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 982/1961] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:52 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1316 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:53.702353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:53.703118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:53.715675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:53.721679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:53.722904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:53.723831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:53.724557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:53.725174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:54.126389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:54.140468 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df0138db-01b7-440b-8fd9-42b3427d65af tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 0.441039 Oct 22 03:11:54.156137 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 983/1962] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:53 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:54.177412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:54.179207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:54.207232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:54.212550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:54.213476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:54.215751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:54.219083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:54.220189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:54.717422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:54.730364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:54.738612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:54.740117 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79f74415-8608-400b-bb9c-8c81c1e84c9e tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1292 microversion: 2.25 time: 1.650876 Oct 22 03:11:54.752406 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 980/1963] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:53 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1292 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:54.752406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:54.752406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:54.752974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:54.768257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:54.773432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:54.774161 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c9fe8bc1-2a07-4abb-be21-b8ac3eb49e65 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1661 microversion: 2.32 time: 0.616057 Oct 22 03:11:54.780441 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 984/1964] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:54 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1661 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:54.785655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:54.786368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:54.786966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:54.792341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:54.793123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:54.793902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:54.896881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4b76949d-b51f-4806-974f-f4bfc0116810 req-3ad379ff-20e3-455d-83ba-7181b1f725df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83aea4f8-aff9-49b1-9fac-7fa0c254fea3", "tag": "cfaf4bdc-ec50-406c-ba43-5295b1573af3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:11:54.912040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b76949d-b51f-4806-974f-f4bfc0116810 req-3ad379ff-20e3-455d-83ba-7181b1f725df service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:54.912480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b76949d-b51f-4806-974f-f4bfc0116810 req-3ad379ff-20e3-455d-83ba-7181b1f725df service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:54.912928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b76949d-b51f-4806-974f-f4bfc0116810 req-3ad379ff-20e3-455d-83ba-7181b1f725df service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:54.939890 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4b76949d-b51f-4806-974f-f4bfc0116810 req-3ad379ff-20e3-455d-83ba-7181b1f725df service nova] Creating event network-changed:cfaf4bdc-ec50-406c-ba43-5295b1573af3 for instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 on n-h2-862416-2 Oct 22 03:11:54.957920 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4b76949d-b51f-4806-974f-f4bfc0116810 req-3ad379ff-20e3-455d-83ba-7181b1f725df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065338 Oct 22 03:11:54.958853 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 985/1965] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:11:55.168580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:55.169791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:55.186999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:55.194219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:55.194957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:55.203452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:55.205348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:55.212763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:55.562054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:55.574097 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a1fe2f5-a0cb-4d2a-825e-a5e19a9ef0ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1316 microversion: 2.1 time: 0.831674 Oct 22 03:11:55.575004 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 981/1966] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:54 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1316 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:55.770702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:55.776271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:55.791881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:55.799824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:55.800396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:55.801171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:55.801651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:55.808711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:55.824954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:55.840988 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20b8ee47-6252-4bc0-b808-c0e5f9f221a3 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 0.674568 Oct 22 03:11:55.860244 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 986/1967] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:55 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:11:55.869181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:55.875177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:55.884472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:55.885136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:55.893740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:55.895158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:55.895628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:55.896075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:56.437791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:56.471182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:56.478023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:56.489398 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84833950-eec2-4909-b3ec-c97b2d1208a1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1292 microversion: 2.25 time: 0.723673 Oct 22 03:11:56.494013 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 982/1968] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:55 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1292 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:11:56.601071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:56.602952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:56.616010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:11:56.618169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:56.618682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:56.619146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:56.619990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:56.620477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:56.622476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:57.039141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:57.067336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:57.074850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:57.076816 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab629cc7-d539-4f77-86a8-f6df7374f6b1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1708 microversion: 2.32 time: 1.224558 Oct 22 03:11:57.094928 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 987/1969] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:55 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1708 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:57.117967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:57.120600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:57.162354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:57.172304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:57.173449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:57.175015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:57.175500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:57.175940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:57.772251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:57.792240 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0bda98c0-466d-48bd-a03e-8df389e27a8f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 0.695600 Oct 22 03:11:57.793515 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 988/1970] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:57 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:57.801343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:57.802590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:57.809868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:57.811766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:57.812742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:57.815463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:57.816990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:57.818359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:57.832138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:57.841337 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7cdb543a-f496-4766-8593-2e408fe78b03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1316 microversion: 2.1 time: 1.246473 Oct 22 03:11:57.841936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 983/1971] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:56 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1316 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:11:58.107924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:58.108592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:58.125124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:58.127235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:58.127735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:58.129960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:58.131685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:58.132135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:58.366022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:58.386662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:58.398605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:58.403107 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e759b58-5286-4db9-8874-0c838f339d65 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1292 microversion: 2.25 time: 0.605054 Oct 22 03:11:58.404814 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 989/1972] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:57 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1292 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:58.559673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:58.573750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:58.586946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:58.590276 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aacba316-41c2-465a-94bb-37ab16b4f95a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1708 microversion: 2.32 time: 0.487964 Oct 22 03:11:58.596164 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 984/1973] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:58 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1708 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:11:58.820651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:58.821237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:58.856776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:58.862357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:58.864657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:58.866465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:58.881613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:58.882537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:58.889382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:58.893462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:58.915379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:58.919310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:58.926279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:58.932377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:58.938178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:58.938721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:59.482572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:59.497537 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27f69dde-fd15-4fd3-928e-e09ddf479e75 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 0.679729 Oct 22 03:11:59.498985 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 990/1974] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:58 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:59.518611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:59.519621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:59.532301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:59.532894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:59.534586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:59.538868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:59.539855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:59.540617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:59.855316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:11:59.874176 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a741133b-3225-4d97-b10b-177d0c314e8b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1316 microversion: 2.1 time: 0.998831 Oct 22 03:11:59.875405 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 985/1975] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:11:58 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1316 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:11:59.880917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:11:59.891448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:11:59.899995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:59.903588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:59.904269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:11:59.905181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:11:59.913693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:11:59.914496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:00.617921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:00.649744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:00.651196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:00.652433 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f55a0620-306c-4d65-8527-2b452caa1dd0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1755 microversion: 2.32 time: 0.775888 Oct 22 03:12:00.653007 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 986/1976] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:59 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1755 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:00.671075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:00.671690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:00.702611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:00.703318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:00.703955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:00.713373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:00.714154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:00.714766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:01.172989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:01.192372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ae67b920-e157-4742-9243-49ad36711954 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 0.538096 Oct 22 03:12:01.194835 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 987/1977] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:00 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:01.206515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:01.207957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:01.224177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:01.230435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:01.231314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:01.233164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:01.233880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:01.235762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:01.593200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:01.599495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:01.602072 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b226fe87-50fe-402d-94b3-46b9095855d0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1316 microversion: 2.1 time: 0.405202 Oct 22 03:12:01.609511 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 988/1978] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:01 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:01.619077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f08df97d-3201-40b9-9d73-16dd0ca5b5aa req-9f7d0d68-6e00-49fa-a3c1-329b21403fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9acf03a-b005-4042-b847-201ad5368653", "name": "network-vif-plugged", "status": "completed", "tag": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:01.640534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f08df97d-3201-40b9-9d73-16dd0ca5b5aa req-9f7d0d68-6e00-49fa-a3c1-329b21403fb4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:01.644512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f08df97d-3201-40b9-9d73-16dd0ca5b5aa req-9f7d0d68-6e00-49fa-a3c1-329b21403fb4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:01.645162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f08df97d-3201-40b9-9d73-16dd0ca5b5aa req-9f7d0d68-6e00-49fa-a3c1-329b21403fb4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:01.672603 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f08df97d-3201-40b9-9d73-16dd0ca5b5aa req-9f7d0d68-6e00-49fa-a3c1-329b21403fb4 service nova] Creating event network-vif-plugged:0b6c9724-a37e-45ce-9211-1d83f2f45fbf for instance e9acf03a-b005-4042-b847-201ad5368653 on n-h1-862416-2 Oct 22 03:12:01.686682 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f08df97d-3201-40b9-9d73-16dd0ca5b5aa req-9f7d0d68-6e00-49fa-a3c1-329b21403fb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075755 Oct 22 03:12:01.693798 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 989/1979] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:01.711057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:01.712594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:01.720567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:01.721612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:01.722446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:01.723434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:01.724163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:01.724934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:01.794049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:01.813886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:01.819338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:01.828630 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-439b95c3-795e-46c9-8258-f3cc27374c05 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1280 microversion: 2.25 time: 2.328348 Oct 22 03:12:01.832061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 991/1980] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:11:59 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1280 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:02.227823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:02.228497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:02.248701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:02.249213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:02.249708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:02.250448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:02.250913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:02.251347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:02.416027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:02.427582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:02.429170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:02.448558 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1b068cf-2c8f-4aa8-8c03-7ed5eed4b3c4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1802 microversion: 2.32 time: 0.753047 Oct 22 03:12:02.451385 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 990/1981] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:01 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1802 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:02.634032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:02.635264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:02.644383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:02.650337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:02.651042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:02.653411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:02.655649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:02.658297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:02.914368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:02.936666 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb31c38b-f669-42e5-8548-48c5bc700eb9 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1324 microversion: 2.1 time: 0.719116 Oct 22 03:12:02.937604 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 992/1982] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:02 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1324 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:12:02.949801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:02.950397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:02.958768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:02.974069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:02.974997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:02.978358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:02.979548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:02.980225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:02.980864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:03.156293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:03.165259 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-830469cc-8236-4fc9-bf70-1fc7e0295dde tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1316 microversion: 2.1 time: 0.536151 Oct 22 03:12:03.165865 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 991/1983] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:02 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:03.482739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:03.483497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:03.503120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:03.503677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:03.504125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:03.504887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:03.505348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:03.505776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:03.683078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:03.701772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:03.722107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:03.731161 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc6c1fc2-8710-4292-9a13-615ba0d6fc7d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1280 microversion: 2.25 time: 0.784509 Oct 22 03:12:03.737423 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 993/1984] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:02 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1280 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:03.770609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b38171f9-8b81-4b4d-8002-a9446a9b25cc req-74eacaaf-7a16-4125-ae25-a91f67c861a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83aea4f8-aff9-49b1-9fac-7fa0c254fea3", "name": "network-vif-plugged", "status": "completed", "tag": "cfaf4bdc-ec50-406c-ba43-5295b1573af3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:03.792187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b38171f9-8b81-4b4d-8002-a9446a9b25cc req-74eacaaf-7a16-4125-ae25-a91f67c861a5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:03.797661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b38171f9-8b81-4b4d-8002-a9446a9b25cc req-74eacaaf-7a16-4125-ae25-a91f67c861a5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:03.798373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b38171f9-8b81-4b4d-8002-a9446a9b25cc req-74eacaaf-7a16-4125-ae25-a91f67c861a5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:03.841284 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b38171f9-8b81-4b4d-8002-a9446a9b25cc req-74eacaaf-7a16-4125-ae25-a91f67c861a5 service nova] Creating event network-vif-plugged:cfaf4bdc-ec50-406c-ba43-5295b1573af3 for instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 on n-h2-862416-2 Oct 22 03:12:03.869010 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b38171f9-8b81-4b4d-8002-a9446a9b25cc req-74eacaaf-7a16-4125-ae25-a91f67c861a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102767 Oct 22 03:12:03.880661 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 994/1985] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:12:03.965673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:03.967200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:03.982101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:03.986562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:03.987481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:03.988466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:03.990967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:03.993008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:04.471292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:04.488649 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe45b665-8e11-4094-8225-867e7224ad59 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1520 microversion: 2.1 time: 0.530208 Oct 22 03:12:04.489580 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 995/1986] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:03 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1520 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:04.501246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:04.506767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:04.520403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:04.522585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:04.525404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:04.526646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:04.527365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:04.528728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:04.947382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:04.960653 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c55497b4-0162-4f50-b194-1b40c4fcbfc3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1316 microversion: 2.1 time: 0.463171 Oct 22 03:12:04.961782 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 996/1987] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:04 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:04.967315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-940c631c-fe2d-4900-a2b8-0787ab9ac0b6 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'create', calling method: .version_select at 0x7f0d1a991040>, body: {"pool": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:05.482112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:05.500740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:05.504487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:05.505920 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c8acbd4a-4c47-4047-801d-21b47f36173c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1849 microversion: 2.32 time: 2.032275 Oct 22 03:12:05.529991 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 992/1988] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:03 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1849 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:05.547819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:05.550799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:05.566656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:05.584612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:05.586498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:05.587900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:05.589642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:05.590275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:06.432474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:06.471079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:06.478258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:06.481966 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2db5aeba-9ea5-42a0-b9f6-9314d6f11b5a tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1280 microversion: 2.25 time: 0.950308 Oct 22 03:12:06.504007 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 993/1989] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:05 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1280 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:06.519327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:06.520629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:06.534747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:06.538148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:06.538869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:06.541190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:06.543748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:06.545662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:07.072477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:07.084268 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0a9fc382-61c8-46d2-ad11-0a745de5b6eb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.578290 Oct 22 03:12:07.084863 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 994/1990] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:06 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:07.099912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:07.102758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:07.119871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:07.120405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:07.120849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:07.121656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:07.122008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:07.122439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:07.595655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:07.610731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:07.615986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:07.620779 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f33308fb-15dc-47d6-a158-9f57fd9db8ca tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1849 microversion: 2.32 time: 0.534437 Oct 22 03:12:07.623100 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 995/1991] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:07 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1849 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:07.632373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1622542229", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:07.781518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] validate_networks() for [('cd333e9d-f9b8-4605-a5a4-47471e05a78d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:12:09.525587 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-940c631c-fe2d-4900-a2b8-0787ab9ac0b6 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.561998 Oct 22 03:12:09.538481 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 997/1992] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:12:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:09.538481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:09.538481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:09.548530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:09.548882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:09.549331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:09.550072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:09.550622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:09.550925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:10.398421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:10.415367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:10.416891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:10.425031 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e1b987b-589c-482d-b34c-9b1c98c8a97d tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1280 microversion: 2.25 time: 0.897302 Oct 22 03:12:10.425654 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 998/1993] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:09 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1280 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:10.442853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b7027936-68ad-4c02-9ac1-43410b4398f2 req-32dd8e53-5eaf-414d-88b0-3b99effdc43f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "tag": "6f7d0505-1709-46d1-b6ba-10387663e348"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:10.515255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7027936-68ad-4c02-9ac1-43410b4398f2 req-32dd8e53-5eaf-414d-88b0-3b99effdc43f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:10.516311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7027936-68ad-4c02-9ac1-43410b4398f2 req-32dd8e53-5eaf-414d-88b0-3b99effdc43f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:10.518593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7027936-68ad-4c02-9ac1-43410b4398f2 req-32dd8e53-5eaf-414d-88b0-3b99effdc43f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:10.568228 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b7027936-68ad-4c02-9ac1-43410b4398f2 req-32dd8e53-5eaf-414d-88b0-3b99effdc43f service nova] Creating event network-changed:6f7d0505-1709-46d1-b6ba-10387663e348 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:12:10.581934 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b7027936-68ad-4c02-9ac1-43410b4398f2 req-32dd8e53-5eaf-414d-88b0-3b99effdc43f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147712 Oct 22 03:12:10.582891 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 999/1994] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:10.596076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:10.601640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:10.618710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:10.619604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:10.621741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:10.624891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:10.626080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:10.628190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:10.640975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:10.997836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:11.017683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:11.019380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:11.026057 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e47739e-bbff-4e5a-8f5d-71471abbf67a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1870 microversion: 2.32 time: 0.435018 Oct 22 03:12:11.026933 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1000/1995] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:10 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1870 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:11.054393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1405909389", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "d718c698-c689-420d-bcc1-1b58b03babf9"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:11.130278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] validate_networks() for [('d718c698-c689-420d-bcc1-1b58b03babf9', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:12:11.959959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:12:11.961508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:12:11.964085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:12:11.964951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:12:11.967032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:12:11.987206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:11.988461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:11.990560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:11.991913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:11.992918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:11.993668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:12.038206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Getting quotas for project f2a1d7beed3948dda94437d6f7b8bb42. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:12:12.048450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Getting quotas for user 5d9b091b268443498d66f34cd397c8dc and project f2a1d7beed3948dda94437d6f7b8bb42. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:12:12.088640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:12:12.091462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:12:12.284911 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-81a9a689-470f-40c4-998a-118b2b219fbc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.660287 Oct 22 03:12:12.285651 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 996/1996] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:12:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:12:12.305692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:12.306534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:12.314593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:12.315701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:12.316504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:12.317439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:12.318080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:12.319222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:13.241928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:13.257586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:13.259124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:13.270860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-09c044dd-dc67-4e8b-982d-7e9f7312a336 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1280 microversion: 2.25 time: 0.961065 Oct 22 03:12:13.271609 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 997/1997] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:12 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1280 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:13.276863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:13.287645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:13.294569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:13.295483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:13.296098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:13.305282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:13.305771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:13.306216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:13.395027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:12:13.395597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:12:13.401346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:12:13.403395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:12:13.405441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:12:13.455407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:13.456402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:13.456997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:13.457998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:13.458822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:13.459626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:13.496451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Getting quotas for project 1895216a97de4e25ae036b7c8af7b690. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:12:13.508547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Getting quotas for user 23bd65aecc4849339a5245a0e63d4a2b and project 1895216a97de4e25ae036b7c8af7b690. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:12:13.563412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:12:13.571358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:12:13.782754 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a1907c5-12ca-419f-b460-8c8adfe026f5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.732066 Oct 22 03:12:13.791372 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1001/1998] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:12:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:12:13.816647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:13.832504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:13.876483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:13.877430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:13.878428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:13.883616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:13.884693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:13.889360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:14.071150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:14.091292 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-203f5239-bb0b-4487-96b2-30b147384b4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1269 microversion: 2.1 time: 0.280196 Oct 22 03:12:14.092966 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1002/1999] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:13 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1269 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:14.100540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d7c00cc8-6e47-400f-a2ef-c030e3f03b82 req-a04a5624-a29d-403d-a8c7-f2a52f47e14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "tag": "45e62a82-f51a-4e73-944b-9a9f24415d51"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:14.111269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d7c00cc8-6e47-400f-a2ef-c030e3f03b82 req-a04a5624-a29d-403d-a8c7-f2a52f47e14b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:14.112819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d7c00cc8-6e47-400f-a2ef-c030e3f03b82 req-a04a5624-a29d-403d-a8c7-f2a52f47e14b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:14.118979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d7c00cc8-6e47-400f-a2ef-c030e3f03b82 req-a04a5624-a29d-403d-a8c7-f2a52f47e14b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:14.135318 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d7c00cc8-6e47-400f-a2ef-c030e3f03b82 req-a04a5624-a29d-403d-a8c7-f2a52f47e14b service nova] Creating event network-changed:45e62a82-f51a-4e73-944b-9a9f24415d51 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:12:14.148577 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d7c00cc8-6e47-400f-a2ef-c030e3f03b82 req-a04a5624-a29d-403d-a8c7-f2a52f47e14b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053951 Oct 22 03:12:14.149210 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1003/2000] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:14.168952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-62ae2a18-1a72-489b-bee4-2b925a39c447 req-acab53e8-5bf1-462c-8b86-9dc45568b984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6904474-1e00-42a7-bc83-8620882fa334", "name": "network-vif-plugged", "status": "completed", "tag": "34820d5a-d397-4b8c-93a7-44afc5851778"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:14.197292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-62ae2a18-1a72-489b-bee4-2b925a39c447 req-acab53e8-5bf1-462c-8b86-9dc45568b984 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:14.197987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-62ae2a18-1a72-489b-bee4-2b925a39c447 req-acab53e8-5bf1-462c-8b86-9dc45568b984 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:14.198428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-62ae2a18-1a72-489b-bee4-2b925a39c447 req-acab53e8-5bf1-462c-8b86-9dc45568b984 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:14.221156 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-62ae2a18-1a72-489b-bee4-2b925a39c447 req-acab53e8-5bf1-462c-8b86-9dc45568b984 service nova] Creating event network-vif-plugged:34820d5a-d397-4b8c-93a7-44afc5851778 for instance d6904474-1e00-42a7-bc83-8620882fa334 on n-h2-862416-2 Oct 22 03:12:14.236435 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-62ae2a18-1a72-489b-bee4-2b925a39c447 req-acab53e8-5bf1-462c-8b86-9dc45568b984 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077162 Oct 22 03:12:14.237163 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1004/2001] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:14.248197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35ee1189-ce25-472e-9506-b5a18a14d09f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:14.248950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35ee1189-ce25-472e-9506-b5a18a14d09f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:14.429247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35ee1189-ce25-472e-9506-b5a18a14d09f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:14.437158 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35ee1189-ce25-472e-9506-b5a18a14d09f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1224 microversion: 2.1 time: 0.198725 Oct 22 03:12:14.440715 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1005/2002] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:14 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1224 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:14.446527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:14.447140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:14.476693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:14.477213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:14.477669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:14.487026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:14.494565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:14.494878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:15.012901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:15.022834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:15.029991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:15.031667 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfe31f20-0161-4f91-89f5-8002d12752c8 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1280 microversion: 2.25 time: 0.589675 Oct 22 03:12:15.032860 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1006/2003] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:14 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1280 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:15.121104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:15.121924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:15.140145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:15.143931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:15.144619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:15.145568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:15.149041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:15.149498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:15.274376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:15.285474 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f74436d6-ed8e-40ee-bc09-2a6082015e32 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1275 microversion: 2.1 time: 0.172872 Oct 22 03:12:15.300883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1007/2004] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:15 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:12:15.325099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:15.347696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1143414496", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fa98f4b1-9dd9-461c-9cc0-26f6d87c66ed"}], "security_groups": [{"name": "tempest-securitygroup--35395408"}], "key_name": "tempest-keypair-1428605690", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e6775e31-3de8-4f52-8b5a-ad63353870eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:15.349943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:15.356630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:15.361988 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b37d50e-ff9c-4ee5-9a54-897cc17c5245 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1870 microversion: 2.32 time: 2.087068 Oct 22 03:12:15.362600 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 998/2005] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:13 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1870 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:15.460773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:15.461815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:15.483495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:15.484498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:15.486349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:15.488690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:15.490860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:15.492748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:15.827099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] validate_networks() for [('fa98f4b1-9dd9-461c-9cc0-26f6d87c66ed', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:12:15.922109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:15.943462 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b8033b68-9d23-4a26-8936-04dd8d2c16ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1276 microversion: 2.1 time: 0.485030 Oct 22 03:12:15.944770 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 999/2006] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:15 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1276 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:16.060096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:16.060754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:16.084582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:16.089189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:16.095021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:16.099711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:16.101453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:16.104147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:17.962408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Getting quotas for project d3d30709037b42e9839252d0b366681a. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:12:17.979697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Getting quotas for user 1a2620c42cb94cf6a8b3f64faa91cfeb and project d3d30709037b42e9839252d0b366681a. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:12:18.017880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:12:18.018336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:12:18.020036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:12:18.020499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:12:18.022120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:12:18.072540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:18.075710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:18.076452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:18.077491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:18.080148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:18.080961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:18.159390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Getting quotas for project d3d30709037b42e9839252d0b366681a. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:12:18.187868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Getting quotas for user 1a2620c42cb94cf6a8b3f64faa91cfeb and project d3d30709037b42e9839252d0b366681a. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:12:18.425495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:12:18.428452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6775e31-3de8-4f52-8b5a-ad63353870eb',volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:12:18.803663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:18.822353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:18.824526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:18.829609 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f8261e3-eaf8-454a-a548-6a404847601c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1280 microversion: 2.25 time: 2.774039 Oct 22 03:12:18.855599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1000/2007] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:16 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1280 bytes in 2802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:12:18.871045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:18.872119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:18.888522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:18.889589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:18.890458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:18.892649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:18.893394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:18.894060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:18.914566 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ae667084-1382-45ef-a901-9527c822e217 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.572763 Oct 22 03:12:18.915677 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1008/2008] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:12:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 3574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:12:18.920614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:18.921788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:18.932181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:18.933024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:18.933683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:18.934648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:18.935319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:18.935962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:19.293591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:19.311200 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68a414ce-d394-4d9a-8c61-f5a379f31bed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1275 microversion: 2.1 time: 0.453893 Oct 22 03:12:19.320844 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1001/2009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:18 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1275 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:19.371413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:19.372045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:19.392768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:19.393814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:19.396403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:19.397585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:19.399022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:19.399991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:20.277664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:20.299359 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20d9a916-2b8f-4548-a34c-20d577cd05c0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1324 microversion: 2.1 time: 0.953379 Oct 22 03:12:20.301890 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1002/2010] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:19 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1324 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:20.319882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:20.323093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:20.341596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:20.348929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:20.349777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:20.350989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:20.351743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:20.352397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:20.655587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:20.664986 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-892e898d-eace-4dd4-adda-dab58fed96ae tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1164 microversion: 2.1 time: 0.361907 Oct 22 03:12:20.666864 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1003/2011] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:20 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1164 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:20.689599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:20.692639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:20.717048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:20.717550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:20.718059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:20.718794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:20.719253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:20.719681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:20.760659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:20.777978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:20.779458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:20.780723 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd2cc133-8045-4952-aed9-dad027623fe1 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1891 microversion: 2.32 time: 1.863828 Oct 22 03:12:20.794141 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1009/2012] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:18 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1891 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:20.813177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5a9b5e46-aa7c-4457-ab40-0b44cf104f21 req-14507ae6-2a5e-4813-8271-ad75d15a3288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "tag": "7898d55a-c69b-4875-a377-906a18281fe9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:20.841417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5a9b5e46-aa7c-4457-ab40-0b44cf104f21 req-14507ae6-2a5e-4813-8271-ad75d15a3288 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:20.841906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5a9b5e46-aa7c-4457-ab40-0b44cf104f21 req-14507ae6-2a5e-4813-8271-ad75d15a3288 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:20.842347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5a9b5e46-aa7c-4457-ab40-0b44cf104f21 req-14507ae6-2a5e-4813-8271-ad75d15a3288 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:20.871144 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5a9b5e46-aa7c-4457-ab40-0b44cf104f21 req-14507ae6-2a5e-4813-8271-ad75d15a3288 service nova] Creating event network-changed:7898d55a-c69b-4875-a377-906a18281fe9 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:12:20.887713 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5a9b5e46-aa7c-4457-ab40-0b44cf104f21 req-14507ae6-2a5e-4813-8271-ad75d15a3288 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091997 Oct 22 03:12:20.894668 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1010/2013] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:20.902920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:20.905586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:20.925794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:20.926297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:20.926743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:20.927472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:20.927935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:20.934460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:21.699016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:21.708739 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f9d95b0-3b47-4770-a626-e95602fc5c8c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1317 microversion: 2.1 time: 0.811301 Oct 22 03:12:21.711999 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1011/2014] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:20 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:21.726888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:21.727629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:21.746550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:21.748422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:21.749670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:21.752830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:21.753695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:21.754812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:22.014392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:22.060815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:22.088232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:22.105650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:22.107764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:22.112630 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cc33b1af-db0c-47df-931c-15023bfc3e79 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1475 microversion: 2.25 time: 1.444459 Oct 22 03:12:22.139734 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1004/2015] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:20 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1475 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:22.155085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:22.161112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:22.175621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:22.176928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:22.177742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:22.181120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:22.181855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:22.183017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:23.477955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:23.492024 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d099cecf-d906-4afb-adf5-a683b769d0d9 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1238 microversion: 2.1 time: 1.346765 Oct 22 03:12:23.495122 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1005/2016] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:22 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1238 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:23.504629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:23.507190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:23.526535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:23.527039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:23.529678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:23.530468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:23.530941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:23.531379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:23.737564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:23.746042 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-693fcf29-0e28-4953-9bfd-bcff9e153695 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1324 microversion: 2.1 time: 2.031204 Oct 22 03:12:23.753290 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1012/2017] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:21 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1324 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:24.149515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:24.150140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:24.160166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:24.160700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:24.161148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:24.161875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:24.162330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:24.173991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:24.880000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:24.885486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:24.900455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:24.902386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:24.911459 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4ac0e6f2-d37a-4d75-add0-3655b91ba83c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1891 microversion: 2.32 time: 1.415162 Oct 22 03:12:24.913006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1006/2018] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:23 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1891 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:24.921864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:24.922673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:24.937904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:24.939005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:24.939366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:24.940243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:24.940707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:24.941321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:26.174470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid d6904474-1e00-42a7-bc83-8620882fa334 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:12:26.213568 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9653050f-21b4-4222-89cd-c45d720375f2 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1967 microversion: 2.25 time: 2.458624 Oct 22 03:12:26.221920 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1013/2019] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:23 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1967 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:26.272155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:26.275507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:26.300437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:26.302932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:26.305047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:26.306472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:26.323269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:26.323968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:27.025583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:27.054221 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-249aa1a3-5467-436b-a1d4-351724dfcac0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1238 microversion: 2.1 time: 0.825069 Oct 22 03:12:27.057996 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1014/2020] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:26 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1238 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:27.072414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:27.078600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:27.094055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:27.095093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:27.095713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:27.096696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:27.097347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:27.098009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:27.442004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:27.456478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-072a7bd9-0bd3-42ce-a2b5-64d8c535e32f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1317 microversion: 2.1 time: 2.537837 Oct 22 03:12:27.457253 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1007/2021] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:24 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1317 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:27.487694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:27.494960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:27.501862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:27.518749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:27.523380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:27.523999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:27.526516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:27.527192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:27.527742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:27.866234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:27.874501 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4539fd3-c3fc-46c5-8361-916a6ecd7620 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1324 microversion: 2.1 time: 0.815127 Oct 22 03:12:27.880538 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1015/2022] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:27 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1324 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:27.892110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8cf80065-a356-44b8-86d7-fd68e886fd2d req-59b57745-acf0-467f-8ce2-06f5bc66c88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "tag": "b0488e2a-8772-4d06-8539-71f4d3e87f13"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:27.911016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8cf80065-a356-44b8-86d7-fd68e886fd2d req-59b57745-acf0-467f-8ce2-06f5bc66c88b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:27.911536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8cf80065-a356-44b8-86d7-fd68e886fd2d req-59b57745-acf0-467f-8ce2-06f5bc66c88b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:27.911970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8cf80065-a356-44b8-86d7-fd68e886fd2d req-59b57745-acf0-467f-8ce2-06f5bc66c88b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:27.937395 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8cf80065-a356-44b8-86d7-fd68e886fd2d req-59b57745-acf0-467f-8ce2-06f5bc66c88b service nova] Creating event network-changed:b0488e2a-8772-4d06-8539-71f4d3e87f13 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:12:27.944087 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8cf80065-a356-44b8-86d7-fd68e886fd2d req-59b57745-acf0-467f-8ce2-06f5bc66c88b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062113 Oct 22 03:12:27.947511 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1016/2023] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:27.958899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:27.960002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:27.968076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:27.968900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:27.969553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:27.970473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:27.971108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:27.971729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:28.130294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:28.232296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=18 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:28.452410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:28.493040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:28.499257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:28.502244 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19c88fc1-8e48-4042-aba9-38d7b5e17b24 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 1.026423 Oct 22 03:12:28.503419 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1008/2024] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:27 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:28.509156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-490efdf1-93a0-4d17-a778-39c21b0aad1f req-b19a7926-3b34-4877-ad73-7c5e76d6c8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d8696f-5c39-446f-9183-412b89491132", "tag": "16b1496b-d847-4e4d-b1c1-975fa3960268"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:28.536136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-490efdf1-93a0-4d17-a778-39c21b0aad1f req-b19a7926-3b34-4877-ad73-7c5e76d6c8fa service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:28.537950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-490efdf1-93a0-4d17-a778-39c21b0aad1f req-b19a7926-3b34-4877-ad73-7c5e76d6c8fa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:28.540541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-490efdf1-93a0-4d17-a778-39c21b0aad1f req-b19a7926-3b34-4877-ad73-7c5e76d6c8fa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:28.573645 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-490efdf1-93a0-4d17-a778-39c21b0aad1f req-b19a7926-3b34-4877-ad73-7c5e76d6c8fa service nova] Creating event network-changed:16b1496b-d847-4e4d-b1c1-975fa3960268 for instance e2d8696f-5c39-446f-9183-412b89491132 on n-h1-862416-2 Oct 22 03:12:28.580384 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-490efdf1-93a0-4d17-a778-39c21b0aad1f req-b19a7926-3b34-4877-ad73-7c5e76d6c8fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075344 Oct 22 03:12:28.583936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1009/2025] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:28.592455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:28.593110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:28.615949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:28.618604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:28.619226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:28.620019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:28.626855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:28.627845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:29.389165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid d6904474-1e00-42a7-bc83-8620882fa334 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:12:29.409938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:29.426514 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b7d6b918-a2ea-4fd4-b86d-fd68dd6f27bf tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1304 microversion: 2.1 time: 0.839341 Oct 22 03:12:29.429989 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1010/2026] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:28 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1304 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:29.472153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:29.474545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:29.478674 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5935aa62-37ad-4bb1-be05-e1a95ce8700b tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1967 microversion: 2.25 time: 1.529578 Oct 22 03:12:29.479205 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1017/2027] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:27 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1967 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:29.482694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:29.483829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:29.484111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:29.484754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:29.486699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:29.487768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:29.488487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:29.489111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:29.502798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:29.503302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:29.503744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:29.504497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:29.504954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:29.505382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:29.959904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:29.971790 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bafef040-3f78-426c-b819-4a39dfca0665 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1317 microversion: 2.1 time: 0.511598 Oct 22 03:12:29.972586 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1011/2028] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:29 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:29.984824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1f43c75-e5b4-4e05-a570-1e0f1f482295 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:29.988694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f43c75-e5b4-4e05-a570-1e0f1f482295 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:29.989468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f43c75-e5b4-4e05-a570-1e0f1f482295 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:29.990164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f43c75-e5b4-4e05-a570-1e0f1f482295 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:29.991444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f43c75-e5b4-4e05-a570-1e0f1f482295 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:29.992186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f43c75-e5b4-4e05-a570-1e0f1f482295 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:29.992923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1f43c75-e5b4-4e05-a570-1e0f1f482295 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:30.023299 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1f43c75-e5b4-4e05-a570-1e0f1f482295 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041950 Oct 22 03:12:30.033268 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1012/2029] 10.222.0.25 () {60 vars in 1217 bytes} [Sat Oct 22 03:12:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:12:30.039355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:30.040333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:30.046900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:30.048265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:30.049190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:30.050150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:30.050861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:30.051526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:30.488105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:30.505752 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b92fe508-a174-445c-84ba-22eb757b2245 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1324 microversion: 2.1 time: 1.024640 Oct 22 03:12:30.506626 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1018/2030] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:29 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1324 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:30.513328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862416-2", "block_migration": "auto"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:30.517261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:30.526448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:30.527267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:30.527884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:30.528835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:30.529458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:30.530558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:30.566097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'flavor' on Instance uuid d6904474-1e00-42a7-bc83-8620882fa334 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:12:30.580238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Going to try to live migrate instance to n-h1-862416-2 {{(pid=120581) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:12:30.659029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:30.874410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:30.886546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:30.888930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:30.890478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d95a4e38-2f9b-42ce-a967-cca982b49c6a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.855781 Oct 22 03:12:30.927235 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1013/2031] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:30 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:30.935550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b5f0c3bc-f54c-412e-8b67-768a8d0f5f58 req-037176f3-d9b0-4efc-b0fc-0bc11bde8abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83f771c-10b0-428a-b06e-dc6ff3241110", "tag": "23a30357-07cb-4571-9d6d-b3ee76b65039"}, {"name": "network-changed", "server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "tag": "ff3ee566-ef16-479d-ac0f-49bce2732089"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:30.958150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b5f0c3bc-f54c-412e-8b67-768a8d0f5f58 req-037176f3-d9b0-4efc-b0fc-0bc11bde8abb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:30.959003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b5f0c3bc-f54c-412e-8b67-768a8d0f5f58 req-037176f3-d9b0-4efc-b0fc-0bc11bde8abb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:30.959637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b5f0c3bc-f54c-412e-8b67-768a8d0f5f58 req-037176f3-d9b0-4efc-b0fc-0bc11bde8abb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:30.975499 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b5f0c3bc-f54c-412e-8b67-768a8d0f5f58 req-037176f3-d9b0-4efc-b0fc-0bc11bde8abb service nova] Creating event network-changed:23a30357-07cb-4571-9d6d-b3ee76b65039 for instance a83f771c-10b0-428a-b06e-dc6ff3241110 on n-h2-862416-2 Oct 22 03:12:30.976372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b5f0c3bc-f54c-412e-8b67-768a8d0f5f58 req-037176f3-d9b0-4efc-b0fc-0bc11bde8abb service nova] Creating event network-changed:ff3ee566-ef16-479d-ac0f-49bce2732089 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:12:31.000247 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b5f0c3bc-f54c-412e-8b67-768a8d0f5f58 req-037176f3-d9b0-4efc-b0fc-0bc11bde8abb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071622 Oct 22 03:12:31.007253 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1014/2032] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:31.020061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:31.022765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:31.037536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:31.039831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:31.040556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:31.041476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:31.043162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:31.049046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:31.491104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:31.508704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2f3ef7a5-c429-4087-8ad8-35592c694ad6 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1304 microversion: 2.1 time: 0.494274 Oct 22 03:12:31.509691 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1015/2033] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:31 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1304 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:31.515694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:31.517397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:31.527549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:31.528410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:31.529027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:31.529969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:31.530586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:31.531811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:31.835055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:31.847465 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9d8c9d9b-7ec9-416c-8282-59ab2eaff9c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1317 microversion: 2.1 time: 0.336483 Oct 22 03:12:31.849958 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1016/2034] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:31 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:31.870194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:31.871070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:31.882024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:31.883925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:31.884652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:31.885813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:31.886948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:31.887816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:32.123310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:32.132103 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62b727f4-4aa0-459a-9e9c-88a44f1b87cd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1324 microversion: 2.1 time: 0.278982 Oct 22 03:12:32.147296 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1017/2035] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:31 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:32.272614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-500112983", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "e05de320-3bab-4c23-a4a6-0a3d411f4dd6"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:32.365832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] validate_networks() for [('e05de320-3bab-4c23-a4a6-0a3d411f4dd6', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:12:33.935777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:12:33.937497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:12:33.938309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:12:33.939109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:12:33.939728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:12:33.958285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:33.958786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:33.959237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:33.959979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:33.965211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:33.965933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:34.034382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:12:34.049539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for user 92523f18567441589dba5548bb33eb9e and project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:12:34.099044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:12:34.110844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:12:34.229030 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2f7a22a-14ce-4737-a3e3-9aa47cde5efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.079051 Oct 22 03:12:34.240250 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1018/2036] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:12:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:12:34.263032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:34.264164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:34.279101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:34.282861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:34.283642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:34.285249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:34.286098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:34.286793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:35.665156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:35.688101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:35.692796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:35.699164 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e7361616-e98d-40dd-860c-7ce6aea3ac68 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 1.461446 Oct 22 03:12:35.720024 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1019/2037] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:34 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:35.738279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:35.739231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:35.761345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:35.762164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:35.763224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:35.764230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:35.765157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:35.767372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:36.357144 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73453066-2319-4988-9e5b-37bdbf8b5a0d tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334/action" status: 202 len: 0 microversion: 2.25 time: 5.848428 Oct 22 03:12:36.358293 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1019/2038] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:12:30 2022] POST /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334/action => generated 0 bytes in 5851 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:12:36.370516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:36.372833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:36.384381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:36.392353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:36.407948 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e1158fc-6dec-4def-80f6-29872682d93e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1292 microversion: 2.1 time: 0.679037 Oct 22 03:12:36.408865 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1020/2039] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:35 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1292 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:36.411715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:36.412221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:36.415657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:36.416442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:36.416911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:36.417354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:36.516223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-229dd09a-e83b-423c-8831-ca8dcd621408 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Action: 'create', calling method: .version_select at 0x7f0d1e55f0d0>, body: {"pool": null} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:37.334236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:37.342824 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a43f4c2a-66cb-4539-ba57-fe87e0baac60 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1317 microversion: 2.1 time: 0.982719 Oct 22 03:12:37.343427 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1020/2040] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:36 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1317 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:37.359604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-09cb6e88-f540-43ad-baa7-515fcc321e48 req-3157ad66-987a-49a9-bc63-d35d4c184928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f265234-6754-4073-93cc-ee1a65ffab52", "tag": "ec5cf3ed-8426-4959-9a3d-b9d84dcfe1d2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:37.390438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-09cb6e88-f540-43ad-baa7-515fcc321e48 req-3157ad66-987a-49a9-bc63-d35d4c184928 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:37.391756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-09cb6e88-f540-43ad-baa7-515fcc321e48 req-3157ad66-987a-49a9-bc63-d35d4c184928 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:37.393645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-09cb6e88-f540-43ad-baa7-515fcc321e48 req-3157ad66-987a-49a9-bc63-d35d4c184928 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:37.415470 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-09cb6e88-f540-43ad-baa7-515fcc321e48 req-3157ad66-987a-49a9-bc63-d35d4c184928 service nova] Creating event network-changed:ec5cf3ed-8426-4959-9a3d-b9d84dcfe1d2 for instance 4f265234-6754-4073-93cc-ee1a65ffab52 on n-h2-862416-2 Oct 22 03:12:37.422941 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-09cb6e88-f540-43ad-baa7-515fcc321e48 req-3157ad66-987a-49a9-bc63-d35d4c184928 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071474 Oct 22 03:12:37.424390 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1021/2041] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:37.449647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:37.455419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:37.469487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:37.470460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:37.470924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:37.471660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:37.472123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:37.472591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:38.321210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:38.362191 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5cc453f7-87bd-4ebb-b6f8-b0221edcdd3c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1324 microversion: 2.1 time: 0.933368 Oct 22 03:12:38.374727 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1022/2042] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:37 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1324 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:38.381210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ed0ce066-8b52-48a4-9e0e-7a35d41d7b4e req-74195bf2-a7e1-497a-8296-402029209332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "tag": "eace4bce-f550-4e2e-bc11-00a14552db28"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:38.420958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed0ce066-8b52-48a4-9e0e-7a35d41d7b4e req-74195bf2-a7e1-497a-8296-402029209332 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:38.421782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed0ce066-8b52-48a4-9e0e-7a35d41d7b4e req-74195bf2-a7e1-497a-8296-402029209332 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:38.423206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed0ce066-8b52-48a4-9e0e-7a35d41d7b4e req-74195bf2-a7e1-497a-8296-402029209332 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:38.440393 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ed0ce066-8b52-48a4-9e0e-7a35d41d7b4e req-74195bf2-a7e1-497a-8296-402029209332 service nova] Creating event network-changed:eace4bce-f550-4e2e-bc11-00a14552db28 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:12:38.475891 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ed0ce066-8b52-48a4-9e0e-7a35d41d7b4e req-74195bf2-a7e1-497a-8296-402029209332 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106045 Oct 22 03:12:38.479518 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1023/2043] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:38.492357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:38.499420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:38.515527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:38.516021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:38.521651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:38.522705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:38.523419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:38.523890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:38.745299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:38.756405 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a911339-85b9-4980-ada6-85e2c29ef5bc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1268 microversion: 2.1 time: 0.274750 Oct 22 03:12:38.757897 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1024/2044] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:38 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1268 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:38.770207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:38.772645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:38.788712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:38.789269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:38.789742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:38.790480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:38.790946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:38.791379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:39.762724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-229dd09a-e83b-423c-8831-ca8dcd621408 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.351801 Oct 22 03:12:39.765338 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1021/2045] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:12:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:39.784174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:39.786774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:39.795069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:39.795836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:39.796309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:39.797223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:39.797980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:39.799620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:39.816402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:39.837986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:39.844625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:39.848020 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-319eae19-0f69-4f64-98e3-91e9d6ceb28b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 1.088883 Oct 22 03:12:39.848657 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1025/2046] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:38 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:39.860937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:39.860937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:39.878097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:39.878589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:39.904007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:39.905546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:39.908085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:39.911322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:40.313473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:40.329734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:40.334831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:40.338714 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9276f961-dda8-459d-8fd0-b8f7b1b465b0 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.571210 Oct 22 03:12:40.339719 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1022/2047] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:39 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:40.354710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7b2e82dc-de9d-4d99-953b-8c1c8d4f505c req-71c6ca43-a782-44f4-bcc5-c9c273afddb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d8696f-5c39-446f-9183-412b89491132", "name": "network-vif-plugged", "status": "completed", "tag": "16b1496b-d847-4e4d-b1c1-975fa3960268"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:40.385204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7b2e82dc-de9d-4d99-953b-8c1c8d4f505c req-71c6ca43-a782-44f4-bcc5-c9c273afddb9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:40.386167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7b2e82dc-de9d-4d99-953b-8c1c8d4f505c req-71c6ca43-a782-44f4-bcc5-c9c273afddb9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:40.386828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7b2e82dc-de9d-4d99-953b-8c1c8d4f505c req-71c6ca43-a782-44f4-bcc5-c9c273afddb9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:40.421321 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7b2e82dc-de9d-4d99-953b-8c1c8d4f505c req-71c6ca43-a782-44f4-bcc5-c9c273afddb9 service nova] Creating event network-vif-plugged:16b1496b-d847-4e4d-b1c1-975fa3960268 for instance e2d8696f-5c39-446f-9183-412b89491132 on n-h1-862416-2 Oct 22 03:12:40.448528 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7b2e82dc-de9d-4d99-953b-8c1c8d4f505c req-71c6ca43-a782-44f4-bcc5-c9c273afddb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105291 Oct 22 03:12:40.455845 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1023/2048] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:40.497881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:40.498603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:40.526445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:40.529908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:40.530469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:40.533776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:40.534266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:40.537840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:40.919024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:40.933255 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c599054a-43cf-49eb-81c2-26e1bd988135 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1292 microversion: 2.1 time: 1.083262 Oct 22 03:12:40.934327 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1026/2049] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:39 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1292 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:40.944128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:40.957387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:40.967639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:40.977871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:40.978743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:40.979783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:40.980760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:40.988464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:41.369491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:41.379563 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2749add-bf8d-4324-9241-81022af99794 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1317 microversion: 2.1 time: 0.913119 Oct 22 03:12:41.400903 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1024/2050] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:40 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1317 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:41.409686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30c58cec-64e5-4ac2-a622-2f5f5f8c3057 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Action: 'create', calling method: .version_select at 0x7f0d1e4ea310>, body: {"pool": null} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:41.815601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:41.829648 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-014ad1ba-be2f-416a-87d0-c0f5a7638640 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1324 microversion: 2.1 time: 0.893433 Oct 22 03:12:41.838959 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1027/2051] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:40 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1324 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:41.851654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:41.859022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:41.877835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:41.889361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:41.890114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:41.891763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:41.892486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:41.893143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:42.393239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:42.408936 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c1848881-6da3-4b2b-9a8e-604b6f6d2b00 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1310 microversion: 2.1 time: 0.563718 Oct 22 03:12:42.409840 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1028/2052] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:41 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1310 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:42.418169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ca55a799-cad5-428d-9f07-b4c020b363d1 req-42e7a009-17b6-4561-add1-71f42418295b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "tag": "f1b84afb-a2c3-4cc5-93fe-295646ed55e0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:42.446882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ca55a799-cad5-428d-9f07-b4c020b363d1 req-42e7a009-17b6-4561-add1-71f42418295b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:42.449369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ca55a799-cad5-428d-9f07-b4c020b363d1 req-42e7a009-17b6-4561-add1-71f42418295b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:42.450115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ca55a799-cad5-428d-9f07-b4c020b363d1 req-42e7a009-17b6-4561-add1-71f42418295b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:42.498755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ca55a799-cad5-428d-9f07-b4c020b363d1 req-42e7a009-17b6-4561-add1-71f42418295b service nova] Creating event network-changed:f1b84afb-a2c3-4cc5-93fe-295646ed55e0 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:12:42.514512 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ca55a799-cad5-428d-9f07-b4c020b363d1 req-42e7a009-17b6-4561-add1-71f42418295b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099722 Oct 22 03:12:42.515734 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1029/2053] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:42.530860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:42.535964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:42.550578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:42.556939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:42.557778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:42.562555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:42.563889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:42.564710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:42.979226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:42.991986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:43.000291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:43.002197 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-781f16d6-4aea-4a89-a230-8ea97026f8c6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.484741 Oct 22 03:12:43.013824 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1030/2054] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:42 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:43.053215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:43.053839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:43.072165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:43.072697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:43.077135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:43.077918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:43.080080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:43.081630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:43.464306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:43.508306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:43.512297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:43.518902 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7608ca5d-f82e-435f-820a-13db88529569 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.475401 Oct 22 03:12:43.530164 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1031/2055] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:43 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:43.570420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:43.581337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:43.603764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:43.605151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:43.606865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:43.608908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:43.609709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:43.611871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:44.012460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:44.072963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:44.237512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:44.253722 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0533ed45-f08f-4487-b562-aac3a479f9e1 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1292 microversion: 2.1 time: 0.722298 Oct 22 03:12:44.273024 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1032/2056] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:43 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1292 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:44.283859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:44.284520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:44.300992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:44.306358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:44.307156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:44.308108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:44.308787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:44.309558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:44.694373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:44.707938 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40e18a5a-4e7a-4f5b-ba06-8471e6a1154e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1317 microversion: 2.1 time: 0.433403 Oct 22 03:12:44.722794 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1033/2057] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:44 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:44.730674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-fed37d68-744e-4214-97d6-0bdcfde269fe req-fab749e2-793b-4edc-af2e-83edc58b1850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83f771c-10b0-428a-b06e-dc6ff3241110", "name": "network-vif-plugged", "status": "completed", "tag": "23a30357-07cb-4571-9d6d-b3ee76b65039"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:44.759921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fed37d68-744e-4214-97d6-0bdcfde269fe req-fab749e2-793b-4edc-af2e-83edc58b1850 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:44.760694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fed37d68-744e-4214-97d6-0bdcfde269fe req-fab749e2-793b-4edc-af2e-83edc58b1850 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:44.761231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fed37d68-744e-4214-97d6-0bdcfde269fe req-fab749e2-793b-4edc-af2e-83edc58b1850 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:44.795411 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-fed37d68-744e-4214-97d6-0bdcfde269fe req-fab749e2-793b-4edc-af2e-83edc58b1850 service nova] Creating event network-vif-plugged:23a30357-07cb-4571-9d6d-b3ee76b65039 for instance a83f771c-10b0-428a-b06e-dc6ff3241110 on n-h2-862416-2 Oct 22 03:12:44.807762 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-fed37d68-744e-4214-97d6-0bdcfde269fe req-fab749e2-793b-4edc-af2e-83edc58b1850 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080526 Oct 22 03:12:44.809086 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1034/2058] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:44.841779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:44.853576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:44.881867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:44.885614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:44.886497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:44.887253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:44.887719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:44.888147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.122248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30c58cec-64e5-4ac2-a622-2f5f5f8c3057 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.719755 Oct 22 03:12:45.132971 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1025/2059] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:12:41 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:45.138332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:45.139239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:45.148817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.149663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.150330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.151266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.151933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.152604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.285696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:45.295985 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-034a38c5-43db-4342-ad25-7555324c8ea2 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 200 len: 1519 microversion: 2.1 time: 0.485276 Oct 22 03:12:45.302687 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1035/2060] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:44 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 1519 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:45.328989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f15b9a14-2a6b-40c2-b324-d39278002be3 req-a257b81b-f511-4b0a-8fda-641ec6cd75c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92752bd-36bb-4182-b4d0-6382fd11831f", "tag": "d821a477-0896-412a-9310-650e2cdea5b2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:45.358443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f15b9a14-2a6b-40c2-b324-d39278002be3 req-a257b81b-f511-4b0a-8fda-641ec6cd75c0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.358930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f15b9a14-2a6b-40c2-b324-d39278002be3 req-a257b81b-f511-4b0a-8fda-641ec6cd75c0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.359365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f15b9a14-2a6b-40c2-b324-d39278002be3 req-a257b81b-f511-4b0a-8fda-641ec6cd75c0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.373356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:45.383525 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dadacb23-cc35-4bea-8d59-fb12ca4de88a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1310 microversion: 2.1 time: 0.249092 Oct 22 03:12:45.393465 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1026/2061] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:45 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:45.402465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f15b9a14-2a6b-40c2-b324-d39278002be3 req-a257b81b-f511-4b0a-8fda-641ec6cd75c0 service nova] Creating event network-changed:d821a477-0896-412a-9310-650e2cdea5b2 for instance f92752bd-36bb-4182-b4d0-6382fd11831f on n-h1-862416-2 Oct 22 03:12:45.406159 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f15b9a14-2a6b-40c2-b324-d39278002be3 req-a257b81b-f511-4b0a-8fda-641ec6cd75c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101865 Oct 22 03:12:45.407016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:45.407833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:45.412869 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1036/2062] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:45.429342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.430210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.430890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.431385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:45.432060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.432244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:45.433088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.433692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.445966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.446787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.448959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.449869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.454537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.455215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.662493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:45.671923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:45.673446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:45.675544 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-16f0368b-f5f5-4003-80ef-fefe2e6090eb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.280376 Oct 22 03:12:45.676721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1027/2063] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:45 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:45.683350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8d817f4d-21e0-40cd-a253-4aeb8d8caadd tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Action: 'create', calling method: .version_select at 0x7f0d1e51eaf0>, body: {"pool": null} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:45.787255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:45.808399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:45.816723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:45.818342 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3effdd66-6886-4cf7-aa71-906988acc865 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.404047 Oct 22 03:12:45.829351 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1037/2064] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:45 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:45.851173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:45.851867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:45.864464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.867161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.868853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:45.869603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:45.870095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:45.870510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:46.090556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:46.101249 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7caf0006-4f87-4a9d-8ff7-843d3ec922bc tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1292 microversion: 2.1 time: 0.268366 Oct 22 03:12:46.101911 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1038/2065] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:45 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1292 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:46.114930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'action', calling method: .version_select at 0x7f0d1bf473a0>, body: {"addFloatingIp": {"address": "172.25.2.47"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:46.124899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:46.132647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:46.133473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:46.133923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:46.134638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:46.135097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:46.135529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:46.172976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:46.223940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:12:46.224618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquired lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:12:48.671467 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8d817f4d-21e0-40cd-a253-4aeb8d8caadd tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.993190 Oct 22 03:12:48.674146 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1028/2066] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:12:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:48.679966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:48.681121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:48.697213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:48.698042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:48.698880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:48.699885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:48.700567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:48.701486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:49.016942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:49.025689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:49.039934 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-58f9d857-636d-4c93-bc30-c91233fda707 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1506 microversion: 2.1 time: 0.362046 Oct 22 03:12:49.051725 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1029/2067] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:48 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:49.086050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:49.087454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:49.108964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:49.113094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:49.114374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:49.117070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:49.118463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:49.121146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:49.375583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:49.386076 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20e5f93e-16cc-4364-848f-0c0efac8deea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1310 microversion: 2.1 time: 0.331899 Oct 22 03:12:49.387692 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1030/2068] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:49 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1310 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:49.394673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:49.395606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:49.403953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:49.404854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:49.405573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:49.410746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:49.412143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:49.413002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:49.582522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Building network info cache for instance {{(pid=120581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:12:49.778956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:49.807956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:49.807956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:49.807956 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f88bde16-e120-4e53-8d0b-0a9ea252b680 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.408142 Oct 22 03:12:49.815986 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1031/2069] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:49 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:49.833290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:49.834098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:49.841946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:49.842736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:49.843280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:49.844849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:49.846761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:49.847364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:50.222434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:50.248499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:50.248499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:50.248499 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2b388bcb-8c24-4bc1-ae30-f67c729d6617 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.428936 Oct 22 03:12:50.248499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1032/2070] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:49 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:50.265212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:50.269008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:50.284001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:50.284955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:50.285655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:50.286793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:50.287621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:50.288560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:50.589473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:50.605091 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b3c5ae6-8219-44f7-9208-7ffdb33edc16 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1292 microversion: 2.1 time: 0.356860 Oct 22 03:12:50.607479 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1033/2071] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:50 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1292 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:50.616621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-efe26fda-d79f-4840-9bec-d60c4455f841 req-1bdb1257-7606-4773-afa2-11dbf0718c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f265234-6754-4073-93cc-ee1a65ffab52", "name": "network-vif-plugged", "status": "completed", "tag": "ec5cf3ed-8426-4959-9a3d-b9d84dcfe1d2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:50.650827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Updating instance_info_cache with network_info: [{"id": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf", "address": "fa:16:3e:10:5c:bd", "network": {"id": "d718c698-c689-420d-bcc1-1b58b03babf9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-788124396-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1895216a97de4e25ae036b7c8af7b690", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0b6c9724-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:12:50.675275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-efe26fda-d79f-4840-9bec-d60c4455f841 req-1bdb1257-7606-4773-afa2-11dbf0718c86 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:50.678158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-efe26fda-d79f-4840-9bec-d60c4455f841 req-1bdb1257-7606-4773-afa2-11dbf0718c86 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:50.678993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-efe26fda-d79f-4840-9bec-d60c4455f841 req-1bdb1257-7606-4773-afa2-11dbf0718c86 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:50.689492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Releasing lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:12:50.691107 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97d117a2-d766-4f12-9ad8-d692819d6f09 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action" status: 202 len: 0 microversion: 2.1 time: 4.587510 Oct 22 03:12:50.691988 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1039/2072] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:12:46 2022] POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action => generated 0 bytes in 4590 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 03:12:50.724623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31019f43-31e4-474c-9676-542d35981582 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Action: 'create', calling method: .version_select at 0x7f0d1a278f70>, body: {"pool": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:50.758686 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-efe26fda-d79f-4840-9bec-d60c4455f841 req-1bdb1257-7606-4773-afa2-11dbf0718c86 service nova] Creating event network-vif-plugged:ec5cf3ed-8426-4959-9a3d-b9d84dcfe1d2 for instance 4f265234-6754-4073-93cc-ee1a65ffab52 on n-h2-862416-2 Oct 22 03:12:50.770287 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-efe26fda-d79f-4840-9bec-d60c4455f841 req-1bdb1257-7606-4773-afa2-11dbf0718c86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160933 Oct 22 03:12:50.771987 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1034/2073] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:50.782132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:50.783279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:50.799239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:50.824971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:50.825802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:50.831540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:50.835394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:50.837084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:50.911594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:12:51.112126 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a1048ce-f554-45bc-90da-fc68d1cad63c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 204 len: 0 microversion: 2.1 time: 0.336689 Oct 22 03:12:51.116157 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1035/2074] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:12:50 2022] DELETE /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:12:51.121125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d491b605-8d19-49da-ba98-73b9710af57a req-4c86ffeb-fdbb-4cb2-8640-a426549bb012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9acf03a-b005-4042-b847-201ad5368653", "tag": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:51.139960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d491b605-8d19-49da-ba98-73b9710af57a req-4c86ffeb-fdbb-4cb2-8640-a426549bb012 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:51.140496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d491b605-8d19-49da-ba98-73b9710af57a req-4c86ffeb-fdbb-4cb2-8640-a426549bb012 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:51.141709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d491b605-8d19-49da-ba98-73b9710af57a req-4c86ffeb-fdbb-4cb2-8640-a426549bb012 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:51.157879 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d491b605-8d19-49da-ba98-73b9710af57a req-4c86ffeb-fdbb-4cb2-8640-a426549bb012 service nova] Creating event network-changed:0b6c9724-a37e-45ce-9211-1d83f2f45fbf for instance e9acf03a-b005-4042-b847-201ad5368653 on n-h1-862416-2 Oct 22 03:12:51.166528 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d491b605-8d19-49da-ba98-73b9710af57a req-4c86ffeb-fdbb-4cb2-8640-a426549bb012 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050778 Oct 22 03:12:51.167644 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1036/2075] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:51.174781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:51.175604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:51.185056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:51.185585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:51.186028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:51.186966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:51.187476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:51.192280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:51.477377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:51.488115 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-526c7d1d-bb5d-4091-bba9-d017188e934c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1310 microversion: 2.1 time: 0.318951 Oct 22 03:12:51.488969 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1037/2076] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:51 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1310 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:51.519936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'action', calling method: .version_select at 0x7f0d1bf480d0>, body: {"addFloatingIp": {"address": "172.25.2.47"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:51.526575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:51.535574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:51.536249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:51.537071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:51.538153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:51.538836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:51.539386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:51.633238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "refresh_cache-e2d8696f-5c39-446f-9183-412b89491132" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:12:51.633504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquired lock "refresh_cache-e2d8696f-5c39-446f-9183-412b89491132" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:12:53.015045 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31019f43-31e4-474c-9676-542d35981582 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.320490 Oct 22 03:12:53.023726 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1040/2077] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:12:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:53.023726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:53.023726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:53.033609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:53.034106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:53.034694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:53.035630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:53.036091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:53.037242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:53.293311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:53.302734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:53.306634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:53.307868 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d6e98a4d-75db-4d37-a9e2-9933e210ec60 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.290231 Oct 22 03:12:53.321076 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1041/2078] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:53 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:53.338906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:53.341107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:53.348768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:53.349534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:53.350153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:53.351401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:53.352023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:53.352737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:53.618792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:53.636294 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3bdcbd1-8962-4939-b016-95fcd4b16898 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 200 len: 1512 microversion: 2.1 time: 0.310767 Oct 22 03:12:53.636812 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1042/2079] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:53 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:53.653470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:53.657381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:53.681333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:53.684230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:53.685025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:53.687343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:53.692193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:53.693205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:53.851238 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.network.neutron [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] re-assign floating IP 172.25.2.47 from instance e9acf03a-b005-4042-b847-201ad5368653 Oct 22 03:12:53.911723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Building network info cache for instance {{(pid=120582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:12:54.135715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:54.162328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:54.166989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:54.168326 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7bf68a06-e769-4228-8925-afbd65abb292 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.523131 Oct 22 03:12:54.174197 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1043/2080] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:53 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:54.186809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:54.189350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:54.204012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:54.204577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:54.205015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:54.205730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:54.209700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:54.213055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:54.495601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:54.504923 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-449bc000-3c66-4bfb-b179-308b0b2294ec tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1482 microversion: 2.1 time: 0.329588 Oct 22 03:12:54.533939 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1044/2081] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:54 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1482 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:54.542777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:54.543643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:54.562967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:54.565331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:54.566190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:54.569779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:54.572292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:54.573424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:54.757174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Updating instance_info_cache with network_info: [{"id": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf", "address": "fa:16:3e:10:5c:bd", "network": {"id": "d718c698-c689-420d-bcc1-1b58b03babf9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-788124396-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1895216a97de4e25ae036b7c8af7b690", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0b6c9724-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:12:54.766794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:54.777610 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03f65ac4-8dc9-4381-99f4-2bbe4e67558f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1310 microversion: 2.1 time: 0.242371 Oct 22 03:12:54.779555 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1045/2082] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:54 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1310 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:54.790958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e6c1e18d-0ea4-4ffc-bb73-7a8bf58f87f5 req-6a52313a-b248-46fd-a5ee-712b44b3d695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92752bd-36bb-4182-b4d0-6382fd11831f", "name": "network-vif-plugged", "status": "completed", "tag": "d821a477-0896-412a-9310-650e2cdea5b2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:54.802653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Building network info cache for instance {{(pid=120582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:12:54.809980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e6c1e18d-0ea4-4ffc-bb73-7a8bf58f87f5 req-6a52313a-b248-46fd-a5ee-712b44b3d695 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:54.810575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e6c1e18d-0ea4-4ffc-bb73-7a8bf58f87f5 req-6a52313a-b248-46fd-a5ee-712b44b3d695 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:54.811115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e6c1e18d-0ea4-4ffc-bb73-7a8bf58f87f5 req-6a52313a-b248-46fd-a5ee-712b44b3d695 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:54.838851 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e6c1e18d-0ea4-4ffc-bb73-7a8bf58f87f5 req-6a52313a-b248-46fd-a5ee-712b44b3d695 service nova] Creating event network-vif-plugged:d821a477-0896-412a-9310-650e2cdea5b2 for instance f92752bd-36bb-4182-b4d0-6382fd11831f on n-h1-862416-2 Oct 22 03:12:54.856828 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e6c1e18d-0ea4-4ffc-bb73-7a8bf58f87f5 req-6a52313a-b248-46fd-a5ee-712b44b3d695 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075067 Oct 22 03:12:54.861268 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1046/2083] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:54.866902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65391cb1-daed-4329-80cf-5b4b5d841f62 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Calling method '.version_select at 0x7f0d1a3915e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:55.189642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65391cb1-daed-4329-80cf-5b4b5d841f62 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/247155b9-3d2c-4d3d-ad87-1d2f0efb1dd9" status: 200 len: 142 microversion: 2.1 time: 0.326835 Oct 22 03:12:55.197866 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1047/2084] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:12:54 2022] GET /compute/v2.1/os-floating-ips/247155b9-3d2c-4d3d-ad87-1d2f0efb1dd9 => generated 142 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:55.197866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e28aa8ad-c1d4-4d36-9126-be210089ec83 req-f190bf32-be35-46c3-ac3b-bdf8147a1c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9acf03a-b005-4042-b847-201ad5368653", "tag": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:55.216908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e28aa8ad-c1d4-4d36-9126-be210089ec83 req-f190bf32-be35-46c3-ac3b-bdf8147a1c0e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.217404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e28aa8ad-c1d4-4d36-9126-be210089ec83 req-f190bf32-be35-46c3-ac3b-bdf8147a1c0e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.218141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e28aa8ad-c1d4-4d36-9126-be210089ec83 req-f190bf32-be35-46c3-ac3b-bdf8147a1c0e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.234601 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e28aa8ad-c1d4-4d36-9126-be210089ec83 req-f190bf32-be35-46c3-ac3b-bdf8147a1c0e service nova] Creating event network-changed:0b6c9724-a37e-45ce-9211-1d83f2f45fbf for instance e9acf03a-b005-4042-b847-201ad5368653 on n-h1-862416-2 Oct 22 03:12:55.239804 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e28aa8ad-c1d4-4d36-9126-be210089ec83 req-f190bf32-be35-46c3-ac3b-bdf8147a1c0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047998 Oct 22 03:12:55.240958 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1048/2085] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:55.245983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-48f4bec3-30ee-4666-be8a-c1f0711b6313 req-916dac06-3e6c-4af6-86ba-ef9a2e9b359c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83f771c-10b0-428a-b06e-dc6ff3241110", "name": "network-vif-deleted", "tag": "23a30357-07cb-4571-9d6d-b3ee76b65039"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:55.259925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-48f4bec3-30ee-4666-be8a-c1f0711b6313 req-916dac06-3e6c-4af6-86ba-ef9a2e9b359c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.260803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-48f4bec3-30ee-4666-be8a-c1f0711b6313 req-916dac06-3e6c-4af6-86ba-ef9a2e9b359c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.261467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-48f4bec3-30ee-4666-be8a-c1f0711b6313 req-916dac06-3e6c-4af6-86ba-ef9a2e9b359c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.274810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-48f4bec3-30ee-4666-be8a-c1f0711b6313 req-916dac06-3e6c-4af6-86ba-ef9a2e9b359c service nova] Creating event network-vif-deleted:23a30357-07cb-4571-9d6d-b3ee76b65039 for instance a83f771c-10b0-428a-b06e-dc6ff3241110 on n-h2-862416-2 Oct 22 03:12:55.279987 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-48f4bec3-30ee-4666-be8a-c1f0711b6313 req-916dac06-3e6c-4af6-86ba-ef9a2e9b359c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037715 Oct 22 03:12:55.284784 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1049/2086] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:55.290082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:55.290795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:55.297217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.297713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.298158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.306830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.307364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.307793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.554031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Updating instance_info_cache with network_info: [{"id": "16b1496b-d847-4e4d-b1c1-975fa3960268", "address": "fa:16:3e:45:b9:a6", "network": {"id": "d718c698-c689-420d-bcc1-1b58b03babf9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-788124396-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1895216a97de4e25ae036b7c8af7b690", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16b1496b-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:12:55.578237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Releasing lock "refresh_cache-e2d8696f-5c39-446f-9183-412b89491132" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:12:55.579906 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c06333f-aa8e-4648-b960-6c6db6998f19 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132/action" status: 202 len: 0 microversion: 2.1 time: 4.081960 Oct 22 03:12:55.584007 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1038/2087] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:12:51 2022] POST /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132/action => generated 0 bytes in 4086 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 03:12:55.585847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:55.586556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:55.593771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.594570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.595277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.596193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.596844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.597432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.646066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:55.654803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:55.658792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:55.668728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6cb0c01d-c8ef-4992-90a7-967fedcf46ca tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.382611 Oct 22 03:12:55.670033 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1050/2088] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:55 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:55.679134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:55.680894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:55.698360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.699189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.699861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.703839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.704656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.705306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.741594 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 HTTP/1.1 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a83f771c-10b0-428a-b06e-dc6ff3241110'} Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:12:55.745431 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:12:55.750896 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42951aab-2088-4c03-bb73-d76c6ba18050 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 404 len: 111 microversion: 2.1 time: 0.075559 Oct 22 03:12:55.751912 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0a3e0b3f-2aad-4a44-9f86-5ee339437e11 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164723 Oct 22 03:12:55.752017 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1051/2089] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:55 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:12:55.752116 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1039/2090] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:12:55 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:55.759103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:55.759924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:55.766163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-836231d7-7dd8-42ec-94f4-8908a3700bfe tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Calling method '.version_select at 0x7f0d1a2c1e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:55.769632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.771709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.772280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:55.773117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:55.774930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:55.775486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:56.593187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:56.607974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:56.611588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:56.612836 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c106b29-41db-46f5-a1a7-3076acacee54 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.863549 Oct 22 03:12:56.633056 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1040/2091] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:55 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:56.649726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'action', calling method: .version_select at 0x7f0d1bf48160>, body: {"removeFloatingIp": {"address": "172.25.2.47"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:57.157130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:57.163812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:57.164447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:57.170199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:57.171136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:57.177336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:57.183804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:57.652298 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-836231d7-7dd8-42ec-94f4-8908a3700bfe tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/247155b9-3d2c-4d3d-ad87-1d2f0efb1dd9" status: 202 len: 0 microversion: 2.1 time: 1.899008 Oct 22 03:12:57.656871 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1052/2092] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:12:55 2022] DELETE /compute/v2.1/os-floating-ips/247155b9-3d2c-4d3d-ad87-1d2f0efb1dd9 => generated 0 bytes in 1909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:12:57.678619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:57.679666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:57.697508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:57.699456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:57.701294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:57.702307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:57.705031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:57.705757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:57.777837 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] HTTP exception thrown: Floating IP 172.25.2.47 is not associated with instance e9acf03a-b005-4042-b847-201ad5368653. Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Request method failure captured: Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action HTTP/1.1 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 48 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19m64E4YBABqEZntuQ939JyO9AkNmDKBflV9zHlcx5zJMr5rTaEtAkAoqbmL4MSgB59hLd-EXhYm7lXTRwRteMxi5lr6eKIy1P926JR4Pn30-ZjdByTexec8SbymrlbzQYenh_cVCopT-633QLX17j1k8QOe_RvRgodhdG2ZdqIzJc Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 1895216a97de4e25ae036b7c8af7b690 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1895216a97de4e25ae036b7c8af7b690"}]}] Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 1895216a97de4e25ae036b7c8af7b690 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FloatingIPsAssociationTestJSON-318199254-project Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 23bd65aecc4849339a5245a0e63d4a2b Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-318199254-project Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: {"removeFloatingIp": {"address": "172.25.2.47"}} Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: exception: Floating IP 172.25.2.47 is not associated with instance e9acf03a-b005-4042-b847-201ad5368653. Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'e9acf03a-b005-4042-b847-201ad5368653', 'body': {'removeFloatingIp': {'address': '172.25.2.47'}}} Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.47 is not associated with instance e9acf03a-b005-4042-b847-201ad5368653. Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.47 is not associated with instance e9acf03a-b005-4042-b847-201ad5368653. Oct 22 03:12:57.782965 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:12:57.791531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Returning 409 to user: Floating IP 172.25.2.47 is not associated with instance e9acf03a-b005-4042-b847-201ad5368653. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:12:57.796637 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ed8fa66-b28c-4035-8232-c5bb2a874a5a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action" status: 409 len: 145 microversion: 2.1 time: 1.160290 Oct 22 03:12:57.800047 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1041/2093] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:12:56 2022] POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action => generated 145 bytes in 1166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:12:57.816440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:57.819150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:57.836802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:12:57.839713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:57.841874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:57.845920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:57.847720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:57.848997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:57.850662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:57.971074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:57.984159 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30414c3c-9307-4267-a7b7-99d477eb0166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.326166 Oct 22 03:12:58.001930 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1053/2094] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:57 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:58.009140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:58.010185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:58.024935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:58.025999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:58.026919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:58.028614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:58.029491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:58.030442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:58.243829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:58.258578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:58.261753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:58.263515 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9773e52c-0388-4826-8f63-d569d1c207b6 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.260149 Oct 22 03:12:58.282027 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1054/2095] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:58 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:58.290159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-19785e89-b504-4269-b216-5569af5dddee req-6978c672-c955-4aac-a421-d87198230431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d8696f-5c39-446f-9183-412b89491132", "tag": "16b1496b-d847-4e4d-b1c1-975fa3960268"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:58.300862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-19785e89-b504-4269-b216-5569af5dddee req-6978c672-c955-4aac-a421-d87198230431 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:58.301912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-19785e89-b504-4269-b216-5569af5dddee req-6978c672-c955-4aac-a421-d87198230431 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:58.302543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-19785e89-b504-4269-b216-5569af5dddee req-6978c672-c955-4aac-a421-d87198230431 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:58.321752 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-19785e89-b504-4269-b216-5569af5dddee req-6978c672-c955-4aac-a421-d87198230431 service nova] Creating event network-changed:16b1496b-d847-4e4d-b1c1-975fa3960268 for instance e2d8696f-5c39-446f-9183-412b89491132 on n-h1-862416-2 Oct 22 03:12:58.324466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:58.327758 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-19785e89-b504-4269-b216-5569af5dddee req-6978c672-c955-4aac-a421-d87198230431 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043988 Oct 22 03:12:58.330084 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1055/2096] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:12:58.336332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:58.337314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:58.341133 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c264bf1c-970d-4ba2-a00c-c4f1028f0ca4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1493 microversion: 2.1 time: 0.533655 Oct 22 03:12:58.356177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:58.358579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:58.358810 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1042/2097] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:57 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1493 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:58.359669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:58.361009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:58.361667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:58.362281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:58.367810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ae7c621-89f1-4056-9f9a-7a608264ead8 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Calling method '.version_select at 0x7f0d1e55f0d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:58.729194 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ae7c621-89f1-4056-9f9a-7a608264ead8 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.368944 Oct 22 03:12:58.730014 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1043/2098] 10.222.0.25 () {58 vars in 1164 bytes} [Sat Oct 22 03:12:58 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:12:58.735946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.47"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:58.847204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:58.860635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:58.863477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:12:58.867449 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90deb40d-9ef8-48f5-a1e1-2dc9dcdb87ab tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.535857 Oct 22 03:12:58.872102 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1056/2099] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:12:58 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:12:58.879273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6afff53-5bfa-4a7b-bc14-49d6a48200dc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6afff53-5bfa-4a7b-bc14-49d6a48200dc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 163 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": 12345, "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 12345 Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:12:58.886363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 22 03:12:58.891887 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:12:58.908903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6afff53-5bfa-4a7b-bc14-49d6a48200dc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:12:58.910297 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6afff53-5bfa-4a7b-bc14-49d6a48200dc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.036359 Oct 22 03:12:58.911099 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1057/2100] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:12:58 2022] POST /compute/v2.1/servers => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:12:59.114290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:59.114918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:59.127933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:59.132764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:59.141441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:59.143354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:59.144747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:59.145654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:59.154907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:59.165527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:59.168176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:59.168919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:59.173981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:59.174771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:59.175698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:59.613444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "refresh_cache-e2d8696f-5c39-446f-9183-412b89491132" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:12:59.615732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquired lock "refresh_cache-e2d8696f-5c39-446f-9183-412b89491132" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:12:59.744450 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-789b45b4-67bc-4fa1-bbcf-4e4b2448218c tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1644 microversion: 2.1 time: 0.830670 Oct 22 03:12:59.752811 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1058/2101] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:58 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1644 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:12:59.768445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:12:59.774225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:12:59.791005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:59.801281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:59.802244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:12:59.805385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:12:59.807257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:12:59.813812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:00.079571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:00.089575 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d171af63-c302-4725-b958-a611edf48ada tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1482 microversion: 2.1 time: 0.331982 Oct 22 03:13:00.090972 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1059/2102] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:12:59 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1482 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:00.097172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b66a847-9d6f-4e59-b3dc-1a0a6dabfa80 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Calling method '.version_select at 0x7f0d1a2d5280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:00.472821 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b66a847-9d6f-4e59-b3dc-1a0a6dabfa80 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.380170 Oct 22 03:13:00.473724 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1060/2103] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:13:00 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:00.482672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:00.483740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:00.513730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:00.514755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:00.515522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:00.517480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:00.518630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:00.519681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:00.722893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:00.742490 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93d2cb65-4951-4ded-a4ab-31950457ff4d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.266820 Oct 22 03:13:00.764416 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1061/2104] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:00 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:00.779441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:00.780149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:00.787797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:00.788414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:00.789164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:00.790167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:00.790820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:00.791243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:01.075713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:01.088241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:01.091317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:01.092866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8251d2ba-0fac-4c86-bda6-de0414174257 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.325360 Oct 22 03:13:01.094287 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1062/2105] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:00 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:01.101117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:01.101919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:01.110095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:01.111115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:01.111423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:01.112460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:01.113030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:01.113590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:01.119787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:01.131531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Building network info cache for instance {{(pid=120582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:13:01.369538 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2724e08-4392-417d-92d9-47eed76e9807 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1644 microversion: 2.1 time: 0.273557 Oct 22 03:13:01.380494 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1063/2106] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:01 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1644 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:01.380494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:01.380494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:01.390694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:01.390694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:01.390694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:01.390694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:01.390694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:01.390694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:01.785421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:01.800721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:01.802576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:01.803995 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32626a1b-f5f5-4f39-88a0-82ac5868b355 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.431590 Oct 22 03:13:01.805573 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1064/2107] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:01 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:01.810975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16394d64-1e22-4801-8bd9-296f9c177389 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Calling method '.version_select at 0x7f0d1a2d5310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:01.936663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Updating instance_info_cache with network_info: [{"id": "16b1496b-d847-4e4d-b1c1-975fa3960268", "address": "fa:16:3e:45:b9:a6", "network": {"id": "d718c698-c689-420d-bcc1-1b58b03babf9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-788124396-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1895216a97de4e25ae036b7c8af7b690", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16b1496b-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:13:01.944896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:01.956748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Releasing lock "refresh_cache-e2d8696f-5c39-446f-9183-412b89491132" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:13:01.962385 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-578e6185-8f1d-43d2-9670-4ec589e7e0a5 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132/action" status: 202 len: 0 microversion: 2.1 time: 3.230994 Oct 22 03:13:01.963285 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1044/2108] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:12:58 2022] POST /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132/action => generated 0 bytes in 3233 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 03:13:01.972269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-72cbaae3-a8e7-4437-ad37-d90226fc102e req-08eeb6a6-f398-42b9-9148-338d7470880b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6904474-1e00-42a7-bc83-8620882fa334", "name": "network-vif-unplugged", "status": "completed", "tag": "34820d5a-d397-4b8c-93a7-44afc5851778"}, {"name": "network-changed", "server_uuid": "4f265234-6754-4073-93cc-ee1a65ffab52", "tag": "ec5cf3ed-8426-4959-9a3d-b9d84dcfe1d2"}, {"name": "network-changed", "server_uuid": "d6904474-1e00-42a7-bc83-8620882fa334", "tag": "34820d5a-d397-4b8c-93a7-44afc5851778"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:01.989853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-72cbaae3-a8e7-4437-ad37-d90226fc102e req-08eeb6a6-f398-42b9-9148-338d7470880b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:01.990677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-72cbaae3-a8e7-4437-ad37-d90226fc102e req-08eeb6a6-f398-42b9-9148-338d7470880b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:01.991313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-72cbaae3-a8e7-4437-ad37-d90226fc102e req-08eeb6a6-f398-42b9-9148-338d7470880b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.008189 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-72cbaae3-a8e7-4437-ad37-d90226fc102e req-08eeb6a6-f398-42b9-9148-338d7470880b service nova] Creating event network-vif-unplugged:34820d5a-d397-4b8c-93a7-44afc5851778 for instance d6904474-1e00-42a7-bc83-8620882fa334 on n-h2-862416-2 Oct 22 03:13:02.013598 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-72cbaae3-a8e7-4437-ad37-d90226fc102e req-08eeb6a6-f398-42b9-9148-338d7470880b service nova] Creating event network-changed:ec5cf3ed-8426-4959-9a3d-b9d84dcfe1d2 for instance 4f265234-6754-4073-93cc-ee1a65ffab52 on n-h2-862416-2 Oct 22 03:13:02.014674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-72cbaae3-a8e7-4437-ad37-d90226fc102e req-08eeb6a6-f398-42b9-9148-338d7470880b service nova] Creating event network-changed:34820d5a-d397-4b8c-93a7-44afc5851778 for instance d6904474-1e00-42a7-bc83-8620882fa334 on n-h2-862416-2 Oct 22 03:13:02.024788 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-72cbaae3-a8e7-4437-ad37-d90226fc102e req-08eeb6a6-f398-42b9-9148-338d7470880b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.060146 Oct 22 03:13:02.032025 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1045/2109] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:02.038444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:02.039889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:02.048096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.048947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.049923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.051029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.051649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.052260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.217427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:02.227688 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f9116b6-01ba-4931-b898-7413f75d7a5e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.194118 Oct 22 03:13:02.229212 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1046/2110] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:02 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:02.234582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43c7ee26-35a6-417c-810d-463774354aef tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:02.238530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c7ee26-35a6-417c-810d-463774354aef tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.239253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c7ee26-35a6-417c-810d-463774354aef tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.239838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c7ee26-35a6-417c-810d-463774354aef tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.241207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c7ee26-35a6-417c-810d-463774354aef tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.242319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c7ee26-35a6-417c-810d-463774354aef tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.243012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c7ee26-35a6-417c-810d-463774354aef tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.283669 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43c7ee26-35a6-417c-810d-463774354aef tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052577 Oct 22 03:13:02.285166 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1047/2111] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:13:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:02.290792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:02.291938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:02.299318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.300011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.300641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.301512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.302126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.302851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.338416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:13:02.522340 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-817aaa50-1fe6-4637-b176-fc8e928362e7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 204 len: 0 microversion: 2.1 time: 0.225182 Oct 22 03:13:02.530035 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1048/2112] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:13:02 2022] DELETE /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:13:02.550321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:02.551619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:02.564138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.565277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.566151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.567444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.569208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.569984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.849965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:02.863242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:02.865222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:02.866512 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e7087d3c-63b7-450c-843a-085801865b53 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.334619 Oct 22 03:13:02.870204 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1049/2113] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:02 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:02.907525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:02.910219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:02.926147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.926911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.927360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.928417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:02.929152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:02.929761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:02.975989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lazy-loading 'flavor' on Instance uuid f92752bd-36bb-4182-b4d0-6382fd11831f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:13:03.029144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Going to try to live migrate instance to n-h2-862416-2 {{(pid=120582) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:13:03.520444 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16394d64-1e22-4801-8bd9-296f9c177389 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/1a2244e3-dbe4-4ce7-8338-5ab4a29256f4" status: 202 len: 0 microversion: 2.1 time: 1.713453 Oct 22 03:13:03.521393 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1065/2114] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:13:01 2022] DELETE /compute/v2.1/os-floating-ips/1a2244e3-dbe4-4ce7-8338-5ab4a29256f4 => generated 0 bytes in 1715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:03.526513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.47"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:03.529038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:03.569724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:03.570560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:03.571109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:03.571984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:03.574672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:03.576879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:03.659837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:13:03.671577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquired lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:13:05.460115 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9090180-b689-4ed9-96c9-134889bae4e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f/action" status: 202 len: 0 microversion: 2.1 time: 2.572822 Oct 22 03:13:05.461126 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1050/2115] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:02 2022] POST /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f/action => generated 0 bytes in 2575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:05.469277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:05.473412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:05.501108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:05.502438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:05.503575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:05.504734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:05.507731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:05.509721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:05.987314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:06.004518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:06.007615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:06.012169 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c2b8a866-1cb0-4797-a0d7-ebc3239f7334 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.549776 Oct 22 03:13:06.015010 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1051/2116] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:05 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:06.028994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cee0e14a-6fa7-4a25-843d-0b35cfe59ec0 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Calling method '.version_select at 0x7f0d1e54e160>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:07.334917 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cee0e14a-6fa7-4a25-843d-0b35cfe59ec0 tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/a52e1562-a8a2-4942-8d7b-f6eafaf6c0da" status: 202 len: 0 microversion: 2.1 time: 1.318164 Oct 22 03:13:07.335495 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1052/2117] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:13:06 2022] DELETE /compute/v2.1/os-floating-ips/a52e1562-a8a2-4942-8d7b-f6eafaf6c0da => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:07.349172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:07.349782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:07.363004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:07.363778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:07.364932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:07.367174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:07.367827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:07.373568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:07.642271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:07.660140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:07.661774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:07.662950 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49f855cd-912b-46a4-afa4-5b935018489c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1485 microversion: 2.25 time: 0.326558 Oct 22 03:13:07.663566 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1053/2118] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:07 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1485 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:07.689507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b3a9b339-88b9-490f-a17b-44ddc1d82125 req-0848cf4f-5ee4-4a7e-9783-efb356481700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d8696f-5c39-446f-9183-412b89491132", "tag": "16b1496b-d847-4e4d-b1c1-975fa3960268"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:07.733629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b3a9b339-88b9-490f-a17b-44ddc1d82125 req-0848cf4f-5ee4-4a7e-9783-efb356481700 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:07.735187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b3a9b339-88b9-490f-a17b-44ddc1d82125 req-0848cf4f-5ee4-4a7e-9783-efb356481700 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:07.735920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b3a9b339-88b9-490f-a17b-44ddc1d82125 req-0848cf4f-5ee4-4a7e-9783-efb356481700 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:07.771364 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b3a9b339-88b9-490f-a17b-44ddc1d82125 req-0848cf4f-5ee4-4a7e-9783-efb356481700 service nova] Creating event network-changed:16b1496b-d847-4e4d-b1c1-975fa3960268 for instance e2d8696f-5c39-446f-9183-412b89491132 on n-h1-862416-2 Oct 22 03:13:07.780813 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b3a9b339-88b9-490f-a17b-44ddc1d82125 req-0848cf4f-5ee4-4a7e-9783-efb356481700 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097270 Oct 22 03:13:07.790409 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1054/2119] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:07.796142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aeec1da3-28e4-4db9-9281-0532d5144ed2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-521902014", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f3f0530b-d7a0-4386-8e7b-bb40b391150b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:07.957257 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-aeec1da3-28e4-4db9-9281-0532d5144ed2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Block Device f3f0530b-d7a0-4386-8e7b-bb40b391150b is not bootable. Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aeec1da3-28e4-4db9-9281-0532d5144ed2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 357 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-521902014", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f3f0530b-d7a0-4386-8e7b-bb40b391150b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: exception: Block Device f3f0530b-d7a0-4386-8e7b-bb40b391150b is not bootable. Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-521902014', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f3f0530b-d7a0-4386-8e7b-bb40b391150b'}], 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f3f0530b-d7a0-4386-8e7b-bb40b391150b is not bootable. Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:07.965109 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f3f0530b-d7a0-4386-8e7b-bb40b391150b is not bootable. Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f3f0530b-d7a0-4386-8e7b-bb40b391150b is not bootable. Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aeec1da3-28e4-4db9-9281-0532d5144ed2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Block Device f3f0530b-d7a0-4386-8e7b-bb40b391150b is not bootable. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aeec1da3-28e4-4db9-9281-0532d5144ed2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.174926 Oct 22 03:13:07.969574 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1055/2120] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:07 2022] POST /compute/v2.1/servers => generated 110 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:07.972639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:07.973157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:07.986473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:07.986964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:08.000498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:08.001909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:08.002631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:08.003263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:08.340774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:08.353402 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5f4cf53-7d84-405b-b6cf-2bda3f784027 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1503 microversion: 2.1 time: 0.384835 Oct 22 03:13:08.356758 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1056/2121] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:07 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:08.367685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:08.368656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:08.380089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:08.380621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:08.381058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:08.385653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:08.386154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:08.386599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:08.737432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:08.754199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:08.762247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:08.766740 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0c1b7a7-2ad2-4c57-941f-7db108cbbd43 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.408633 Oct 22 03:13:08.770911 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1057/2122] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:08 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:08.783923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-615896be-2dfb-40d2-957e-fde523b46dfd tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] Calling method '.version_select at 0x7f0d1e4eac10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:08.990894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Building network info cache for instance {{(pid=120581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:13:10.163223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Updating instance_info_cache with network_info: [{"id": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf", "address": "fa:16:3e:10:5c:bd", "network": {"id": "d718c698-c689-420d-bcc1-1b58b03babf9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-788124396-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1895216a97de4e25ae036b7c8af7b690", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0b6c9724-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:13:10.186695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Releasing lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:13:10.187915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6139caaf-8f6f-4dca-a8ff-2126601a554a tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action" status: 202 len: 0 microversion: 2.1 time: 6.665483 Oct 22 03:13:10.189413 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1066/2123] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:03 2022] POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action => generated 0 bytes in 6667 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 03:13:10.196142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-73c5e6a6-b953-4d85-83a4-705b53f54b34 req-78a5f58b-195d-492f-b4c1-8152c68719a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d8696f-5c39-446f-9183-412b89491132", "name": "network-vif-deleted", "tag": "16b1496b-d847-4e4d-b1c1-975fa3960268"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:10.217812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=82 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:10.223501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73c5e6a6-b953-4d85-83a4-705b53f54b34 req-78a5f58b-195d-492f-b4c1-8152c68719a9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:10.227137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73c5e6a6-b953-4d85-83a4-705b53f54b34 req-78a5f58b-195d-492f-b4c1-8152c68719a9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:10.227904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73c5e6a6-b953-4d85-83a4-705b53f54b34 req-78a5f58b-195d-492f-b4c1-8152c68719a9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:10.266261 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-73c5e6a6-b953-4d85-83a4-705b53f54b34 req-78a5f58b-195d-492f-b4c1-8152c68719a9 service nova] Creating event network-vif-deleted:16b1496b-d847-4e4d-b1c1-975fa3960268 for instance e2d8696f-5c39-446f-9183-412b89491132 on n-h1-862416-2 Oct 22 03:13:10.279588 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-73c5e6a6-b953-4d85-83a4-705b53f54b34 req-78a5f58b-195d-492f-b4c1-8152c68719a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088706 Oct 22 03:13:10.292843 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1067/2124] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:10.298975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:10.300407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:10.315081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:10.316241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:10.316916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:10.318527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:10.321330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:10.322508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:10.645950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:10.656269 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b45f688e-bfc2-4f66-83e6-76eed48f86b1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.361611 Oct 22 03:13:10.658767 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1068/2125] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:10 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:10.660912 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-615896be-2dfb-40d2-957e-fde523b46dfd tempest-FloatingIPDetailsTestJSON-1916017209 tempest-FloatingIPDetailsTestJSON-1916017209-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/3d3822fd-187b-48a7-9303-79a3a93f2bb2" status: 202 len: 0 microversion: 2.1 time: 1.887883 Oct 22 03:13:10.661909 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1058/2126] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:13:08 2022] DELETE /compute/v2.1/os-floating-ips/3d3822fd-187b-48a7-9303-79a3a93f2bb2 => generated 0 bytes in 1890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:10.665383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:10.666241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:10.667459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:10.668163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:10.682107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:10.684268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:10.688494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:10.689697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:10.691902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:10.693210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:10.693890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:10.696778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:10.697593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:10.698567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:10.701156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:10.701850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:10.961860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:10.980668 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77c8cfb3-2f27-491e-bc38-e9189a9890bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1503 microversion: 2.1 time: 0.317394 Oct 22 03:13:10.982433 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1059/2127] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:10 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:10.988198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:10.989168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:10.996502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:10.997868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.001020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.001895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.009791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:11.013755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.014239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.018992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:11.020817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:11.022080 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b5da7f82-eaf2-4fc3-9093-4e9dfdd90387 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1475 microversion: 2.25 time: 0.361309 Oct 22 03:13:11.028292 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1069/2128] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:10 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1475 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:11.039117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34f31146-8de8-4cbc-bce9-377a36b70bc0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '.version_select at 0x7f0d1a998e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:11.274550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:11.289111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:11.289481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:11.291054 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-25a93b1c-203f-4166-8653-c8330309b635 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.306803 Oct 22 03:13:11.291992 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1060/2129] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:10 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:11.297357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:11.297964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:11.304684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.305174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.305624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.306323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.306775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.307215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.333652 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34f31146-8de8-4cbc-bce9-377a36b70bc0 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/3f5b10d7-320f-445b-ada6-3948acdc98af" status: 200 len: 184 microversion: 2.1 time: 0.298601 Oct 22 03:13:11.340377 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1070/2130] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:13:11 2022] GET /compute/v2.1/os-floating-ips/3f5b10d7-320f-445b-ada6-3948acdc98af => generated 184 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:11.345718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-92529411-ce93-4b3e-a1e7-3bdb2d87e2e4 req-0747d6c9-b814-4bf8-a8c6-c4eb9fd673fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-plugged", "status": "completed", "tag": "6f7d0505-1709-46d1-b6ba-10387663e348"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:11.364290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-92529411-ce93-4b3e-a1e7-3bdb2d87e2e4 req-0747d6c9-b814-4bf8-a8c6-c4eb9fd673fc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.365621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-92529411-ce93-4b3e-a1e7-3bdb2d87e2e4 req-0747d6c9-b814-4bf8-a8c6-c4eb9fd673fc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.371027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-92529411-ce93-4b3e-a1e7-3bdb2d87e2e4 req-0747d6c9-b814-4bf8-a8c6-c4eb9fd673fc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.397642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-92529411-ce93-4b3e-a1e7-3bdb2d87e2e4 req-0747d6c9-b814-4bf8-a8c6-c4eb9fd673fc service nova] Creating event network-vif-plugged:6f7d0505-1709-46d1-b6ba-10387663e348 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:13:11.403103 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-92529411-ce93-4b3e-a1e7-3bdb2d87e2e4 req-0747d6c9-b814-4bf8-a8c6-c4eb9fd673fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061309 Oct 22 03:13:11.409400 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1071/2131] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:11.415766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e9a4d33-592e-4772-b1a7-301dfc40e281 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '.version_select at 0x7f0d1a991310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:11.419774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e9a4d33-592e-4772-b1a7-301dfc40e281 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.420548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e9a4d33-592e-4772-b1a7-301dfc40e281 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.421363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e9a4d33-592e-4772-b1a7-301dfc40e281 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.433054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e9a4d33-592e-4772-b1a7-301dfc40e281 tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2604 microversion: 2.25 time: 0.022203 Oct 22 03:13:11.434439 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1072/2132] 10.222.0.25 () {60 vars in 1184 bytes} [Sat Oct 22 03:13:11 2022] GET /compute/v2.1/os-migrations => generated 2604 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:11.442224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Action: 'action', calling method: .version_select at 0x7f0d1c107940>, body: {"removeFloatingIp": {"address": "172.25.2.47"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:11.518032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:11.526605 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a773ffb9-2fdc-46bb-a8f5-fa7c5f3d2c3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.233450 Oct 22 03:13:11.527107 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1061/2133] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:11 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:11.532755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:11.533618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:11.539920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.540893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.541516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.542533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.543187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.543850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.792713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:11.806239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] Lazy-loading 'services' on Instance uuid d6904474-1e00-42a7-bc83-8620882fa334 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:13:11.813207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:11.822492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.823220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.823877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.824866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.825783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.826624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.841223 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8034295d-1543-48e2-b8c0-1c0154fa2d2a tempest-LiveAutoBlockMigrationV225Test-1423711929 tempest-LiveAutoBlockMigrationV225Test-1423711929-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1967 microversion: 2.25 time: 0.312850 Oct 22 03:13:11.843814 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1062/2134] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:11 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1967 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:11.879130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:11.879734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:11.902846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.905124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.907586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.909481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:11.912493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:11.913081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:11.955118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:13:12.153091 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-728a4417-5332-421e-ac25-881422becdb4 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 204 len: 0 microversion: 2.25 time: 0.268172 Oct 22 03:13:12.153091 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1063/2135] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:13:11 2022] DELETE /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:13:12.153091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:12.153091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:12.163594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:12.165448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:12.173340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:12.174570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:12.175055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:12.175495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:12.257358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:12.363803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:13:12.364500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquired lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:13:12.440122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:12.456240 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b0ef67d2-3862-442a-9e65-ec6e3520a6bf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1503 microversion: 2.1 time: 0.310893 Oct 22 03:13:12.469812 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1064/2136] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:12 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:12.492700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:12.493943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:12.511999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:12.512692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:12.513187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:12.514618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:12.515193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:12.515688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:12.750078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:12.765771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:12.767874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:12.769132 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61d03ae1-704d-4a21-8bd7-c09dfe2b0681 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1481 microversion: 2.25 time: 0.291505 Oct 22 03:13:12.772516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1065/2137] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:12 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1481 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:12.780923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:12.782380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:12.796672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:12.798504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:12.799130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:12.801152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:12.807256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:12.807723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:13.404178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:13.447867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:13.456949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:13.458099 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-657bf685-0cdc-4b7a-8100-6849eb2a422b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.684406 Oct 22 03:13:13.458750 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1066/2138] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:12 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:13.465670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b8df6a07-022c-4d78-aca2-d159f4ac3725 req-1517980c-c549-4f23-9771-a8b36e6a2945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9acf03a-b005-4042-b847-201ad5368653", "tag": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf"}, {"server_uuid": "f92752bd-36bb-4182-b4d0-6382fd11831f", "name": "network-vif-unplugged", "status": "completed", "tag": "d821a477-0896-412a-9310-650e2cdea5b2"}, {"name": "network-changed", "server_uuid": "f92752bd-36bb-4182-b4d0-6382fd11831f", "tag": "d821a477-0896-412a-9310-650e2cdea5b2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:13.499987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b8df6a07-022c-4d78-aca2-d159f4ac3725 req-1517980c-c549-4f23-9771-a8b36e6a2945 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:13.507484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b8df6a07-022c-4d78-aca2-d159f4ac3725 req-1517980c-c549-4f23-9771-a8b36e6a2945 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:13.507996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b8df6a07-022c-4d78-aca2-d159f4ac3725 req-1517980c-c549-4f23-9771-a8b36e6a2945 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:13.556254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b8df6a07-022c-4d78-aca2-d159f4ac3725 req-1517980c-c549-4f23-9771-a8b36e6a2945 service nova] Creating event network-changed:0b6c9724-a37e-45ce-9211-1d83f2f45fbf for instance e9acf03a-b005-4042-b847-201ad5368653 on n-h1-862416-2 Oct 22 03:13:13.556254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b8df6a07-022c-4d78-aca2-d159f4ac3725 req-1517980c-c549-4f23-9771-a8b36e6a2945 service nova] Creating event network-vif-unplugged:d821a477-0896-412a-9310-650e2cdea5b2 for instance f92752bd-36bb-4182-b4d0-6382fd11831f on n-h1-862416-2 Oct 22 03:13:13.556254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b8df6a07-022c-4d78-aca2-d159f4ac3725 req-1517980c-c549-4f23-9771-a8b36e6a2945 service nova] Creating event network-changed:d821a477-0896-412a-9310-650e2cdea5b2 for instance f92752bd-36bb-4182-b4d0-6382fd11831f on n-h1-862416-2 Oct 22 03:13:13.564642 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b8df6a07-022c-4d78-aca2-d159f4ac3725 req-1517980c-c549-4f23-9771-a8b36e6a2945 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.104358 Oct 22 03:13:13.568590 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1067/2139] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:13.585227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:13.586182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:13.595996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:13.600514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:13.601526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:13.602479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:13.605261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:13.605921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:13.938217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:13.953733 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e53f422-b236-4d35-8a6a-5a1ccfe0285b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1503 microversion: 2.1 time: 0.381337 Oct 22 03:13:13.956439 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1068/2140] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:13 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:13.964118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:13.966346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:13.977431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:13.978469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:13.978908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:13.979645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:13.980484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:13.981120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:14.116013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:14.133394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:14.139445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:14.144145 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4526284e-01d8-42eb-a5e3-9eb4fe3c7f89 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1439 microversion: 2.25 time: 0.185215 Oct 22 03:13:14.147770 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1069/2141] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:13 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1439 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:14.206277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e2fb1b45-d95e-474e-9532-b59fb5f76421 req-8c0242bc-b61e-4f0d-84af-60613cd9510b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6904474-1e00-42a7-bc83-8620882fa334", "name": "network-vif-deleted", "tag": "34820d5a-d397-4b8c-93a7-44afc5851778"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:14.218091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e2fb1b45-d95e-474e-9532-b59fb5f76421 req-8c0242bc-b61e-4f0d-84af-60613cd9510b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:14.219507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e2fb1b45-d95e-474e-9532-b59fb5f76421 req-8c0242bc-b61e-4f0d-84af-60613cd9510b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:14.219947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e2fb1b45-d95e-474e-9532-b59fb5f76421 req-8c0242bc-b61e-4f0d-84af-60613cd9510b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:14.254306 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e2fb1b45-d95e-474e-9532-b59fb5f76421 req-8c0242bc-b61e-4f0d-84af-60613cd9510b service nova] Creating event network-vif-deleted:34820d5a-d397-4b8c-93a7-44afc5851778 for instance d6904474-1e00-42a7-bc83-8620882fa334 on n-h1-862416-2 Oct 22 03:13:14.254306 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e2fb1b45-d95e-474e-9532-b59fb5f76421 req-8c0242bc-b61e-4f0d-84af-60613cd9510b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052399 Oct 22 03:13:14.258332 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1070/2142] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:13:14.616054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Building network info cache for instance {{(pid=120581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:13:14.637140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-53bff13d-6984-40ff-83ed-aede7efafc09 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Action: 'create', calling method: .version_select at 0x7f0d1e3ff040>, body: {"keypair": {"name": "tempest-keypair-843982101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLishVxr2LPZ39WHuiuaKztbcBVeE0tue9MMSyuyLJUuK0FQ587ZINGmhunFRyvWFNr1yPKQ16Bj10fLBGC6wHcjONBnXZ+M89jgy6+sCvQGsX56Vtb0BJPTB4+aHi6GpQ=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:14.657633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-53bff13d-6984-40ff-83ed-aede7efafc09 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Getting quotas for project f90d2937262c4cc2bc0e7fbf770a9c49. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:13:14.666243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-53bff13d-6984-40ff-83ed-aede7efafc09 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Getting quotas for user 513dea8aa0114c2aa365124eb2b302a1 and project f90d2937262c4cc2bc0e7fbf770a9c49. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:13:14.697286 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-53bff13d-6984-40ff-83ed-aede7efafc09 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.235456 Oct 22 03:13:14.698685 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1071/2143] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:13:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:13:14.704786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:14.707020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:14.717535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:14.718426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:14.720482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:14.722200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:14.722937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:14.723592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:15.883180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:15.894412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:15.902711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:15.907377 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c67a0c2-fe08-4780-9a09-eef3661ce65d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 1.206597 Oct 22 03:13:15.910010 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1072/2144] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:14 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:15.919024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af8fc815-9866-4385-bd82-c47499245202 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1920383287", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "78462069-c4b0-4a1c-b064-2d19ad600046", "destination_type": "local"}, {"source_type": "volume", "uuid": "419a9c87-3231-4cc8-b281-ee766147c5b9", "destination_type": "invalid"}], "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af8fc815-9866-4385-bd82-c47499245202 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 495 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1920383287", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "78462069-c4b0-4a1c-b064-2d19ad600046", "destination_type": "local"}, {"source_type": "volume", "uuid": "419a9c87-3231-4cc8-b281-ee766147c5b9", "destination_type": "invalid"}], "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1920383287', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '78462069-c4b0-4a1c-b064-2d19ad600046', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '419a9c87-3231-4cc8-b281-ee766147c5b9', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'invalid' Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:15.930843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 22 03:13:15.935745 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:15.955104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af8fc815-9866-4385-bd82-c47499245202 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:15.959758 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af8fc815-9866-4385-bd82-c47499245202 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.048383 Oct 22 03:13:15.963153 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1073/2145] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:15 2022] POST /compute/v2.1/servers => generated 155 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:15.980947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:15.981953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:16.024380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:16.026152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:16.026889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:16.029144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:16.029731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:16.033303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:16.205057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Updating instance_info_cache with network_info: [{"id": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf", "address": "fa:16:3e:10:5c:bd", "network": {"id": "d718c698-c689-420d-bcc1-1b58b03babf9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-788124396-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1895216a97de4e25ae036b7c8af7b690", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0b6c9724-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:13:16.215962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Releasing lock "refresh_cache-e9acf03a-b005-4042-b847-201ad5368653" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:13:16.221826 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-00726e85-cd39-477b-b84a-6451acdd54ff tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action" status: 202 len: 0 microversion: 2.1 time: 4.785784 Oct 22 03:13:16.229485 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1073/2146] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:11 2022] POST /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653/action => generated 0 bytes in 4794 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 03:13:16.244093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:16.251744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:16.269107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:16.270021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:16.270714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:16.271708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:16.272448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:16.273130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:16.392114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:16.410675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:16.412423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:16.414574 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-517f2a3b-de9a-4f9e-bf62-b3e7a8e7298f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1265 microversion: 2.25 time: 0.183944 Oct 22 03:13:16.415745 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1074/2147] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:16 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:16.425893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:16.427865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:16.444569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:16.445246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:16.445829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:16.446679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:16.453000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:16.453789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:16.871601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:16.882654 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b0c4deb4-8dd6-4a4c-8cf2-23ed43fa4803 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.465538 Oct 22 03:13:16.885516 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1075/2148] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:16 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:16.902202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-38900761-521c-49a7-9222-ca9edbaef0a9 req-1664656f-e903-47ec-98f2-68cea5b36f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9acf03a-b005-4042-b847-201ad5368653", "tag": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:16.949155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-38900761-521c-49a7-9222-ca9edbaef0a9 req-1664656f-e903-47ec-98f2-68cea5b36f5b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:16.950087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-38900761-521c-49a7-9222-ca9edbaef0a9 req-1664656f-e903-47ec-98f2-68cea5b36f5b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:16.951159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-38900761-521c-49a7-9222-ca9edbaef0a9 req-1664656f-e903-47ec-98f2-68cea5b36f5b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:16.982865 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-38900761-521c-49a7-9222-ca9edbaef0a9 req-1664656f-e903-47ec-98f2-68cea5b36f5b service nova] Creating event network-changed:0b6c9724-a37e-45ce-9211-1d83f2f45fbf for instance e9acf03a-b005-4042-b847-201ad5368653 on n-h1-862416-2 Oct 22 03:13:16.999661 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-38900761-521c-49a7-9222-ca9edbaef0a9 req-1664656f-e903-47ec-98f2-68cea5b36f5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109709 Oct 22 03:13:17.009316 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1076/2149] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:17.020146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:17.022500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:17.038101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.038988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.044073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.046118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.046876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.049982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.086263 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] HTTP exception thrown: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Request method failure captured: Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 HTTP/1.1 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19m64E4YBABqEZntuQ939JyO9AkNmDKBflV9zHlcx5zJMr5rTaEtAkAoqbmL4MSgB59hLd-EXhYm7lXTRwRteMxi5lr6eKIy1P926JR4Pn30-ZjdByTexec8SbymrlbzQYenh_cVCopT-633QLX17j1k8QOe_RvRgodhdG2ZdqIzJc Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1895216a97de4e25ae036b7c8af7b690 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1895216a97de4e25ae036b7c8af7b690"}]}] Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1895216a97de4e25ae036b7c8af7b690 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FloatingIPsAssociationTestJSON-318199254-project Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 23bd65aecc4849339a5245a0e63d4a2b Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-318199254-project Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e2d8696f-5c39-446f-9183-412b89491132'} Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:17.088139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.093427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.099922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Returning 404 to user: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:17.101462 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0a0d4944-e9cd-4f77-b316-fdbfd9a48288 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 404 len: 111 microversion: 2.1 time: 0.090260 Oct 22 03:13:17.102509 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1077/2150] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:13:17 2022] DELETE /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:17.110635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e8df1671-0192-41e6-9d9a-10394f3d3996 req-7cc4da18-47de-4cf8-8f62-022667f64817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-plugged", "status": "completed", "tag": "b0488e2a-8772-4d06-8539-71f4d3e87f13"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:17.142886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e8df1671-0192-41e6-9d9a-10394f3d3996 req-7cc4da18-47de-4cf8-8f62-022667f64817 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.143734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e8df1671-0192-41e6-9d9a-10394f3d3996 req-7cc4da18-47de-4cf8-8f62-022667f64817 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.144386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e8df1671-0192-41e6-9d9a-10394f3d3996 req-7cc4da18-47de-4cf8-8f62-022667f64817 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.162645 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e8df1671-0192-41e6-9d9a-10394f3d3996 req-7cc4da18-47de-4cf8-8f62-022667f64817 service nova] Creating event network-vif-plugged:b0488e2a-8772-4d06-8539-71f4d3e87f13 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:13:17.175890 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e8df1671-0192-41e6-9d9a-10394f3d3996 req-7cc4da18-47de-4cf8-8f62-022667f64817 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072009 Oct 22 03:13:17.180454 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1078/2151] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:17.192839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:17.197348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:17.210749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.217635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.218446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.221185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.221939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.222660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.506908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:17.528038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e03448c-132d-4102-817d-b02fc7ddf3a0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1503 microversion: 2.1 time: 1.558646 Oct 22 03:13:17.538742 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1074/2152] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:15 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1503 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:17.547848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:17.547848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:17.570192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.570972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.571524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.573168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.573769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.575154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.799084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:17.808937 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b2e7ca1-93d6-4437-92fb-64a5070a669f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.626376 Oct 22 03:13:17.809556 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1079/2153] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:17 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:17.820911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:17.829108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e2d8696f-5c39-446f-9183-412b89491132] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:17.846469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.848124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.849786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.851786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.853116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.855660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.878761 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] HTTP exception thrown: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Request method failure captured: Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 HTTP/1.1 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19m64E4YBABqEZntuQ939JyO9AkNmDKBflV9zHlcx5zJMr5rTaEtAkAoqbmL4MSgB59hLd-EXhYm7lXTRwRteMxi5lr6eKIy1P926JR4Pn30-ZjdByTexec8SbymrlbzQYenh_cVCopT-633QLX17j1k8QOe_RvRgodhdG2ZdqIzJc Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1895216a97de4e25ae036b7c8af7b690 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1895216a97de4e25ae036b7c8af7b690"}]}] Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1895216a97de4e25ae036b7c8af7b690 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FloatingIPsAssociationTestJSON-318199254-project Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 23bd65aecc4849339a5245a0e63d4a2b Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-318199254-project Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e2d8696f-5c39-446f-9183-412b89491132'} Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.880799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:17.887898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.887898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:17.887898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:17.887898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:17.887898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:17.887898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:17.887898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. Oct 22 03:13:17.887898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:17.890368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Returning 404 to user: Instance e2d8696f-5c39-446f-9183-412b89491132 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:17.891235 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f959692-26d9-45b8-a503-e7fe76ba174c tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132" status: 404 len: 111 microversion: 2.1 time: 0.074224 Oct 22 03:13:17.892521 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1080/2154] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:17 2022] GET /compute/v2.1/servers/e2d8696f-5c39-446f-9183-412b89491132 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:17.897696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:17.898623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:17.907062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.907976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.908806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:17.909909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:17.910654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:17.911398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:18.043293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:18.065000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:18.070206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:18.072725 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-772a53de-334c-4b6f-bfc2-9c97724ef4c5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.538679 Oct 22 03:13:18.074664 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1075/2155] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:17 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:18.082368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9d8f072-a861-4202-a94a-7a2092b5c71b tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '.version_select at 0x7f0d19ae9670>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:18.158799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:18.172703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:18.175241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:18.180554 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c742d72-2f0a-4525-9765-9c9ffbff0621 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1265 microversion: 2.25 time: 0.286615 Oct 22 03:13:18.181304 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1081/2156] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:17 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:18.190484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cde0c084-1850-42d0-bfce-2a2e8e17854e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1147813178", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cde0c084-1850-42d0-bfce-2a2e8e17854e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 492 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1147813178", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1147813178', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:18.202707 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cde0c084-1850-42d0-bfce-2a2e8e17854e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cde0c084-1850-42d0-bfce-2a2e8e17854e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.028314 Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1082/2157] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:18 2022] POST /compute/v2.1/servers => generated 624 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:18.255699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:18.260024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:18.281257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:18.281257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:18.281257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:18.281257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:18.281257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:18.281257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:18.507049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:18.524106 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b80e076e-00d1-4a60-9f00-eb2c1f296281 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.306164 Oct 22 03:13:18.528591 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1083/2158] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:18 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:18.557691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:18.558469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:18.569259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:18.572657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:18.574095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:18.576662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:18.577388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:18.579646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:18.909080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:18.923361 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44312303-eb80-409a-b309-73c2be8d0bd3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1503 microversion: 2.1 time: 0.371258 Oct 22 03:13:18.925265 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1084/2159] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:18 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:18.930873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:18.931915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:18.940697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:18.941469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:18.942300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:18.943503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:18.944462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:18.945718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:19.125718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:19.135469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f84dbfe0-6e12-45ae-9a80-03fc1ba7cda2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.208921 Oct 22 03:13:19.136792 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1085/2160] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:18 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:19.146358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:19.147385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:19.158938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:19.160140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:19.161744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:19.163159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:19.163848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:19.176862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:19.217356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:19.480725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:19.498775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:19.502344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:19.504301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0350f242-9788-4e80-a18f-f935b2f9aa7b tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.366235 Oct 22 03:13:19.506249 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1086/2161] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:19 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:19.513939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:19.516186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:19.525344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:19.526257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:19.527803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:19.529477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:19.530175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:19.530860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:19.638574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:19.652046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:19.653790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:19.655320 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6834041b-c6d4-4206-8010-775e31f10fbb tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1265 microversion: 2.25 time: 0.147562 Oct 22 03:13:19.657118 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1087/2162] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:19 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:19.662889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a80f8d83-af20-4e2b-9bfb-78f5ea568b88 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a80f8d83-af20-4e2b-9bfb-78f5ea568b88 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 416 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:19.667277 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:13:19.670362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:19.673161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a80f8d83-af20-4e2b-9bfb-78f5ea568b88 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:19.674457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a80f8d83-af20-4e2b-9bfb-78f5ea568b88 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.016079 Oct 22 03:13:19.675566 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1088/2163] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:19 2022] POST /compute/v2.1/servers => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:19.681398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2f905623-5ab9-4823-b55c-ba70ebdd71d3 req-2560b53d-d04e-4bf7-8352-9df969856fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-plugged", "status": "completed", "tag": "eace4bce-f550-4e2e-bc11-00a14552db28"}, {"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-plugged", "status": "completed", "tag": "45e62a82-f51a-4e73-944b-9a9f24415d51"}, {"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-plugged", "status": "completed", "tag": "f1b84afb-a2c3-4cc5-93fe-295646ed55e0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:19.696834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f905623-5ab9-4823-b55c-ba70ebdd71d3 req-2560b53d-d04e-4bf7-8352-9df969856fba service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:19.697671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f905623-5ab9-4823-b55c-ba70ebdd71d3 req-2560b53d-d04e-4bf7-8352-9df969856fba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:19.698221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f905623-5ab9-4823-b55c-ba70ebdd71d3 req-2560b53d-d04e-4bf7-8352-9df969856fba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:19.713671 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2f905623-5ab9-4823-b55c-ba70ebdd71d3 req-2560b53d-d04e-4bf7-8352-9df969856fba service nova] Creating event network-vif-plugged:eace4bce-f550-4e2e-bc11-00a14552db28 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:13:19.715330 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2f905623-5ab9-4823-b55c-ba70ebdd71d3 req-2560b53d-d04e-4bf7-8352-9df969856fba service nova] Creating event network-vif-plugged:45e62a82-f51a-4e73-944b-9a9f24415d51 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:13:19.715956 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2f905623-5ab9-4823-b55c-ba70ebdd71d3 req-2560b53d-d04e-4bf7-8352-9df969856fba service nova] Creating event network-vif-plugged:f1b84afb-a2c3-4cc5-93fe-295646ed55e0 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:13:19.743055 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2f905623-5ab9-4823-b55c-ba70ebdd71d3 req-2560b53d-d04e-4bf7-8352-9df969856fba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.065881 Oct 22 03:13:19.745532 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1089/2164] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:19.762859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:19.763823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:19.784078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:19.786764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:19.787700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:19.792268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:19.792934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:19.793543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:20.661829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:20.679030 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b8e097e-234c-4e02-ab93-8dc46576c618 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.929974 Oct 22 03:13:20.680418 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1090/2165] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:19 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:20.718303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:20.720118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:20.728456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:20.729106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:20.729738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:20.730557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:20.731206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:20.731846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:20.769606 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9d8f072-a861-4202-a94a-7a2092b5c71b tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/3f5b10d7-320f-445b-ada6-3948acdc98af" status: 202 len: 0 microversion: 2.1 time: 2.690291 Oct 22 03:13:20.775279 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1076/2166] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:13:18 2022] DELETE /compute/v2.1/os-floating-ips/3f5b10d7-320f-445b-ada6-3948acdc98af => generated 0 bytes in 2699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:20.781443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:20.782399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:20.793722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:20.794537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:20.796922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:20.799071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:20.799946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:20.801319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.177176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:21.182767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:21.191589 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6f9d1e9-b2d6-4be3-918c-d53e855d5b12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1503 microversion: 2.1 time: 0.509793 Oct 22 03:13:21.192194 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1091/2167] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:20 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1503 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:21.209752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:21.210849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:21.219566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:21.220813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.221618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.222511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.224621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.226469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.227555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.235756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:21.239463 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c6436158-db8c-4f8e-8634-ff55193b4bbd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.462250 Oct 22 03:13:21.262725 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1077/2168] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:20 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:21.287968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:21.290270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:21.302299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.305383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.305987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.306883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.308722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.310787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.464161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:21.487283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:21.491068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:21.494421 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da818372-66f4-4283-8c62-a6e0a0c38155 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 200 len: 1265 microversion: 2.25 time: 0.289014 Oct 22 03:13:21.496429 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1092/2169] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:21 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:21.507744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:21.509045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:21.528670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.529159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.529600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.530345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.530808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.531294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.583458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:13:21.782277 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3700dfc1-0c55-45db-b88c-a0315b04efd7 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 204 len: 0 microversion: 2.1 time: 0.283249 Oct 22 03:13:21.784406 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1093/2170] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:13:21 2022] DELETE /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:13:21.796059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-917273577", "imageRef": "5810261e-7cad-463e-ad6f-f494f160fd89", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4db8dfb3-6c0c-4acc-b38f-71faf40713a2"}], "security_groups": [{"name": "tempest-securitygroup--270253599"}], "key_name": "tempest-keypair-843982101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:21.903166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:21.913510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72c58cf3-90dd-43b5-88bd-4f704f1eb00b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.648629 Oct 22 03:13:21.914788 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1078/2171] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:21 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:21.920279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5e1964ef-78df-4f9c-a5ae-2a257b0b311f req-0daa596f-e64c-4bf8-adc8-6274df2414e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-plugged", "status": "completed", "tag": "7898d55a-c69b-4875-a377-906a18281fe9"}, {"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-plugged", "status": "completed", "tag": "ff3ee566-ef16-479d-ac0f-49bce2732089"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:21.941260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5e1964ef-78df-4f9c-a5ae-2a257b0b311f req-0daa596f-e64c-4bf8-adc8-6274df2414e3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.941810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5e1964ef-78df-4f9c-a5ae-2a257b0b311f req-0daa596f-e64c-4bf8-adc8-6274df2414e3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.942588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5e1964ef-78df-4f9c-a5ae-2a257b0b311f req-0daa596f-e64c-4bf8-adc8-6274df2414e3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.961331 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5e1964ef-78df-4f9c-a5ae-2a257b0b311f req-0daa596f-e64c-4bf8-adc8-6274df2414e3 service nova] Creating event network-vif-plugged:7898d55a-c69b-4875-a377-906a18281fe9 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:13:21.962138 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5e1964ef-78df-4f9c-a5ae-2a257b0b311f req-0daa596f-e64c-4bf8-adc8-6274df2414e3 service nova] Creating event network-vif-plugged:ff3ee566-ef16-479d-ac0f-49bce2732089 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:13:21.969725 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5e1964ef-78df-4f9c-a5ae-2a257b0b311f req-0daa596f-e64c-4bf8-adc8-6274df2414e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053064 Oct 22 03:13:21.974400 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1079/2172] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:21.981891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:21.982870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:21.992708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.993481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.994004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:21.995056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:21.995825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:21.996512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:22.033807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] validate_networks() for [('4db8dfb3-6c0c-4acc-b38f-71faf40713a2', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:13:22.159880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:22.170064 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d75a251-58a5-4893-92fc-d10df88c57ee tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1526 microversion: 2.1 time: 0.193187 Oct 22 03:13:22.171057 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1080/2173] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:21 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:22.176826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d72ada1b-e602-46f3-88d2-4637bdaacf03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1998550801", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": -1, "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:22.191608 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d72ada1b-e602-46f3-88d2-4637bdaacf03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Flavor -1 could not be found. Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d72ada1b-e602-46f3-88d2-4637bdaacf03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 206 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1998550801", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": -1, "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: exception: Flavor -1 could not be found. Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1998550801', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': -1, 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:22.193930 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d72ada1b-e602-46f3-88d2-4637bdaacf03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d72ada1b-e602-46f3-88d2-4637bdaacf03 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.022732 Oct 22 03:13:22.198451 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1081/2174] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:22 2022] POST /compute/v2.1/servers => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:13:22.219833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:22.220824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:22.228527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:22.229113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:22.229770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:22.230515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:22.231055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:22.231535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:22.442128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:22.459356 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17a87b1e-be6a-4ec8-9ed9-861b11e85cdb tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.252460 Oct 22 03:13:22.460658 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1082/2175] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:22 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:22.465839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:22.468248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:22.481934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:22.483756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:22.487713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:22.488628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:22.489343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:22.490531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:22.513169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:22.673695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:22.683493 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-368c8018-354e-430f-aae0-68c6a0b84b49 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1493 microversion: 2.1 time: 0.221333 Oct 22 03:13:22.698864 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1083/2176] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:22 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1493 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:22.709273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:22.710411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:22.712681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:22.720438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:22.721001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:22.721552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:22.722455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:22.722933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:22.723514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.004734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:23.015007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:23.018258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:23.018479 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dfa9f631-243c-4634-bc66-a17624d0b6a2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.319433 Oct 22 03:13:23.031140 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1084/2177] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:22 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:23.031140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:23.031140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:23.032682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.033352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.033952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.034862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.035488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.036074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.051033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:13:23.053224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:13:23.053825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:13:23.054262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:13:23.055973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:13:23.082869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.083683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.084912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.090471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.092944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.094126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.136268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Getting quotas for project f90d2937262c4cc2bc0e7fbf770a9c49. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:13:23.141704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Getting quotas for user 513dea8aa0114c2aa365124eb2b302a1 and project f90d2937262c4cc2bc0e7fbf770a9c49. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:13:23.159223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:13:23.161740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5810261e-7cad-463e-ad6f-f494f160fd89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:13:23.247414 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-287729a3-13e7-483d-af56-2d3b7c7f7572 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.461481 Oct 22 03:13:23.257283 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1094/2178] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:13:23.269175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:23.271258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: d6904474-1e00-42a7-bc83-8620882fa334] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:23.282894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.284274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.284745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.285568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.286130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.286663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.303567 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] HTTP exception thrown: Instance d6904474-1e00-42a7-bc83-8620882fa334 could not be found. Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Request method failure captured: Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 HTTP/1.1 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13oG4viltKolwDfU_1NX8L17Bi42bHNQ9NgtvCHNlYv0rXhxvKqg_vCLwySDA1TSb32JiJ42Bi-a4t_R--Ob9in8MlBOI-jkDEi3_veH7fRu4zjzGy6OpGHZNMU-UI48pfr-WzdPRRnse25KewgPw7xST87Qk4mQXKbVEa_I-B0ffk Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.25 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e33669cd6c0040cda12f8063688eacc4 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e33669cd6c0040cda12f8063688eacc4"}]}] Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e33669cd6c0040cda12f8063688eacc4 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-LiveAutoBlockMigrationV225Test-644726329-project Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2868158117ea4f7797f9931a97bcedfd Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-644726329-project Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d6904474-1e00-42a7-bc83-8620882fa334 could not be found. Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd6904474-1e00-42a7-bc83-8620882fa334'} Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6904474-1e00-42a7-bc83-8620882fa334 could not be found. Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6904474-1e00-42a7-bc83-8620882fa334 could not be found. Oct 22 03:13:23.305524 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6904474-1e00-42a7-bc83-8620882fa334 could not be found. Oct 22 03:13:23.308974 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.310098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Returning 404 to user: Instance d6904474-1e00-42a7-bc83-8620882fa334 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:23.311551 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-24bab70e-f09b-4010-a9c3-6d99f52e1a59 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334" status: 404 len: 111 microversion: 2.25 time: 0.053167 Oct 22 03:13:23.312672 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1095/2179] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:23 2022] GET /compute/v2.1/servers/d6904474-1e00-42a7-bc83-8620882fa334 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:23.319026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa9183b4-3f91-4814-943b-f7dda6c64a97 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '.version_select at 0x7f0d1a23db80>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:23.323323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa9183b4-3f91-4814-943b-f7dda6c64a97 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.323920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa9183b4-3f91-4814-943b-f7dda6c64a97 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.324732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa9183b4-3f91-4814-943b-f7dda6c64a97 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.343061 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa9183b4-3f91-4814-943b-f7dda6c64a97 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.028250 Oct 22 03:13:23.357815 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1096/2180] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:13:23 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:23.366114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:23.368684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:23.383791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.384646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.386009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.387191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.387794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.388398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.480332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:23.520985 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49f4f715-4864-433e-9034-9d8dd4fa3586 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.499586 Oct 22 03:13:23.528816 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1085/2181] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:23 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:23.540367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c7e659e6-bb9c-487e-80af-1aaec0e4ba9a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:23.541367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c7e659e6-bb9c-487e-80af-1aaec0e4ba9a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:23.657732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c7e659e6-bb9c-487e-80af-1aaec0e4ba9a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:23.675493 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c7e659e6-bb9c-487e-80af-1aaec0e4ba9a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1244 microversion: 2.1 time: 0.143736 Oct 22 03:13:23.678019 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1086/2182] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:23 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1244 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:23.689906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:23.691585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:23.709869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.727645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.728550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.730171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:23.740736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:23.741486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:23.948551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:23.962070 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ca7d131-5d1b-4a18-aacf-0738d11c2efd tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1526 microversion: 2.1 time: 0.601952 Oct 22 03:13:23.972827 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1097/2183] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:23 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1526 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:23.986576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f8f9e3b-e2cd-4056-bc7c-c1fcb7796aec tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1959725779", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f8f9e3b-e2cd-4056-bc7c-c1fcb7796aec tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 173 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1959725779", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1959725779', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi -1 Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:13:23.997780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 22 03:13:24.001773 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:24.013153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f8f9e3b-e2cd-4056-bc7c-c1fcb7796aec tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:24.017335 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f8f9e3b-e2cd-4056-bc7c-c1fcb7796aec tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.043421 Oct 22 03:13:24.018435 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1098/2184] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:23 2022] POST /compute/v2.1/servers => generated 145 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:24.029509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:24.042228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:24.059949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:24.063384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:24.065088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:24.066560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:24.069219 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c413759-0a6e-4b56-8278-6f22fe1ca80b tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1644 microversion: 2.1 time: 0.387993 Oct 22 03:13:24.070117 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1087/2185] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:23 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1644 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:24.070866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:24.072741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:24.075123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:24.075823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:24.082070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:24.082814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:24.083425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:24.084301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:24.084893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:24.085626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:24.410256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:24.427466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:24.429862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:24.432260 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32575af6-166c-4626-8f0d-5e33c525afbe tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1879 microversion: 2.32 time: 0.361060 Oct 22 03:13:24.434546 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1088/2186] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:24 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1879 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:24.440073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2054469104", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "e05de320-3bab-4c23-a4a6-0a3d411f4dd6"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:24.514755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:24.544180 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4e40cca5-3c32-4b63-ab1d-e35c2bc5f577 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.514539 Oct 22 03:13:24.545054 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1099/2187] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:24 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:24.571771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:24.572439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:24.608147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] validate_networks() for [('e05de320-3bab-4c23-a4a6-0a3d411f4dd6', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:13:24.612603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:24.613115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:24.613567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:24.614748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:24.614748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:24.615159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:25.073639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:25.089478 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2465f233-62cc-43da-b17b-d28184ae9f1c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.523335 Oct 22 03:13:25.090109 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1100/2188] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:24 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:25.132180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:25.133266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:25.141245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:25.145464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:25.146119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:25.147036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:25.147919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:25.148589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:25.274612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:25.288885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87d218e6-3c1e-4c4f-9a3d-3e0b0ff36229 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1296 microversion: 2.1 time: 0.169997 Oct 22 03:13:25.289802 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1101/2189] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:25 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:25.296050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8d0a6815-75e4-483d-981c-50630b1172d4 req-97aab1b0-123f-4d51-beed-fe056b204aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9acf03a-b005-4042-b847-201ad5368653", "name": "network-vif-deleted", "tag": "0b6c9724-a37e-45ce-9211-1d83f2f45fbf"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:25.325734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8d0a6815-75e4-483d-981c-50630b1172d4 req-97aab1b0-123f-4d51-beed-fe056b204aac service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:25.326579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8d0a6815-75e4-483d-981c-50630b1172d4 req-97aab1b0-123f-4d51-beed-fe056b204aac service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:25.329470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8d0a6815-75e4-483d-981c-50630b1172d4 req-97aab1b0-123f-4d51-beed-fe056b204aac service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:25.356759 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8d0a6815-75e4-483d-981c-50630b1172d4 req-97aab1b0-123f-4d51-beed-fe056b204aac service nova] Creating event network-vif-deleted:0b6c9724-a37e-45ce-9211-1d83f2f45fbf for instance e9acf03a-b005-4042-b847-201ad5368653 on n-h1-862416-2 Oct 22 03:13:25.368630 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8d0a6815-75e4-483d-981c-50630b1172d4 req-97aab1b0-123f-4d51-beed-fe056b204aac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077056 Oct 22 03:13:25.376193 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1102/2190] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:25.386774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:25.389963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:25.407176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:25.407930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:25.411095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:25.412091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:25.415738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:25.416460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:25.492158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:25.492158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:25.492158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:25.492158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lazy-loading 'fault' on Instance uuid e9acf03a-b005-4042-b847-201ad5368653 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:13:25.634431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bd65aecc4849339a5245a0e63d4a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1895216a97de4e25ae036b7c8af7b690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:25.650033 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b52e785-8c3c-4aa3-bb9a-0b9168e30818 tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 200 len: 1314 microversion: 2.1 time: 0.265737 Oct 22 03:13:25.650671 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1103/2191] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:25 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:25.678926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a95683b-a053-452a-aed9-d8eba575a1a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1465566324", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:25.694303 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6a95683b-a053-452a-aed9-d8eba575a1a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a95683b-a053-452a-aed9-d8eba575a1a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 216 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1465566324", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1465566324', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:25.696435 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:25.701969 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:25.701969 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:25.701969 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:25.701969 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:25.701969 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:25.701969 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:25.701969 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 22 03:13:25.701969 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:25.706003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a95683b-a053-452a-aed9-d8eba575a1a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:25.707099 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a95683b-a053-452a-aed9-d8eba575a1a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.051852 Oct 22 03:13:25.711306 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1104/2192] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:25 2022] POST /compute/v2.1/servers => generated 123 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:25.728349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:25.733886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:25.770764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:25.775446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:25.780648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:25.788141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:25.788687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:25.795444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:26.159855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:13:26.161560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:13:26.162514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:13:26.163609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:13:26.164633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:13:26.180698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:26.181507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:26.182307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:26.184427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:26.185189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:26.186658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:26.212037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:13:26.220609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for user 92523f18567441589dba5548bb33eb9e and project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:13:26.244335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:13:26.247189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:13:26.324720 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a8ab5bc-1897-4645-9e57-5ad5a7faa269 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.888836 Oct 22 03:13:26.325477 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1089/2193] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:13:26.339893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:26.340680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:26.347992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:26.348593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:26.349111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:26.350124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:26.350606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:26.351291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:26.658087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:26.679941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41964b9c-5f9e-445e-a9ba-7e030e4e15ed tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.353142 Oct 22 03:13:26.680956 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1090/2194] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:26 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:26.917968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:26.935249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:26.939822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:26.941550 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1dad91d0-0eaa-4ff0-9cb0-7eff57b1494c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2832 microversion: 2.32 time: 1.228270 Oct 22 03:13:26.942336 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1105/2195] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:25 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2832 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:26.945048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1520004511", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:26.947634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:26.948833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:26.956870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:26.957553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:26.958969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:26.959811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:26.960607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:26.961283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:27.088821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:13:27.190813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:27.206919 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-61113667-f931-437e-8edd-bbbc953a5a26 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1302 microversion: 2.1 time: 0.261678 Oct 22 03:13:27.208474 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1106/2196] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:26 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1302 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:27.241601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81ffeeb6-35f5-4254-9ba3-0b35298b77f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:27.242435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81ffeeb6-35f5-4254-9ba3-0b35298b77f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:27.524679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-81ffeeb6-35f5-4254-9ba3-0b35298b77f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:27.536002 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81ffeeb6-35f5-4254-9ba3-0b35298b77f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1211 microversion: 2.1 time: 0.306300 Oct 22 03:13:27.539678 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1107/2197] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:27 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1211 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:27.555029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:27.563666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] [instance: e9acf03a-b005-4042-b847-201ad5368653] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:27.568867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:13:27.569349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:13:27.569737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:13:27.570139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:13:27.571386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:13:27.594841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:27.603545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:27.604010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:27.604797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:27.608816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:27.609170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:27.610750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:27.611365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:27.611711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:27.614178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:27.614958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:27.616569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:27.628739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:27.697742 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] HTTP exception thrown: Instance e9acf03a-b005-4042-b847-201ad5368653 could not be found. Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Request method failure captured: Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 HTTP/1.1 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19m64E4YBABqEZntuQ939JyO9AkNmDKBflV9zHlcx5zJMr5rTaEtAkAoqbmL4MSgB59hLd-EXhYm7lXTRwRteMxi5lr6eKIy1P926JR4Pn30-ZjdByTexec8SbymrlbzQYenh_cVCopT-633QLX17j1k8QOe_RvRgodhdG2ZdqIzJc Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1895216a97de4e25ae036b7c8af7b690 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1895216a97de4e25ae036b7c8af7b690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1895216a97de4e25ae036b7c8af7b690"}]}] Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1895216a97de4e25ae036b7c8af7b690 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-318199254 Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FloatingIPsAssociationTestJSON-318199254-project Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 23bd65aecc4849339a5245a0e63d4a2b Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-318199254-project Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance e9acf03a-b005-4042-b847-201ad5368653 could not be found. Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e9acf03a-b005-4042-b847-201ad5368653'} Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9acf03a-b005-4042-b847-201ad5368653 could not be found. Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9acf03a-b005-4042-b847-201ad5368653 could not be found. Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:27.703181 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:27.707274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:27.707274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:27.707274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:27.707274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:27.707274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:27.707274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:27.707274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9acf03a-b005-4042-b847-201ad5368653 could not be found. Oct 22 03:13:27.707274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:27.710971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] Returning 404 to user: Instance e9acf03a-b005-4042-b847-201ad5368653 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:27.713684 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-817b507d-f08b-4da2-b524-496eee4b0f6f tempest-FloatingIPsAssociationTestJSON-318199254 tempest-FloatingIPsAssociationTestJSON-318199254-project] 10.222.0.25 "GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653" status: 404 len: 111 microversion: 2.1 time: 0.171989 Oct 22 03:13:27.716352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Getting quotas for project 08a29e66084f4621bfec65de1c77d3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:13:27.717034 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1108/2198] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:27 2022] GET /compute/v2.1/servers/e9acf03a-b005-4042-b847-201ad5368653 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:27.733635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Getting quotas for user a214582bec4040d3a315b687fb8f972a and project 08a29e66084f4621bfec65de1c77d3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:13:27.745475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:27.746095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:27.772300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:27.772870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:27.774900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:13:27.778055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:13:27.794246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:27.796070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:27.798920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:27.800364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:27.953821 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c2259111-1b7d-42ca-8fd1-8402abf79044 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.248504 Oct 22 03:13:27.959070 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1091/2199] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:13:27.986582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:27.997218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:28.061740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:28.066381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:28.068259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:28.071521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:28.074235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:28.074802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:28.477831 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dcc6e1fb-cec8-4de1-bf97-9990fa1f6396 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.516253 Oct 22 03:13:28.479135 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1092/2200] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Oct 22 03:13:27 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e/os-interface => generated 1832 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:28.483758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e331e11-2e1e-4833-a710-295a9f744ed7 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:28.484633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e331e11-2e1e-4833-a710-295a9f744ed7 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:28.632676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:28.650683 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3fc242e-6df6-4518-9dae-ed4c85d37969 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.930979 Oct 22 03:13:28.651371 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1109/2201] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:27 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:28.670007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:28.684564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:28.702176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:28.703700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:28.706671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:28.707911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:28.710022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:28.711601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:28.918851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e331e11-2e1e-4833-a710-295a9f744ed7 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:28.927569 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e331e11-2e1e-4833-a710-295a9f744ed7 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1217 microversion: 2.1 time: 0.447363 Oct 22 03:13:28.929218 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1093/2202] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:28 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1217 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:28.934821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:28.949898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:28.994865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:28.997788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:29.001904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:29.005672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:29.010332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:29.012538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:29.316835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:29.330398 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0c19a38-60d3-4c02-ab54-039ff467dde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1281 microversion: 2.1 time: 0.399130 Oct 22 03:13:29.364003 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1094/2203] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:28 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1281 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:29.383988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f806c714-06d9-4a47-8d33-3aae220a512c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1375254192", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-key-498749502", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:29.526683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-f806c714-06d9-4a47-8d33-3aae220a512c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] validate_networks() for [('cd333e9d-f9b8-4605-a5a4-47471e05a78d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:13:29.975290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:30.000074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b4c58c2-cae0-4630-aeea-d1e39ceb420d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1302 microversion: 2.1 time: 1.337163 Oct 22 03:13:30.001586 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1110/2204] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:28 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1302 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:30.012362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:30.013353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:30.016344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:30.055577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.057249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.059865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.063646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.065730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.071127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.401389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:30.415721 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40427009-8227-4d68-93f4-0183c969ebce tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1269 microversion: 2.1 time: 0.407548 Oct 22 03:13:30.418078 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1111/2205] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:30 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1269 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:30.431917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:30.432668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:30.458460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.460528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.461088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.461970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.462529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.463055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.514770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:13:30.663702 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4b8e0a0-cc82-486c-9272-46dd9f5bc95b tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 204 len: 0 microversion: 2.25 time: 0.243096 Oct 22 03:13:30.667919 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1112/2206] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:13:30 2022] DELETE /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:13:30.678193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:30.680184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:30.691855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.693445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.693951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.694958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.695337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.695818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.846437 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-f806c714-06d9-4a47-8d33-3aae220a512c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Invalid key_name provided. Oct 22 03:13:30.846893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f806c714-06d9-4a47-8d33-3aae220a512c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 246 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1375254192", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-key-498749502", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid key_name provided. Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1375254192', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'key_name': 'tempest-key-498749502', 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-498749502 not found for user 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:30.849751 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 22 03:13:30.854187 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:30.860238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f806c714-06d9-4a47-8d33-3aae220a512c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid key_name provided. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:30.861559 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f806c714-06d9-4a47-8d33-3aae220a512c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.492437 Oct 22 03:13:30.864979 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1095/2207] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:29 2022] POST /compute/v2.1/servers => generated 70 bytes in 1500 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:13:30.868768 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-49f34275-17df-4bcb-bb10-21d72adf4f84 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1269 microversion: 2.1 time: 0.198206 Oct 22 03:13:30.880361 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1113/2208] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:30 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1269 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:30.880361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:30.880361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:30.890508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:30.890777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.890777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.890777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.891576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:30.902519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.905389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.908524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.920308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.921467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.931613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:30.934566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:30.939456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:30.940095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:31.578443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:31.588632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:31.597249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:31.611174 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-572322f5-5730-479e-b9f4-f67ebdc268ac tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1731 microversion: 2.25 time: 0.732092 Oct 22 03:13:31.612738 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1096/2209] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:30 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1731 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:31.625799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:31.626437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:31.636596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:31.637091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:31.637529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:31.639074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:31.639074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:31.639074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:31.877161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:31.904965 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-080aa487-3a20-4534-8d5f-37b6fab16fff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 1.032827 Oct 22 03:13:31.907648 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1114/2210] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:30 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:31.921306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:31.922965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:31.937891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:31.940489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:31.941818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:31.944027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:31.946586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:31.947461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:32.210953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:32.221387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-29bf748b-7fa4-444d-b1cb-f1c97b93de92 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1277 microversion: 2.1 time: 0.312271 Oct 22 03:13:32.222504 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1115/2211] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:31 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:32.237136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:32.238162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:32.244964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:32.246487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:32.247497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:32.248557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:32.249211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:32.249997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:32.533235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:32.549940 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17cfd494-23c6-4f17-8d4b-9945dc75352b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.935943 Oct 22 03:13:32.551335 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1097/2212] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:31 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:32.557151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:32.558525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:32.574351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:32.575392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:32.576038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:32.577690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:32.578957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:32.579628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:32.666416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:32.679810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1095b221-e0f9-41cd-be59-9f2f8da371f6 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1269 microversion: 2.1 time: 0.455034 Oct 22 03:13:32.681908 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1116/2213] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:32 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1269 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:32.689410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:32.690306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:32.698359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:32.699570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:32.700517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:32.702011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:32.705899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:32.707014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:33.125461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:33.337991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:33.350248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7164696f-f389-41b5-8c91-7f7bb103b170 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.797522 Oct 22 03:13:33.354551 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1098/2214] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:32 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:33.364666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:33.365618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:33.365936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:33.374467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:33.378252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:33.378958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:33.379547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:33.380447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:33.381193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:33.383078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:33.384436 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6dc2955b-9e34-4a06-bcce-af7254494b91 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1731 microversion: 2.25 time: 0.701304 Oct 22 03:13:33.385288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:33.399800 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1117/2215] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:32 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1731 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:33.412241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c4e74e9b-1b29-4950-bd8d-a750cd3c2cd3 req-fa8b302f-a4a6-4bc1-8fb0-ead0f0ad93d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "tag": "6f7d0505-1709-46d1-b6ba-10387663e348"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:33.458586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4e74e9b-1b29-4950-bd8d-a750cd3c2cd3 req-fa8b302f-a4a6-4bc1-8fb0-ead0f0ad93d4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:33.459078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4e74e9b-1b29-4950-bd8d-a750cd3c2cd3 req-fa8b302f-a4a6-4bc1-8fb0-ead0f0ad93d4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:33.459509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4e74e9b-1b29-4950-bd8d-a750cd3c2cd3 req-fa8b302f-a4a6-4bc1-8fb0-ead0f0ad93d4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:33.547894 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c4e74e9b-1b29-4950-bd8d-a750cd3c2cd3 req-fa8b302f-a4a6-4bc1-8fb0-ead0f0ad93d4 service nova] Creating event network-changed:6f7d0505-1709-46d1-b6ba-10387663e348 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:13:33.565533 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c4e74e9b-1b29-4950-bd8d-a750cd3c2cd3 req-fa8b302f-a4a6-4bc1-8fb0-ead0f0ad93d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163119 Oct 22 03:13:33.571030 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1118/2216] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:33.586920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:33.614133 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-007a37e2-dd00-462b-9576-aadd79c3573c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1277 microversion: 2.1 time: 0.241004 Oct 22 03:13:33.615640 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1099/2217] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:33 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:33.616513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b76b882a-7392-4378-956b-605ce32819d2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-198535993", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:33.646724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:33.655269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:33.677268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:33.678396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:33.680840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:33.685818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:33.689156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:33.691449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.038790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.security_group_api [None req-b76b882a-7392-4378-956b-605ce32819d2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Neutron security group does_not_exist not found {{(pid=120581) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 22 03:13:34.039868 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b76b882a-7392-4378-956b-605ce32819d2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b76b882a-7392-4378-956b-605ce32819d2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 257 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-198535993", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-198535993', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 22 03:13:34.049395 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:34.054145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b76b882a-7392-4378-956b-605ce32819d2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:34.058784 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b76b882a-7392-4378-956b-605ce32819d2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.478038 Oct 22 03:13:34.058784 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1119/2218] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:33 2022] POST /compute/v2.1/servers => generated 106 bytes in 480 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:34.058784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:34.058784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:34.073858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:34.074604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:34.075200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.077138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:34.079382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:34.092103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.144604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:34.155355 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-34e9b3c3-888d-4522-a313-51020bca1b56 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.537333 Oct 22 03:13:34.161319 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1100/2219] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:33 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:34.169921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:34.176952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:34.190579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:34.191318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:34.191996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.205370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:34.206278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:34.206987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.617155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:34.628874 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0217eaf7-31ae-48f0-a53c-8ab507c6c2f4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.466097 Oct 22 03:13:34.629459 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1101/2220] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:34 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:34.659291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:34.660281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:34.668336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:34.669160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:34.670177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.671663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:34.673651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:34.675000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.856079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:34.869676 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b4e39744-3144-4637-8d10-8a76264e38e2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.816490 Oct 22 03:13:34.872553 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1120/2221] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:34 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:34.919343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:34.935761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:34.954083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:34.960342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:34.962689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.963932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:34.967183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:34.967827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:34.978103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:35.012239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:35.020683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:35.027896 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3c67882-c287-4a73-912a-b749e8129177 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 200 len: 1663 microversion: 2.25 time: 0.372904 Oct 22 03:13:35.031165 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1102/2222] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:34 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 1663 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:35.055598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:35.056962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:35.065295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:35.067417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:35.068072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:35.070019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:35.071259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:35.072239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:35.374662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:35.387206 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9cdb92bc-b906-4706-b034-15b6aa527b81 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.340287 Oct 22 03:13:35.407170 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1103/2223] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:35 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:35.412563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:35.413477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:35.429645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:35.430473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:35.431144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:35.432086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:35.432765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:35.435964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:35.484775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:35.502708 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d975ac0e-7c04-47d2-bbc9-a8997fd40530 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1275 microversion: 2.1 time: 0.606573 Oct 22 03:13:35.517602 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1121/2224] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:34 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1275 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:35.517602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a027fbb-dc37-4565-8b44-9883a8799d2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:35.517602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a027fbb-dc37-4565-8b44-9883a8799d2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 49e67241-60fd-4f74-ae9e-2a67cb27d932] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:35.552825 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-2a027fbb-dc37-4565-8b44-9883a8799d2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 49e67241-60fd-4f74-ae9e-2a67cb27d932 could not be found. Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a027fbb-dc37-4565-8b44-9883a8799d2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/49e67241-60fd-4f74-ae9e-2a67cb27d932 HTTP/1.1 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 49e67241-60fd-4f74-ae9e-2a67cb27d932 could not be found. Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '49e67241-60fd-4f74-ae9e-2a67cb27d932'} Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e67241-60fd-4f74-ae9e-2a67cb27d932 could not be found. Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e67241-60fd-4f74-ae9e-2a67cb27d932 could not be found. Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:35.554655 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:35.558510 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:35.558510 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:35.558510 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:35.558510 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:35.558510 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:35.558510 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:35.558510 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e67241-60fd-4f74-ae9e-2a67cb27d932 could not be found. Oct 22 03:13:35.558510 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:35.559802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a027fbb-dc37-4565-8b44-9883a8799d2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 49e67241-60fd-4f74-ae9e-2a67cb27d932 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:35.561004 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a027fbb-dc37-4565-8b44-9883a8799d2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "DELETE /compute/v2.1/servers/49e67241-60fd-4f74-ae9e-2a67cb27d932" status: 404 len: 111 microversion: 2.1 time: 0.056626 Oct 22 03:13:35.562019 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1122/2225] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:13:35 2022] DELETE /compute/v2.1/servers/49e67241-60fd-4f74-ae9e-2a67cb27d932 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:35.571550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:35.578701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:35.594352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:35.595472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:35.596054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:35.600942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:35.602589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:35.606144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:35.953852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:35.956649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:35.976683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dd3c9cda-d71e-44be-92b4-ef8321645592 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.560509 Oct 22 03:13:35.979853 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1104/2226] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:35 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:35.998416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9abcd597-fe15-49f9-abe1-aa3c8e87e352 req-e32116af-f5cd-4261-aa74-bf3d1244acf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a218e3e3-6082-4b65-8edb-b406c7cd582f", "name": "network-vif-deleted", "tag": "b0191679-9c81-4ff7-8391-549473bf995c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:36.029473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9abcd597-fe15-49f9-abe1-aa3c8e87e352 req-e32116af-f5cd-4261-aa74-bf3d1244acf3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:36.032150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9abcd597-fe15-49f9-abe1-aa3c8e87e352 req-e32116af-f5cd-4261-aa74-bf3d1244acf3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:36.033535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9abcd597-fe15-49f9-abe1-aa3c8e87e352 req-e32116af-f5cd-4261-aa74-bf3d1244acf3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:36.068374 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9abcd597-fe15-49f9-abe1-aa3c8e87e352 req-e32116af-f5cd-4261-aa74-bf3d1244acf3 service nova] Creating event network-vif-deleted:b0191679-9c81-4ff7-8391-549473bf995c for instance a218e3e3-6082-4b65-8edb-b406c7cd582f on n-h1-862416-2 Oct 22 03:13:36.081113 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9abcd597-fe15-49f9-abe1-aa3c8e87e352 req-e32116af-f5cd-4261-aa74-bf3d1244acf3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098481 Oct 22 03:13:36.083684 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1105/2227] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:36.101497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:36.102929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:36.117485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:36.119748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:36.120340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:36.121213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:36.123760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:36.127093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:36.821068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:36.833480 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38b434f8-50e2-42bb-aacd-05d5d7e56495 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.745427 Oct 22 03:13:36.848428 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1106/2228] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:36 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:36.872775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:36.875808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: a218e3e3-6082-4b65-8edb-b406c7cd582f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:36.893813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:36.895480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:36.897555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:36.899458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:36.899964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:36.903237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:36.944142 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] HTTP exception thrown: Instance a218e3e3-6082-4b65-8edb-b406c7cd582f could not be found. Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Request method failure captured: Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f HTTP/1.1 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13oG4viltKolwDfU_1NX8L17Bi42bHNQ9NgtvCHNlYv0rXhxvKqg_vCLwySDA1TSb32JiJ42Bi-a4t_R--Ob9in8MlBOI-jkDEi3_veH7fRu4zjzGy6OpGHZNMU-UI48pfr-WzdPRRnse25KewgPw7xST87Qk4mQXKbVEa_I-B0ffk Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.25 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e33669cd6c0040cda12f8063688eacc4 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e33669cd6c0040cda12f8063688eacc4"}]}] Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e33669cd6c0040cda12f8063688eacc4 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-LiveAutoBlockMigrationV225Test-644726329-project Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2868158117ea4f7797f9931a97bcedfd Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-644726329-project Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance a218e3e3-6082-4b65-8edb-b406c7cd582f could not be found. Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'a218e3e3-6082-4b65-8edb-b406c7cd582f'} Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a218e3e3-6082-4b65-8edb-b406c7cd582f could not be found. Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a218e3e3-6082-4b65-8edb-b406c7cd582f could not be found. Oct 22 03:13:36.949603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a218e3e3-6082-4b65-8edb-b406c7cd582f could not be found. Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Returning 404 to user: Instance a218e3e3-6082-4b65-8edb-b406c7cd582f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:36.953611 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3bae6784-3ec5-4e49-b892-a459e2e087ad tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f" status: 404 len: 111 microversion: 2.25 time: 0.101743 Oct 22 03:13:36.959214 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1107/2229] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:36 2022] GET /compute/v2.1/servers/a218e3e3-6082-4b65-8edb-b406c7cd582f => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:36.973803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:36.974609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:36.992877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:36.994186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:36.996483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:36.997438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:36.999273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:36.999544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:37.164126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:37.181548 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e3e3a1a8-fb44-4dd4-a245-fab34469226d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1275 microversion: 2.1 time: 0.222928 Oct 22 03:13:37.184857 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1108/2230] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:36 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:37.206656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c45e75c-6198-4df7-bdb7-933c7a81456c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '.version_select at 0x7f0d1e586ee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:37.239608 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c45e75c-6198-4df7-bdb7-933c7a81456c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759714454" status: 204 len: 0 microversion: 2.25 time: 0.052259 Oct 22 03:13:37.241008 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1109/2231] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:13:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759714454 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:13:37.252829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:37.254011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:37.264836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:37.266686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:37.267304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:37.269040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:37.269972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:37.270728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:37.530195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:37.622718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:37.637386 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-58a1ce97-abc2-4f86-a727-9458d9bbfd42 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 2.066166 Oct 22 03:13:37.638082 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1123/2232] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:35 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:37.679556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:37.680044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:37.682710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:37.700652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:37.703209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:37.704784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:37.706795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:37.708127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:37.709486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:37.801504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:37.811622 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f761f35c-3e77-424e-80ca-548625cf95d4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.569230 Oct 22 03:13:37.816063 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1110/2233] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:37 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:37.860979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:37.861607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:37.868252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:37.868750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:37.869192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:37.869909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:37.870368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:37.870796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:38.333713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:38.345783 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a17e9572-9665-4ef2-804c-07a3a0d4498d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.489087 Oct 22 03:13:38.352929 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1111/2234] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:37 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:38.358691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0767b620-e8ac-4c72-bcd3-85f091e54357 req-879cf7c4-5279-4a94-8af1-a628b40f6642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bcace45-2b9b-4d3f-b68c-06ca98c4a3df", "tag": "5dc7dda7-0c84-47ba-b8e3-ffc2f5a98839"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:38.391829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0767b620-e8ac-4c72-bcd3-85f091e54357 req-879cf7c4-5279-4a94-8af1-a628b40f6642 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:38.392714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0767b620-e8ac-4c72-bcd3-85f091e54357 req-879cf7c4-5279-4a94-8af1-a628b40f6642 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:38.393390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0767b620-e8ac-4c72-bcd3-85f091e54357 req-879cf7c4-5279-4a94-8af1-a628b40f6642 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:38.412485 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0767b620-e8ac-4c72-bcd3-85f091e54357 req-879cf7c4-5279-4a94-8af1-a628b40f6642 service nova] Creating event network-changed:5dc7dda7-0c84-47ba-b8e3-ffc2f5a98839 for instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df on n-h2-862416-2 Oct 22 03:13:38.425292 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0767b620-e8ac-4c72-bcd3-85f091e54357 req-879cf7c4-5279-4a94-8af1-a628b40f6642 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070792 Oct 22 03:13:38.426646 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1112/2235] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:38.431978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:38.443974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:38.455285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:38.456131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:38.456833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:38.457780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:38.459194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:38.459880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:38.929615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=20 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:38.959897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:38.971896 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-12984842-4586-48e3-bcc7-f953c115deac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.543390 Oct 22 03:13:39.004449 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1113/2236] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:38 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:39.028697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:39.029350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:39.054240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:39.054747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:39.055198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:39.055938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:39.056426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:39.056851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:39.114606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:39.139358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-366d35ea-f755-4111-bd6a-8d80323286de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 1.478027 Oct 22 03:13:39.140131 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1124/2237] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:37 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:39.169121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bc7378c-4a6c-467b-8b18-5c13ba731321 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:39.169864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2bc7378c-4a6c-467b-8b18-5c13ba731321 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 03:13:39.170377 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-2bc7378c-4a6c-467b-8b18-5c13ba731321 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bc7378c-4a6c-467b-8b18-5c13ba731321 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 9223372036854775808 could not be found. Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9223372036854775808'} Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:39.173356 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:39.177022 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:39.177022 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:39.177022 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:39.177022 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 22 03:13:39.177022 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:39.177022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bc7378c-4a6c-467b-8b18-5c13ba731321 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:39.177022 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2bc7378c-4a6c-467b-8b18-5c13ba731321 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009695 Oct 22 03:13:39.180088 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1125/2238] 10.222.0.25 () {58 vars in 1188 bytes} [Sat Oct 22 03:13:39 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:13:39.195566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:39.196181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:39.224234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:39.224765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:39.225208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:39.227760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:39.228335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:39.228831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:39.535863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:39.544981 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-acfd301c-8359-4817-a8f7-4efc6de47d4e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.363775 Oct 22 03:13:39.545665 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1126/2239] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:39 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:39.552727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:39.553811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:39.560701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:39.561818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:39.563993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:39.564346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:39.565900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:39.566843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:39.568341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:39.581542 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83257639-22c4-41de-8070-6aff45f0c994 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.575808 Oct 22 03:13:39.582162 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1114/2240] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:39 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:39.603640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:39.604698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:39.605318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:39.613482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:39.614215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:39.614957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:39.615868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:39.616576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:39.617202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:39.794116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:39.805316 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fdca977c-14d8-4794-a8b1-d3d620f2255a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.258365 Oct 22 03:13:39.821275 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1127/2241] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:39 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:40.014572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:40.016564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:40.027500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.029973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.030889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.031959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.032718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.033546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.068071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:40.082627 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98ffed99-1d74-497b-bbf3-a011c6dac82c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.489147 Oct 22 03:13:40.084684 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1115/2242] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:39 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:40.109874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5cfd58a9-b53a-4e86-ab11-3c93b6201261 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:40.110744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5cfd58a9-b53a-4e86-ab11-3c93b6201261 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Failed to fetch instance by id -1 {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 03:13:40.111464 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-5cfd58a9-b53a-4e86-ab11-3c93b6201261 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance -1 could not be found. Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5cfd58a9-b53a-4e86-ab11-3c93b6201261 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance -1 could not be found. Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '-1'} Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:40.113273 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:40.117956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:40.117956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:40.117956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 22 03:13:40.117956 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:40.119629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5cfd58a9-b53a-4e86-ab11-3c93b6201261 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:40.120709 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5cfd58a9-b53a-4e86-ab11-3c93b6201261 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015308 Oct 22 03:13:40.125669 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1116/2243] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:13:40 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:13:40.131278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:40.132124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:40.135529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:40.141225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.141965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.142685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.143736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.144422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.145071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.304337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:40.321448 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-89e92ccc-9b4c-403d-841c-9314eea11b5f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.313665 Oct 22 03:13:40.322549 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1128/2244] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:40 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:40.483254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5d70ca8b-2082-49e6-ba30-78c38fcd34e2 req-402036a3-60e7-4819-9b7c-fa2947adee5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ac884a-4e4c-46eb-bed5-ff095d21ed4e", "tag": "e5c48f88-4317-4ffd-8341-8454067bd0fc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:40.495381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5d70ca8b-2082-49e6-ba30-78c38fcd34e2 req-402036a3-60e7-4819-9b7c-fa2947adee5b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.496102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5d70ca8b-2082-49e6-ba30-78c38fcd34e2 req-402036a3-60e7-4819-9b7c-fa2947adee5b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.496725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5d70ca8b-2082-49e6-ba30-78c38fcd34e2 req-402036a3-60e7-4819-9b7c-fa2947adee5b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.521297 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5d70ca8b-2082-49e6-ba30-78c38fcd34e2 req-402036a3-60e7-4819-9b7c-fa2947adee5b service nova] Creating event network-changed:e5c48f88-4317-4ffd-8341-8454067bd0fc for instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e on n-h1-862416-2 Oct 22 03:13:40.528623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5d70ca8b-2082-49e6-ba30-78c38fcd34e2 req-402036a3-60e7-4819-9b7c-fa2947adee5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049374 Oct 22 03:13:40.530093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1129/2245] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:13:40.608689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:40.611010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:40.618533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.619354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.619987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.622795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.623565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.625494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.909343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:40.912136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:40.921134 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-91012371-d7a1-4542-adac-b68cadf49cf9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.793220 Oct 22 03:13:40.925640 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15840dec-ccf6-4761-ad39-4386f261dda8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.321923 Oct 22 03:13:40.926506 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1130/2246] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:40 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:40.934850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:40.936428 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1117/2247] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:40 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:40.938215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:40.947261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.948428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.949291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.950866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.952288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.953977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.956593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:40.957333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:40.964343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.965303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.965924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:40.967192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:40.967863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:40.969101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.168098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:41.178535 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ea4c100-5b1a-4327-b0af-fede9174db2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.250572 Oct 22 03:13:41.179125 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1131/2248] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:40 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:41.183957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:41.184676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:41.191262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.192021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.193019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.194037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.194674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.195576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.225450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:13:41.281003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:41.291208 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9760998-b2e6-441c-ac29-c78f0a948d31 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.341519 Oct 22 03:13:41.323165 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1118/2249] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:40 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:41.334651 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2c9eef31-767a-4d83-9624-19c7a4802986 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 204 len: 0 microversion: 2.25 time: 0.153979 Oct 22 03:13:41.336960 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1132/2250] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:13:41 2022] DELETE /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:13:41.342194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e228e6fd-7750-46d4-a14c-6cea847c0c94 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:41.342958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e228e6fd-7750-46d4-a14c-6cea847c0c94 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: ff3eb711-665d-4936-a82a-e84d84e08c45] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:41.343981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-22beaaa2-aeb1-4b9f-83bf-31079cc7f3aa req-8064fb40-1980-4a8c-a47b-1385f4592d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2411dd-1a42-4047-90ab-5e6bb098541a", "tag": "27c46b57-feba-40bd-95ee-929c50f6d0e4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:41.350909 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e228e6fd-7750-46d4-a14c-6cea847c0c94 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance ff3eb711-665d-4936-a82a-e84d84e08c45 could not be found. Oct 22 03:13:41.358127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-22beaaa2-aeb1-4b9f-83bf-31079cc7f3aa req-8064fb40-1980-4a8c-a47b-1385f4592d85 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.358592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-22beaaa2-aeb1-4b9f-83bf-31079cc7f3aa req-8064fb40-1980-4a8c-a47b-1385f4592d85 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.359550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-22beaaa2-aeb1-4b9f-83bf-31079cc7f3aa req-8064fb40-1980-4a8c-a47b-1385f4592d85 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e228e6fd-7750-46d4-a14c-6cea847c0c94 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/ff3eb711-665d-4936-a82a-e84d84e08c45/action HTTP/1.1 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 19 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: {"forceDelete": {}} Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ff3eb711-665d-4936-a82a-e84d84e08c45 could not be found. Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ff3eb711-665d-4936-a82a-e84d84e08c45', 'body': {'forceDelete': {}}} Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3eb711-665d-4936-a82a-e84d84e08c45 could not be found. Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3eb711-665d-4936-a82a-e84d84e08c45 could not be found. Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:41.360607 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:41.367343 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:41.367343 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:41.367343 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3eb711-665d-4936-a82a-e84d84e08c45 could not be found. Oct 22 03:13:41.367343 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:41.369418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e228e6fd-7750-46d4-a14c-6cea847c0c94 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance ff3eb711-665d-4936-a82a-e84d84e08c45 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:41.370741 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e228e6fd-7750-46d4-a14c-6cea847c0c94 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/ff3eb711-665d-4936-a82a-e84d84e08c45/action" status: 404 len: 111 microversion: 2.1 time: 0.044684 Oct 22 03:13:41.371537 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1119/2251] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:41 2022] POST /compute/v2.1/servers/ff3eb711-665d-4936-a82a-e84d84e08c45/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:41.377025 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-22beaaa2-aeb1-4b9f-83bf-31079cc7f3aa req-8064fb40-1980-4a8c-a47b-1385f4592d85 service nova] Creating event network-changed:27c46b57-feba-40bd-95ee-929c50f6d0e4 for instance ba2411dd-1a42-4047-90ab-5e6bb098541a on n-h2-862416-2 Oct 22 03:13:41.381787 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-22beaaa2-aeb1-4b9f-83bf-31079cc7f3aa req-8064fb40-1980-4a8c-a47b-1385f4592d85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043246 Oct 22 03:13:41.381918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:41.382414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:41.382983 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1133/2252] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:41.388250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:41.389014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:41.389366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.389858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.390822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.391525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.392137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.392743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.397509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.399538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.400030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.400876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.401523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.402137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.627488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:41.635511 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e32f21a8-eef4-494b-bddb-932378082d08 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.251466 Oct 22 03:13:41.636600 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1134/2253] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:41 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:41.643827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:41.644708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:41.650903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.651542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.652289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.653141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.653718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.654358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.701942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:41.711030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:41.712524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:41.713836 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e79c25fd-a33d-4b0c-9f6a-7bdab70a4d07 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1549 microversion: 2.25 time: 0.341733 Oct 22 03:13:41.714855 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1120/2254] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:41 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1549 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:41.951351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:41.952170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:41.959607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.960418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.961022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:41.961847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:41.962369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:41.962882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:42.232186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:42.248730 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e657481d-cbe5-4f18-a274-6009f022dfe8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.301049 Oct 22 03:13:42.250824 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1121/2255] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:41 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:42.256485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:42.257434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:42.264722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:42.268460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:42.268976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:42.269724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:42.270207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:42.270622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:42.407919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:42.419860 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ecadb241-f527-464a-954f-0fddafddc59d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.782062 Oct 22 03:13:42.421121 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1135/2256] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:41 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:42.447848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:42.449249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:42.459172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:42.459676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:42.460183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:42.468552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:42.468979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:42.469587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:42.590143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:42.600986 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-51f6ce5c-d0a2-4f76-9cdb-994e171de205 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.348675 Oct 22 03:13:42.603714 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1122/2257] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:42 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:42.665920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:42.668487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:42.678792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:42.679323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:42.680844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:42.681813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:42.682336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:42.682995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:42.846202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:42.854472 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0d6bb113-8416-4474-82ca-c97bc6dc67c1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.410387 Oct 22 03:13:42.869471 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1136/2258] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:42 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:42.880518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:42.881209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:42.887758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:42.888656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:42.889458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:42.890925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:42.891711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:42.892411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.010786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:43.021028 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28b10666-f9ab-41e7-9e9d-96d2b2f7d66d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.364232 Oct 22 03:13:43.021964 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1123/2259] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:42 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:43.027323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83ca69e2-5716-4f1a-b914-d9695a74b421 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:43.029882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83ca69e2-5716-4f1a-b914-d9695a74b421 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 8331b81b-8f3a-4f61-b207-2d15d2bbb267] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:43.037061 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-83ca69e2-5716-4f1a-b914-d9695a74b421 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 8331b81b-8f3a-4f61-b207-2d15d2bbb267 could not be found. Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83ca69e2-5716-4f1a-b914-d9695a74b421 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/8331b81b-8f3a-4f61-b207-2d15d2bbb267/action HTTP/1.1 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 39 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: {"os-getConsoleOutput": {"length": 10}} Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 8331b81b-8f3a-4f61-b207-2d15d2bbb267 could not be found. Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '8331b81b-8f3a-4f61-b207-2d15d2bbb267', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8331b81b-8f3a-4f61-b207-2d15d2bbb267 could not be found. Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8331b81b-8f3a-4f61-b207-2d15d2bbb267 could not be found. Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.040556 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:43.044843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:43.044843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:43.044843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:43.044843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:43.044843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8331b81b-8f3a-4f61-b207-2d15d2bbb267 could not be found. Oct 22 03:13:43.044843 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.047225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83ca69e2-5716-4f1a-b914-d9695a74b421 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 8331b81b-8f3a-4f61-b207-2d15d2bbb267 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:43.048352 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83ca69e2-5716-4f1a-b914-d9695a74b421 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/8331b81b-8f3a-4f61-b207-2d15d2bbb267/action" status: 404 len: 111 microversion: 2.1 time: 0.025367 Oct 22 03:13:43.049583 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1124/2260] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:43 2022] POST /compute/v2.1/servers/8331b81b-8f3a-4f61-b207-2d15d2bbb267/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:43.058001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:43.058638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:43.067835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.068390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.068851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.069579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.070076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.070677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.204176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:43.213216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:43.214669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:43.217201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d6034b64-60a1-4e4e-8774-8b156409d0b7 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 200 len: 1549 microversion: 2.25 time: 0.346580 Oct 22 03:13:43.218288 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1137/2261] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:42 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 1549 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:43.223055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-134ae50c-2781-40b5-a431-2570371c6887 req-3849697a-79fe-4f16-a6fc-b2ad1164c706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c61b591-09ae-4f8c-877a-972aefaf2591", "name": "network-vif-deleted", "tag": "93d2b602-d49e-42d9-b515-4384e2056ba0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:43.233154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-134ae50c-2781-40b5-a431-2570371c6887 req-3849697a-79fe-4f16-a6fc-b2ad1164c706 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.233870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-134ae50c-2781-40b5-a431-2570371c6887 req-3849697a-79fe-4f16-a6fc-b2ad1164c706 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.234582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-134ae50c-2781-40b5-a431-2570371c6887 req-3849697a-79fe-4f16-a6fc-b2ad1164c706 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.247041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-134ae50c-2781-40b5-a431-2570371c6887 req-3849697a-79fe-4f16-a6fc-b2ad1164c706 service nova] Creating event network-vif-deleted:93d2b602-d49e-42d9-b515-4384e2056ba0 for instance 1c61b591-09ae-4f8c-877a-972aefaf2591 on n-h1-862416-2 Oct 22 03:13:43.253216 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-134ae50c-2781-40b5-a431-2570371c6887 req-3849697a-79fe-4f16-a6fc-b2ad1164c706 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Oct 22 03:13:43.257085 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1138/2262] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:43.276315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:43.277101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:43.291924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.294890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.295505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.296349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.297773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.299321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.306395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:43.316858 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-186978b9-0787-4008-84e7-4e8f416edf96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.263319 Oct 22 03:13:43.342111 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1125/2263] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:43 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:43.354741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:43.355634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:43.362346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.363668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.364314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.365211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.365882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.366497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.544276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:43.560915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7fa19c9a-c942-4e1d-8c4e-0b33b447b87a tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.289351 Oct 22 03:13:43.572660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1139/2264] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:43 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:43.600143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:43.611165 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fca70e77-bb62-458b-9c55-1c00fcf70244 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.261702 Oct 22 03:13:43.616713 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1126/2265] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:43 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:43.628687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:43.629640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:43.636110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.636959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.637610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.638180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b9e9e1f-4b80-4171-a8f6-e95f504da85e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:43.638669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.638808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9b9e9e1f-4b80-4171-a8f6-e95f504da85e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: fb2b295b-619e-4660-93c2-28c4d671009f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:43.639417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.639949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.645429 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-9b9e9e1f-4b80-4171-a8f6-e95f504da85e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance fb2b295b-619e-4660-93c2-28c4d671009f could not be found. Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b9e9e1f-4b80-4171-a8f6-e95f504da85e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/fb2b295b-619e-4660-93c2-28c4d671009f HTTP/1.1 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance fb2b295b-619e-4660-93c2-28c4d671009f could not be found. Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'fb2b295b-619e-4660-93c2-28c4d671009f'} Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb2b295b-619e-4660-93c2-28c4d671009f could not be found. Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb2b295b-619e-4660-93c2-28c4d671009f could not be found. Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:43.646989 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:43.650305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:43.650305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:43.650305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:43.650305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb2b295b-619e-4660-93c2-28c4d671009f could not be found. Oct 22 03:13:43.650305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:43.650305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b9e9e1f-4b80-4171-a8f6-e95f504da85e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance fb2b295b-619e-4660-93c2-28c4d671009f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:43.650305 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b9e9e1f-4b80-4171-a8f6-e95f504da85e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/fb2b295b-619e-4660-93c2-28c4d671009f" status: 404 len: 111 microversion: 2.1 time: 0.014659 Oct 22 03:13:43.652515 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1127/2266] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:43 2022] GET /compute/v2.1/servers/fb2b295b-619e-4660-93c2-28c4d671009f => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:13:43.666723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:43.667495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:43.688058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.688586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.689035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.689766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:43.690404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:43.690837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:43.707584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:43.943010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:43.962664 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32248a08-66f1-42b2-824b-13f6218351e6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.300234 Oct 22 03:13:43.963340 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1128/2267] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:43 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:43.997557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:43.999052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:44.011163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:44.022978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.024482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.025030 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e264eac5-ba78-49b9-83e1-04851cca48e5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.398527 Oct 22 03:13:44.025581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.041667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.046146 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1140/2268] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:43 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:44.048796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.052834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.057977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:44.058954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:44.074854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.075995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.077430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.079893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.081742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.084803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.340395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:44.344134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:44.352120 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-abc47484-4181-4c6c-9633-13842c5ca59c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.360053 Oct 22 03:13:44.353733 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1129/2269] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:43 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:44.353855 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4229da13-7fd6-46ac-9137-c4191421eddc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.305820 Oct 22 03:13:44.355284 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1141/2270] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:44 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:44.364725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:44.367768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: 1c61b591-09ae-4f8c-877a-972aefaf2591] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:44.382090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.382733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.383292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.384263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.385045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.385576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.417561 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] HTTP exception thrown: Instance 1c61b591-09ae-4f8c-877a-972aefaf2591 could not be found. Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Request method failure captured: Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 HTTP/1.1 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU13oG4viltKolwDfU_1NX8L17Bi42bHNQ9NgtvCHNlYv0rXhxvKqg_vCLwySDA1TSb32JiJ42Bi-a4t_R--Ob9in8MlBOI-jkDEi3_veH7fRu4zjzGy6OpGHZNMU-UI48pfr-WzdPRRnse25KewgPw7xST87Qk4mQXKbVEa_I-B0ffk Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.25 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e33669cd6c0040cda12f8063688eacc4 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e33669cd6c0040cda12f8063688eacc4"}]}] Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e33669cd6c0040cda12f8063688eacc4 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-LiveAutoBlockMigrationV225Test-644726329-project Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2868158117ea4f7797f9931a97bcedfd Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-644726329-project Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 1c61b591-09ae-4f8c-877a-972aefaf2591 could not be found. Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1c61b591-09ae-4f8c-877a-972aefaf2591'} Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c61b591-09ae-4f8c-877a-972aefaf2591 could not be found. Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c61b591-09ae-4f8c-877a-972aefaf2591 could not be found. Oct 22 03:13:44.419271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c61b591-09ae-4f8c-877a-972aefaf2591 could not be found. Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Returning 404 to user: Instance 1c61b591-09ae-4f8c-877a-972aefaf2591 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:44.424732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18929e34-d69e-45b3-9ccd-f07e24fd8ef0 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591" status: 404 len: 111 microversion: 2.25 time: 0.066228 Oct 22 03:13:44.425897 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1130/2271] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:44 2022] GET /compute/v2.1/servers/1c61b591-09ae-4f8c-877a-972aefaf2591 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:44.434391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:44.435072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:44.448945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.451373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.451879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.454938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.455418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.455860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.493138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:13:44.527466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc030ef6-484a-4681-83f0-6a429bc03392 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1959365767", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc030ef6-484a-4681-83f0-6a429bc03392 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 238 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1959365767", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1959365767', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.550081 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 22 03:13:44.553963 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:44.558137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc030ef6-484a-4681-83f0-6a429bc03392 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:44.559879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:44.562091 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cc030ef6-484a-4681-83f0-6a429bc03392 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.039249 Oct 22 03:13:44.564125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1131/2272] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:44.574526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:44.575863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:44.587811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.588584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.589246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.590260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.590940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.592269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.631363 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a5bb70b9-1d84-43fd-aaaf-30539e6243ee tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 204 len: 0 microversion: 2.25 time: 0.201648 Oct 22 03:13:44.635425 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1142/2273] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:13:44 2022] DELETE /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:13:44.641709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:44.642412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:44.651926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.652784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.653423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.655044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.655764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.656919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.773025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:44.781277 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b21d999b-2342-4641-a115-f9b54cd32cae tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.212359 Oct 22 03:13:44.781846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1132/2274] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:44 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:44.787506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:44.788452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:44.795255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.796618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.797307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.798224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.799399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.800019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.838925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:44.848464 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4e811a89-be0c-4454-a858-341a8007e43b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.211766 Oct 22 03:13:44.849054 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1143/2275] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:44 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:44.854391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:44.855006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:44.866053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.866564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.866976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.867766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:44.868551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:44.869071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:44.987215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.000095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.001842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.003087 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8a7386b-8632-4eb8-a2cd-d2e7259b2837 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1563 microversion: 2.25 time: 0.220074 Oct 22 03:13:45.013860 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1133/2276] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:44 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:45.013860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:45.024292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.024292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Searching by: {'deleted': False, 'project_id': 'd3d30709037b42e9839252d0b366681a'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:13:45.024292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.024292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.024292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.025166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.025345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.025778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.045424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.056959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d7e8f1d-92b1-4a81-a07b-536cf90b9754 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.206716 Oct 22 03:13:45.058411 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1144/2277] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:44 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:45.059043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:13:45.067822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:45.069180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:45.090436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.091764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.092826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.094190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.095282 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-26c54402-2284-4676-9e68-f6079864f086 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.088898 Oct 22 03:13:45.095819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.096350 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1134/2278] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:13:45 2022] GET /compute/v2.1/servers => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:45.097003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.116551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:45.127941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.128744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Searching by: {'deleted': False, 'project_id': 'd3d30709037b42e9839252d0b366681a'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:13:45.134456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.135044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.135597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.136937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.137950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.138849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.295587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:13:45.319265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.337056 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b27296e6-ffdd-4c05-85bb-2fac09d51214 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.276994 Oct 22 03:13:45.352735 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1145/2279] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:45 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:45.359645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2b9f7e8-c105-4354-b5ec-53bf799c4a2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1209150796", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2b9f7e8-c105-4354-b5ec-53bf799c4a2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 235 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1209150796", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1209150796', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.367641 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 22 03:13:45.372012 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:45.375861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2b9f7e8-c105-4354-b5ec-53bf799c4a2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:45.377571 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2b9f7e8-c105-4354-b5ec-53bf799c4a2f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.023520 Oct 22 03:13:45.381890 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1146/2280] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:13:45 2022] POST /compute/v2.1/servers => generated 133 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:45.382445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.388299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:45.389270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:45.389433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.390090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.391225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.399287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.399951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.400500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.401528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.402235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.402918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.575532 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a5ac494a-7a44-457f-8e47-ebadc1e10062 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.468435 Oct 22 03:13:45.576403 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1135/2281] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:13:45 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:45.582552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:45.583158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:45.589694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.590221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.590666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.592169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.592696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.593136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.688443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.716922 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-092f9855-a2f1-4567-a435-9115d09c14ac tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.333358 Oct 22 03:13:45.717518 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1147/2282] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:45 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:45.725857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-03b0afcd-a3dc-4188-8495-878c3c10e393 req-64bb0e80-5ab2-4035-8f33-f2e85719890a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ac884a-4e4c-46eb-bed5-ff095d21ed4e", "name": "network-vif-plugged", "status": "completed", "tag": "e5c48f88-4317-4ffd-8341-8454067bd0fc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:45.744371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-03b0afcd-a3dc-4188-8495-878c3c10e393 req-64bb0e80-5ab2-4035-8f33-f2e85719890a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.744886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-03b0afcd-a3dc-4188-8495-878c3c10e393 req-64bb0e80-5ab2-4035-8f33-f2e85719890a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.745333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-03b0afcd-a3dc-4188-8495-878c3c10e393 req-64bb0e80-5ab2-4035-8f33-f2e85719890a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.761429 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-03b0afcd-a3dc-4188-8495-878c3c10e393 req-64bb0e80-5ab2-4035-8f33-f2e85719890a service nova] Creating event network-vif-plugged:e5c48f88-4317-4ffd-8341-8454067bd0fc for instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e on n-h1-862416-2 Oct 22 03:13:45.769044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-03b0afcd-a3dc-4188-8495-878c3c10e393 req-64bb0e80-5ab2-4035-8f33-f2e85719890a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048139 Oct 22 03:13:45.769903 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1148/2283] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:45.776891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ed9061c6-dcd9-4c07-88c1-af7b4b8543ff tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:45.780128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:45.787090 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ed9061c6-dcd9-4c07-88c1-af7b4b8543ff tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015816 Oct 22 03:13:45.788743 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1149/2284] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:13:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:45.789218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73af1910-9e6b-4fca-8b5e-99265f38f869 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.211694 Oct 22 03:13:45.789909 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1136/2285] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:45 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:45.813525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:45.814540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:45.820993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.821488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.821931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.822641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.823097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.823524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.874093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:45.876024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:45.882337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.882816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.883249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:45.883953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:45.884439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:45.884862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.020163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.028810 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83124abc-c0e0-4e28-87cf-5296281be0f6 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.158635 Oct 22 03:13:46.029514 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1137/2286] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:45 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:46.040830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:46.041440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.048629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.049067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.049508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.050219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.050673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.051102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.080148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.107799 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bbde09f8-ad94-4b13-8182-9f029d3f5b37 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.298571 Oct 22 03:13:46.124238 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1150/2287] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:45 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:46.136990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:46.137742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.151852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.152810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.153560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.154554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.155317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.155864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.186811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:13:46.310911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.321909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:46.332874 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1fa3850c-fd24-4d16-8c3c-f1183f613ef3 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 204 len: 0 microversion: 2.1 time: 0.199075 Oct 22 03:13:46.332874 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1151/2288] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:13:46 2022] DELETE /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:13:46.337935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.339990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.341517 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-00d5bc12-76af-43dc-a399-24d569c71f0f tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1563 microversion: 2.25 time: 0.307648 Oct 22 03:13:46.356460 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1138/2289] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:46 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1563 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:13:46.356573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12406346-44d7-49c5-85f9-6dd98f058b47 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:46.356573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12406346-44d7-49c5-85f9-6dd98f058b47 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: f093bc82-aff7-4671-abb9-ef24fc3b0046] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.356748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:46.356748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.356908 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-12406346-44d7-49c5-85f9-6dd98f058b47 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance f093bc82-aff7-4671-abb9-ef24fc3b0046 could not be found. Oct 22 03:13:46.356991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.357453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.358115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.359138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12406346-44d7-49c5-85f9-6dd98f058b47 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/f093bc82-aff7-4671-abb9-ef24fc3b0046/action HTTP/1.1 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 13 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: {"pause": {}} Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f093bc82-aff7-4671-abb9-ef24fc3b0046 could not be found. Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f093bc82-aff7-4671-abb9-ef24fc3b0046', 'body': {'pause': {}}} Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f093bc82-aff7-4671-abb9-ef24fc3b0046 could not be found. Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f093bc82-aff7-4671-abb9-ef24fc3b0046 could not be found. Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:46.359249 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f093bc82-aff7-4671-abb9-ef24fc3b0046 could not be found. Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12406346-44d7-49c5-85f9-6dd98f058b47 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance f093bc82-aff7-4671-abb9-ef24fc3b0046 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-12406346-44d7-49c5-85f9-6dd98f058b47 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/f093bc82-aff7-4671-abb9-ef24fc3b0046/action" status: 404 len: 111 microversion: 2.1 time: 0.022137 Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1152/2290] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:46 2022] POST /compute/v2.1/servers/f093bc82-aff7-4671-abb9-ef24fc3b0046/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:46.368331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.370671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.371345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.375781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.376295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.376732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.377428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.379052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.379630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.533971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.543048 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-71c171f5-b117-4536-893f-5f484917a7a0 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1607 microversion: 2.1 time: 0.199128 Oct 22 03:13:46.543851 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1139/2291] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:46 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1607 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:46.549561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:46.550256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.557277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.557277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.558412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.559714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.559714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.560304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.626872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.635569 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1de7415e-1a74-4097-a242-c5cecc37db6e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1311 microversion: 2.1 time: 0.273005 Oct 22 03:13:46.636492 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1153/2292] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:46 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:46.725982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.735146 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-33419c93-10f1-42d7-a3fe-77bfb78a17aa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.189416 Oct 22 03:13:46.742448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:46.743148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.746831 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1140/2293] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:46 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:46.752311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.753125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.753778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.754881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.755502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.756013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.760960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:46.761764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.770524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.770960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.771403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.772135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.772605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.773042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.927474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:46.936483 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a6681d5-535b-4cd7-929d-08189361f02a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.180474 Oct 22 03:13:46.937931 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1141/2294] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:46 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:46.961238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:46.961882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:46.968044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.969164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.969745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:46.970597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:46.971150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:46.971982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.033348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:47.043073 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-71315929-8090-4602-82b4-623e09dcf597 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.304395 Oct 22 03:13:47.043664 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1154/2295] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:46 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:47.056844 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-222dff2c-d511-4d4d-bbdc-feb9877a31fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 202 len: 0 microversion: 2.1 time: 0.099302 Oct 22 03:13:47.065214 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1142/2296] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:46 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:47.068364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:47.069915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:47.070850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:47.071560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:47.079878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.080427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.081102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.082621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.083273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.083919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.094649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.095172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.098264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.099022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.099553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.103841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.252372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:47.269381 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-feb7c7ba-106f-4151-9dac-111dc3d04376 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1511 microversion: 2.1 time: 0.202672 Oct 22 03:13:47.269824 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1143/2297] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:47 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:47.385319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:47.386030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:47.395096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.395695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.396198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.396940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.397390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.397816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.404580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:47.416991 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50835ab5-ad1b-43cb-bb80-0b883000a341 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.367314 Oct 22 03:13:47.428793 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1155/2298] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:47 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:47.574467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:47.576161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:47.585174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.585663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.586103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.586989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.587449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.587873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.666225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:47.670371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:47.682198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:47.683972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:47.685201 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ad84095-d9f1-4e07-a850-a8fc3a2884ef tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1563 microversion: 2.25 time: 0.315850 Oct 22 03:13:47.688594 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1144/2299] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:47 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1563 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:47.691257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:47.691904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:47.700086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.701091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.701609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.702390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.703440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.703933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.877786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:47.885697 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-40265777-4c7e-43df-a52d-79c792930141 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1493 microversion: 2.1 time: 0.198588 Oct 22 03:13:47.886270 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1145/2300] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:47 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1493 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:47.891236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4f0c095c-9196-4f76-90bc-d3a73ce27543 req-faddea1b-9704-48b7-902e-2ab2fc8afcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bcace45-2b9b-4d3f-b68c-06ca98c4a3df", "name": "network-vif-plugged", "status": "completed", "tag": "5dc7dda7-0c84-47ba-b8e3-ffc2f5a98839"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:47.900846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4f0c095c-9196-4f76-90bc-d3a73ce27543 req-faddea1b-9704-48b7-902e-2ab2fc8afcd5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.901331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4f0c095c-9196-4f76-90bc-d3a73ce27543 req-faddea1b-9704-48b7-902e-2ab2fc8afcd5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.901926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4f0c095c-9196-4f76-90bc-d3a73ce27543 req-faddea1b-9704-48b7-902e-2ab2fc8afcd5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.914140 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4f0c095c-9196-4f76-90bc-d3a73ce27543 req-faddea1b-9704-48b7-902e-2ab2fc8afcd5 service nova] Creating event network-vif-plugged:5dc7dda7-0c84-47ba-b8e3-ffc2f5a98839 for instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df on n-h2-862416-2 Oct 22 03:13:47.915728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:47.919480 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4f0c095c-9196-4f76-90bc-d3a73ce27543 req-faddea1b-9704-48b7-902e-2ab2fc8afcd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Oct 22 03:13:47.920188 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1146/2301] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:47.924952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:47.925741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:47.928301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08be39a8-0d1d-444e-85b1-70d6a68d08ca tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1607 microversion: 2.1 time: 0.363626 Oct 22 03:13:47.929110 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1156/2302] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:47 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1607 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:47.931945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.932571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.933054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:47.933860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:47.934397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:47.934915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.071748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:48.072811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:48.082667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90ea7e8c-5a56-48ad-adab-382d4d1178f4 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1644 microversion: 2.1 time: 0.161345 Oct 22 03:13:48.084259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.085079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.085768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.086937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.088049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.088773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.116333 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1147/2303] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:47 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1644 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:48.126354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:48.127010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:48.137260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.137768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.138223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.139013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.139471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.139904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.306892 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-de7b0fc4-f767-4b3e-8d14-00565cb6e896 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1644 microversion: 2.1 time: 0.186983 Oct 22 03:13:48.317904 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1148/2304] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:48 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1644 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:48.332645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:48.333613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:48.336465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:48.340685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.341413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.342075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.343870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.345238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.345965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.347642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8829cb68-9582-4e6f-b29d-3be8a0abcf7a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.283596 Oct 22 03:13:48.349181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1157/2305] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:48 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:48.354827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db8ae692-1113-404e-a898-f101bdc49f31 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:48.360481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db8ae692-1113-404e-a898-f101bdc49f31 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.362216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db8ae692-1113-404e-a898-f101bdc49f31 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.362857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db8ae692-1113-404e-a898-f101bdc49f31 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.364704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db8ae692-1113-404e-a898-f101bdc49f31 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.365507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db8ae692-1113-404e-a898-f101bdc49f31 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.366648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db8ae692-1113-404e-a898-f101bdc49f31 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.404197 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db8ae692-1113-404e-a898-f101bdc49f31 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053396 Oct 22 03:13:48.405128 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1158/2306] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:13:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:48.420339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:48.421087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:48.438195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.438368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.438962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.444656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.445456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.446200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.608354 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7977b8b2-c54a-4df3-8c72-63a5efc01084 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e/action" status: 202 len: 0 microversion: 2.1 time: 0.193372 Oct 22 03:13:48.613859 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1159/2307] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:48 2022] POST /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:48.620398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:48.621452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:48.631975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.646173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.647253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.649974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.649974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.651844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.666228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:48.678478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1fc1560-2d21-46b9-917e-2bad0451f8ff tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1511 microversion: 2.1 time: 0.351770 Oct 22 03:13:48.699548 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1149/2308] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:48 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:48.713758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:48.714645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:48.721826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.722326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.722765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.723477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.723928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.728634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.914478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:48.927374 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9cd74e4f-a785-4002-a67a-6edb709826ff tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.312228 Oct 22 03:13:48.929524 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1160/2309] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:48 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:48.941891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:48.943428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:48.963096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.964160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.964900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.965868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:48.966539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:48.967177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:48.973453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:49.143368 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7afbd336-f3de-44c4-8a33-f4c512dfe359 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1649 microversion: 2.1 time: 0.442636 Oct 22 03:13:49.147578 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1150/2310] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:48 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1649 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:49.161629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:49.162259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:49.184583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:49.194891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:49.195367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:49.196355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:49.196872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:49.197608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:49.340923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:49.354762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:49.356251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:49.363982 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7363adeb-05ce-4a61-b0d3-99db2fdeb94c tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1563 microversion: 2.25 time: 0.433024 Oct 22 03:13:49.364542 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1161/2311] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:48 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1563 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:49.379388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:49.380011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:49.394958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:49.395471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:49.395921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:49.399663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:49.400159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:49.400640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:49.528786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:49.541218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c96b4b0-dc93-4f82-a4ec-867eb6f9be56 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1607 microversion: 2.1 time: 0.388176 Oct 22 03:13:49.541839 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1151/2312] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:49 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1607 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:49.708448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:49.709497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:49.728481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:49.728481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:49.729097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:49.729855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:49.730304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:49.733241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:49.740467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:49.743597 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97225819-f470-4724-8252-6bec40f231b9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.368138 Oct 22 03:13:49.744241 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1162/2313] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:49 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:49.961863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:49.963135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:49.981400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:49.982152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:49.982795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:49.985237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:49.988429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:49.989161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:50.030500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:50.039843 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2b27d599-0e2c-43cc-87b1-17c6cdbeead3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1491 microversion: 2.1 time: 0.337772 Oct 22 03:13:50.041108 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1152/2314] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:49 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1491 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:50.069271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:50.070666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:50.077091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:50.077946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:50.079333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:50.080299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:50.080989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:50.081627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:50.108523 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Cannot 'pause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state paused Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action HTTP/1.1 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 13 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: {"pause": {}} Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot 'pause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state paused Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'pause': {}}} Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 in vm_state paused. Cannot pause while the instance is in this state. Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state paused Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:50.111422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:50.115335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:50.115335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:50.115335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:50.115335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state paused Oct 22 03:13:50.115335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:50.117320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 409 to user: Cannot 'pause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state paused {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:50.119338 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4bd34488-c936-4a57-9188-20d4c5af2d17 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 409 len: 143 microversion: 2.1 time: 0.054102 Oct 22 03:13:50.120353 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1153/2315] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:50 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 143 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:13:50.130354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:50.131289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:50.139482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:50.140541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:50.141478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:50.143529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:50.144721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:50.145419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:50.263664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:50.268991 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ce08b1ad-e899-4563-b3e0-d45faa26d019 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 202 len: 0 microversion: 2.1 time: 0.140414 Oct 22 03:13:50.271412 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1154/2316] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:50 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:50.280551 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6179ab60-c84b-4cc9-878e-6fc1b56fd60f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1369 microversion: 2.1 time: 0.329424 Oct 22 03:13:50.285269 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1163/2317] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:49 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1369 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:13:50.290491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:50.291292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:50.300705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:50.301420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:50.307217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:50.307727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:50.308248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:50.308913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:50.313393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:50.314828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:50.323475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:50.327440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:50.329465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:50.331290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:50.346728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:50.361443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.177895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:51.193712 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7aeca25c-ef2a-474f-8762-7ab887090173 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1498 microversion: 2.1 time: 0.904337 Oct 22 03:13:51.194799 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1164/2318] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:50 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1498 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:51.203297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:51.215981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:51.229167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.229948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.230606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.232155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.232994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.234078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.286447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.286934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.287361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.287818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lazy-loading 'fault' on Instance uuid dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:13:51.373627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:51.392437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:51.394765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2868158117ea4f7797f9931a97bcedfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33669cd6c0040cda12f8063688eacc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:51.396544 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0aefafaf-6cf9-40c0-b4a3-bde5a7f7c3c1 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 200 len: 1351 microversion: 2.25 time: 0.200505 Oct 22 03:13:51.397915 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1165/2319] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:51 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 1351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:13:51.403005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:51.403859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:51.423093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.424815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.425475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.426415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.428277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.428938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.472816 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a407325c-38ce-489d-b6f8-8dca16f220fe tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1629 microversion: 2.1 time: 1.197583 Oct 22 03:13:51.475429 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1155/2320] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:50 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1629 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:51.483334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-31c8f28f-728c-4f19-a0b8-c0a702f827ed req-e3b384b4-c520-42c2-aeb3-391d21a51279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992", "name": "network-vif-deleted", "tag": "212bb93a-8709-465c-8065-5f0349088f1a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:51.505562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-31c8f28f-728c-4f19-a0b8-c0a702f827ed req-e3b384b4-c520-42c2-aeb3-391d21a51279 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.506891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-31c8f28f-728c-4f19-a0b8-c0a702f827ed req-e3b384b4-c520-42c2-aeb3-391d21a51279 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.507432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-31c8f28f-728c-4f19-a0b8-c0a702f827ed req-e3b384b4-c520-42c2-aeb3-391d21a51279 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.523866 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-31c8f28f-728c-4f19-a0b8-c0a702f827ed req-e3b384b4-c520-42c2-aeb3-391d21a51279 service nova] Creating event network-vif-deleted:212bb93a-8709-465c-8065-5f0349088f1a for instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 on n-h2-862416-2 Oct 22 03:13:51.529844 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-31c8f28f-728c-4f19-a0b8-c0a702f827ed req-e3b384b4-c520-42c2-aeb3-391d21a51279 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051369 Oct 22 03:13:51.532407 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1156/2321] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:51.538178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:51.539134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:51.546691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.547412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.547949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.548913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.549558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.549991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.567277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:51.600791 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b457af6-16e8-4665-908c-c9291bb87383 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1541 microversion: 2.1 time: 0.201480 Oct 22 03:13:51.603338 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1166/2322] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:51 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1541 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:51.617257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:51.635857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:51.654858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.657111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.657612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.658616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.659092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.659689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.877332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:51.886549 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e60b209d-78d1-4e10-89db-1dc97f56f542 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.352579 Oct 22 03:13:51.887151 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1157/2323] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:51 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:51.915087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6168f60c-97a7-4532-a85b-c9d0174ed8d5 req-106452d2-78bd-4093-a2ea-fe385818bc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f265234-6754-4073-93cc-ee1a65ffab52", "name": "network-vif-deleted", "tag": "ec5cf3ed-8426-4959-9a3d-b9d84dcfe1d2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:51.938521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6168f60c-97a7-4532-a85b-c9d0174ed8d5 req-106452d2-78bd-4093-a2ea-fe385818bc1b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:51.939262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6168f60c-97a7-4532-a85b-c9d0174ed8d5 req-106452d2-78bd-4093-a2ea-fe385818bc1b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:51.939846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6168f60c-97a7-4532-a85b-c9d0174ed8d5 req-106452d2-78bd-4093-a2ea-fe385818bc1b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:51.968704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6168f60c-97a7-4532-a85b-c9d0174ed8d5 req-106452d2-78bd-4093-a2ea-fe385818bc1b service nova] Creating event network-vif-deleted:ec5cf3ed-8426-4959-9a3d-b9d84dcfe1d2 for instance 4f265234-6754-4073-93cc-ee1a65ffab52 on n-h2-862416-2 Oct 22 03:13:51.980107 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6168f60c-97a7-4532-a85b-c9d0174ed8d5 req-106452d2-78bd-4093-a2ea-fe385818bc1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077477 Oct 22 03:13:51.981015 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1158/2324] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:51.997523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:52.001287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:52.006735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:52.010726 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1362ce0e-4331-4997-b891-b749a081c34b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1555 microversion: 2.1 time: 0.405381 Oct 22 03:13:52.016233 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1167/2325] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:51 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1555 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:52.029349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5113308f-5ca1-47c2-9416-01e0fb411f2e req-0e5717d9-4455-4ceb-9dce-196125231238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2411dd-1a42-4047-90ab-5e6bb098541a", "name": "network-vif-plugged", "status": "completed", "tag": "27c46b57-feba-40bd-95ee-929c50f6d0e4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:52.042638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:52.043527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:52.044167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:52.045250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:52.045900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:52.047057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:52.057923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5113308f-5ca1-47c2-9416-01e0fb411f2e req-0e5717d9-4455-4ceb-9dce-196125231238 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:52.059737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5113308f-5ca1-47c2-9416-01e0fb411f2e req-0e5717d9-4455-4ceb-9dce-196125231238 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:52.060341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5113308f-5ca1-47c2-9416-01e0fb411f2e req-0e5717d9-4455-4ceb-9dce-196125231238 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:52.080616 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5113308f-5ca1-47c2-9416-01e0fb411f2e req-0e5717d9-4455-4ceb-9dce-196125231238 service nova] Creating event network-vif-plugged:27c46b57-feba-40bd-95ee-929c50f6d0e4 for instance ba2411dd-1a42-4047-90ab-5e6bb098541a on n-h2-862416-2 Oct 22 03:13:52.094988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lazy-loading 'flavor' on Instance uuid 25ac884a-4e4c-46eb-bed5-ff095d21ed4e {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:13:52.101914 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5113308f-5ca1-47c2-9416-01e0fb411f2e req-0e5717d9-4455-4ceb-9dce-196125231238 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071542 Oct 22 03:13:52.103509 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1168/2326] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:52.121516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:52.124575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:52.144180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:52.145074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:52.145729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:52.146654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:52.151247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:52.151919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:52.161372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Going to try to live migrate instance to n-h2-862416-2 {{(pid=120582) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:13:52.439242 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c79e2644-d710-4244-b276-b1eed90481e9 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332642 Oct 22 03:13:52.440317 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1169/2327] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:13:52 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-interface => generated 284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:52.446691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:52.446691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:52.480933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:52.481511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:52.482032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:52.482833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:52.483298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:52.483735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:53.123090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:53.134679 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-66084ad0-501f-4c9b-9d98-2b2543a7214f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.693160 Oct 22 03:13:53.135279 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1170/2328] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:52 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:53.142847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:53.143463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] [instance: dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:53.161948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:53.162490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:53.162925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:53.163687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:53.164155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:53.164682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:53.204866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] HTTP exception thrown: Instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 could not be found. Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Request method failure captured: Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 HTTP/1.1 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU13oG4viltKolwDfU_1NX8L17Bi42bHNQ9NgtvCHNlYv0rXhxvKqg_vCLwySDA1TSb32JiJ42Bi-a4t_R--Ob9in8MlBOI-jkDEi3_veH7fRu4zjzGy6OpGHZNMU-UI48pfr-WzdPRRnse25KewgPw7xST87Qk4mQXKbVEa_I-B0ffk Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.25 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e33669cd6c0040cda12f8063688eacc4 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e33669cd6c0040cda12f8063688eacc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e33669cd6c0040cda12f8063688eacc4"}]}] Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e33669cd6c0040cda12f8063688eacc4 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-644726329 Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-LiveAutoBlockMigrationV225Test-644726329-project Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2868158117ea4f7797f9931a97bcedfd Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-644726329-project Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 could not be found. Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992'} Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 could not be found. Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 could not be found. Oct 22 03:13:53.207074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 could not be found. Oct 22 03:13:53.211374 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:53.212888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] Returning 404 to user: Instance dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:53.213914 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd4d1907-4b3d-4ce3-a4dd-0826317e0566 tempest-LiveAutoBlockMigrationV225Test-644726329 tempest-LiveAutoBlockMigrationV225Test-644726329-project] 10.222.0.25 "GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992" status: 404 len: 111 microversion: 2.25 time: 0.077708 Oct 22 03:13:53.215737 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1171/2329] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:13:53 2022] GET /compute/v2.1/servers/dc73640d-f9eb-4ea8-a0d8-d9fae1bbf992 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:13:53.225464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:53.229695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:53.248350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:53.249092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:53.250463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:53.251367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:53.251991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:53.252601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:53.445451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:53.459469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba67c67e-66d1-4ca1-be1d-37afd5603660 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1253 microversion: 2.1 time: 0.239727 Oct 22 03:13:53.464944 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1172/2330] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:53 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1253 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:53.471463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:53.474572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:53.504515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:53.506182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:53.509345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:53.510252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:53.514063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:53.514688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.088477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:54.097555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e3e73be-9810-474c-b361-d853ddebad44 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1317 microversion: 2.1 time: 0.631324 Oct 22 03:13:54.098714 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1173/2331] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:53 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:54.103823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:54.110024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:54.125704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.129083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.130406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.131372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.132043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.132937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.398073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:54.417224 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4de4367-9710-402a-a36c-16081835b747 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.313937 Oct 22 03:13:54.417985 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1174/2332] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:54 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:54.441189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:54.443903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:54.460558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.465029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.466574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.468924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.469546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.471351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.526678 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110/action HTTP/1.1 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 28 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: {"reboot": {"type": "SOFT"}} Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a83f771c-10b0-428a-b06e-dc6ff3241110', 'body': {'reboot': {'type': 'SOFT'}}} Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:54.529743 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:54.534224 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:54.538814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:54.539886 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a09d5c51-5b8d-49f9-9b23-b4ea6192209e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110/action" status: 404 len: 111 microversion: 2.1 time: 0.102994 Oct 22 03:13:54.540985 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1175/2333] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:54 2022] POST /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110/action => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:13:54.546977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:54.548032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:54.557640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.558299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.558883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.559738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.560369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.561129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.669506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:54.679450 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1c7e6fea-2ca1-46d6-8c21-73e3e510266e tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1253 microversion: 2.1 time: 0.137197 Oct 22 03:13:54.680284 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1176/2334] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:54 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1253 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:54.685073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:54.685939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:54.693203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.694341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.694979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.695866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.696509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.697552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.868077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:54.878865 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-88bc812c-9f13-4031-b318-33cd2ad73db1 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.197348 Oct 22 03:13:54.881618 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1177/2335] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:54 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:54.888257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d1025430-71e6-4d15-aa50-78c6b18b71bb req-098267ca-9ebf-46ba-a107-6c3dfadb1f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bcace45-2b9b-4d3f-b68c-06ca98c4a3df", "tag": "5dc7dda7-0c84-47ba-b8e3-ffc2f5a98839"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:54.899882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1025430-71e6-4d15-aa50-78c6b18b71bb req-098267ca-9ebf-46ba-a107-6c3dfadb1f31 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:54.900490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1025430-71e6-4d15-aa50-78c6b18b71bb req-098267ca-9ebf-46ba-a107-6c3dfadb1f31 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:54.901144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1025430-71e6-4d15-aa50-78c6b18b71bb req-098267ca-9ebf-46ba-a107-6c3dfadb1f31 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:54.915755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d1025430-71e6-4d15-aa50-78c6b18b71bb req-098267ca-9ebf-46ba-a107-6c3dfadb1f31 service nova] Creating event network-changed:5dc7dda7-0c84-47ba-b8e3-ffc2f5a98839 for instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df on n-h2-862416-2 Oct 22 03:13:54.922000 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d1025430-71e6-4d15-aa50-78c6b18b71bb req-098267ca-9ebf-46ba-a107-6c3dfadb1f31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038475 Oct 22 03:13:54.928166 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1178/2336] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:55.095124 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41093e47-fd8a-4f91-93ea-fd7916cef3e7 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e/action" status: 202 len: 0 microversion: 2.1 time: 3.112619 Oct 22 03:13:55.096255 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1159/2337] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:51 2022] POST /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e/action => generated 0 bytes in 3114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:13:55.109662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:55.111382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:55.159764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:55.165899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:55.166385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:55.167206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:55.172505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:55.176816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:55.271520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e38070d-7167-402c-a95b-6595def6d6b5 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Action: 'create', calling method: .version_select at 0x7f0d196ebaf0>, body: {"pool": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:55.304551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:55.380809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:55.852026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:55.855313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:55.869867 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d4a2e0c1-2daa-47fc-80ad-a56626318a3e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.767675 Oct 22 03:13:55.891112 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1160/2338] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:55 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:55.897888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:55.899982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:55.915263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:55.915787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:55.916253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:55.917647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:55.918798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:55.919237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:56.684118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:56.694127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4be48c03-c059-425a-a702-9a276f721efc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.801063 Oct 22 03:13:56.698108 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1161/2339] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:55 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:56.709898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:56.713327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:56.725356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:56.728297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:56.729938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:56.732978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:56.733613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:56.735685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:57.368312 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e38070d-7167-402c-a95b-6595def6d6b5 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.438559 Oct 22 03:13:57.368974 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1179/2340] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:13:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:57.374222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:57.376540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:57.385420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:57.386184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:57.386753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:57.387667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:57.388292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:57.388861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:57.469036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:57.480743 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9dfca202-78b8-4af2-9780-66ca9b07bf1a tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1253 microversion: 2.1 time: 0.110310 Oct 22 03:13:57.482553 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1180/2341] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:57 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1253 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:57.498736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-909cc5b1-5121-4cbc-bb09-1344faa23ba7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:57.502267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-909cc5b1-5121-4cbc-bb09-1344faa23ba7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: e4e2997a-0ebb-4244-b2d9-059369ebb2e1] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:57.509642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-909cc5b1-5121-4cbc-bb09-1344faa23ba7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance e4e2997a-0ebb-4244-b2d9-059369ebb2e1 could not be found. Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-909cc5b1-5121-4cbc-bb09-1344faa23ba7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/e4e2997a-0ebb-4244-b2d9-059369ebb2e1/action HTTP/1.1 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 28 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: {"reboot": {"type": "SOFT"}} Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance e4e2997a-0ebb-4244-b2d9-059369ebb2e1 could not be found. Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e4e2997a-0ebb-4244-b2d9-059369ebb2e1', 'body': {'reboot': {'type': 'SOFT'}}} Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e2997a-0ebb-4244-b2d9-059369ebb2e1 could not be found. Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e2997a-0ebb-4244-b2d9-059369ebb2e1 could not be found. Oct 22 03:13:57.511526 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e2997a-0ebb-4244-b2d9-059369ebb2e1 could not be found. Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-909cc5b1-5121-4cbc-bb09-1344faa23ba7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance e4e2997a-0ebb-4244-b2d9-059369ebb2e1 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-909cc5b1-5121-4cbc-bb09-1344faa23ba7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/e4e2997a-0ebb-4244-b2d9-059369ebb2e1/action" status: 404 len: 111 microversion: 2.1 time: 0.029368 Oct 22 03:13:57.516235 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1181/2342] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:57 2022] POST /compute/v2.1/servers/e4e2997a-0ebb-4244-b2d9-059369ebb2e1/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:57.521504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-49d8ed25-868b-4f40-a7c0-65af0114692d tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Calling method '.version_select at 0x7f0d1976ce50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:57.594682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:57.604257 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cb02edfd-f583-4433-a8b4-7b347a665e6e tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1466 microversion: 2.1 time: 0.904265 Oct 22 03:13:57.605592 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1162/2343] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:56 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1466 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:57.611067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:57.612426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:57.620488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:57.621201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:57.622098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:57.623429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:57.624048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:57.626623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:57.817183 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-49d8ed25-868b-4f40-a7c0-65af0114692d tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/8d669841-ba18-4371-84db-9aaf070a75cd" status: 200 len: 142 microversion: 2.1 time: 0.301421 Oct 22 03:13:57.818765 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1182/2344] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:13:57 2022] GET /compute/v2.1/os-floating-ips/8d669841-ba18-4371-84db-9aaf070a75cd => generated 142 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:57.831418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-133529104", "metadata": {"image_type": "test"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:57.834591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:57.852696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:57.854094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:57.854704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:57.856765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:57.857667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:57.858308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:57.894839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:57.938716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Getting quotas for project 08a29e66084f4621bfec65de1c77d3ef. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:13:57.945777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Getting quotas for user a214582bec4040d3a315b687fb8f972a and project 08a29e66084f4621bfec65de1c77d3ef. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:13:58.282951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:58.299756 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-558b123e-5071-4aee-a135-09f9c5b874b7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.692915 Oct 22 03:13:58.305699 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1163/2345] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:57 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:58.354087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:58.362970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:58.380697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:58.401557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:58.402255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:58.404893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:58.407291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:58.407962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:58.409300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:58.647535 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81d122e1-009a-485f-8186-a19f95e2a9bb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "POST /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a/action" status: 202 len: 0 microversion: 2.1 time: 0.810362 Oct 22 03:13:58.650509 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1183/2346] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:57 2022] POST /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 03:13:58.682254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1148512f-342b-43a0-91dd-c0f7e0c71866 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Calling method '.version_select at 0x7f0d1976c550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:58.908670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:58.916818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-349b4493-469c-467b-9306-6936aa7cd876 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.609733 Oct 22 03:13:58.927343 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1164/2347] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:58 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:58.937982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:58.939250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:58.954596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:58.957067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:58.957718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:58.962559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:58.963247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:58.964681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:59.307010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:59.320711 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-40dc89a8-3e23-4017-bc0b-dc808a8d79ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.392065 Oct 22 03:13:59.323663 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1165/2348] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:58 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:59.331973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:59.353006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:59.362725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:13:59.364238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:59.364786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:59.365311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:59.366045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:59.366688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:59.367676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:59.472486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:13:59.485054 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f89a1921-4113-467f-8f08-d6c938a83cb7 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1253 microversion: 2.1 time: 0.159664 Oct 22 03:13:59.488604 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1166/2349] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:59 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1253 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:59.500736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-daa07d87-7a13-45f5-a342-deccc8f064ae tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a4ffc10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:59.559912 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-daa07d87-7a13-45f5-a342-deccc8f064ae tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.069293 Oct 22 03:13:59.561115 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1167/2350] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:13:59 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:13:59.566119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b2003679-db0e-4338-a276-66e1dbca0176 req-f107c181-be3b-4bac-bac9-b97eb6a051c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ac884a-4e4c-46eb-bed5-ff095d21ed4e", "name": "network-vif-unplugged", "status": "completed", "tag": "e5c48f88-4317-4ffd-8341-8454067bd0fc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:59.576180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b2003679-db0e-4338-a276-66e1dbca0176 req-f107c181-be3b-4bac-bac9-b97eb6a051c5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:59.576929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b2003679-db0e-4338-a276-66e1dbca0176 req-f107c181-be3b-4bac-bac9-b97eb6a051c5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:59.578109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b2003679-db0e-4338-a276-66e1dbca0176 req-f107c181-be3b-4bac-bac9-b97eb6a051c5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:59.592696 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b2003679-db0e-4338-a276-66e1dbca0176 req-f107c181-be3b-4bac-bac9-b97eb6a051c5 service nova] Creating event network-vif-unplugged:e5c48f88-4317-4ffd-8341-8454067bd0fc for instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e on n-h1-862416-2 Oct 22 03:13:59.598413 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b2003679-db0e-4338-a276-66e1dbca0176 req-f107c181-be3b-4bac-bac9-b97eb6a051c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035718 Oct 22 03:13:59.599649 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1168/2351] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:13:59.606589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:13:59.611949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:59.622061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:59.622788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:59.623423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:59.624500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:59.625122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:59.625712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:59.645021 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110/action HTTP/1.1 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 65 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'a83f771c-10b0-428a-b06e-dc6ff3241110', 'body': {'rebuild': {'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046'}}} Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 22 03:13:59.647032 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:13:59.651248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-978db93e-2a22-44e2-b6de-f113a3474afe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110/action" status: 404 len: 111 microversion: 2.1 time: 0.046692 Oct 22 03:13:59.652767 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1169/2352] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:13:59 2022] POST /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:13:59.658136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:13:59.658947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:13:59.667281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:59.668036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:59.668660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:13:59.669545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:13:59.670724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:13:59.674319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:00.007158 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1148512f-342b-43a0-91dd-c0f7e0c71866 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.354530 Oct 22 03:14:00.019248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1184/2353] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:13:58 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:00.020237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:00.022126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:00.022700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:00.043725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:00.044253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:00.044687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:00.045579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:00.045849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:00.046336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:00.051424 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ec78ef6f-2295-4e9c-bf95-06a177be728d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.396099 Oct 22 03:14:00.064248 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1170/2354] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:13:59 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:00.064248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18d88df1-2457-4b99-970e-a7b361022e0c tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Calling method '.version_select at 0x7f0d1a61f940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:00.533149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:00.547441 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-89ceabf6-42a7-41e6-8597-1464b5d0d960 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.533614 Oct 22 03:14:00.548056 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1185/2355] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:00 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:00.568133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:00.568133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:00.568133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:00.568133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:00.568133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:00.568133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:00.568133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:00.568133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.024949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:01.038878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f420e4c-f489-48f0-a97d-ec8ada840a0e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.488334 Oct 22 03:14:01.040158 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1186/2356] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:00 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:01.048348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:01.049283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:01.061450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.063801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.064550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.066399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.067160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.067657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.115755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.116405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.116853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.117411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lazy-loading 'fault' on Instance uuid 4f265234-6754-4073-93cc-ee1a65ffab52 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:14:01.180568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2620c42cb94cf6a8b3f64faa91cfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d30709037b42e9839252d0b366681a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:01.194639 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa3f010b-2359-49ae-9d5e-d8671f68dfab tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 200 len: 1258 microversion: 2.1 time: 0.153055 Oct 22 03:14:01.197140 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1187/2357] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:01 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:01.202128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ededfbd7-fb71-4b54-9e4e-ae91ad19927f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1975cdc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:01.257733 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ededfbd7-fb71-4b54-9e4e-ae91ad19927f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.059302 Oct 22 03:14:01.258867 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1188/2358] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:01 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:01.264488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e37c7fcb-59e3-4c09-9530-b08fdd54bc19 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:01.268336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e37c7fcb-59e3-4c09-9530-b08fdd54bc19 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 7ea13708-527e-4621-93eb-c3e2316c7491] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:01.274719 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e37c7fcb-59e3-4c09-9530-b08fdd54bc19 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 7ea13708-527e-4621-93eb-c3e2316c7491 could not be found. Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e37c7fcb-59e3-4c09-9530-b08fdd54bc19 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/7ea13708-527e-4621-93eb-c3e2316c7491/action HTTP/1.1 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 65 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 7ea13708-527e-4621-93eb-c3e2316c7491 could not be found. Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '7ea13708-527e-4621-93eb-c3e2316c7491', 'body': {'rebuild': {'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046'}}} Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea13708-527e-4621-93eb-c3e2316c7491 could not be found. Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 22 03:14:01.278008 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea13708-527e-4621-93eb-c3e2316c7491 could not be found. Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea13708-527e-4621-93eb-c3e2316c7491 could not be found. Oct 22 03:14:01.281688 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:01.285299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e37c7fcb-59e3-4c09-9530-b08fdd54bc19 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 7ea13708-527e-4621-93eb-c3e2316c7491 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:01.286648 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e37c7fcb-59e3-4c09-9530-b08fdd54bc19 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/7ea13708-527e-4621-93eb-c3e2316c7491/action" status: 404 len: 111 microversion: 2.1 time: 0.026255 Oct 22 03:14:01.287451 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1189/2359] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:01 2022] POST /compute/v2.1/servers/7ea13708-527e-4621-93eb-c3e2316c7491/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:14:01.305410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:01.306289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:01.319835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.323291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.323714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.325271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.328433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.329274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.632424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:01.643246 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-841a19be-7464-4f29-9785-4e8f6cbffb3b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.350922 Oct 22 03:14:01.644313 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1190/2360] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:01 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:01.649309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:01.650027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:01.656802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.657396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.657910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.658697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.659224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.659751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.823421 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18d88df1-2457-4b99-970e-a7b361022e0c tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/8d669841-ba18-4371-84db-9aaf070a75cd" status: 202 len: 0 microversion: 2.1 time: 1.769049 Oct 22 03:14:01.824027 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1171/2361] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:14:00 2022] DELETE /compute/v2.1/os-floating-ips/8d669841-ba18-4371-84db-9aaf070a75cd => generated 0 bytes in 1771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:14:01.829690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:01.830524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:01.841761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.850069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.851499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.853680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.856584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.857128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.943652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:01.949599 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15593910-e737-43dd-804f-027e6c0b5541 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.303599 Oct 22 03:14:01.951862 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1191/2362] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:01 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:01.957108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4502a53c-32ce-4af8-832d-424ad294c6ed req-fc877a5d-acf6-4e5c-a554-6b7e8d5d7066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ac884a-4e4c-46eb-bed5-ff095d21ed4e", "tag": "e5c48f88-4317-4ffd-8341-8454067bd0fc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:01.966767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4502a53c-32ce-4af8-832d-424ad294c6ed req-fc877a5d-acf6-4e5c-a554-6b7e8d5d7066 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:01.967247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4502a53c-32ce-4af8-832d-424ad294c6ed req-fc877a5d-acf6-4e5c-a554-6b7e8d5d7066 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:01.967681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4502a53c-32ce-4af8-832d-424ad294c6ed req-fc877a5d-acf6-4e5c-a554-6b7e8d5d7066 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:01.981281 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4502a53c-32ce-4af8-832d-424ad294c6ed req-fc877a5d-acf6-4e5c-a554-6b7e8d5d7066 service nova] Creating event network-changed:e5c48f88-4317-4ffd-8341-8454067bd0fc for instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e on n-h1-862416-2 Oct 22 03:14:01.986311 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4502a53c-32ce-4af8-832d-424ad294c6ed req-fc877a5d-acf6-4e5c-a554-6b7e8d5d7066 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033496 Oct 22 03:14:01.987221 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1192/2363] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:01.992235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-edfbfb21-027f-459a-8e4e-4d8ed5017702 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Action: 'create', calling method: .version_select at 0x7f0d196ebaf0>, body: {"pool": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:02.182210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:02.191769 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-96187de6-b9ba-4a4e-a3ac-55c305675bee tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.366628 Oct 22 03:14:02.192744 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1172/2364] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:01 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:02.214088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3936bc5-10c2-4da6-a5a7-1e83d278b0fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:02.214893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3936bc5-10c2-4da6-a5a7-1e83d278b0fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 42174dde-1e0b-4d0e-bc3f-e388111270cc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:02.221472 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c3936bc5-10c2-4da6-a5a7-1e83d278b0fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 42174dde-1e0b-4d0e-bc3f-e388111270cc could not be found. Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3936bc5-10c2-4da6-a5a7-1e83d278b0fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/42174dde-1e0b-4d0e-bc3f-e388111270cc/action HTTP/1.1 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 15 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: {"restore": {}} Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 42174dde-1e0b-4d0e-bc3f-e388111270cc could not be found. Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '42174dde-1e0b-4d0e-bc3f-e388111270cc', 'body': {'restore': {}}} Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42174dde-1e0b-4d0e-bc3f-e388111270cc could not be found. Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42174dde-1e0b-4d0e-bc3f-e388111270cc could not be found. Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:02.223251 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:02.227122 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:02.227122 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:02.227122 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42174dde-1e0b-4d0e-bc3f-e388111270cc could not be found. Oct 22 03:14:02.227122 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.228889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3936bc5-10c2-4da6-a5a7-1e83d278b0fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 42174dde-1e0b-4d0e-bc3f-e388111270cc could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:02.230054 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3936bc5-10c2-4da6-a5a7-1e83d278b0fa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/42174dde-1e0b-4d0e-bc3f-e388111270cc/action" status: 404 len: 111 microversion: 2.1 time: 0.019852 Oct 22 03:14:02.235434 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1173/2365] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:02 2022] POST /compute/v2.1/servers/42174dde-1e0b-4d0e-bc3f-e388111270cc/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:14:02.240154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:02.241355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] [instance: 4f265234-6754-4073-93cc-ee1a65ffab52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:02.252279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:02.253010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:02.253657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:02.254603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:02.255431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:02.256062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:02.278835 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] HTTP exception thrown: Instance 4f265234-6754-4073-93cc-ee1a65ffab52 could not be found. Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Request method failure captured: Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 HTTP/1.1 Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19h09weFzOCeRmu6Ay76kvkygNzW1NZJLixVc3Q4YKcHIVr9GXHEss3B5j6U9Ds5zc2fXOjB_7dPa_f8TFwN_aSi6GlTxPGqGhUS3rsbzl6w_3nLL8P-nLpP44YFG4X_OBVbqxF76oGQOwoc_aIWAX8Em28NHEVMmLxv6z69qFYqeo Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: d3d30709037b42e9839252d0b366681a Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestBootFromVolume-185830628 Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3d30709037b42e9839252d0b366681a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3d30709037b42e9839252d0b366681a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3d30709037b42e9839252d0b366681a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3d30709037b42e9839252d0b366681a"}]}] Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestBootFromVolume-185830628 Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: d3d30709037b42e9839252d0b366681a Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestBootFromVolume-185830628 Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestBootFromVolume-185830628-project Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 1a2620c42cb94cf6a8b3f64faa91cfeb Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestBootFromVolume-185830628-project Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 4f265234-6754-4073-93cc-ee1a65ffab52 could not be found. Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '4f265234-6754-4073-93cc-ee1a65ffab52'} Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f265234-6754-4073-93cc-ee1a65ffab52 could not be found. Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f265234-6754-4073-93cc-ee1a65ffab52 could not be found. Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:02.281522 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.286430 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:02.286430 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:02.286430 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:02.286430 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:02.286430 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:02.286430 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f265234-6754-4073-93cc-ee1a65ffab52 could not be found. Oct 22 03:14:02.286430 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:02.288247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Returning 404 to user: Instance 4f265234-6754-4073-93cc-ee1a65ffab52 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:02.289394 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73f6bb54-a32c-498a-aa8d-dc598f3b5519 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52" status: 404 len: 111 microversion: 2.1 time: 0.053291 Oct 22 03:14:02.290609 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1174/2366] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:02 2022] GET /compute/v2.1/servers/4f265234-6754-4073-93cc-ee1a65ffab52 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:14:02.296076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:02.297022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:02.304052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:02.304878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:02.305468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:02.306330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:02.306937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:02.307538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:02.586200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:02.597967 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-837f431e-4d8a-4a81-a4bc-1482353ec121 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.305726 Oct 22 03:14:02.598962 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1175/2367] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:02 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:02.608160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-378a0104-e538-4595-a9c7-091608e19324 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1e534790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:02.679198 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-378a0104-e538-4595-a9c7-091608e19324 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.078362 Oct 22 03:14:02.680036 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1176/2368] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:02 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:02.686578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd10996a-50ff-4ff5-8371-4abb122e3f79 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] Calling method '.version_select at 0x7f0d1a4ff940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:02.710931 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dd10996a-50ff-4ff5-8371-4abb122e3f79 tempest-ServersTestBootFromVolume-185830628 tempest-ServersTestBootFromVolume-185830628-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428605690" status: 202 len: 0 microversion: 2.1 time: 0.029249 Oct 22 03:14:02.712316 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1177/2369] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:14:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428605690 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:14:02.718751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:02.720512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:02.729154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:02.729960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:02.730835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:02.731911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:02.732791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:02.733535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:02.980435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:02.990338 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63fe989c-7cf2-4cfa-9324-a4c2ea741f46 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.276882 Oct 22 03:14:02.991556 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1178/2370] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:02 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:02.996535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:02.997462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:03.004856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:03.005618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:03.006415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:03.007402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:03.008084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:03.008756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:03.264103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:03.282918 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e39bfac1-fb5b-442b-8f4e-2bfeb16e0403 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.289478 Oct 22 03:14:03.284271 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1179/2371] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:02 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:03.293263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:03.294352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:03.303946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:03.305400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:03.306116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:03.307524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:03.308586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:03.309287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:03.342403 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Cannot 'restore' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action HTTP/1.1 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 15 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: {"restore": {}} Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot 'restore' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'restore': {}}} Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 in vm_state active. Cannot restore while the instance is in this state. Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:03.345075 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:03.349727 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:03.349727 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:03.349727 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:03.349727 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:14:03.349727 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:03.352731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 409 to user: Cannot 'restore' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:03.354185 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad861ee3-3c1e-4b5f-a7b6-042188fc7a90 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 409 len: 145 microversion: 2.1 time: 0.068248 Oct 22 03:14:03.355693 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1180/2372] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:03 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 145 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:14:03.364851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:03.366042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:03.375469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:03.377596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:03.378440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:03.380907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:03.382592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:03.383246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:03.607537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:03.622074 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e92ebb30-fce4-4f38-b5ef-75db496debc7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.259093 Oct 22 03:14:03.623078 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1181/2373] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:03 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:03.654641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:03.657659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:03.668196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:03.669178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:03.682001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:03.682838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:03.683319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:03.683768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:04.125866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:04.144665 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d8e9377-9c87-4b1b-8038-70293d482af7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.496972 Oct 22 03:14:04.145319 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1182/2374] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:03 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:04.159013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c8f2c7d-27f0-4eb3-97cb-079a242eccd6 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a59caf0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:04.262129 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1c8f2c7d-27f0-4eb3-97cb-079a242eccd6 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.114016 Oct 22 03:14:04.264255 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1183/2375] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:04 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:04.281349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c47b12a7-ac43-44cc-ae2d-56ff90dad360 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:04.282564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c47b12a7-ac43-44cc-ae2d-56ff90dad360 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 47b38e7a-277d-43b4-bf83-443eff0b6fdc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:04.304329 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c47b12a7-ac43-44cc-ae2d-56ff90dad360 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 47b38e7a-277d-43b4-bf83-443eff0b6fdc could not be found. Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c47b12a7-ac43-44cc-ae2d-56ff90dad360 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/47b38e7a-277d-43b4-bf83-443eff0b6fdc/action HTTP/1.1 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 14 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: {"resume": {}} Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 47b38e7a-277d-43b4-bf83-443eff0b6fdc could not be found. Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '47b38e7a-277d-43b4-bf83-443eff0b6fdc', 'body': {'resume': {}}} Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b38e7a-277d-43b4-bf83-443eff0b6fdc could not be found. Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b38e7a-277d-43b4-bf83-443eff0b6fdc could not be found. Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:04.320997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:04.327565 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:04.327565 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:04.327565 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b38e7a-277d-43b4-bf83-443eff0b6fdc could not be found. Oct 22 03:14:04.327565 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:04.331998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c47b12a7-ac43-44cc-ae2d-56ff90dad360 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 47b38e7a-277d-43b4-bf83-443eff0b6fdc could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:04.333190 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c47b12a7-ac43-44cc-ae2d-56ff90dad360 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/47b38e7a-277d-43b4-bf83-443eff0b6fdc/action" status: 404 len: 111 microversion: 2.1 time: 0.066031 Oct 22 03:14:04.338332 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1184/2376] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:04 2022] POST /compute/v2.1/servers/47b38e7a-277d-43b4-bf83-443eff0b6fdc/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:14:04.356513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:04.357752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:04.389158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:04.389732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:04.390227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:04.391119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:04.393825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:04.394287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:04.678503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:04.687912 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62aad9e5-41f9-4e3b-9e39-337bdba660dc tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.347624 Oct 22 03:14:04.693613 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1185/2377] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:04 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:04.698455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:04.704574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:04.716445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:04.717153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:04.720502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:04.721452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:04.722064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:04.722646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:04.782427 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-edfbfb21-027f-459a-8e4e-4d8ed5017702 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.793988 Oct 22 03:14:04.783539 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1193/2378] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:14:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:04.795536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-17e422c9-d29a-4281-a552-cd3ff1fb253e tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Calling method '.version_select at 0x7f0d1a991310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:05.543321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:05.551206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:05.557524 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d014f7d5-51cb-47b2-9ac5-e660933e32b4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.862504 Oct 22 03:14:05.560699 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1186/2379] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:04 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:05.573242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2fed2e97-f2dc-47a2-9065-0abd68866895 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a59c8b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:05.659572 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2fed2e97-f2dc-47a2-9065-0abd68866895 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.097507 Oct 22 03:14:05.661262 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1187/2380] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:05 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:05.675431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:05.677139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:05.696460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:05.697025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:05.700741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:05.701400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:05.705133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:05.709983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.044102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:06.055110 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3d001800-113e-465f-9bea-96dc39b2066f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.392771 Oct 22 03:14:06.055704 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1188/2381] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:05 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:06.081377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:06.082089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:06.089107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.089713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.090160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.090943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.091573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.092156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.385745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:06.404223 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a548f1e-ddca-4b0a-8cc4-22ee7cad53ed tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.327677 Oct 22 03:14:06.407761 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1189/2382] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:06 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:06.416965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:06.417757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:06.429035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.431675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.432472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.433850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.434673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.435289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.472415 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Cannot 'resume' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action HTTP/1.1 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 14 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: {"resume": {}} Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot 'resume' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'resume': {}}} Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 in vm_state active. Cannot resume while the instance is in this state. Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:06.474442 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:06.479755 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:06.479755 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:06.479755 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:06.479755 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:06.479755 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:06.479755 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:14:06.479755 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:06.481105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 409 to user: Cannot 'resume' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:06.482732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4bed4b5d-9750-4e3c-879d-f8e5b45bd264 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 409 len: 144 microversion: 2.1 time: 0.072190 Oct 22 03:14:06.483689 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1190/2383] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:06 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 144 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:14:06.491270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-be3d6e2a-2596-4f49-b25a-7a6d127a9abe req-fc8f378d-53cb-4606-8439-6c1486c97675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2411dd-1a42-4047-90ab-5e6bb098541a", "name": "network-vif-plugged", "status": "completed", "tag": "27c46b57-feba-40bd-95ee-929c50f6d0e4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:06.502974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be3d6e2a-2596-4f49-b25a-7a6d127a9abe req-fc8f378d-53cb-4606-8439-6c1486c97675 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.503731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be3d6e2a-2596-4f49-b25a-7a6d127a9abe req-fc8f378d-53cb-4606-8439-6c1486c97675 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.504374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be3d6e2a-2596-4f49-b25a-7a6d127a9abe req-fc8f378d-53cb-4606-8439-6c1486c97675 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.519529 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-be3d6e2a-2596-4f49-b25a-7a6d127a9abe req-fc8f378d-53cb-4606-8439-6c1486c97675 service nova] Creating event network-vif-plugged:27c46b57-feba-40bd-95ee-929c50f6d0e4 for instance ba2411dd-1a42-4047-90ab-5e6bb098541a on n-h2-862416-2 Oct 22 03:14:06.526738 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-be3d6e2a-2596-4f49-b25a-7a6d127a9abe req-fc8f378d-53cb-4606-8439-6c1486c97675 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041739 Oct 22 03:14:06.532046 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1191/2384] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:06.540524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:06.541292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:06.548712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.549649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.550503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.551589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.552298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.552968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.829552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:06.845563 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-228ddfb6-0002-4bdd-b4c9-10abe296c19b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.311234 Oct 22 03:14:06.847820 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1192/2385] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:06 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:06.854092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49401e8a-d2b4-4049-beb3-f3d55f33622b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a58d700>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:06.939722 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49401e8a-d2b4-4049-beb3-f3d55f33622b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.089930 Oct 22 03:14:06.940987 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1193/2386] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:06 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:06.950978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:06.951883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:06.962470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.963228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.971940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:06.973336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:06.974049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:06.974692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:07.267260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:07.281893 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e94f29f-4172-4d92-9f5c-1e0c40a1424d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.338573 Oct 22 03:14:07.283234 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1194/2387] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:06 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:07.361555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-906f6291-0ebe-475c-89e3-29d43bdb91a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-906f6291-0ebe-475c-89e3-29d43bdb91a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 160 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "cd333e9d-f9b8-4605-a5a4-47471e05a78d"}]}} Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': '', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'networks': [{'uuid': 'cd333e9d-f9b8-4605-a5a4-47471e05a78d'}]}}} Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi '' Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:14:07.370975 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-906f6291-0ebe-475c-89e3-29d43bdb91a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:07.376485 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-906f6291-0ebe-475c-89e3-29d43bdb91a4 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017852 Oct 22 03:14:07.378252 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1195/2388] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:14:07 2022] POST /compute/v2.1/servers => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:14:07.378813 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-17e422c9-d29a-4281-a552-cd3ff1fb253e tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e5878b8a-b571-439f-a91a-68bd26d68f3e" status: 202 len: 0 microversion: 2.1 time: 2.586957 Oct 22 03:14:07.382398 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1194/2389] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:14:04 2022] DELETE /compute/v2.1/os-floating-ips/e5878b8a-b571-439f-a91a-68bd26d68f3e => generated 0 bytes in 2588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:14:07.389267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:07.390844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:07.394504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfd53b11-0956-48c3-83f5-523a040586d3 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Calling method '.version_select at 0x7f0d1978b4c0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:07.408146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:07.408743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:07.409186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:07.409916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:07.410375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:07.410808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:07.590676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-bfd53b11-0956-48c3-83f5-523a040586d3 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e5878b8a-b571-439f-a91a-68bd26d68f3e could not be found", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:14:07.591618 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-bfd53b11-0956-48c3-83f5-523a040586d3 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] HTTP exception thrown: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfd53b11-0956-48c3-83f5-523a040586d3 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Request method failure captured: Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-floating-ips/e5878b8a-b571-439f-a91a-68bd26d68f3e HTTP/1.1 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU1_yoZCd0IU3C_atu4KuYcpOeaky1YO3vbRI6ACGBKFS1AmSw996aJ8pX2gBj0SVKR-0PrrT0-LJbaR3DcBACu8DA3dMnIzyATLJcvZmO2asnfnJTNg174N0iy8Vb8OqeZ-krV0VYf9IGSmdG0ud67DakjC3b64toM7zGntayOhZU14 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: c94d9fe798594b7fbbd2a9eba793f165 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FloatingIPsTestJSON-707031607 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c94d9fe798594b7fbbd2a9eba793f165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c94d9fe798594b7fbbd2a9eba793f165"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c94d9fe798594b7fbbd2a9eba793f165"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c94d9fe798594b7fbbd2a9eba793f165"}]}] Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FloatingIPsTestJSON-707031607 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: c94d9fe798594b7fbbd2a9eba793f165 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FloatingIPsTestJSON-707031607 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FloatingIPsTestJSON-707031607-project Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0c267f771eda4489bc2ff3b6a8f4ea37 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FloatingIPsTestJSON-707031607-project Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: exception: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e5878b8a-b571-439f-a91a-68bd26d68f3e'} Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e5878b8a-b571-439f-a91a-68bd26d68f3e could not be found Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7dd1155-9c7e-4891-b615-c2e284a4952b'] Oct 22 03:14:07.594272 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e. Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e Oct 22 03:14:07.598292 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.602093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfd53b11-0956-48c3-83f5-523a040586d3 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Returning 404 to user: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:07.603010 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfd53b11-0956-48c3-83f5-523a040586d3 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/e5878b8a-b571-439f-a91a-68bd26d68f3e" status: 404 len: 111 microversion: 2.1 time: 0.219112 Oct 22 03:14:07.603581 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1195/2390] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:14:07 2022] GET /compute/v2.1/os-floating-ips/e5878b8a-b571-439f-a91a-68bd26d68f3e => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:14:07.614572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:07.615356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:07.636522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:07.637021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:07.637458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:07.638178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:07.638681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:07.639074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:07.795470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:07.803297 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13cb6a59-f5cc-41c9-a524-474dab340cdd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.421573 Oct 22 03:14:07.805796 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1196/2391] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:07 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:07.815255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8dfc702a-7dfe-440e-b9ef-5ebbddb9cb25 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Calling method '.version_select at 0x7f0d1a51d700>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:07.902966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-8dfc702a-7dfe-440e-b9ef-5ebbddb9cb25 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e5878b8a-b571-439f-a91a-68bd26d68f3e could not be found", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:14:07.903744 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-8dfc702a-7dfe-440e-b9ef-5ebbddb9cb25 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] HTTP exception thrown: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8dfc702a-7dfe-440e-b9ef-5ebbddb9cb25 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Request method failure captured: Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-floating-ips/e5878b8a-b571-439f-a91a-68bd26d68f3e HTTP/1.1 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1_yoZCd0IU3C_atu4KuYcpOeaky1YO3vbRI6ACGBKFS1AmSw996aJ8pX2gBj0SVKR-0PrrT0-LJbaR3DcBACu8DA3dMnIzyATLJcvZmO2asnfnJTNg174N0iy8Vb8OqeZ-krV0VYf9IGSmdG0ud67DakjC3b64toM7zGntayOhZU14 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c94d9fe798594b7fbbd2a9eba793f165 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FloatingIPsTestJSON-707031607 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c94d9fe798594b7fbbd2a9eba793f165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c94d9fe798594b7fbbd2a9eba793f165"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c94d9fe798594b7fbbd2a9eba793f165"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c94d9fe798594b7fbbd2a9eba793f165"}]}] Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FloatingIPsTestJSON-707031607 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c94d9fe798594b7fbbd2a9eba793f165 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FloatingIPsTestJSON-707031607 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FloatingIPsTestJSON-707031607-project Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0c267f771eda4489bc2ff3b6a8f4ea37 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FloatingIPsTestJSON-707031607-project Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: exception: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'e5878b8a-b571-439f-a91a-68bd26d68f3e'} Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e5878b8a-b571-439f-a91a-68bd26d68f3e could not be found Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9c643b6-481b-4ca5-a16b-dbbd27d3fdff'] Oct 22 03:14:07.905842 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e. Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:07.910823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8dfc702a-7dfe-440e-b9ef-5ebbddb9cb25 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] Returning 404 to user: Floating IP not found for ID e5878b8a-b571-439f-a91a-68bd26d68f3e {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:07.914295 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8dfc702a-7dfe-440e-b9ef-5ebbddb9cb25 tempest-FloatingIPsTestJSON-707031607 tempest-FloatingIPsTestJSON-707031607-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e5878b8a-b571-439f-a91a-68bd26d68f3e" status: 404 len: 111 microversion: 2.1 time: 0.106735 Oct 22 03:14:07.919701 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1197/2392] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:14:07 2022] DELETE /compute/v2.1/os-floating-ips/e5878b8a-b571-439f-a91a-68bd26d68f3e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:14:07.929088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:07.931821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:07.947136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:07.949645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:07.952193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:07.953346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:07.956722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:07.957396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:08.187534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:08.198075 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44f590ad-dd8e-44ea-872b-2f446e0cae30 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.592975 Oct 22 03:14:08.210488 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1196/2393] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:07 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:08.217292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-645e207a-1dd2-4714-a9fd-d9569e089e25 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1978bb80>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:08.317881 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-645e207a-1dd2-4714-a9fd-d9569e089e25 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.114554 Oct 22 03:14:08.320276 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1197/2394] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:08 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:08.427062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:08.440846 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c8328ac4-cd99-4c75-beae-e828e65b670b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.519621 Oct 22 03:14:08.445967 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1198/2395] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:07 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:08.481380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1080e59d-72ea-4e7b-a643-bd49c1edf7ab tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:08.482058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1080e59d-72ea-4e7b-a643-bd49c1edf7ab tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: d98c02ba-a259-4b83-8d99-8f46add79131] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:08.504507 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1080e59d-72ea-4e7b-a643-bd49c1edf7ab tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance d98c02ba-a259-4b83-8d99-8f46add79131 could not be found. Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1080e59d-72ea-4e7b-a643-bd49c1edf7ab tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/d98c02ba-a259-4b83-8d99-8f46add79131/action HTTP/1.1 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 14 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: {"shelve": {}} Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d98c02ba-a259-4b83-8d99-8f46add79131 could not be found. Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd98c02ba-a259-4b83-8d99-8f46add79131', 'body': {'shelve': {}}} Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d98c02ba-a259-4b83-8d99-8f46add79131 could not be found. Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d98c02ba-a259-4b83-8d99-8f46add79131 could not be found. Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:08.509448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:08.513178 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:08.513178 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:08.513178 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d98c02ba-a259-4b83-8d99-8f46add79131 could not be found. Oct 22 03:14:08.513178 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:08.516536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1080e59d-72ea-4e7b-a643-bd49c1edf7ab tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance d98c02ba-a259-4b83-8d99-8f46add79131 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:08.518870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1080e59d-72ea-4e7b-a643-bd49c1edf7ab tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/d98c02ba-a259-4b83-8d99-8f46add79131/action" status: 404 len: 111 microversion: 2.1 time: 0.041500 Oct 22 03:14:08.519971 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1198/2396] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:08 2022] POST /compute/v2.1/servers/d98c02ba-a259-4b83-8d99-8f46add79131/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:14:08.535297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:08.536107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:08.553754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:08.555864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:08.560559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:08.561524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:08.562208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:08.564722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:09.230137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:09.231323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:09.245496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:09.246006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:09.246449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:09.247170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:09.261331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:09.263167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:09.399424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:09.411722 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5167615-3184-447c-be82-a1d8128d861c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.881601 Oct 22 03:14:09.412361 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1199/2397] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:08 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:09.425469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c20ecda-9821-482a-b182-4aa669fcbfd6 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a10a550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:09.524290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5c20ecda-9821-482a-b182-4aa669fcbfd6 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.110573 Oct 22 03:14:09.525193 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1200/2398] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:09 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:09.541819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:09.544554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:09.575127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:09.575676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:09.576127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:09.576954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:09.586547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:09.587389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:10.029958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:10.043131 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e3a3e9ff-8e1f-49b6-8e49-9685c5a3949b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.820213 Oct 22 03:14:10.047887 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1199/2399] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:09 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:10.223194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:10.232703 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-380c5255-fb51-4362-98f7-860b2eae5d35 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.705728 Oct 22 03:14:10.233554 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1201/2400] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:09 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:10.273131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:10.273796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:10.288334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:10.293313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:10.294842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:10.298248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:10.300706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:10.303737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:10.411822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lazy-loading 'flavor' on Instance uuid 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:14:10.541177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-839b32a4-a3ad-475c-a3b8-e45863206ed0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a5b31f0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:10.630740 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-839b32a4-a3ad-475c-a3b8-e45863206ed0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.093635 Oct 22 03:14:10.632123 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1202/2401] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:10 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:10.893681 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11baa3e9-9945-4537-82c6-619f0a84240b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 202 len: 0 microversion: 2.1 time: 0.630082 Oct 22 03:14:10.895085 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1200/2402] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:10 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:14:10.903786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:10.904433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:10.916599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:10.917285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:10.920166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:10.922024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:10.924617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:10.926494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:11.078997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:11.080520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:11.094166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:11.099784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:11.100653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:11.102836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:11.103666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:11.104357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:11.352014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:11.370462 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73c92a5f-44b2-4cda-be56-a43982b028a3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1503 microversion: 2.1 time: 0.295914 Oct 22 03:14:11.384780 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1201/2403] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:11 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:11.503516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:11.512104 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-21ce8993-cc38-4af1-b525-87ede9f4ebce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.612752 Oct 22 03:14:11.515785 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1203/2404] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:10 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:11.647241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-505e412e-6959-4479-ac81-84513c65e2a0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1976c820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:11.721642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-505e412e-6959-4479-ac81-84513c65e2a0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.078456 Oct 22 03:14:11.723752 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1202/2405] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:11 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:12.396387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:12.397024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:12.413002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:12.413493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:12.414130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:12.414634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:12.415097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:12.415523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:12.549706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:12.550315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:12.552436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:12.573304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:12.573943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:12.575027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:12.585071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:12.589889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:12.591068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:12.975654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:12.996813 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e12462d-c858-44a8-b299-21e91cfd2d69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1478 microversion: 2.1 time: 0.603540 Oct 22 03:14:13.000527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1204/2406] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:12 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1478 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:13.011863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30b4d148-a69c-4804-b448-2fdde62625c8 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a462c10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:13.012855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:13.023677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9647156c-f9e9-4715-b395-a7072a9a9664 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.477922 Oct 22 03:14:13.033111 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1203/2407] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:12 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:13.049215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-041ebfae-bfff-4a72-9997-1fbd5e87e714 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '.version_select at 0x7f0d19759e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:13.065255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-041ebfae-bfff-4a72-9997-1fbd5e87e714 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:13.065754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-041ebfae-bfff-4a72-9997-1fbd5e87e714 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:13.066197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-041ebfae-bfff-4a72-9997-1fbd5e87e714 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:13.095229 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-041ebfae-bfff-4a72-9997-1fbd5e87e714 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.060970 Oct 22 03:14:13.099348 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1204/2408] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:14:13 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:13.116144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:13.116986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:13.117091 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30b4d148-a69c-4804-b448-2fdde62625c8 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.109758 Oct 22 03:14:13.118516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1205/2409] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:13 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:13.133396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:13.133890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:13.134330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:13.135138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:13.135605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:13.136038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:13.519416 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b643111f-527f-4f72-a8f6-67f8710acb13 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1629 microversion: 2.1 time: 0.413787 Oct 22 03:14:13.521327 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1205/2410] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:13 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1629 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:13.560183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-154b5268-3505-4697-851d-857139273258 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Action: 'create', calling method: .version_select at 0x7f0d1a8a1d30>, body: {"keypair": {"name": "tempest-keypair-627815688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2Y68qKQ8VJcutyZPWRSyLjB/j5W0pdCpaS3ilnbGmQ7lE0IMu4hVDjduRZ0r0Y2jI9kHfnWy2YcfWgPtFqC/mjVLUQ3hkBQs46OaghAktMD+/KjtbSz3rzt+RpFPbG6w=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:13.629288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-154b5268-3505-4697-851d-857139273258 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:14:13.645940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-154b5268-3505-4697-851d-857139273258 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for user 92523f18567441589dba5548bb33eb9e and project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:14:13.710653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-154b5268-3505-4697-851d-857139273258 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153384 Oct 22 03:14:13.720897 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1206/2411] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:14:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:14.059022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:14.059762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:14.079135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:14.082139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:14.082895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:14.086345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:14.089550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:14.090512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:14.103874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:14.136633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fea63e0a-7317-48cb-bcc6-eadaca526424 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a4ff5e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:14.240418 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fea63e0a-7317-48cb-bcc6-eadaca526424 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.107462 Oct 22 03:14:14.241906 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1207/2412] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:14 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:14.741125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:14.759951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1bac3893-210b-4296-9dce-b4e2ee350111 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.702982 Oct 22 03:14:14.760726 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1206/2413] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:14 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:15.258015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fcbada93-8daf-4b32-9791-0e94d5d53181 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a8a19d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:15.363963 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fcbada93-8daf-4b32-9791-0e94d5d53181 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.107259 Oct 22 03:14:15.376542 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1208/2414] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:15 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:15.831169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:15.832550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:15.849457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:15.852357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:15.853229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:15.855660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:15.856793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:15.857963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:16.314236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1664971100", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:16.422309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:14:16.770566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:16.782953 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bb24d38b-c90f-4e45-b7a0-6e8117a5c69c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.957112 Oct 22 03:14:16.786690 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1209/2415] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:15 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:16.795322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-afce78ac-8964-4713-951f-0b33cfcf2c83 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a51d0d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:16.878830 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-afce78ac-8964-4713-951f-0b33cfcf2c83 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.090014 Oct 22 03:14:16.879605 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1210/2416] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:16 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:17.294244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:14:17.294938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:14:17.295644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:14:17.297081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:14:17.297703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:14:17.316110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:17.319035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:17.324308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:17.325464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:17.326185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:17.326780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:17.372046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Getting quotas for project 49b19776feac4cc18fa1980aca044892. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:14:17.386285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Getting quotas for user 0bf6eac62509482ebfa5b1ebb4dd08ab and project 49b19776feac4cc18fa1980aca044892. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:14:17.417147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:14:17.419763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:14:17.555243 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63cc8275-d86a-4768-98ec-914b902944c7 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.804927 Oct 22 03:14:17.566248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1207/2417] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:14:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:14:17.579578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5692809-8c7d-4aaa-9912-f3aba3c94e57 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:17.580529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5692809-8c7d-4aaa-9912-f3aba3c94e57 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:17.778585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-511032561", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "e05de320-3bab-4c23-a4a6-0a3d411f4dd6"}], "security_groups": [{"name": "tempest-securitygroup--581045830"}], "key_name": "tempest-keypair-627815688", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:17.882614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5692809-8c7d-4aaa-9912-f3aba3c94e57 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:17.898384 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5692809-8c7d-4aaa-9912-f3aba3c94e57 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1219 microversion: 2.1 time: 0.323174 Oct 22 03:14:17.901482 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1211/2418] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:17 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1219 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:17.912312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:17.914586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:17.932418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:17.933234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:17.933855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:17.934836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:17.935418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:17.945977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:18.072728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] validate_networks() for [('e05de320-3bab-4c23-a4a6-0a3d411f4dd6', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:14:18.665221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:18.675218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bde0f5a4-a88a-449a-8677-f347b1258c13 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.770673 Oct 22 03:14:18.677440 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1212/2419] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:17 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:18.684702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-319fab6c-c365-4dbf-842c-af1ce10a38d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a10a0d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:18.758023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:14:18.758541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:14:18.758873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:14:18.759264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:14:18.759666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:14:18.772505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:18.773303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:18.773964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:18.774887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:18.775511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:18.775875 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-319fab6c-c365-4dbf-842c-af1ce10a38d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.095927 Oct 22 03:14:18.775998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:18.784853 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1213/2420] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:18 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:18.796625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:14:18.804156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for user 92523f18567441589dba5548bb33eb9e and project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:14:18.819308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:14:18.821568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:14:18.917987 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6bb88f1-1902-457a-ac61-f2d197464188 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.143286 Oct 22 03:14:18.923095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1208/2421] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:14:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:14:18.927826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:18.928665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:18.937722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:18.945561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:18.946457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-80c43526-2a13-413c-87db-074b407b1684 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:18.947111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:18.947319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-80c43526-2a13-413c-87db-074b407b1684 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:18.949018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:18.951490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:18.952996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:19.010694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80c43526-2a13-413c-87db-074b407b1684 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:19.020397 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-80c43526-2a13-413c-87db-074b407b1684 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1233 microversion: 2.1 time: 0.082757 Oct 22 03:14:19.022575 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1209/2422] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:18 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:19.075731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:19.084101 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0cdcf31c-3b22-463b-865a-243d2e23eef0 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1215 microversion: 2.1 time: 0.160044 Oct 22 03:14:19.085024 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1214/2423] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:18 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:19.707821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:19.709866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:19.726532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:19.727644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:19.729625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:19.731789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:19.732592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:19.733182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:19.794680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97c26835-5074-4a93-b666-90b1f9665d98 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a51de50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:19.918289 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97c26835-5074-4a93-b666-90b1f9665d98 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.128209 Oct 22 03:14:19.921383 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1215/2424] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:19 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:20.068427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:20.070625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:20.085435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:20.086066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:20.087107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:20.088658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:20.092254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:20.093186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:20.252636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:20.267050 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e49050d-80c7-4b69-8634-e6c211192e2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1229 microversion: 2.1 time: 0.215661 Oct 22 03:14:20.268272 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1216/2425] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:20 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1229 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:20.274059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:20.275098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:20.285126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:20.286126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:20.286821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:20.287787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:20.288504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:20.289156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:20.443852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:20.459937 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2902e595-3458-45a7-ad94-6f7388697b88 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1277 microversion: 2.1 time: 0.190305 Oct 22 03:14:20.465027 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1217/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:20 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:20.542268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:20.551403 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b200d6c3-efb7-4263-af06-a35dfa181908 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.849506 Oct 22 03:14:20.557233 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1210/2427] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:19 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:20.938905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-02a4388c-285b-4fa9-bba5-1a60fc3d1f58 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a712e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:21.015482 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-02a4388c-285b-4fa9-bba5-1a60fc3d1f58 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.080094 Oct 22 03:14:21.016319 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1218/2428] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:20 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:21.303207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:21.308303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:21.317121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:21.318372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:21.319023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:21.320015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:21.320713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:21.321349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:21.494434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:21.496302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:21.497583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:21.506729 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-696ad61b-9148-4135-bb4e-e6a3d31fbde2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1291 microversion: 2.1 time: 0.205772 Oct 22 03:14:21.507446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:21.508169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:21.508848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:21.509779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:21.510206 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1211/2429] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:21 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1291 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:21.511771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:21.512344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:21.544017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:21.582340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:21.584879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:21.595265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:21.596058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:21.597000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:21.597928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:21.598883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:21.599749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:21.646530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:21.660575 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1b53972-70ae-477a-87b0-aa71935f516d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1277 microversion: 2.1 time: 0.169429 Oct 22 03:14:21.681782 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1219/2430] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:21 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:22.034509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-12a52ce4-43a7-4705-b9c6-409ddc88eb55 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a6fa5e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:22.151853 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-12a52ce4-43a7-4705-b9c6-409ddc88eb55 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.121578 Oct 22 03:14:22.154773 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1220/2431] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:22 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:22.253895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:22.254716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:22.325918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:22.326434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:22.326863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:22.341251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:22.345497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:22.346503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:22.784653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:22.803465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:22.814740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:22.824769 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb3e8088-cda8-4867-af3b-f6a77c5ffbf5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2950 microversion: 2.32 time: 0.571959 Oct 22 03:14:22.825722 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1221/2432] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:14:22 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2950 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:14:22.843837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:22.850981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:22.875005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:22.878279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:22.882973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:22.888795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:22.889455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:22.893459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:23.074139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:23.109344 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9ffc7460-4221-42fa-8740-6c98de7be397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1291 microversion: 2.1 time: 0.278188 Oct 22 03:14:23.112690 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1222/2433] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:22 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1291 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:23.121316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:23.122344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:23.131061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:23.131916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:23.132627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:23.134795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:23.135495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:23.136967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:23.181895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:23.190236 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39edc7a7-397d-41e6-93df-59f745d812c6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 1.612768 Oct 22 03:14:23.190833 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1212/2434] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:21 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:23.203420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:23.203657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:23.221529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:23.228894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:23.229429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:23.230340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:23.231582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:23.232280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:23.317892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:23.336242 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-397d4469-57d8-42a6-a80e-4d2a320d4fa1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1277 microversion: 2.1 time: 0.221464 Oct 22 03:14:23.336868 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1223/2435] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:23 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:23.357523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f6669cc-2da7-4243-a975-4e96b4d0434a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a51de50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:23.472715 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd241d35-8056-44ec-967f-6aa1a933e056 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.280680 Oct 22 03:14:23.473399 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1213/2436] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Oct 22 03:14:23 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e/os-interface => generated 1832 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:14:23.497714 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f6669cc-2da7-4243-a975-4e96b4d0434a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.138136 Oct 22 03:14:23.498662 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1224/2437] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:23 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:24.138791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:24.139630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:24.151719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:24.152486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:24.153079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:24.154098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:24.154743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:24.155251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:24.220142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:24.220792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:24.228021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:24.228513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:24.228953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:24.238565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:24.243946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:24.244670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:24.425758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:24.434636 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a3f8026-895e-477a-a304-9ee7bbec80b9 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1291 microversion: 2.1 time: 0.299762 Oct 22 03:14:24.435226 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1214/2438] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:24 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1291 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:24.454690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:24.461370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:24.482939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:24.487035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:24.487718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:24.489175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:24.490296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:24.490884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:24.809328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:24.823005 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-011b9ef9-eba9-4a36-9324-496295ba2914 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.608538 Oct 22 03:14:24.827082 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1225/2439] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:24 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:24.847697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41d3faaa-3ae3-483a-ae82-4533ee245edd tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a51da60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:24.916070 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41d3faaa-3ae3-483a-ae82-4533ee245edd tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.086472 Oct 22 03:14:24.927449 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1226/2440] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:24 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:25.091655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:25.110193 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5661eec9-70f8-4ff4-bd41-87164d8deab9 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.671380 Oct 22 03:14:25.121070 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1215/2441] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:24 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:25.462315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:25.462931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:25.487959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:25.488746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:25.489550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:25.492098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:25.504242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:25.505070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:25.856640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:25.858014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:25.887860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:25.889346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:25.890471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:25.894942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:25.895666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:25.896276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:25.897399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:25.907481 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f74679eb-85da-4f90-a71c-666219c4c987 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.449937 Oct 22 03:14:25.910795 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1227/2442] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:25 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:25.933415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92ca5931-3ca0-4b86-a955-25e5ff55ea1d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1e4eaca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:25.985035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92ca5931-3ca0-4b86-a955-25e5ff55ea1d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.055390 Oct 22 03:14:25.986177 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1228/2443] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:25 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:26.147191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:26.147809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:26.160335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:26.161093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:26.161705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:26.162572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:26.163195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:26.163782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:26.443914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:26.452114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7eac4c3a-ea3b-4a90-9a84-2193ba8f8011 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.308765 Oct 22 03:14:26.462133 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1229/2444] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:26 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:26.647529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:26.675322 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8fee8863-b581-4835-808d-6ea312374ea3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.823019 Oct 22 03:14:26.689319 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1216/2445] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:25 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:26.935689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:26.937948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:26.941844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:26.953896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:26.967532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:26.968231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:26.969106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:26.972584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:26.974153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:27.002432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a9bfbdd7-dce5-463c-ae0f-43deca4f9a97 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d19716d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:27.081680 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a9bfbdd7-dce5-463c-ae0f-43deca4f9a97 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.084311 Oct 22 03:14:27.082822 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1217/2446] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:26 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:27.335492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:27.344704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-52ba3cbc-d8f3-41d0-8796-864a4e488cad tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.413519 Oct 22 03:14:27.349203 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1230/2447] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:26 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:27.478374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:27.479443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:27.493764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:27.494567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:27.495196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:27.496843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:27.500909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:27.501649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:27.700471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:27.701452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:27.724844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:27.725361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:27.725806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:27.726558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:27.727460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:27.734355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:27.898396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:28.181931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:28.190279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:28.190825 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4e052f5-4455-4342-a220-6b0614862022 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.494182 Oct 22 03:14:28.205530 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1231/2448] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:27 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:28.205530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-40d0352b-aed1-4fb4-8ffc-66a0192c90d7 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a6a2e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:28.214182 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-624beb96-8cfd-4b82-8b3c-bc08d6d3d5e2 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.740276 Oct 22 03:14:28.214785 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1218/2449] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:27 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:28.281801 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-40d0352b-aed1-4fb4-8ffc-66a0192c90d7 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.084675 Oct 22 03:14:28.282650 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1232/2450] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:28 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:28.375591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:28.376285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:28.386251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:28.386757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:28.397402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:28.398177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:28.398678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:28.399118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:28.785823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:28.863823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b6f1c713-32d9-4d0d-988c-dbd28d38c0dc req-b227eebe-e05f-4e85-b4d0-e8c7d99dca85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e08eda2-0515-4df1-8934-b9bbbbb4cf37", "tag": "da83328b-2366-4541-9e9a-28f1ed37f8bd"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:28.888382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b6f1c713-32d9-4d0d-988c-dbd28d38c0dc req-b227eebe-e05f-4e85-b4d0-e8c7d99dca85 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:28.889061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b6f1c713-32d9-4d0d-988c-dbd28d38c0dc req-b227eebe-e05f-4e85-b4d0-e8c7d99dca85 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:28.889593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b6f1c713-32d9-4d0d-988c-dbd28d38c0dc req-b227eebe-e05f-4e85-b4d0-e8c7d99dca85 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:28.914139 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b6f1c713-32d9-4d0d-988c-dbd28d38c0dc req-b227eebe-e05f-4e85-b4d0-e8c7d99dca85 service nova] Creating event network-changed:da83328b-2366-4541-9e9a-28f1ed37f8bd for instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 on n-h1-862416-2 Oct 22 03:14:28.926111 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b6f1c713-32d9-4d0d-988c-dbd28d38c0dc req-b227eebe-e05f-4e85-b4d0-e8c7d99dca85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066147 Oct 22 03:14:28.928575 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1233/2451] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:29.015854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=14 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:29.220360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:29.221810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:29.237497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:29.239262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:29.239875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:29.245546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:29.246185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:29.246782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:29.368027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:29.382628 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1ba291b3-9cb1-4e26-8a6f-6f31603e1379 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 1.011357 Oct 22 03:14:29.402375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1219/2452] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:28 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:29.411926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:29.418775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:29.434426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:29.437270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:29.437977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:29.441018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:29.445307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:29.446040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:30.023066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:30.035783 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9aa9672-9091-4494-a9a9-8477bd67c08a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1533 microversion: 2.1 time: 0.820087 Oct 22 03:14:30.049318 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1234/2453] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:29 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1533 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:30.066528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-343647e1-73c0-44e4-8b3f-c89abf657894 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1e5340d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:30.312814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:30.333618 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1da5e0fc-9241-4773-ace5-07d4f614641b tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.929719 Oct 22 03:14:30.336840 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1220/2454] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:29 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:30.412857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:30.413616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:30.428145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:30.431019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:30.431742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:30.434343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:30.435022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:30.438700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:30.589676 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-343647e1-73c0-44e4-8b3f-c89abf657894 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.539041 Oct 22 03:14:30.600300 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1235/2455] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:30 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:31.063374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:31.064120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:31.083063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:31.085020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:31.086714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:31.087624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:31.089123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:31.093644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:31.564565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:31.591445 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2051e60-cf17-47e8-ba1f-b93ab4018f9c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 1.185338 Oct 22 03:14:31.592481 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1221/2456] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:30 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:31.611669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3c8057c8-1400-429b-950a-88384e517570 req-af4a6516-5cec-4ea6-abc4-8fb73d1ef121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d5af8e-154b-4a08-bb37-0a1947b49d82", "tag": "ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:31.635301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c8057c8-1400-429b-950a-88384e517570 req-af4a6516-5cec-4ea6-abc4-8fb73d1ef121 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:31.635301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c8057c8-1400-429b-950a-88384e517570 req-af4a6516-5cec-4ea6-abc4-8fb73d1ef121 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:31.641111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c8057c8-1400-429b-950a-88384e517570 req-af4a6516-5cec-4ea6-abc4-8fb73d1ef121 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:31.670191 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3c8057c8-1400-429b-950a-88384e517570 req-af4a6516-5cec-4ea6-abc4-8fb73d1ef121 service nova] Creating event network-changed:ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3 for instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 on n-h1-862416-2 Oct 22 03:14:31.678179 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3c8057c8-1400-429b-950a-88384e517570 req-af4a6516-5cec-4ea6-abc4-8fb73d1ef121 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083135 Oct 22 03:14:31.680824 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1222/2457] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:31.689523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:31.690232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:31.711091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:31.711912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:31.712585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:31.713496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:31.714949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:31.715580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:32.212100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:32.243339 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ccc371a-7d9a-4c56-a994-20b6b6322a0c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1533 microversion: 2.1 time: 1.184091 Oct 22 03:14:32.272707 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1236/2458] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:31 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1533 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:32.305334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1eb0c4df-1c64-4e71-8c9f-0cae7b6cfe40 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a741550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:32.391288 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:14:32.391454 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 03:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 (ip 10.222.0.25) !!! Oct 22 03:14:32.457172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:32.459150 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1eb0c4df-1c64-4e71-8c9f-0cae7b6cfe40 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1421 microversion: 2.1 time: 0.165468 Oct 22 03:14:32.466436 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1237/2459] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:32 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1421 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:32.478002 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-84952563-53a9-4103-b29e-e1efba57f2ff tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.793968 Oct 22 03:14:32.492266 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1223/2460] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:31 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:32.493602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-81ead166-f6f9-465d-8f6e-1c00e8043eb5 req-cd25aebf-96be-4f47-b85d-71b9bc65b5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83aea4f8-aff9-49b1-9fac-7fa0c254fea3", "name": "network-vif-plugged", "status": "completed", "tag": "cfaf4bdc-ec50-406c-ba43-5295b1573af3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:32.569627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-81ead166-f6f9-465d-8f6e-1c00e8043eb5 req-cd25aebf-96be-4f47-b85d-71b9bc65b5cb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:32.570115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-81ead166-f6f9-465d-8f6e-1c00e8043eb5 req-cd25aebf-96be-4f47-b85d-71b9bc65b5cb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:32.573613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-81ead166-f6f9-465d-8f6e-1c00e8043eb5 req-cd25aebf-96be-4f47-b85d-71b9bc65b5cb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:32.599601 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-81ead166-f6f9-465d-8f6e-1c00e8043eb5 req-cd25aebf-96be-4f47-b85d-71b9bc65b5cb service nova] Creating event network-vif-plugged:cfaf4bdc-ec50-406c-ba43-5295b1573af3 for instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 on n-h2-862416-2 Oct 22 03:14:32.620757 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-81ead166-f6f9-465d-8f6e-1c00e8043eb5 req-cd25aebf-96be-4f47-b85d-71b9bc65b5cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149104 Oct 22 03:14:32.622081 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1238/2461] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:32.624321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:32.624945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:32.652038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:32.657118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:32.657672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:32.663338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:32.663946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:32.664485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:33.120829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4cd2825e-59b4-435d-aabf-b14951adff8b tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Action: 'create', calling method: .version_select at 0x7f0d1e5a0ee0>, body: {"keypair": {"name": "tempest-keypair-1997247212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0jrQbQd3MbGfOWNqfDNxQCBzBn7g2wSj80hxUiwtVdeFgwSd21bJrSWppBXq2bxcf/2lHrFyDmGQrW+tyRivhtOF7oPd5Cg+xF1P9fgCQyWlbGvyF7dgh9oJHHOfX5fA=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:33.146179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4cd2825e-59b4-435d-aabf-b14951adff8b tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Getting quotas for project fc0f26b39545436ab7f8653d75dd1473. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:14:33.152523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4cd2825e-59b4-435d-aabf-b14951adff8b tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Getting quotas for user 0b451a429e97450aabad0f31a00dd88f and project fc0f26b39545436ab7f8653d75dd1473. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:14:33.188159 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4cd2825e-59b4-435d-aabf-b14951adff8b tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135783 Oct 22 03:14:33.188992 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1239/2462] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:14:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:33.284628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:33.285394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:33.295331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:33.296476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:33.297679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:33.298435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:33.299237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:33.299827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:33.438929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:33.457213 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ae6edc1c-45ba-49a5-a3de-c9465d369b8f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.840845 Oct 22 03:14:33.457813 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1224/2463] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:32 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:33.486575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34440961-4f92-4ad4-af1b-8bf34535b254 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d19759e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:33.532987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:33.550801 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f6d72d4-31ef-4c21-9b39-c58d95d86773 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1533 microversion: 2.1 time: 0.275981 Oct 22 03:14:33.552345 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1240/2464] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:33 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1533 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:33.557870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:33.558725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:33.562136 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34440961-4f92-4ad4-af1b-8bf34535b254 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1430 microversion: 2.1 time: 0.086273 Oct 22 03:14:33.563486 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1225/2465] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:33 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1430 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:33.567619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:33.568399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:33.569043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:33.570100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:33.570850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:33.571306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:33.580718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc4d1618-c63c-45d4-8ab3-f7b75597f478 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d196f0820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:33.684604 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc4d1618-c63c-45d4-8ab3-f7b75597f478 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 200 len: 1430 microversion: 2.1 time: 0.111334 Oct 22 03:14:33.711365 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1226/2466] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:33 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 1430 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:33.719724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:33.720573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:33.728963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:33.729539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:33.730498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:33.731455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:33.732500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:33.733138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:33.796266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:33.809694 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ff98bd0-0a81-414a-af71-059d74b9bce1 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.255611 Oct 22 03:14:33.825369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1241/2467] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:33 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:34.054837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:34.063729 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-12612bab-eab5-4720-b5b8-0e237997f3c1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1479 microversion: 2.1 time: 0.351010 Oct 22 03:14:34.076738 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1227/2468] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:33 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1479 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:34.488844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:34.490035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:34.504500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:34.505326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:34.507296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:34.508284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:34.510572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:34.511952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:34.574837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:34.575844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:34.585871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:34.591300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:34.594183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:34.597646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:34.599066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:34.600664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:34.879375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:34.893745 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a74ec481-1e34-4162-8053-57f698b831ff tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.410493 Oct 22 03:14:34.894886 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1242/2469] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:34 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:34.902107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:34.903108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:34.910349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:34.911387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:34.912682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:34.913830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:34.914456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:34.915202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:35.047652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:35.056983 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fca133f2-7e11-4449-9c61-c6e420fcff1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1533 microversion: 2.1 time: 0.485911 Oct 22 03:14:35.064970 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1228/2470] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:34 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1533 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:35.172881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1640952587", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "49c953fb-5979-4a50-be05-1edf628aca16"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:35.258853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] validate_networks() for [('49c953fb-5979-4a50-be05-1edf628aca16', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:14:35.271559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:35.286566 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-834458cf-0699-4d46-9cd2-26375c1484a6 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.390213 Oct 22 03:14:35.287412 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1243/2471] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:34 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:35.294505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:35.295347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:35.309656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:35.317966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:35.318708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:35.319634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:35.320684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:35.323209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:35.728458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:35.740123 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-158deef8-f2d5-4e02-bb76-fafaa7f7c5d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1466 microversion: 2.1 time: 0.451148 Oct 22 03:14:35.741617 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1244/2472] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:35 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1466 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:35.776879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b9b43c87-fb87-4daa-9cbb-11a0414c19df tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a8a1550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:35.846176 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b9b43c87-fb87-4daa-9cbb-11a0414c19df tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/78462069-c4b0-4a1c-b064-2d19ad600046" status: 200 len: 784 microversion: 2.1 time: 0.079552 Oct 22 03:14:35.847552 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1245/2473] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:35 2022] GET /compute/v2.1/images/78462069-c4b0-4a1c-b064-2d19ad600046 => generated 784 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:35.855205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a37a187f-401e-4f71-b6cc-a6d8a7b96725"}], "security_groups": [{"name": "tempest-securitygroup--2057003196"}], "key_name": "tempest-keypair-1997247212", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:35.975426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:14:35.975859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:14:35.976381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:14:35.976797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:14:35.977640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:14:35.990031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:35.991043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:35.991773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:35.992990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:35.993819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:35.994521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:36.008265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:36.013995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] validate_networks() for [('a37a187f-401e-4f71-b6cc-a6d8a7b96725', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:14:36.029341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:14:36.040073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for user 2468c1f92230450db3397e1f0e97b5e0 and project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:14:36.073710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:14:36.080111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:14:36.185829 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f36cda1-f075-4890-a643-1c0ccd1a534c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119493 Oct 22 03:14:36.188599 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1229/2474] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:14:36.197766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9985d5b1-e379-4453-b8f8-8c68353ab4a4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:36.224283 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9985d5b1-e379-4453-b8f8-8c68353ab4a4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034362 Oct 22 03:14:36.225288 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1230/2475] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:14:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:36.238787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:36.239427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:36.254148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:36.254656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:36.255109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:36.255832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:36.260569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:36.261359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:36.642526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:36.651607 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-911d3be7-02c0-43db-a460-70a1da807f0f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.417787 Oct 22 03:14:36.652842 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1231/2476] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:36 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:36.665479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:36.666336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:36.700157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:36.700699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:36.701304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:36.702624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:36.703808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:36.704443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:36.741419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:14:36.741971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:14:36.742322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:14:36.742743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:14:36.743180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:14:36.757469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:36.757970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:36.758417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:36.759472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:36.759965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:36.760412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:36.786944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Getting quotas for project fc0f26b39545436ab7f8653d75dd1473. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:14:36.792859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Getting quotas for user 0b451a429e97450aabad0f31a00dd88f and project fc0f26b39545436ab7f8653d75dd1473. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:14:36.813293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:14:36.817018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:14:36.890857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be5acdf2-a189-4739-b826-59448a09397e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.041866 Oct 22 03:14:36.891518 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1246/2477] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:14:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:14:36.906526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5090c496-e2db-4ed0-a881-a728d7e1eabc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:36.908199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5090c496-e2db-4ed0-a881-a728d7e1eabc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:37.005880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5090c496-e2db-4ed0-a881-a728d7e1eabc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:37.016349 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5090c496-e2db-4ed0-a881-a728d7e1eabc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1208 microversion: 2.1 time: 0.115706 Oct 22 03:14:37.018522 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1247/2478] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:36 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1208 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:37.037661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e903ca04-cedc-4821-94af-dcb1aeb8a91b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a8a1a60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:37.066796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:37.075292 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e47d0b85-84a2-4f40-914e-24771ef551a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.421164 Oct 22 03:14:37.076690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1232/2479] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:36 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:37.082333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:37.083167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:37.089774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:37.090460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:37.091093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:37.091962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:37.093001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:37.093711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:37.381228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:37.395644 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ecf94a48-29b1-4f3a-83f7-6a361abaf391 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.317583 Oct 22 03:14:37.396274 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1233/2480] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:37 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:37.436087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31aae7ce-ef12-4177-a0a4-353ff381b819 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:37.437841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-31aae7ce-ef12-4177-a0a4-353ff381b819 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:37.440746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:37.563065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-31aae7ce-ef12-4177-a0a4-353ff381b819 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:37.571612 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31aae7ce-ef12-4177-a0a4-353ff381b819 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1226 microversion: 2.1 time: 0.153658 Oct 22 03:14:37.572197 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1234/2481] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:37 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:37.676862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:37.677691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:37.695379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:37.698900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:37.700523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:37.704053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:37.708352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:37.709340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.063937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:38.072943 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c309aaf3-9825-4f81-b499-b107f6b9e7cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.401086 Oct 22 03:14:38.075770 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1235/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:37 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:38.088479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:38.093625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:38.108191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.110192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.117120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.118644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.119132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.119573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.131396 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e903ca04-cedc-4821-94af-dcb1aeb8a91b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "DELETE /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 204 len: 0 microversion: 2.1 time: 1.110817 Oct 22 03:14:38.133464 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1248/2483] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:37 2022] DELETE /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 0 bytes in 1114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:14:38.139852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:38.140917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:38.150508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.152095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.157534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.159043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.161233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.162619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.166868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:38.248388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:38.263598 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba76481f-8043-42fd-8d8a-00a814136e80 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1260 microversion: 2.1 time: 0.185354 Oct 22 03:14:38.264432 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1236/2484] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:38 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:38.289188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd06aacc-3fd0-4bb4-89d0-641712d61cc4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d196baf70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:38.330223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-dd06aacc-3fd0-4bb4-89d0-641712d61cc4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] HTTP exception thrown: Image not found. Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd06aacc-3fd0-4bb4-89d0-641712d61cc4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Request method failure captured: Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 HTTP/1.1 Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU1_VuTZMz2ibaE_ARnzVF2LDcJ2O7yaWDf7sES6l6rxwSlymBl0DYoYHM6OdRMrBuliGMvRbqSbFwctYNEAy3T4o1yAoRsvF8DqepJ_KxfTCgPo9pmsmBaKx52fnrQLPgUCO6YlFst232nYO9Yrqa6pZ_hqI7XNco0J2HAQXCDtNVRQ Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 08a29e66084f4621bfec65de1c77d3ef Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a29e66084f4621bfec65de1c77d3ef"}]}] Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 08a29e66084f4621bfec65de1c77d3ef Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesOneServerTestJSON-244308695-project Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: a214582bec4040d3a315b687fb8f972a Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesOneServerTestJSON-244308695-project Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ce1dbe39-da73-4c9b-bec6-2b10cb0ad528'} Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:14:38.332411 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 could not be found. Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:14:38.337564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:38.348061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd06aacc-3fd0-4bb4-89d0-641712d61cc4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:38.348061 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd06aacc-3fd0-4bb4-89d0-641712d61cc4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 404 len: 62 microversion: 2.1 time: 0.073388 Oct 22 03:14:38.348061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1237/2485] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:38 2022] GET /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:14:38.369095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-229986086"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:38.378082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:38.389176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:38.398420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.399641 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1c1d1f5-de65-4a82-be95-5b599e26d761 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.264866 Oct 22 03:14:38.400383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.400914 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1249/2486] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:38 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:38.414060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.420314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.422978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.423718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.426595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:38.428051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:38.444342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.444878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.445330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.446073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.446535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.446965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.792646 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f91c6cf-436a-406d-a7ee-e4f737c1148d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "POST /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a/action" status: 202 len: 0 microversion: 2.1 time: 0.428389 Oct 22 03:14:38.795041 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1238/2487] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:38 2022] POST /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 03:14:38.808293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0e6c9d7c-d130-430f-a0ac-7614df60b1ef req-24dbec85-db6c-4a9f-9f72-e38593bf233e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2411dd-1a42-4047-90ab-5e6bb098541a", "name": "network-vif-unplugged", "status": "completed", "tag": "27c46b57-feba-40bd-95ee-929c50f6d0e4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:38.866802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:38.885508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93e11975-75ce-4ebd-b8f1-459903d29aae tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.467528 Oct 22 03:14:38.900804 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1250/2488] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:38 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:38.906221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0e6c9d7c-d130-430f-a0ac-7614df60b1ef req-24dbec85-db6c-4a9f-9f72-e38593bf233e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.908934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0e6c9d7c-d130-430f-a0ac-7614df60b1ef req-24dbec85-db6c-4a9f-9f72-e38593bf233e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.910235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0e6c9d7c-d130-430f-a0ac-7614df60b1ef req-24dbec85-db6c-4a9f-9f72-e38593bf233e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.914054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:38.916828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:38.939930 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0e6c9d7c-d130-430f-a0ac-7614df60b1ef req-24dbec85-db6c-4a9f-9f72-e38593bf233e service nova] Creating event network-vif-unplugged:27c46b57-feba-40bd-95ee-929c50f6d0e4 for instance ba2411dd-1a42-4047-90ab-5e6bb098541a on n-h2-862416-2 Oct 22 03:14:38.944058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.944852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.945442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.946304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:38.947010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:38.949097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:38.956283 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0e6c9d7c-d130-430f-a0ac-7614df60b1ef req-24dbec85-db6c-4a9f-9f72-e38593bf233e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157097 Oct 22 03:14:38.959297 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1239/2489] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:38.972650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a3f83192-b9d4-42a7-b89c-9b628860a4d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d196ebaf0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:39.086962 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a3f83192-b9d4-42a7-b89c-9b628860a4d0 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.126019 Oct 22 03:14:39.115368 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1240/2490] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:38 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:39.136793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:39.141840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:39.159761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:39.161504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:39.164658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:39.165695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:39.166673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:39.167306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:39.168194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:39.182585 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd707f4a-1104-4e7e-bb09-0d5a44834fdc tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1222 microversion: 2.1 time: 0.279993 Oct 22 03:14:39.186721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1251/2491] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:38 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1222 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:39.291733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:39.292388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:39.331010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:39.345043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:39.346400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:39.354561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:39.355066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:39.355510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:39.558292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:39.585832 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-228c2598-3d3c-4ca9-8e3e-42d2681b8adf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.467105 Oct 22 03:14:39.588259 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1241/2492] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:39 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:39.609373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:39.610210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:39.630037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:39.633021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:39.636945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:39.640510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:39.643420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:39.644991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:39.667392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:39.678775 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f49c6b16-2ab7-4061-8d0b-b44dadd57807 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1278 microversion: 2.1 time: 0.393322 Oct 22 03:14:39.679369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1252/2493] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:39 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1278 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:39.864097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:39.875106 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7bdb0097-5c03-4bcd-bf98-0f197fe1895f tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.284743 Oct 22 03:14:39.876198 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1242/2494] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:39 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:39.911013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:39.911934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:39.921213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:39.927310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:39.928749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:39.930698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:39.931437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:39.932575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:40.119500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4203a47b-9e25-418b-9fe3-f3d157be261a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d197033a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:40.215394 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4203a47b-9e25-418b-9fe3-f3d157be261a tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.100486 Oct 22 03:14:40.215968 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1243/2495] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:40 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:40.233412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:40.234313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:40.245897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:40.246656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:40.247272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:40.248137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:40.248788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:40.250662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:40.303034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:40.315792 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dbb51df9-be16-4610-a952-70367fd67fc4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.408218 Oct 22 03:14:40.318546 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1253/2496] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:39 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:40.388180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:40.397903 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f8817ac-ddf3-44a5-b698-b65660d40fc8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1296 microversion: 2.1 time: 0.180644 Oct 22 03:14:40.398769 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1244/2497] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:40 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1296 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:40.614010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:40.614780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:40.630789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:40.631293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:40.631786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:40.632672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:40.633461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:40.633955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:40.708555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:40.709788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:40.716586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:40.717383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:40.719277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:40.720481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:40.721150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:40.721936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:41.101923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:41.119334 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35ce044b-b0ed-415d-8ea4-a9a87f45a905 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.512443 Oct 22 03:14:41.126400 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1254/2498] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:40 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:41.134010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:41.135902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:41.148889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:41.149671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:41.150773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:41.151655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:41.152806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:41.153900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:41.223172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:41.239217 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23e6a933-258c-4eeb-b780-9a62daea33b1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.535147 Oct 22 03:14:41.250208 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1245/2499] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:40 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:41.250692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8ae1f862-e3dc-4793-870c-b9fa02c4ea9f req-2fe92037-2cf6-451a-a941-a72ab07f6982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e08eda2-0515-4df1-8934-b9bbbbb4cf37", "name": "network-vif-plugged", "status": "completed", "tag": "da83328b-2366-4541-9e9a-28f1ed37f8bd"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:41.293960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8ae1f862-e3dc-4793-870c-b9fa02c4ea9f req-2fe92037-2cf6-451a-a941-a72ab07f6982 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:41.294561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8ae1f862-e3dc-4793-870c-b9fa02c4ea9f req-2fe92037-2cf6-451a-a941-a72ab07f6982 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:41.294966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8ae1f862-e3dc-4793-870c-b9fa02c4ea9f req-2fe92037-2cf6-451a-a941-a72ab07f6982 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:41.316644 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8ae1f862-e3dc-4793-870c-b9fa02c4ea9f req-2fe92037-2cf6-451a-a941-a72ab07f6982 service nova] Creating event network-vif-plugged:da83328b-2366-4541-9e9a-28f1ed37f8bd for instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 on n-h1-862416-2 Oct 22 03:14:41.328119 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8ae1f862-e3dc-4793-870c-b9fa02c4ea9f req-2fe92037-2cf6-451a-a941-a72ab07f6982 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083334 Oct 22 03:14:41.329114 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1246/2500] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:41.337828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a2abcb0a-c665-45c3-8e55-614a0fec91e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d196ee3a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:41.435189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a2abcb0a-c665-45c3-8e55-614a0fec91e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.104821 Oct 22 03:14:41.435790 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1247/2501] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:41 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:41.479202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:41.479894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:41.495873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:41.496645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:41.497243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:41.498121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:41.498736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:41.506481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:41.616305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:41.640145 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1b148cf-59c3-47e1-b8a5-220055fb09dd tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.511698 Oct 22 03:14:41.641511 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1255/2502] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:41 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:41.647767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:41.654358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:41.664148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:41.666571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:41.669841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:41.679684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:41.680364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:41.682905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:42.002008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:42.015360 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bf217644-d3b5-4cd5-9655-9831dbd3a75c tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1319 microversion: 2.1 time: 0.558512 Oct 22 03:14:42.017409 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1248/2503] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:41 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:42.041812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:42.056408 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ff00f3c-70a5-4fcb-ad35-7a428b075ee3 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.413315 Oct 22 03:14:42.059577 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1256/2504] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:41 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:42.152572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:42.153184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:42.161122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:42.161620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:42.162057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:42.162766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:42.163220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:42.163643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:42.263974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:42.265166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:42.277538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:42.278037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:42.278479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:42.279198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:42.279658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:42.280149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:42.490411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:42.503223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6e166bf-a654-4dfc-b209-8da285ae2f09 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.354490 Oct 22 03:14:42.504391 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1249/2505] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:42 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:42.509204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ba71eb6-de9c-4896-86e6-a590301f981f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1978bca0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:42.574814 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ba71eb6-de9c-4896-86e6-a590301f981f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.069236 Oct 22 03:14:42.575948 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1250/2506] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:42 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:42.602993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:42.613712 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2537e8f4-a4a4-429d-8a3c-d0035922d893 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.353451 Oct 22 03:14:42.637062 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1257/2507] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:42 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:42.668427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:42.669026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:42.679293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:42.680705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:42.681559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:42.682536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:42.686965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:42.687817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:42.924476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8070aa7b-8964-4830-a211-d16eadda3e68 req-21135d04-7fe7-4e5d-90db-47096022573b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9186d1-57ed-48a2-b004-417df2ad0eec", "tag": "cc77aa24-6af1-4fd0-a9b9-15f2d3264543"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:42.971694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8070aa7b-8964-4830-a211-d16eadda3e68 req-21135d04-7fe7-4e5d-90db-47096022573b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:42.973132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8070aa7b-8964-4830-a211-d16eadda3e68 req-21135d04-7fe7-4e5d-90db-47096022573b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:42.973639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8070aa7b-8964-4830-a211-d16eadda3e68 req-21135d04-7fe7-4e5d-90db-47096022573b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.018023 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8070aa7b-8964-4830-a211-d16eadda3e68 req-21135d04-7fe7-4e5d-90db-47096022573b service nova] Creating event network-changed:cc77aa24-6af1-4fd0-a9b9-15f2d3264543 for instance ff9186d1-57ed-48a2-b004-417df2ad0eec on n-h2-862416-2 Oct 22 03:14:43.031821 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8070aa7b-8964-4830-a211-d16eadda3e68 req-21135d04-7fe7-4e5d-90db-47096022573b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119338 Oct 22 03:14:43.032521 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1258/2508] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:43.043683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:43.048736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:43.060368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.061184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.062526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.063704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.064342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.064913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.112997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:43.124270 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eaaf0bd7-f847-4d11-bad3-24e254b4c4de tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.459298 Oct 22 03:14:43.128644 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1251/2509] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:42 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:43.141298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:43.142241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:43.156984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.158087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.160837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.162685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.168309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.169003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.436327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:43.452906 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-87b8308b-9397-4175-9841-de7c8329154d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1469 microversion: 2.1 time: 0.413254 Oct 22 03:14:43.462518 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1259/2510] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:43 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1469 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:43.470236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-377d1b6f-ce01-4f98-82cf-e96c382b6b66 req-30ca4063-52ad-4280-821c-f3516620a025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a060e0-503f-4872-9fef-4f919a12ebd9", "tag": "15602e98-f74c-4c56-b0d3-4eb8b025a109"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:43.489836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-377d1b6f-ce01-4f98-82cf-e96c382b6b66 req-30ca4063-52ad-4280-821c-f3516620a025 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.490321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-377d1b6f-ce01-4f98-82cf-e96c382b6b66 req-30ca4063-52ad-4280-821c-f3516620a025 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.490756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-377d1b6f-ce01-4f98-82cf-e96c382b6b66 req-30ca4063-52ad-4280-821c-f3516620a025 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.499273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:43.518477 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-377d1b6f-ce01-4f98-82cf-e96c382b6b66 req-30ca4063-52ad-4280-821c-f3516620a025 service nova] Creating event network-changed:15602e98-f74c-4c56-b0d3-4eb8b025a109 for instance f4a060e0-503f-4872-9fef-4f919a12ebd9 on n-h2-862416-2 Oct 22 03:14:43.526600 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3630603-c1ad-435e-b72d-5bae3bebadcf tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.395017 Oct 22 03:14:43.527180 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1252/2511] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:43 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:43.532791 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-377d1b6f-ce01-4f98-82cf-e96c382b6b66 req-30ca4063-52ad-4280-821c-f3516620a025 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068487 Oct 22 03:14:43.539362 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1260/2512] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:43.557260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d2b56e40-5c0a-4e87-a668-56e1f00f7f4c req-4f532a00-f9f0-4511-a6f3-2b4974276ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d5af8e-154b-4a08-bb37-0a1947b49d82", "name": "network-vif-plugged", "status": "completed", "tag": "ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:43.576014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d2b56e40-5c0a-4e87-a668-56e1f00f7f4c req-4f532a00-f9f0-4511-a6f3-2b4974276ab8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.576928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d2b56e40-5c0a-4e87-a668-56e1f00f7f4c req-4f532a00-f9f0-4511-a6f3-2b4974276ab8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.578209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d2b56e40-5c0a-4e87-a668-56e1f00f7f4c req-4f532a00-f9f0-4511-a6f3-2b4974276ab8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.591861 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d2b56e40-5c0a-4e87-a668-56e1f00f7f4c req-4f532a00-f9f0-4511-a6f3-2b4974276ab8 service nova] Creating event network-vif-plugged:ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3 for instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 on n-h1-862416-2 Oct 22 03:14:43.599455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d2b56e40-5c0a-4e87-a668-56e1f00f7f4c req-4f532a00-f9f0-4511-a6f3-2b4974276ab8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062970 Oct 22 03:14:43.605517 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1253/2513] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:43.612576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:43.613940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:43.621433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.622687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.623347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.625143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.626054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.638061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.665428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:43.776096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-258146119", "block_migration": true, "disk_over_commit": false}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:43.780803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:43.789504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.790225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.790839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.791855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.792501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.793101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.833715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lazy-loading 'flavor' on Instance uuid 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:14:43.851322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Going to try to live migrate instance to tempest-host-258146119 {{(pid=120582) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:14:43.861514 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] HTTP exception thrown: Compute host tempest-host-258146119 could not be found. Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Request method failure captured: Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37/action HTTP/1.1 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 106 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2AHvPVcPRlV2RBm5IF2hpNXu1DfGOtTO2s7QIx2Go4dsPcpQy9c5mE_JlBOxdlRY6zDpz-3iqMsVTu6qZgG2WEtefnQ4WzwBiOTFgD5Zkk-inYxoeTNJC0RgxYnDu0ho4buKcDlJ3NEoZfhLfvD-Um6Ntz38DpgCP3zJgL981T8II8 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: bc1eaf5de08044adb7e08347166043a9 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-LiveMigrationNegativeTest-688124954 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc1eaf5de08044adb7e08347166043a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc1eaf5de08044adb7e08347166043a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc1eaf5de08044adb7e08347166043a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc1eaf5de08044adb7e08347166043a9"}]}] Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-LiveMigrationNegativeTest-688124954 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: bc1eaf5de08044adb7e08347166043a9 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-688124954 Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-LiveMigrationNegativeTest-688124954-project-admin Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4c71db24b10c460aa0697d822686830e Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-LiveMigrationNegativeTest-688124954-project-admin Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: {"os-migrateLive": {"host": "tempest-host-258146119", "block_migration": true, "disk_over_commit": false}} Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: exception: Compute host tempest-host-258146119 could not be found. Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '3e08eda2-0515-4df1-8934-b9bbbbb4cf37', 'body': {'os-migrateLive': {'host': 'tempest-host-258146119', 'block_migration': True, 'disk_over_commit': False}}} Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 22 03:14:43.875916 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-258146119 could not be found. Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-258146119 could not be found. Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-258146119 could not be found. Oct 22 03:14:43.880959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:14:43.887592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Returning 400 to user: Compute host tempest-host-258146119 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:43.888953 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83b505d1-8fc8-4744-97e4-d84977b2286f tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37/action" status: 400 len: 99 microversion: 2.1 time: 0.347684 Oct 22 03:14:43.894767 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1261/2514] 10.222.0.25 () {60 vars in 1279 bytes} [Sat Oct 22 03:14:43 2022] POST /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37/action => generated 99 bytes in 354 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:14:43.900799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-928ed5e9-8c15-422b-93c0-daa58e46262c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a8a1550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:43.963084 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-928ed5e9-8c15-422b-93c0-daa58e46262c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.066125 Oct 22 03:14:43.963734 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1262/2515] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:43 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:43.970847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:43.972824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:43.982494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.983707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.984438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:43.985394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:43.986753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:43.987499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.140860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:44.151207 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-acdab634-0ea8-4f56-be78-b17197d0e8c3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.186087 Oct 22 03:14:44.152199 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1263/2516] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:43 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:44.157562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:44.158386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:44.165110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:44.165813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:44.166414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.167293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:44.167906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:44.168516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.279427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:44.288697 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2efdd296-9b40-4ebe-87ec-45ec637814ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.681471 Oct 22 03:14:44.289960 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1254/2517] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:43 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:44.294832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:44.295836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:44.303040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:44.303729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:44.304392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.305526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:44.306157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:44.306730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.323538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:44.333961 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2946c994-03c2-4b25-8f55-ff2d4fd517a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1469 microversion: 2.1 time: 0.180428 Oct 22 03:14:44.335191 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1264/2518] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:44 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:44.477069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1765345026", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:44.478201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:44.491309 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d6407a81-5669-4b28-901b-7bc1ed4d79f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.199818 Oct 22 03:14:44.492090 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1255/2519] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:44 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:44.545205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:14:44.551711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:44.553766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:44.562237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:44.564196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:44.564863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.565793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:44.566472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:44.567302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.726742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:44.736132 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4dbc73b-d3fc-41e6-8359-8178f41d73c0 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.188158 Oct 22 03:14:44.737355 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1256/2520] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:44 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:44.818545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:14:44.819032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:14:44.819681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:14:44.820096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:14:44.820534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:14:44.830877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:44.831438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:44.831899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.832926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:44.833390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:44.833843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:44.852813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Getting quotas for project 49b19776feac4cc18fa1980aca044892. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:14:44.859423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Getting quotas for user 0bf6eac62509482ebfa5b1ebb4dd08ab and project 49b19776feac4cc18fa1980aca044892. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:14:44.872343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:14:44.874913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:14:44.896755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:44.926367 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f77b73db-68fa-4caf-9bd1-04dadab4a3a4 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453670 Oct 22 03:14:44.934623 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1265/2521] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:14:44.939968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2192c13-a4fa-4bd0-bcb4-31b7c64232aa tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:44.940747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2192c13-a4fa-4bd0-bcb4-31b7c64232aa tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:44.990457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aec2c300-d482-47b2-8dcc-61afea0ff648 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a8a1f70>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:45.017651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d2192c13-a4fa-4bd0-bcb4-31b7c64232aa tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:45.027920 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2192c13-a4fa-4bd0-bcb4-31b7c64232aa tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1219 microversion: 2.1 time: 0.090300 Oct 22 03:14:45.029166 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1257/2522] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:44 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:45.074509 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aec2c300-d482-47b2-8dcc-61afea0ff648 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.094688 Oct 22 03:14:45.085073 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1266/2523] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:44 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:45.178658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:45.180895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:45.194043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:45.195285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:45.195980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:45.197240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:45.198184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:45.198819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:45.321091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:45.322357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:45.337072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:45.337555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:45.338232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:45.339152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:45.340304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:45.344219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:45.389988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:45.400283 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2430f057-0871-456b-b121-056f6cc8a331 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.227773 Oct 22 03:14:45.401636 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1258/2524] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:45 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:45.515788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:45.516438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:45.532252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:45.532705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:45.533170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:45.533883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:45.534336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:45.534756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:45.551112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:45.565816 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eef064dd-5a13-43fd-8d91-8a29e985cbcf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1358 microversion: 2.1 time: 0.253472 Oct 22 03:14:45.587544 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1267/2525] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:45 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:45.744570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:45.761386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:45.762061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:45.770998 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6dbaf51-8837-406f-8389-1758df77c9e9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.259485 Oct 22 03:14:45.776236 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1259/2526] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:45 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:45.777020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:45.778043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:45.778648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:45.779518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:45.780678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:45.781941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.029301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:46.042254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bfb057d7-36a4-4233-a6b1-5546cacb72a7 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.285537 Oct 22 03:14:46.046459 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1268/2527] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:45 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:46.056522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:46.057978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:46.066081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:46.073524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.074820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.075598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.076625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.078580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.079738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.096122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af96eb77-b453-4063-96a0-4850571c10eb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a6c5040>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:46.181005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:46.181178 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af96eb77-b453-4063-96a0-4850571c10eb tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.094056 Oct 22 03:14:46.182260 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1269/2528] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:46 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:46.193571 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-587cee4e-c2d6-43d3-b0a5-d58945f61075 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1215 microversion: 2.1 time: 0.141212 Oct 22 03:14:46.194085 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1260/2529] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:46 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:46.424971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:46.425779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:46.435700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.436238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.437922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.438640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.439096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.439530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.458707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:46.592147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:46.593489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:46.601185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.601672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.601906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:46.602097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.603365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.603818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.604444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.616880 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5afb9fe-96b4-435f-8c72-3e6f1d66689a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.197163 Oct 22 03:14:46.617485 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1270/2530] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:46 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:46.801773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:46.802387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:46.809201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:46.813772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.814506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.816687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.817597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.818213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.821415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.821520 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0dbb9f38-a847-4d32-b1e8-5054146f429c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1541 microversion: 2.1 time: 0.233441 Oct 22 03:14:46.831804 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1261/2531] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:46 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1541 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:46.860938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:46.861525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:46.871712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.873503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.875299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:46.876127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:46.876780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:46.877291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:47.007333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:47.018464 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80d682a0-3158-42c6-a9cf-90151e6ee076 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.220599 Oct 22 03:14:47.021099 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1271/2532] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:46 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:47.069863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:47.071279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:47.078429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:47.079122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:47.079898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:47.080806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:47.081411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:47.081992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:47.091564 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db57aca6-9317-4f12-85e7-802d08aa2cfe tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236197 Oct 22 03:14:47.092909 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1262/2533] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:14:46 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-interface => generated 285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:14:47.201036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c31a43b-b4f9-43aa-85a4-215c214d1da6 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d196cdc10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:47.274147 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c31a43b-b4f9-43aa-85a4-215c214d1da6 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.077620 Oct 22 03:14:47.274753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1263/2534] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:47 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:47.286081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:47.286716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:47.310036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:47.311158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:47.312413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:47.313182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:47.313642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:47.314064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:47.457686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:47.458670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:47.466724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0b91a22-7227-4a1b-9cec-5980d24a1f44 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.401541 Oct 22 03:14:47.489383 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1272/2535] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:47 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:47.496548 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d1d49b41-4f09-4a59-8422-4558f561fc0a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1277 microversion: 2.1 time: 0.213199 Oct 22 03:14:47.497685 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1264/2536] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:47 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:47.641012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:47.641274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:47.658254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:47.659139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:47.659793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:47.660759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:47.661450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:47.662133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:48.047369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:48.048053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:48.056044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:48.061849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:48.062850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:48.063851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:48.064418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:48.066002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:48.382291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:48.391206 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aad34071-1616-4230-93e2-bd5d6e4890fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.348398 Oct 22 03:14:48.395734 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1265/2537] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:48 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:48.403637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:48.404196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3a48a0bb-37d3-4796-a476-c98a4179c5f6 req-dbd8fdd7-a6ff-4f77-a16f-977e662595dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2411dd-1a42-4047-90ab-5e6bb098541a", "name": "network-vif-plugged", "status": "completed", "tag": "27c46b57-feba-40bd-95ee-929c50f6d0e4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:48.416038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-903fda48-5bdb-4f84-bf73-387a85b0eaac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.779837 Oct 22 03:14:48.418929 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1273/2538] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:47 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:48.428829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a48a0bb-37d3-4796-a476-c98a4179c5f6 req-dbd8fdd7-a6ff-4f77-a16f-977e662595dc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:48.431257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a48a0bb-37d3-4796-a476-c98a4179c5f6 req-dbd8fdd7-a6ff-4f77-a16f-977e662595dc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:48.438972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9d8bfe3-123f-460f-bffe-8fe02d0c6aa9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1e4eaca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:48.440450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a48a0bb-37d3-4796-a476-c98a4179c5f6 req-dbd8fdd7-a6ff-4f77-a16f-977e662595dc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:48.460363 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3a48a0bb-37d3-4796-a476-c98a4179c5f6 req-dbd8fdd7-a6ff-4f77-a16f-977e662595dc service nova] Creating event network-vif-plugged:27c46b57-feba-40bd-95ee-929c50f6d0e4 for instance ba2411dd-1a42-4047-90ab-5e6bb098541a on n-h2-862416-2 Oct 22 03:14:48.466096 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3a48a0bb-37d3-4796-a476-c98a4179c5f6 req-dbd8fdd7-a6ff-4f77-a16f-977e662595dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069028 Oct 22 03:14:48.468527 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1266/2539] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:48.501976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:48.502793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:48.514149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:48.517713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:48.518773 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9d8bfe3-123f-460f-bffe-8fe02d0c6aa9 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.097352 Oct 22 03:14:48.519420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:48.520061 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1274/2540] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:48 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:48.527055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:48.528221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:48.533810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:48.534505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:48.537151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:48.537613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:48.537748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:48.538074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:48.538867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:48.539331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:48.539761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:48.857528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:48.867379 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d1f9545-5bf5-4c94-ad1f-5373a629925c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.370951 Oct 22 03:14:48.878947 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1267/2541] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:48 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:49.121489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:49.137720 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f666c865-4019-40ff-84f0-3ac3d18b838a tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1319 microversion: 2.1 time: 0.616461 Oct 22 03:14:49.138325 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1275/2542] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:48 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:49.420108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:49.421428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:49.438425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:49.438924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:49.439365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:49.440074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:49.440554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:49.440978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:49.442458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:49.443424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:49.455145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:49.455715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:49.456157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:49.456930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:49.457608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:49.458040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:49.637226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:49.652041 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0d08102-5b7d-4862-829d-48e6111d6af5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.215078 Oct 22 03:14:49.666447 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1276/2543] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:49 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:49.677721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0958308a-6675-4d82-b4a3-ed49ac656b2b req-7567b975-313a-4fe1-b243-9e3e936721ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d5af8e-154b-4a08-bb37-0a1947b49d82", "tag": "ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:49.693318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0958308a-6675-4d82-b4a3-ed49ac656b2b req-7567b975-313a-4fe1-b243-9e3e936721ad service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:49.694199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0958308a-6675-4d82-b4a3-ed49ac656b2b req-7567b975-313a-4fe1-b243-9e3e936721ad service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:49.694905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0958308a-6675-4d82-b4a3-ed49ac656b2b req-7567b975-313a-4fe1-b243-9e3e936721ad service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:49.709218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0958308a-6675-4d82-b4a3-ed49ac656b2b req-7567b975-313a-4fe1-b243-9e3e936721ad service nova] Creating event network-changed:ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3 for instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 on n-h1-862416-2 Oct 22 03:14:49.715140 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0958308a-6675-4d82-b4a3-ed49ac656b2b req-7567b975-313a-4fe1-b243-9e3e936721ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042047 Oct 22 03:14:49.716899 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1277/2544] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:49.724506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f77976aa-5b82-4cfa-b039-07940208773d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a58d9d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:49.797790 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f77976aa-5b82-4cfa-b039-07940208773d tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.078171 Oct 22 03:14:49.798862 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1278/2545] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:49 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:49.819744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:49.831093 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc292bfe-e2ca-468a-8a85-0801260b7dfc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.412861 Oct 22 03:14:49.833219 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1268/2546] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:49 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:49.897848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:49.898851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:49.913224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:49.915299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:49.915987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:49.919846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:49.921410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:49.922164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:50.162083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:50.162695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:50.176569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:50.177402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:50.178048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:50.179061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:50.179701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:50.181078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:50.208711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:50.221471 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82b01314-c480-4c81-af1b-b41e1e324d8a tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.330008 Oct 22 03:14:50.228612 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1279/2547] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:49 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:50.241311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4cd520d7-51a3-4a7d-abc0-1da727fad3ec req-ffabd5ef-3e80-44be-aa67-83d83e28520d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56cb105f-28e8-4f91-becc-ecd4ad359910", "tag": "6eefe9c5-3e63-4c25-9303-f4a4c3d476f2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:50.256069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4cd520d7-51a3-4a7d-abc0-1da727fad3ec req-ffabd5ef-3e80-44be-aa67-83d83e28520d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:50.256589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4cd520d7-51a3-4a7d-abc0-1da727fad3ec req-ffabd5ef-3e80-44be-aa67-83d83e28520d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:50.257027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4cd520d7-51a3-4a7d-abc0-1da727fad3ec req-ffabd5ef-3e80-44be-aa67-83d83e28520d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:50.275989 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4cd520d7-51a3-4a7d-abc0-1da727fad3ec req-ffabd5ef-3e80-44be-aa67-83d83e28520d service nova] Creating event network-changed:6eefe9c5-3e63-4c25-9303-f4a4c3d476f2 for instance 56cb105f-28e8-4f91-becc-ecd4ad359910 on n-h1-862416-2 Oct 22 03:14:50.283032 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4cd520d7-51a3-4a7d-abc0-1da727fad3ec req-ffabd5ef-3e80-44be-aa67-83d83e28520d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052994 Oct 22 03:14:50.285153 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1280/2548] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:50.622326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:50.638869 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-77527029-a83a-4a24-9937-5d6ec137cbb5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1319 microversion: 2.1 time: 0.479116 Oct 22 03:14:50.640709 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1269/2549] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:50 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:50.679395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:50.680427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:50.691155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:50.692011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:50.692710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:50.693447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:50.693910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:50.694366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:50.817112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-247bf055-5fc9-4c84-b479-e170ae99304f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d196c11f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:50.898318 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-247bf055-5fc9-4c84-b479-e170ae99304f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.087326 Oct 22 03:14:50.898932 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1270/2550] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:50 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:50.914889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:50.915506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:50.923294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:50.923789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:50.924261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:50.924961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:50.925407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:50.926138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:50.981231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:50.993065 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-87438508-842f-4119-8a86-5a31d793b863 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.317612 Oct 22 03:14:50.993301 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1281/2551] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:50 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:51.251589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:51.252246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:51.267282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:51.267945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:51.268563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:51.269360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:51.269987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:51.270546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:51.282162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:51.292126 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b4880aef-9662-44e0-8b32-44189496c519 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.382877 Oct 22 03:14:51.293360 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1271/2552] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:50 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:51.458418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:51.466711 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db48e353-ebb4-48c4-8bf0-27ff02adcd75 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.219740 Oct 22 03:14:51.483979 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1282/2553] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:51 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:51.662724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:51.663241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:51.670370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:51.671470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:51.671930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:51.672847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:51.673302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:51.673723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:51.835773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:51.848623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa686a32-6598-4fd0-bd57-026ad176ee3d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1319 microversion: 2.1 time: 0.189924 Oct 22 03:14:51.860819 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1272/2554] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:51 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:51.915261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e599c365-0b53-4d8e-9cf4-083202d83a6c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a0e0b80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:51.980459 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e599c365-0b53-4d8e-9cf4-083202d83a6c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.069168 Oct 22 03:14:51.981356 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1283/2555] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:51 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:52.025109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:52.025755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:52.036928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.037706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.038158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.038884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.039349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.039839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.309120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2aa5e990-55c1-46e2-bd84-47e4e829804c req-ef3f3a45-3424-48a5-ab9d-a4b73f936d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9186d1-57ed-48a2-b004-417df2ad0eec", "name": "network-vif-plugged", "status": "completed", "tag": "cc77aa24-6af1-4fd0-a9b9-15f2d3264543"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:52.338546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2aa5e990-55c1-46e2-bd84-47e4e829804c req-ef3f3a45-3424-48a5-ab9d-a4b73f936d22 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.339272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2aa5e990-55c1-46e2-bd84-47e4e829804c req-ef3f3a45-3424-48a5-ab9d-a4b73f936d22 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.339900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2aa5e990-55c1-46e2-bd84-47e4e829804c req-ef3f3a45-3424-48a5-ab9d-a4b73f936d22 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.355002 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2aa5e990-55c1-46e2-bd84-47e4e829804c req-ef3f3a45-3424-48a5-ab9d-a4b73f936d22 service nova] Creating event network-vif-plugged:cc77aa24-6af1-4fd0-a9b9-15f2d3264543 for instance ff9186d1-57ed-48a2-b004-417df2ad0eec on n-h2-862416-2 Oct 22 03:14:52.366689 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2aa5e990-55c1-46e2-bd84-47e4e829804c req-ef3f3a45-3424-48a5-ab9d-a4b73f936d22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061426 Oct 22 03:14:52.367872 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1284/2556] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:52.376661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:52.386786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:52.418486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.424311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.424951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.429716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.430449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.431089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.482756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:52.500983 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-468752ee-2b9f-423a-b84f-5a5db1a0ab29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.481716 Oct 22 03:14:52.501581 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1273/2557] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:52 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:52.506027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:52.506630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:52.523280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.523776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.524260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.525045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.525504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.526093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.672675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:52.681392 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5d5eb47-c6b0-4fdb-95ad-d86086a97b1e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.311933 Oct 22 03:14:52.684583 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1285/2558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:52 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:52.874377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:52.875899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:52.883970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.884481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.884936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.885865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:52.886345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:52.886785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:52.891793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:52.894327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:52.906574 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2db2732d-43f5-4bfb-badd-51e0930c0d67 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.402281 Oct 22 03:14:52.927002 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1274/2559] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:52 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:53.003671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2034de57-0dfc-46a6-ad56-9af6514c98f5 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d19703790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:53.063383 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2034de57-0dfc-46a6-ad56-9af6514c98f5 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.064082 Oct 22 03:14:53.064465 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1275/2560] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:52 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:53.093492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:53.101663 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ffcc98c-fa37-4f22-b16a-2fb9fd15c6cb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1319 microversion: 2.1 time: 0.232101 Oct 22 03:14:53.114616 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1286/2561] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:52 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:53.523917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:53.524554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:53.530833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:53.531306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:53.531739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:53.532472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:53.532926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:53.533379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:53.667206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:53.675890 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cd6bc814-c4af-4d0c-9714-0bf22d3c7204 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1308 microversion: 2.1 time: 0.155760 Oct 22 03:14:53.676375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1276/2562] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:53 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:53.707055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:53.707727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:53.715701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:53.716177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:53.716627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:53.717352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:53.718368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:53.718794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:53.855158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:53.863646 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92710711-828e-44ea-aed1-c84117c0fd10 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1528 microversion: 2.1 time: 0.160577 Oct 22 03:14:53.864232 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1287/2563] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:53 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1528 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:53.934259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:53.934863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:53.941312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:53.941794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:53.942226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:53.942905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:53.943347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:53.943764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:54.076094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:54.079050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e59c0d3-f9a0-4084-8811-79845df5727b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1e5340d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:54.085184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0a5a5e4-3e96-44d0-a75e-44937c440ae1 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.155059 Oct 22 03:14:54.100745 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1277/2564] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:53 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:54.124954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:54.125682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:54.127505 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e59c0d3-f9a0-4084-8811-79845df5727b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.052682 Oct 22 03:14:54.132176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:54.132756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:54.133258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:54.134030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:54.134553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:54.135048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:54.136378 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1288/2565] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:54 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:54.270029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:54.278292 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-21a275cd-97ff-41d4-a616-08ef4be19065 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1319 microversion: 2.1 time: 0.157327 Oct 22 03:14:54.278880 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1278/2566] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:54 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:54.701090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:54.701697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:54.710264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:54.710753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:54.711215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:54.711919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:54.712404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:54.712834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:54.844489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:54.866847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=18 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:54.889864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:54.890925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:54.891772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:54.900930 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b275d25d-2825-44fc-8212-99ea1d095999 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1488 microversion: 2.1 time: 0.203605 Oct 22 03:14:54.902059 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1289/2567] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:54 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1488 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:54.915034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:54.915896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:54.916601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:54.917559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:54.918015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:54.918437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:54.927434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:54.928255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:54.935228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:54.936066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:54.936819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:54.937834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:54.938502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:54.939136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:55.025491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:55.048982 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a78db226-7d77-4279-a724-ae6c3f9b17bf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec/action" status: 202 len: 0 microversion: 2.1 time: 0.125492 Oct 22 03:14:55.053608 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1290/2568] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:54 2022] POST /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:14:55.064915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:55.066660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:55.076450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:55.077742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:55.078896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:55.080675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:55.081912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:55.087203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:55.325033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:55.335735 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a071189-430c-4be2-92ff-24e1c1582091 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1493 microversion: 2.1 time: 0.277857 Oct 22 03:14:55.336532 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1291/2569] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:55 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1493 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:55.341855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:55.342761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:55.350354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:55.351059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:55.351691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:55.352827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:55.353563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:55.354133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:55.381038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:14:55.518768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:55.526747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4198d92b-63c0-4cad-a9a5-330061b9e47d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.188598 Oct 22 03:14:55.527862 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1292/2570] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:55 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:55.533839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-028f45c7-bcaa-4f13-929b-cfed1d0a7ee1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a473b80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:55.593334 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-028f45c7-bcaa-4f13-929b-cfed1d0a7ee1 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.064271 Oct 22 03:14:55.600338 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1293/2571] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:55 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:55.605968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:55.606538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:55.607341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:55.616255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:55.617429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:55.617967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:55.618093 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f333ec0d-0682-4c89-a185-d5bde5cd3416 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1510 microversion: 2.1 time: 0.734813 Oct 22 03:14:55.624654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:55.624819 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1279/2572] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:54 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1510 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:55.624905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:55.624905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:55.789175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:55.799292 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41724b12-e936-4caa-b2a6-e38aa51df6fb tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1319 microversion: 2.1 time: 0.197626 Oct 22 03:14:55.800140 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1294/2573] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:55 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:56.270519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e4b8e3c4-0e2d-420d-b55a-0015153ffa0a req-477d7691-85b1-4675-826b-c051692ea702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56cb105f-28e8-4f91-becc-ecd4ad359910", "name": "network-vif-plugged", "status": "completed", "tag": "6eefe9c5-3e63-4c25-9303-f4a4c3d476f2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:56.290215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e4b8e3c4-0e2d-420d-b55a-0015153ffa0a req-477d7691-85b1-4675-826b-c051692ea702 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.290941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e4b8e3c4-0e2d-420d-b55a-0015153ffa0a req-477d7691-85b1-4675-826b-c051692ea702 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.291809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e4b8e3c4-0e2d-420d-b55a-0015153ffa0a req-477d7691-85b1-4675-826b-c051692ea702 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.308455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e4b8e3c4-0e2d-420d-b55a-0015153ffa0a req-477d7691-85b1-4675-826b-c051692ea702 service nova] Creating event network-vif-plugged:6eefe9c5-3e63-4c25-9303-f4a4c3d476f2 for instance 56cb105f-28e8-4f91-becc-ecd4ad359910 on n-h1-862416-2 Oct 22 03:14:56.313705 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e4b8e3c4-0e2d-420d-b55a-0015153ffa0a req-477d7691-85b1-4675-826b-c051692ea702 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047457 Oct 22 03:14:56.314821 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1280/2574] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:14:56.362624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:56.363251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:56.371863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.372877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.373550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.374543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.375373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.375996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.554345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:56.556732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:56.569264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.571367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.571816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.573490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:56.575114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.575592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.576023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.582433 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2abe12a-eadf-41d8-9697-ea509e6eb9a2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 200 len: 1473 microversion: 2.1 time: 0.223747 Oct 22 03:14:56.583606 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1295/2575] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:56 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 1473 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:56.608444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1734473963"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:56.611137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:56.617792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.618293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.619389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.620116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.620606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.621041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.806351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:56.821068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f28ee07d-637c-4316-80a6-ad2c73282890 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.271120 Oct 22 03:14:56.821805 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1281/2576] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:56 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:56.826055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92f170d1-b5b3-49e3-9934-c9d18e1f8495 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d19675820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:56.930179 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92f170d1-b5b3-49e3-9934-c9d18e1f8495 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.107499 Oct 22 03:14:56.930858 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1282/2577] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:56 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:56.948191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:56.948995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:56.954928 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61595105-d23e-403e-85cc-6dfa90a8bb90 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec/action" status: 202 len: 0 microversion: 2.1 time: 0.351244 Oct 22 03:14:56.955580 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1296/2578] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:56 2022] POST /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 22 03:14:56.956865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.957485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.965273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:56.968927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.969697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.969801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:56.970170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.970598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.976427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.977012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.977450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:56.978496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:56.978960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:56.979385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:57.160040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:57.160519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:57.171827 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4919d068-c35c-4afe-94b5-c5e1dd4db4a5 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1319 microversion: 2.1 time: 0.212407 Oct 22 03:14:57.171979 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0e90958-7601-4447-96fd-0471f8eb0e67 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1510 microversion: 2.1 time: 0.239793 Oct 22 03:14:57.187679 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1283/2579] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:56 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:57.187679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28998fb5-bd22-4837-8ae7-ccaf85480727 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d19675d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:57.189173 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1297/2580] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:56 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:57.235196 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28998fb5-bd22-4837-8ae7-ccaf85480727 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.061105 Oct 22 03:14:57.235808 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1284/2581] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:57 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:57.852236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:57.853241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:57.870859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:57.871366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:57.871809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:57.872558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:57.873016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:57.873448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:57.948693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa219b3b-5de5-4ad3-a717-76059fe2a268 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a23d790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:58.017425 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa219b3b-5de5-4ad3-a717-76059fe2a268 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.074726 Oct 22 03:14:58.026740 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1285/2582] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:57 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:58.064470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:58.075124 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97a1aa64-efbb-4dba-8c1d-ac21cf0cddff tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.230314 Oct 22 03:14:58.090253 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1298/2583] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:57 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:58.195596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:58.196294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:58.203281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.203604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.204047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.204781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.205446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.205881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.213933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:58.214555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:58.224637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.225132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.225573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.226807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.226807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.227161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.386747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:58.395653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d5e991f-542a-4ef5-a090-f120fc4e0673 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1469 microversion: 2.1 time: 0.186421 Oct 22 03:14:58.409262 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1299/2584] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:58 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:58.411611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:58.418296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-51a73595-7c5b-4dc2-89ca-2e4263647d46 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a0e0700>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:58.425819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-60541439-c9d4-400e-ab39-2e8e2b367557 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1513 microversion: 2.1 time: 0.234107 Oct 22 03:14:58.432585 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1286/2585] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:58 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:58.441414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-775453e5-3e17-432d-8b84-54b3cb5e08a8 req-50fdb970-00b6-4de5-9cfa-8d683d3bcb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a060e0-503f-4872-9fef-4f919a12ebd9", "name": "network-vif-plugged", "status": "completed", "tag": "15602e98-f74c-4c56-b0d3-4eb8b025a109"}, {"server_uuid": "83aea4f8-aff9-49b1-9fac-7fa0c254fea3", "name": "network-vif-unplugged", "status": "completed", "tag": "cfaf4bdc-ec50-406c-ba43-5295b1573af3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:58.474288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-775453e5-3e17-432d-8b84-54b3cb5e08a8 req-50fdb970-00b6-4de5-9cfa-8d683d3bcb8c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.478699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-775453e5-3e17-432d-8b84-54b3cb5e08a8 req-50fdb970-00b6-4de5-9cfa-8d683d3bcb8c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.479172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-775453e5-3e17-432d-8b84-54b3cb5e08a8 req-50fdb970-00b6-4de5-9cfa-8d683d3bcb8c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.486685 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-51a73595-7c5b-4dc2-89ca-2e4263647d46 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.076192 Oct 22 03:14:58.487316 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1300/2586] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:58 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:58.491918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:58.492479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:58.498920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.499419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.499984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.500733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.501198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.501633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.507882 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-775453e5-3e17-432d-8b84-54b3cb5e08a8 req-50fdb970-00b6-4de5-9cfa-8d683d3bcb8c service nova] Creating event network-vif-plugged:15602e98-f74c-4c56-b0d3-4eb8b025a109 for instance f4a060e0-503f-4872-9fef-4f919a12ebd9 on n-h2-862416-2 Oct 22 03:14:58.508457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-775453e5-3e17-432d-8b84-54b3cb5e08a8 req-50fdb970-00b6-4de5-9cfa-8d683d3bcb8c service nova] Creating event network-vif-unplugged:cfaf4bdc-ec50-406c-ba43-5295b1573af3 for instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 on n-h2-862416-2 Oct 22 03:14:58.517178 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-775453e5-3e17-432d-8b84-54b3cb5e08a8 req-50fdb970-00b6-4de5-9cfa-8d683d3bcb8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.082917 Oct 22 03:14:58.517787 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1287/2587] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:14:58.523585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:58.524487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:58.533205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lazy-loading 'flavor' on Instance uuid 56cb105f-28e8-4f91-becc-ecd4ad359910 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:14:58.536430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.537087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.537519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.538224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.538824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.539394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.659795 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d6658dd7-fe90-4622-83e7-c331f22ab0c2 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910/action" status: 202 len: 0 microversion: 2.1 time: 0.171132 Oct 22 03:14:58.660922 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1301/2588] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:58 2022] POST /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:14:58.669768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:58.671093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:58.692852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.693357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.693804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.694548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:58.695005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:58.696380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:58.825999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:58.855026 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3fc9c3e-6379-4c20-864f-526ba2aef2ce tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1513 microversion: 2.1 time: 0.335812 Oct 22 03:14:58.861199 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1288/2589] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:58 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:58.912395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:58.924588 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e586b25-43ce-4d89-9466-143b598e8b36 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1477 microversion: 2.1 time: 0.258730 Oct 22 03:14:58.925451 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1302/2590] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:58 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:59.002131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:59.003923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:59.026277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.028616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.029285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.035441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.035948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.036415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.041799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b758da2-bd17-47ea-a513-d7eafc5bb812 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a929e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:59.079169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lazy-loading 'flavor' on Instance uuid 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:14:59.098516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Cannot 'shelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state shelved_offloaded Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action HTTP/1.1 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 14 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: {"shelve": {}} Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: exception: Cannot 'shelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state shelved_offloaded Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'shelve': {}}} Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:14:59.101371 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state shelved_offloaded Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state shelved_offloaded Oct 22 03:14:59.105303 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:14:59.107758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 409 to user: Cannot 'shelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state shelved_offloaded {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:14:59.108970 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-683a9b6b-2de9-40aa-af5a-3814165c7166 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 409 len: 155 microversion: 2.1 time: 0.120030 Oct 22 03:14:59.110025 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1289/2591] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:58 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 155 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:14:59.115774 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b758da2-bd17-47ea-a513-d7eafc5bb812 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.086257 Oct 22 03:14:59.120406 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1303/2592] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:59 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:59.120671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:59.120671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:59.121723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:14:59.122339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:59.124741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.125553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.126206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.127096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.127851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.128505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.129311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.129801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.130237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.130941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.131400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.131828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.189225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120582) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 03:14:59.300042 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-358e6965-fc24-46a0-888c-639586d35fe6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 202 len: 0 microversion: 2.1 time: 0.182059 Oct 22 03:14:59.307325 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1304/2593] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:14:59 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:14:59.313438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:59.314495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:59.322711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.322711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.323414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.324239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.324896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.325482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.327574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:59.340842 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33bfa512-f284-48ba-9c39-162705eedeb5 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.229289 Oct 22 03:14:59.341640 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1290/2594] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:59 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:59.504026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72720b0d-7174-4124-8cb1-c8e13406d4ed tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196ee160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:59.542096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:14:59.554312 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72720b0d-7174-4124-8cb1-c8e13406d4ed tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.055539 Oct 22 03:14:59.555427 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1291/2595] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:14:59 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:14:59.557825 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0bf4dae1-c486-4b91-a3fd-aa6c34c3a724 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1461 microversion: 2.1 time: 0.249093 Oct 22 03:14:59.558648 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1305/2596] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:59 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1461 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:14:59.955613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:14:59.956162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:14:59.968074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.969613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.970565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:14:59.972953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:14:59.974592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:14:59.975410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.132534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d355abf9-24b5-45a4-be74-619a11b56807 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a4250d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:00.168712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:00.184950 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-149f0309-ea8d-48b6-bcfe-9c381118aad3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1460 microversion: 2.1 time: 0.236488 Oct 22 03:15:00.189180 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1292/2597] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:14:59 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1460 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:00.212470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:00.214483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:00.225197 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d355abf9-24b5-45a4-be74-619a11b56807 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.096667 Oct 22 03:15:00.235172 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1306/2598] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:00 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:00.240531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.241306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.241915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.242798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.243401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.244003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.372669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:00.373627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:00.384990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.388199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.388857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.390636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.391760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.393038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.581811 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-64179534-06c6-4a51-b23c-56e9be0ac64c tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1611 microversion: 2.1 time: 0.374951 Oct 22 03:15:00.594201 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1293/2599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:00 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1611 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:00.607119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50b0da5f-25de-482a-ba6a-2c14775b48df tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196a9a60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:00.683906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50b0da5f-25de-482a-ba6a-2c14775b48df tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.086004 Oct 22 03:15:00.684753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1294/2600] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:00 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:00.692698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:00.699195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:00.716116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:00.718915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:00.721270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.722020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.722682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.723903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.724607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.725246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.728047 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84ae7e87-3fd3-442b-ab88-e55df49c4619 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1352 microversion: 2.1 time: 0.363914 Oct 22 03:15:00.728621 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1307/2601] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:00 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1352 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:00.752310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14c67638-342a-4889-8fb3-2d458de0db15 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:00.769054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14c67638-342a-4889-8fb3-2d458de0db15 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.769806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14c67638-342a-4889-8fb3-2d458de0db15 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.786289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14c67638-342a-4889-8fb3-2d458de0db15 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.789009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14c67638-342a-4889-8fb3-2d458de0db15 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.789835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14c67638-342a-4889-8fb3-2d458de0db15 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.790445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14c67638-342a-4889-8fb3-2d458de0db15 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.835221 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-14c67638-342a-4889-8fb3-2d458de0db15 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.105254 Oct 22 03:15:00.837717 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1308/2602] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:15:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:00.853569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:00.856953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:00.867898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.868607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.870583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.872200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.872861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.873444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.896069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:00.913617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Lazy-loading 'flavor' on Instance uuid 56cb105f-28e8-4f91-becc-ecd4ad359910 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:15:00.934493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:00.935488 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 56cb105f-28e8-4f91-becc-ecd4ad359910 while it is in vm_state suspended Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Request method failure captured: Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910/action HTTP/1.1 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 97 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2AHvPVcPRlV2RBm5IF2hpNXu1DfGOtTO2s7QIx2Go4dsPcpQy9c5mE_JlBOxdlRY6zDpz-3iqMsVTu6qZgG2WEtefnQ4WzwBiOTFgD5Zkk-inYxoeTNJC0RgxYnDu0ho4buKcDlJ3NEoZfhLfvD-Um6Ntz38DpgCP3zJgL981T8II8 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: bc1eaf5de08044adb7e08347166043a9 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-LiveMigrationNegativeTest-688124954 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc1eaf5de08044adb7e08347166043a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc1eaf5de08044adb7e08347166043a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc1eaf5de08044adb7e08347166043a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc1eaf5de08044adb7e08347166043a9"}]}] Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-LiveMigrationNegativeTest-688124954 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: bc1eaf5de08044adb7e08347166043a9 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-688124954 Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-LiveMigrationNegativeTest-688124954-project-admin Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4c71db24b10c460aa0697d822686830e Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-LiveMigrationNegativeTest-688124954-project-admin Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: {"os-migrateLive": {"host": "n-h2-862416-2", "block_migration": true, "disk_over_commit": false}} Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot 'os-migrateLive' instance 56cb105f-28e8-4f91-becc-ecd4ad359910 while it is in vm_state suspended Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '56cb105f-28e8-4f91-becc-ecd4ad359910', 'body': {'os-migrateLive': {'host': 'n-h2-862416-2', 'block_migration': True, 'disk_over_commit': False}}} Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56cb105f-28e8-4f91-becc-ecd4ad359910 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:00.940153 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 56cb105f-28e8-4f91-becc-ecd4ad359910 while it is in vm_state suspended Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 56cb105f-28e8-4f91-becc-ecd4ad359910 while it is in vm_state suspended Oct 22 03:15:00.944123 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:00.948542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 56cb105f-28e8-4f91-becc-ecd4ad359910 while it is in vm_state suspended {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:00.949843 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-792ac309-b90c-43f7-8193-239e790c25f0 tempest-LiveMigrationNegativeTest-688124954 tempest-LiveMigrationNegativeTest-688124954-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910/action" status: 409 len: 155 microversion: 2.1 time: 0.103487 Oct 22 03:15:00.950941 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1309/2603] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:00 2022] POST /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910/action => generated 155 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:00.961289 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c7266d54-a088-43ab-859e-0948c0f08272 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.275371 Oct 22 03:15:00.972438 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1295/2604] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:00 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:00.982130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:00.982130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:00.983985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.984457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.985012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:00.985925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:00.986702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:00.987143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:01.025241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:15:01.157991 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6fabf18-25c2-4cbe-aa36-8fc6691238af tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "DELETE /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 204 len: 0 microversion: 2.1 time: 0.197505 Oct 22 03:15:01.159936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1310/2605] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:15:00 2022] DELETE /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:15:01.167587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:01.168230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:01.176407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:01.177624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:01.178212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:01.179097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:01.179550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:01.180143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:01.243793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-298f83e3-4e90-41ca-8594-f2e8b24f853b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a51d0d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:01.326153 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-298f83e3-4e90-41ca-8594-f2e8b24f853b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.086802 Oct 22 03:15:01.327622 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1311/2606] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:01 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:01.444266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:01.457173 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c4fcdd3-76f5-49e1-ae60-e48542bb180f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1466 microversion: 2.1 time: 0.293316 Oct 22 03:15:01.462620 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1296/2607] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:01 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1466 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:01.705081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee4a46b3-3566-4891-9323-332d23920191 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a4135e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:01.751408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:01.752228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:01.769575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:01.772288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:01.772892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:01.773842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:01.774417 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee4a46b3-3566-4891-9323-332d23920191 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.075878 Oct 22 03:15:01.775074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:01.777061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:01.782127 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1312/2608] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:01 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:01.991946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:01.992606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:02.000107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:02.002829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:02.002829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:02.002829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:02.002829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:02.002829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:02.091569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:02.104117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4315cf8-82f2-4646-8e45-9dd3b3ba6b2c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1542 microversion: 2.1 time: 0.357156 Oct 22 03:15:02.105904 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1297/2609] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:01 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1542 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:02.132088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:02.132710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:02.143752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:02.144472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:02.144993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:02.145992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:02.146827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:02.147331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:02.240799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:02.251431 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-177c2162-fb87-4c43-b3a0-74be0652da09 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.265283 Oct 22 03:15:02.252835 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1313/2610] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:01 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:02.286678 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b83e597-8f47-4efe-8217-3873cd380e57 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160641 Oct 22 03:15:02.288320 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1298/2611] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:15:02 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:02.344525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bb95ddb6-dffc-4227-a441-a24a0aa7cf2c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a58d9d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:02.406604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9131c4b8-ec6a-451b-9d02-0d78a005f096 req-e35b1fe4-f0b2-4613-8734-38571c29e41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83aea4f8-aff9-49b1-9fac-7fa0c254fea3", "tag": "cfaf4bdc-ec50-406c-ba43-5295b1573af3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:02.502404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bb95ddb6-dffc-4227-a441-a24a0aa7cf2c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.163108 Oct 22 03:15:02.503010 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1314/2612] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:02 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:02.515768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9131c4b8-ec6a-451b-9d02-0d78a005f096 req-e35b1fe4-f0b2-4613-8734-38571c29e41c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:02.516524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9131c4b8-ec6a-451b-9d02-0d78a005f096 req-e35b1fe4-f0b2-4613-8734-38571c29e41c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:02.518345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:02.519013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9131c4b8-ec6a-451b-9d02-0d78a005f096 req-e35b1fe4-f0b2-4613-8734-38571c29e41c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:02.525979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:02.530914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:02.536861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:02.538182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:02.538730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:02.539557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:02.540120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:02.540679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:02.542327 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9131c4b8-ec6a-451b-9d02-0d78a005f096 req-e35b1fe4-f0b2-4613-8734-38571c29e41c service nova] Creating event network-changed:cfaf4bdc-ec50-406c-ba43-5295b1573af3 for instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 on n-h1-862416-2 Oct 22 03:15:02.547804 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9131c4b8-ec6a-451b-9d02-0d78a005f096 req-e35b1fe4-f0b2-4613-8734-38571c29e41c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155991 Oct 22 03:15:02.549036 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1299/2613] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:02.674215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ddfd8e7c-f09f-49d3-a541-c5fae5619968 req-cfb27d8d-1f1c-44c8-b797-94f3c4d2b82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9186d1-57ed-48a2-b004-417df2ad0eec", "name": "network-vif-plugged", "status": "completed", "tag": "cc77aa24-6af1-4fd0-a9b9-15f2d3264543"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:02.695779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ddfd8e7c-f09f-49d3-a541-c5fae5619968 req-cfb27d8d-1f1c-44c8-b797-94f3c4d2b82e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:02.696270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ddfd8e7c-f09f-49d3-a541-c5fae5619968 req-cfb27d8d-1f1c-44c8-b797-94f3c4d2b82e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:02.696704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ddfd8e7c-f09f-49d3-a541-c5fae5619968 req-cfb27d8d-1f1c-44c8-b797-94f3c4d2b82e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:02.722583 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ddfd8e7c-f09f-49d3-a541-c5fae5619968 req-cfb27d8d-1f1c-44c8-b797-94f3c4d2b82e service nova] Creating event network-vif-plugged:cc77aa24-6af1-4fd0-a9b9-15f2d3264543 for instance ff9186d1-57ed-48a2-b004-417df2ad0eec on n-h2-862416-2 Oct 22 03:15:02.735568 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ddfd8e7c-f09f-49d3-a541-c5fae5619968 req-cfb27d8d-1f1c-44c8-b797-94f3c4d2b82e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065828 Oct 22 03:15:02.741338 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1300/2614] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:02.792305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4fe58bb4-8d7d-43fd-9ea0-4db78ee85d49 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196f0d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:02.867044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4fe58bb4-8d7d-43fd-9ea0-4db78ee85d49 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.079710 Oct 22 03:15:02.876771 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1301/2615] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:02 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:02.912139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:02.921820 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-de8a3ddf-4bce-4ca3-b33b-627882872de3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1466 microversion: 2.1 time: 0.409971 Oct 22 03:15:02.926438 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1315/2616] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:02 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1466 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:03.283791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:03.285487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:03.305626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:03.306909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:03.308020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:03.309005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:03.309674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:03.310466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:03.527623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5ed2267-3821-4a16-941c-5f87a377cd29 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a4250d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:03.592202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:03.601276 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f547ebff-5480-4ce8-b690-cddc53ce20a7 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.328072 Oct 22 03:15:03.605288 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1302/2617] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:03 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:03.605560 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5ed2267-3821-4a16-941c-5f87a377cd29 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1426 microversion: 2.1 time: 0.081710 Oct 22 03:15:03.606523 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1316/2618] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:03 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:03.882920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-89ce65e7-4ec8-4ad5-b4da-54224f9f6faf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a0d1820>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:04.083755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f55ef2c0-0378-4855-b666-de8230efcbcb req-5211276c-6bf3-40a7-8bf3-f5c7185420dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a060e0-503f-4872-9fef-4f919a12ebd9", "tag": "15602e98-f74c-4c56-b0d3-4eb8b025a109"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:04.111270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f55ef2c0-0378-4855-b666-de8230efcbcb req-5211276c-6bf3-40a7-8bf3-f5c7185420dd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:04.111779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f55ef2c0-0378-4855-b666-de8230efcbcb req-5211276c-6bf3-40a7-8bf3-f5c7185420dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:04.112242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f55ef2c0-0378-4855-b666-de8230efcbcb req-5211276c-6bf3-40a7-8bf3-f5c7185420dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:04.158938 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f55ef2c0-0378-4855-b666-de8230efcbcb req-5211276c-6bf3-40a7-8bf3-f5c7185420dd service nova] Creating event network-changed:15602e98-f74c-4c56-b0d3-4eb8b025a109 for instance f4a060e0-503f-4872-9fef-4f919a12ebd9 on n-h2-862416-2 Oct 22 03:15:04.175989 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f55ef2c0-0378-4855-b666-de8230efcbcb req-5211276c-6bf3-40a7-8bf3-f5c7185420dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290325 Oct 22 03:15:04.179742 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1303/2619] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:04.186863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:04.187905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:04.195679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:04.196451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:04.197128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:04.197998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:04.198740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:04.199376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:04.238074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:04.239084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:04.239681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:04.240434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lazy-loading 'fault' on Instance uuid 56cb105f-28e8-4f91-becc-ecd4ad359910 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:15:04.366417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:04.382450 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-078017cc-0bda-4334-8db2-17283fe2279d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 200 len: 1309 microversion: 2.1 time: 0.200454 Oct 22 03:15:04.383368 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1304/2620] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:04 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 1309 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:04.565425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c04c37f9-d601-451f-a2c6-999f7cacd919 req-9dd55237-f42b-4013-8ff3-97936b0c760b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56cb105f-28e8-4f91-becc-ecd4ad359910", "name": "network-vif-deleted", "tag": "6eefe9c5-3e63-4c25-9303-f4a4c3d476f2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:04.586080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c04c37f9-d601-451f-a2c6-999f7cacd919 req-9dd55237-f42b-4013-8ff3-97936b0c760b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:04.586568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c04c37f9-d601-451f-a2c6-999f7cacd919 req-9dd55237-f42b-4013-8ff3-97936b0c760b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:04.587001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c04c37f9-d601-451f-a2c6-999f7cacd919 req-9dd55237-f42b-4013-8ff3-97936b0c760b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:04.613149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c04c37f9-d601-451f-a2c6-999f7cacd919 req-9dd55237-f42b-4013-8ff3-97936b0c760b service nova] Creating event network-vif-deleted:6eefe9c5-3e63-4c25-9303-f4a4c3d476f2 for instance 56cb105f-28e8-4f91-becc-ecd4ad359910 on n-h1-862416-2 Oct 22 03:15:04.623485 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c04c37f9-d601-451f-a2c6-999f7cacd919 req-9dd55237-f42b-4013-8ff3-97936b0c760b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061509 Oct 22 03:15:04.625703 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1305/2621] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:15:04.638438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2067e26-dc6d-473c-8283-0589eac51eca tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1978b790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:07.787302 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-89ce65e7-4ec8-4ad5-b4da-54224f9f6faf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 3.908315 Oct 22 03:15:07.787897 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1317/2622] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:03 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 3910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:07.792395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:07.793007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:07.799673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:07.800165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:07.800691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:07.801429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:07.801890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:07.802323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:07.805210 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2067e26-dc6d-473c-8283-0589eac51eca tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1435 microversion: 2.1 time: 3.174626 Oct 22 03:15:07.806492 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1306/2623] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:04 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1435 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:07.813701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:07.814596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 56cb105f-28e8-4f91-becc-ecd4ad359910] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:07.821873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:07.822590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:07.823217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:07.824107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:07.824766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:07.825371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:07.857064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] HTTP exception thrown: Instance 56cb105f-28e8-4f91-becc-ecd4ad359910 could not be found. Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Request method failure captured: Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 HTTP/1.1 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AFVtL57sk__lhMUp4JJkwUWSnk2isvcgOLSh-o97ZDNc05JoqLSARGMBVhrG1QKiFoWhqk7e4tU1ouFpTxDHKyqvujSf6lXM3FqBsbz7OKi2wBepyp4YZAM1AvLQAFgJCBqHiabqJHu31pI59l9Gc4Ht2R3g88X-0EbBHcj-iV9r4 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 49b19776feac4cc18fa1980aca044892 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-LiveMigrationNegativeTest-880163219 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49b19776feac4cc18fa1980aca044892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49b19776feac4cc18fa1980aca044892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49b19776feac4cc18fa1980aca044892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49b19776feac4cc18fa1980aca044892"}]}] Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-LiveMigrationNegativeTest-880163219 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 49b19776feac4cc18fa1980aca044892 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-880163219 Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-LiveMigrationNegativeTest-880163219-project Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0bf6eac62509482ebfa5b1ebb4dd08ab Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-LiveMigrationNegativeTest-880163219-project Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 56cb105f-28e8-4f91-becc-ecd4ad359910 could not be found. Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '56cb105f-28e8-4f91-becc-ecd4ad359910'} Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56cb105f-28e8-4f91-becc-ecd4ad359910 could not be found. Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56cb105f-28e8-4f91-becc-ecd4ad359910 could not be found. Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:07.858782 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56cb105f-28e8-4f91-becc-ecd4ad359910 could not be found. Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Returning 404 to user: Instance 56cb105f-28e8-4f91-becc-ecd4ad359910 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a84e8675-c07d-446d-8489-979b9c5adc5f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910" status: 404 len: 111 microversion: 2.1 time: 0.052285 Oct 22 03:15:07.862908 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1307/2624] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:07 2022] GET /compute/v2.1/servers/56cb105f-28e8-4f91-becc-ecd4ad359910 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:07.868440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a295d33-ecd3-4317-85d3-9b1aafc1558f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d19630e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:07.931480 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a295d33-ecd3-4317-85d3-9b1aafc1558f tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 200 len: 1435 microversion: 2.1 time: 0.066468 Oct 22 03:15:07.932304 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1308/2625] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:07 2022] GET /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 1435 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:07.942652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:07.943165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:07.953462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:07.953966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:07.954411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:07.955125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:07.955831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:07.956547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:07.967991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:07.976319 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-983bbc1a-99b3-44ed-9361-03bc2f8cc60c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.187323 Oct 22 03:15:07.976924 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1318/2626] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:07 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:07.997085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:15:08.004421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:08.005351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:08.012245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:08.012958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:08.013593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:08.015125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:08.015966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:08.016587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:08.170013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:08.184039 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fd91a914-0f20-43e4-9ad0-1421b82a2c65 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 204 len: 0 microversion: 2.1 time: 0.250267 Oct 22 03:15:08.189432 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1309/2627] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:15:07 2022] DELETE /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:15:08.194285 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5ee62625-6bef-4698-8782-1f100ab860bc tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1479 microversion: 2.1 time: 0.203619 Oct 22 03:15:08.196470 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1319/2628] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:07 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1479 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:08.199219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:08.200032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:08.208654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:08.209313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:08.209833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:08.210639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:08.211195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:08.211783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:08.406116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:08.415018 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-731b0d50-b624-40be-8a23-91fb9fdc2626 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1475 microversion: 2.1 time: 0.222061 Oct 22 03:15:08.434302 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1310/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:08 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1475 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:08.805701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-11b6d528-6456-43c7-a713-d6bf7bdb82fa tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a0735e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:09.006263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:09.007847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:09.031342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:09.031342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:09.031780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:09.032683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:09.033148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:09.033576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:09.251652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:09.261788 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b2dd565f-99bd-4b37-8bc3-2ff0bb8232e2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.259570 Oct 22 03:15:09.263411 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1311/2630] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:09 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:09.269281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:09.270441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:09.290186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:09.291067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:09.291791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:09.292700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:09.293327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:09.293908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:09.583233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:09.595299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be52d2da-205b-480a-a423-3caa45a153d3 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1466 microversion: 2.1 time: 0.330625 Oct 22 03:15:09.621087 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1312/2631] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:09 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1466 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:09.628431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:09.629384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:09.637086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:09.638480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:09.639238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:09.643772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:09.644861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:09.645407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:09.856878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:09.865555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-36b53d9b-f4b1-420d-a76f-9413f77d314f tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1475 microversion: 2.1 time: 0.242877 Oct 22 03:15:09.866322 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1313/2632] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:09 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1475 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:09.873028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce35c0f1-a985-4477-a4c4-a81d0de9d40b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1963d310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:10.805730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:13.942406 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce35c0f1-a985-4477-a4c4-a81d0de9d40b tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "DELETE /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451" status: 204 len: 0 microversion: 2.1 time: 4.074925 Oct 22 03:15:13.943062 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1314/2633] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:09 2022] DELETE /compute/v2.1/images/55944c9b-5913-468d-b393-d664c64f9451 => generated 0 bytes in 4076 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:15:13.947583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:13.948198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:13.958361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:13.958853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:13.959322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:13.960026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:13.960501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:13.964941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:13.974721 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-11b6d528-6456-43c7-a713-d6bf7bdb82fa tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 5.173551 Oct 22 03:15:13.983924 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1320/2634] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:08 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 5176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:13.983924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:13.983924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:13.991597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:13.992905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:13.993598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:13.994512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:13.994983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:13.995705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:14.118864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:14.130236 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-657915f2-a006-4cc5-b38f-affa172dfae3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.184409 Oct 22 03:15:14.141652 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1315/2635] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:13 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:14.161539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:14.173512 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-926a350d-4d31-48d1-8522-46bcc4c5344d tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1475 microversion: 2.1 time: 0.196089 Oct 22 03:15:14.174762 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1321/2636] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:13 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:14.179938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-521056f4-226e-4072-aed1-824363932a3c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '.version_select at 0x7f0d1a043e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:14.226487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a9ff8d13-383d-46ea-8317-fd1708ae915f req-1eb573d4-5edb-4fc4-a743-cfc884127309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2411dd-1a42-4047-90ab-5e6bb098541a", "name": "network-vif-unplugged", "status": "completed", "tag": "27c46b57-feba-40bd-95ee-929c50f6d0e4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:14.242747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-521056f4-226e-4072-aed1-824363932a3c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] HTTP exception thrown: Image not found. Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-521056f4-226e-4072-aed1-824363932a3c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Request method failure captured: Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 HTTP/1.1 Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1_VuTZMz2ibaE_ARnzVF2LDcJ2O7yaWDf7sES6l6rxwSlymBl0DYoYHM6OdRMrBuliGMvRbqSbFwctYNEAy3T4o1yAoRsvF8DqepJ_KxfTCgPo9pmsmBaKx52fnrQLPgUCO6YlFst232nYO9Yrqa6pZ_hqI7XNco0J2HAQXCDtNVRQ Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 08a29e66084f4621bfec65de1c77d3ef Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a29e66084f4621bfec65de1c77d3ef"}]}] Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 08a29e66084f4621bfec65de1c77d3ef Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerTestJSON-244308695-project Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: a214582bec4040d3a315b687fb8f972a Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerTestJSON-244308695-project Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: exception: Image not found. Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ce1dbe39-da73-4c9b-bec6-2b10cb0ad528'} Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 to delete Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 could not be found. Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:14.244788 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-521056f4-226e-4072-aed1-824363932a3c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Returning 404 to user: Image not found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:14.250752 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-521056f4-226e-4072-aed1-824363932a3c tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "DELETE /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528" status: 404 len: 62 microversion: 2.1 time: 0.071184 Oct 22 03:15:14.253040 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1322/2637] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:14 2022] DELETE /compute/v2.1/images/ce1dbe39-da73-4c9b-bec6-2b10cb0ad528 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:14.256330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a9ff8d13-383d-46ea-8317-fd1708ae915f req-1eb573d4-5edb-4fc4-a743-cfc884127309 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:14.256830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a9ff8d13-383d-46ea-8317-fd1708ae915f req-1eb573d4-5edb-4fc4-a743-cfc884127309 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:14.257474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a9ff8d13-383d-46ea-8317-fd1708ae915f req-1eb573d4-5edb-4fc4-a743-cfc884127309 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:14.263556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:14.264476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:14.271862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:14.272524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:14.273078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:14.273884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:14.274426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:14.274985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:14.276585 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a9ff8d13-383d-46ea-8317-fd1708ae915f req-1eb573d4-5edb-4fc4-a743-cfc884127309 service nova] Creating event network-vif-unplugged:27c46b57-feba-40bd-95ee-929c50f6d0e4 for instance ba2411dd-1a42-4047-90ab-5e6bb098541a on n-h2-862416-2 Oct 22 03:15:14.286197 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a9ff8d13-383d-46ea-8317-fd1708ae915f req-1eb573d4-5edb-4fc4-a743-cfc884127309 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142872 Oct 22 03:15:14.287081 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1316/2638] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:14.305931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:15:14.379251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:14.394250 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e188232a-b7a2-4ff3-a5e7-9f9ede535299 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 204 len: 0 microversion: 2.1 time: 0.137037 Oct 22 03:15:14.395150 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1323/2639] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:15:14 2022] DELETE /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:15:14.404788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:14.409434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:14.417210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:14.417695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:14.418419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:14.419300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:14.419753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:14.420188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:14.594321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:14.606623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55e58113-0ae7-492a-96cb-9404d0ad4af4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1472 microversion: 2.1 time: 0.206790 Oct 22 03:15:14.607214 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1317/2640] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:14 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:14.991708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82c56c43-1c06-4e89-a1b1-275739ca51d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a043e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:15.048233 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82c56c43-1c06-4e89-a1b1-275739ca51d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.060564 Oct 22 03:15:15.056861 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1324/2641] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:14 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:15.158134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:15.159592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:15.167714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:15.168453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:15.169072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:15.169938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:15.172350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:15.172999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:15.199872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:15.201367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:15.214847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:15.215684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:15.219194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:15.220173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:15.220991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:15.222050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:15.432081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:15.442906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3fb91f7f-d6c5-4831-8416-96140e6334fc tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.291839 Oct 22 03:15:15.449774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:15.454671 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1318/2642] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:15 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:15.464985 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-edbc0281-cb69-4240-ab81-640a764a3db3 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1475 microversion: 2.1 time: 0.269429 Oct 22 03:15:15.466115 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1325/2643] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:15 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1475 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:15.631266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:15.631877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:15.638775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:15.639863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:15.640328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:15.641151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:15.641614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:15.642101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:15.793811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:15.805770 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-37279753-c31d-4037-9589-e3f0344351d4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1472 microversion: 2.1 time: 0.178660 Oct 22 03:15:15.806946 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1319/2644] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:15 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:16.065337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b75c7d9b-7b9f-4b8d-8b2e-7a406e5ffcc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a45a310>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:16.115209 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b75c7d9b-7b9f-4b8d-8b2e-7a406e5ffcc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.054991 Oct 22 03:15:16.116411 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1326/2645] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:16 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:16.481060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:16.482214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:16.493244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:16.494741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:16.496014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:16.496464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:16.497025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:16.497396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:16.497559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:16.498229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:16.505529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:16.506311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:16.506935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:16.507640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:16.508088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:16.508689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:16.914499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:16.924574 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-866b5fdb-8af6-4507-9f69-dfb1bd76ca87 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1433 microversion: 2.1 time: 0.432018 Oct 22 03:15:16.936516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1327/2646] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:16 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1433 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:16.936516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:16.936516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:16.943048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:16.943048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:16.943048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:16.943048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:16.943048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:16.943048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:17.113489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:17.123976 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-040cfa63-2093-4a1a-8de4-7afea5e50411 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1472 microversion: 2.1 time: 0.197297 Oct 22 03:15:17.125218 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1328/2647] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:16 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:17.143756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f62d812c-88e6-495b-b6bd-c1452e31c177 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a0d1940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:17.235272 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f62d812c-88e6-495b-b6bd-c1452e31c177 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.107386 Oct 22 03:15:17.237532 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1329/2648] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:17 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:17.245197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f4d77f4d-6c81-48c9-befb-429c5bee2645 req-493d44eb-249f-41c5-ac06-3c882e6424c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e08eda2-0515-4df1-8934-b9bbbbb4cf37", "name": "network-vif-deleted", "tag": "da83328b-2366-4541-9e9a-28f1ed37f8bd"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:17.259991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f4d77f4d-6c81-48c9-befb-429c5bee2645 req-493d44eb-249f-41c5-ac06-3c882e6424c9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:17.260797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f4d77f4d-6c81-48c9-befb-429c5bee2645 req-493d44eb-249f-41c5-ac06-3c882e6424c9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:17.261400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f4d77f4d-6c81-48c9-befb-429c5bee2645 req-493d44eb-249f-41c5-ac06-3c882e6424c9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:17.264633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:17.276919 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9803817-76f2-45e2-9400-29145ed1b755 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.801970 Oct 22 03:15:17.277554 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f4d77f4d-6c81-48c9-befb-429c5bee2645 req-493d44eb-249f-41c5-ac06-3c882e6424c9 service nova] Creating event network-vif-deleted:da83328b-2366-4541-9e9a-28f1ed37f8bd for instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 on n-h1-862416-2 Oct 22 03:15:17.283813 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f4d77f4d-6c81-48c9-befb-429c5bee2645 req-493d44eb-249f-41c5-ac06-3c882e6424c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044062 Oct 22 03:15:17.285566 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1330/2649] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:17.289042 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1320/2650] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:16 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:17.955164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:17.956051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:17.966056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:17.966547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:17.966983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:17.973182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:17.973876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:17.976700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:18.035995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:18.036930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:18.038035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:18.039281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lazy-loading 'fault' on Instance uuid 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:15:18.101031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf6eac62509482ebfa5b1ebb4dd08ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b19776feac4cc18fa1980aca044892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:18.125191 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2f9432f3-dda1-4b5d-a284-b7077efab1ea tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 200 len: 1309 microversion: 2.1 time: 0.175370 Oct 22 03:15:18.151575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:18.152973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:18.163875 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1331/2651] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:17 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:18.172315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:18.174894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:18.176938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:18.177933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:18.179173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:18.179841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:18.252392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c03fe95d-9311-45bd-976d-7e5293d18a70 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a494dc0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:18.256320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:18.256746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:18.257192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:18.257653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lazy-loading 'fault' on Instance uuid ba2411dd-1a42-4047-90ab-5e6bb098541a {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:15:18.265690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:18.346998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a214582bec4040d3a315b687fb8f972a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a29e66084f4621bfec65de1c77d3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:18.355804 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5d633a2-ab0a-4ca0-97eb-938a201e32d2 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 200 len: 1307 microversion: 2.1 time: 0.209433 Oct 22 03:15:18.357017 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1321/2652] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:18 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:18.368390 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c03fe95d-9311-45bd-976d-7e5293d18a70 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1414 microversion: 2.1 time: 0.111821 Oct 22 03:15:18.368390 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1332/2653] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:18 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:18.383179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:18.384926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:18.393767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:18.394294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:18.394760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:18.413171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:18.413657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:18.414097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:18.579743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:18.589020 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-283be2be-5b58-4174-98de-1a34e200603e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.216727 Oct 22 03:15:18.589726 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1333/2654] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:18 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:19.171127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:19.171732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] [instance: 3e08eda2-0515-4df1-8934-b9bbbbb4cf37] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:19.178496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:19.178981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:19.179418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:19.180099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:19.180583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:19.181011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:19.194846 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] HTTP exception thrown: Instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 could not be found. Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Request method failure captured: Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 HTTP/1.1 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AFVtL57sk__lhMUp4JJkwUWSnk2isvcgOLSh-o97ZDNc05JoqLSARGMBVhrG1QKiFoWhqk7e4tU1ouFpTxDHKyqvujSf6lXM3FqBsbz7OKi2wBepyp4YZAM1AvLQAFgJCBqHiabqJHu31pI59l9Gc4Ht2R3g88X-0EbBHcj-iV9r4 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 49b19776feac4cc18fa1980aca044892 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-LiveMigrationNegativeTest-880163219 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49b19776feac4cc18fa1980aca044892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49b19776feac4cc18fa1980aca044892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49b19776feac4cc18fa1980aca044892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49b19776feac4cc18fa1980aca044892"}]}] Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-LiveMigrationNegativeTest-880163219 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 49b19776feac4cc18fa1980aca044892 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-880163219 Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-LiveMigrationNegativeTest-880163219-project Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0bf6eac62509482ebfa5b1ebb4dd08ab Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-LiveMigrationNegativeTest-880163219-project Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 could not be found. Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '3e08eda2-0515-4df1-8934-b9bbbbb4cf37'} Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 could not be found. Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 could not be found. Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:19.196438 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 could not be found. Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] Returning 404 to user: Instance 3e08eda2-0515-4df1-8934-b9bbbbb4cf37 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c91bb359-760a-469d-b56a-f8af7e37ac59 tempest-LiveMigrationNegativeTest-880163219 tempest-LiveMigrationNegativeTest-880163219-project] 10.222.0.25 "GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37" status: 404 len: 111 microversion: 2.1 time: 0.031207 Oct 22 03:15:19.200994 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1322/2655] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:19 2022] GET /compute/v2.1/servers/3e08eda2-0515-4df1-8934-b9bbbbb4cf37 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:19.311159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e90cdce6-18ab-46e2-8d50-aa16dd5fbaac req-79352c2c-3e7d-4ac0-8471-07ae7d701539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2411dd-1a42-4047-90ab-5e6bb098541a", "name": "network-vif-deleted", "tag": "27c46b57-feba-40bd-95ee-929c50f6d0e4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:19.321975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e90cdce6-18ab-46e2-8d50-aa16dd5fbaac req-79352c2c-3e7d-4ac0-8471-07ae7d701539 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:19.322460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e90cdce6-18ab-46e2-8d50-aa16dd5fbaac req-79352c2c-3e7d-4ac0-8471-07ae7d701539 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:19.322901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e90cdce6-18ab-46e2-8d50-aa16dd5fbaac req-79352c2c-3e7d-4ac0-8471-07ae7d701539 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:19.327406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:19.335348 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e90cdce6-18ab-46e2-8d50-aa16dd5fbaac req-79352c2c-3e7d-4ac0-8471-07ae7d701539 service nova] Creating event network-vif-deleted:27c46b57-feba-40bd-95ee-929c50f6d0e4 for instance ba2411dd-1a42-4047-90ab-5e6bb098541a on n-h2-862416-2 Oct 22 03:15:19.340682 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e90cdce6-18ab-46e2-8d50-aa16dd5fbaac req-79352c2c-3e7d-4ac0-8471-07ae7d701539 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033496 Oct 22 03:15:19.341497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1334/2656] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:15:19.375221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a5588ce-9ea8-43a7-977e-094606e71a72 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1963a940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:19.384550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:19.385142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] [instance: ba2411dd-1a42-4047-90ab-5e6bb098541a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:19.392755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:19.393240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:19.393671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:19.394552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:19.395005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:19.395422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:19.413012 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] HTTP exception thrown: Instance ba2411dd-1a42-4047-90ab-5e6bb098541a could not be found. Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Request method failure captured: Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a HTTP/1.1 Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1_VuTZMz2ibaE_ARnzVF2LDcJ2O7yaWDf7sES6l6rxwSlymBl0DYoYHM6OdRMrBuliGMvRbqSbFwctYNEAy3T4o1yAoRsvF8DqepJ_KxfTCgPo9pmsmBaKx52fnrQLPgUCO6YlFst232nYO9Yrqa6pZ_hqI7XNco0J2HAQXCDtNVRQ Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 08a29e66084f4621bfec65de1c77d3ef Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08a29e66084f4621bfec65de1c77d3ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08a29e66084f4621bfec65de1c77d3ef"}]}] Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 08a29e66084f4621bfec65de1c77d3ef Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-244308695 Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesOneServerTestJSON-244308695-project Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: a214582bec4040d3a315b687fb8f972a Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesOneServerTestJSON-244308695-project Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ba2411dd-1a42-4047-90ab-5e6bb098541a could not be found. Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ba2411dd-1a42-4047-90ab-5e6bb098541a'} Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2411dd-1a42-4047-90ab-5e6bb098541a could not be found. Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2411dd-1a42-4047-90ab-5e6bb098541a could not be found. Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:19.414655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2411dd-1a42-4047-90ab-5e6bb098541a could not be found. Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] Returning 404 to user: Instance ba2411dd-1a42-4047-90ab-5e6bb098541a could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac26f7d2-dbaa-4843-9599-6fa77acfa8e4 tempest-ImagesOneServerTestJSON-244308695 tempest-ImagesOneServerTestJSON-244308695-project] 10.222.0.25 "GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a" status: 404 len: 111 microversion: 2.1 time: 0.036929 Oct 22 03:15:19.419197 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1335/2657] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:19 2022] GET /compute/v2.1/servers/ba2411dd-1a42-4047-90ab-5e6bb098541a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:15:19.433516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a5588ce-9ea8-43a7-977e-094606e71a72 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1423 microversion: 2.1 time: 0.062145 Oct 22 03:15:19.434250 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1323/2658] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:19 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1423 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:19.455286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed599cd3-951a-44ae-9032-d178498096f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a1dc280>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:19.510963 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ed599cd3-951a-44ae-9032-d178498096f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 200 len: 1423 microversion: 2.1 time: 0.066118 Oct 22 03:15:19.520952 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1336/2659] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:15:19 2022] GET /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 1423 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:19.525893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-461958b3-3166-4be3-8bbd-48a896c3459c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1964c9d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:19.618324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:19.619695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:19.628141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:19.628958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:19.629641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:19.630479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:19.631274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:19.631801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:19.793570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:19.803115 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-44364ed9-1782-42dd-a218-f4e1335aae64 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.190943 Oct 22 03:15:19.804013 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1337/2660] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:19 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:20.243209 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-461958b3-3166-4be3-8bbd-48a896c3459c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 204 len: 0 microversion: 2.1 time: 0.720438 Oct 22 03:15:20.244121 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1324/2661] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:19 2022] DELETE /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:15:20.252562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:20.253059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:20.259556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:20.260301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:20.260785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:20.261489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:20.261978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:20.262517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:20.289891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:15:20.418184 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2bd0b71-5fdb-478a-b485-f45e8af254b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 204 len: 0 microversion: 2.1 time: 0.169630 Oct 22 03:15:20.418895 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1338/2662] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:15:20 2022] DELETE /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:15:20.560748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3e75e3eb-4c34-4541-bfe1-4471423983a9 req-50a5ca97-3e42-4daa-8fd1-0c6691c64ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83aea4f8-aff9-49b1-9fac-7fa0c254fea3", "name": "network-vif-plugged", "status": "completed", "tag": "cfaf4bdc-ec50-406c-ba43-5295b1573af3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:20.571350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e75e3eb-4c34-4541-bfe1-4471423983a9 req-50a5ca97-3e42-4daa-8fd1-0c6691c64ca9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:20.572081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e75e3eb-4c34-4541-bfe1-4471423983a9 req-50a5ca97-3e42-4daa-8fd1-0c6691c64ca9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:20.572989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e75e3eb-4c34-4541-bfe1-4471423983a9 req-50a5ca97-3e42-4daa-8fd1-0c6691c64ca9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:20.599231 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3e75e3eb-4c34-4541-bfe1-4471423983a9 req-50a5ca97-3e42-4daa-8fd1-0c6691c64ca9 service nova] Creating event network-vif-plugged:cfaf4bdc-ec50-406c-ba43-5295b1573af3 for instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 on n-h1-862416-2 Oct 22 03:15:20.605226 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3e75e3eb-4c34-4541-bfe1-4471423983a9 req-50a5ca97-3e42-4daa-8fd1-0c6691c64ca9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048336 Oct 22 03:15:20.606902 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1325/2663] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:20.607022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1340145449", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "49c953fb-5979-4a50-be05-1edf628aca16"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:20.724960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] validate_networks() for [('49c953fb-5979-4a50-be05-1edf628aca16', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:15:20.831388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:20.831911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:20.840723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:20.841734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:20.843562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:20.845407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:20.846550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:20.847209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:21.106380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:21.117543 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8aeab43-1f78-4c3c-b7f9-1a9b1d0c0354 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.291599 Oct 22 03:15:21.118827 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1326/2664] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:20 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:21.225932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:15:21.226380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:15:21.226875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:15:21.227695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:15:21.228337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:15:21.238300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:21.238742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:21.239183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:21.239912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:21.240401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:21.240830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:21.260487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:15:21.266001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for user 2468c1f92230450db3397e1f0e97b5e0 and project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:15:21.279827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:15:21.282344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:15:21.333384 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f843a0c-0c90-45ee-a5cb-fc209638d6b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730776 Oct 22 03:15:21.334505 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1339/2665] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:15:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:15:21.345238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ec05b6f-b75c-4ed3-bf9a-efba3a18a3fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:21.346052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ec05b6f-b75c-4ed3-bf9a-efba3a18a3fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:21.424750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ec05b6f-b75c-4ed3-bf9a-efba3a18a3fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:21.432297 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ec05b6f-b75c-4ed3-bf9a-efba3a18a3fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1208 microversion: 2.1 time: 0.090950 Oct 22 03:15:21.433367 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1340/2666] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:21 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:21.642053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13de9d43-9715-4df7-943a-7e1fc0d1a85d tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Action: 'create', calling method: .version_select at 0x7f0d1964c9d0>, body: {"keypair": {"name": "tempest-keypair-1101227202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQbNHSg6vY9i34N17ziQnby+KZ0/RiJob3ZC0cw3TYckfH8/3xPuTr7vOmNBY7QsMn5N8qkwcaPUEJr82+X5OXzUMtJZuXGP21D50eyLUOXIOOzbnnaxYNeHbhsjtfRvQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:21.659686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-13de9d43-9715-4df7-943a-7e1fc0d1a85d tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:15:21.666060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-13de9d43-9715-4df7-943a-7e1fc0d1a85d tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for user fec8ef53b2604f8dba36103d6b50b7a5 and project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:15:21.697027 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13de9d43-9715-4df7-943a-7e1fc0d1a85d tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.356188 Oct 22 03:15:21.698786 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1327/2667] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:15:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:15:21.716888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d893fd81-66f3-4a87-89da-c41ebb4c867d tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Calling method '.version_select at 0x7f0d1a61f0d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:21.732607 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d893fd81-66f3-4a87-89da-c41ebb4c867d tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1101227202" status: 200 len: 498 microversion: 2.1 time: 0.024185 Oct 22 03:15:21.734531 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1341/2668] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:15:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1101227202 => generated 498 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:21.747073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f35bb25e-0454-498b-b797-5d557d03085b tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Calling method '.version_select at 0x7f0d1963d040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:21.773404 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f35bb25e-0454-498b-b797-5d557d03085b tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101227202" status: 202 len: 0 microversion: 2.1 time: 0.030894 Oct 22 03:15:21.780685 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1328/2669] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:15:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101227202 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:15:21.787403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dbfca761-756f-4241-a417-62a42beeae10 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Action: 'create', calling method: .version_select at 0x7f0d1a0430d0>, body: {"keypair": {"name": "tempest-keypair-2051572755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvRM0jXMrPVbVI9JiK0O9rGI01CLDVOwW0iYzyxWU2O5NBx42a2N9ncaQc8h2BYJ08NshLy8jLtGEZ1Qtr7bxR1gQ6f1XzskgRm1LxfzMDp9D1B5fyBVv89nnDM1e4gTw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:21.803943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-dbfca761-756f-4241-a417-62a42beeae10 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:15:21.811184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-dbfca761-756f-4241-a417-62a42beeae10 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for user fec8ef53b2604f8dba36103d6b50b7a5 and project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:15:21.839873 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dbfca761-756f-4241-a417-62a42beeae10 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056763 Oct 22 03:15:21.840922 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1342/2670] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:15:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:21.853772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f513c035-2474-4e18-9b24-8dffeb51f417 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Calling method '.version_select at 0x7f0d1963ae50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:21.875003 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f513c035-2474-4e18-9b24-8dffeb51f417 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051572755" status: 202 len: 0 microversion: 2.1 time: 0.025563 Oct 22 03:15:21.876009 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1329/2671] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:15:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051572755 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:15:21.890390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-480272d0-b1e4-4706-a939-7721d39abd11 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Action: 'create', calling method: .version_select at 0x7f0d1a0d18b0>, body: {"keypair": {"name": "tempest-keypair-321568701", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:21.918415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-480272d0-b1e4-4706-a939-7721d39abd11 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:15:21.925986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-480272d0-b1e4-4706-a939-7721d39abd11 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for user fec8ef53b2604f8dba36103d6b50b7a5 and project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:15:21.962083 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-480272d0-b1e4-4706-a939-7721d39abd11 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.078858 Oct 22 03:15:21.963162 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1343/2672] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:15:21 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:21.974844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d57414e-584b-42e9-be20-a29e0ad17eda tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Calling method '.version_select at 0x7f0d196759d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:22.012213 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d57414e-584b-42e9-be20-a29e0ad17eda tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-321568701" status: 202 len: 0 microversion: 2.1 time: 0.042369 Oct 22 03:15:22.013089 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1330/2673] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:15:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-321568701 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:15:22.027162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97b26c9f-1ce3-4492-a373-f80ccc1bc70c tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Action: 'create', calling method: .version_select at 0x7f0d1a0fe5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-43706945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUoVD44aijavkV+H289EdNPWnzXL+pV/ltnFhC8DyGMYjfm6LP5nuNKEH9uZQzWwJhM5fR5fbrkjTKyALXmWTRsRcNYaaGdKEZHVJtcw84tr53WYjco2ntn3EazA0ebgw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:22.048602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-97b26c9f-1ce3-4492-a373-f80ccc1bc70c tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:15:22.054511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-97b26c9f-1ce3-4492-a373-f80ccc1bc70c tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for user fec8ef53b2604f8dba36103d6b50b7a5 and project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:15:22.084086 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97b26c9f-1ce3-4492-a373-f80ccc1bc70c tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062158 Oct 22 03:15:22.085267 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1344/2674] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:15:22 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:15:22.098946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c53dc25-2876-4f9b-8323-adfc7c0edbad tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Action: 'create', calling method: .version_select at 0x7f0d196c7280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-134489862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8EgJ08Qi5u9m1JiEM+tddyhicDyDwKmAQUNhnuH/QiW4O4v9OeBVD0alQK7H2wibQXO3A9LCoNBQGOMHU/NwVKcDU9uFPa6CFLFwROR1qw9zC1HNbGYkd1BByr6AUYAA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:22.128133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9c53dc25-2876-4f9b-8323-adfc7c0edbad tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:15:22.133482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9c53dc25-2876-4f9b-8323-adfc7c0edbad tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for user fec8ef53b2604f8dba36103d6b50b7a5 and project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:15:22.143462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:22.144093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:22.158504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:22.158740 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c53dc25-2876-4f9b-8323-adfc7c0edbad tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.063400 Oct 22 03:15:22.158995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:22.160953 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1331/2675] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:15:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:22.161452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:22.162187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:22.163203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:22.163942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:22.174719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc811154-d795-43a0-942e-e5cd65474db1 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Action: 'create', calling method: .version_select at 0x7f0d196758b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1082484164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoXGWOf2N4VvXepQ536HAJEPXvjFgj3OlOSysG6MZp/qzYQgKkUyONc2eAa5wvKD7EaWHlO9nU8Npvp83BcrspT6amgB5TXvtaBiaL/bREroE99FznGJ4Am4csyA6nJOQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:22.189956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:22.198670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fc811154-d795-43a0-942e-e5cd65474db1 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:15:22.209821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fc811154-d795-43a0-942e-e5cd65474db1 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Getting quotas for user fec8ef53b2604f8dba36103d6b50b7a5 and project d6b74c7ddbf54c9092b5d264fbbe7f68. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:15:22.249819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc811154-d795-43a0-942e-e5cd65474db1 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.081024 Oct 22 03:15:22.251000 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1332/2676] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:15:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:22.262765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5228395f-84b5-4b7f-92e6-90025e5a8afc tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Calling method '.version_select at 0x7f0d1963a3a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:22.269517 n-d-862416-2 devstack@n-api.service[120581]: WARNING oslo_db.sqlalchemy.utils [None req-5228395f-84b5-4b7f-92e6-90025e5a8afc tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 03:15:22.275632 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5228395f-84b5-4b7f-92e6-90025e5a8afc tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.018652 Oct 22 03:15:22.276237 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1333/2677] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:15:22 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:22.289990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6cd9d2db-0698-4a4b-a190-7afaa1d9200f tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Calling method '.version_select at 0x7f0d1978b700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:22.320255 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6cd9d2db-0698-4a4b-a190-7afaa1d9200f tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1082484164" status: 202 len: 0 microversion: 2.1 time: 0.034626 Oct 22 03:15:22.322544 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1334/2678] 10.222.0.25 () {58 vars in 1278 bytes} [Sat Oct 22 03:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1082484164 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:15:22.333459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e4c0868-766e-449d-b2ee-784fa0d80030 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Calling method '.version_select at 0x7f0d19703e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:22.360392 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e4c0868-766e-449d-b2ee-784fa0d80030 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-134489862" status: 202 len: 0 microversion: 2.1 time: 0.033627 Oct 22 03:15:22.361248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1335/2679] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-134489862 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:15:22.372238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-64b592db-68ac-471e-84d8-bea302d1eae5 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] Calling method '.version_select at 0x7f0d19630dc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:22.406196 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-64b592db-68ac-471e-84d8-bea302d1eae5 tempest-KeyPairsV2TestJSON-85236685 tempest-KeyPairsV2TestJSON-85236685-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-43706945" status: 202 len: 0 microversion: 2.1 time: 0.039169 Oct 22 03:15:22.407095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1336/2680] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-43706945 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:15:22.419787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:22.431691 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-201742c0-cec6-49fe-99e2-00083032607b tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1519 microversion: 2.1 time: 0.292812 Oct 22 03:15:22.440658 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1345/2681] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:22 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:22.482511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:22.484590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:22.498060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:22.499176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:22.500899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:22.502944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:22.504713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:22.505552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:22.666116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:22.685352 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d65841e-6c54-4696-9789-2f1b7ee3a076 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1260 microversion: 2.1 time: 0.220236 Oct 22 03:15:22.687123 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1337/2682] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:22 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:23.458941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:23.460149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:23.483294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:23.485661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:23.486384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:23.488495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:23.490304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:23.492601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:23.678059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9f4f5be2-7a83-49cc-8171-3690acae9a13 req-97539e00-d8cc-4189-94af-02f6f1160210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9186d1-57ed-48a2-b004-417df2ad0eec", "name": "network-vif-deleted", "tag": "cc77aa24-6af1-4fd0-a9b9-15f2d3264543"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:23.702895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9f4f5be2-7a83-49cc-8171-3690acae9a13 req-97539e00-d8cc-4189-94af-02f6f1160210 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:23.706721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9f4f5be2-7a83-49cc-8171-3690acae9a13 req-97539e00-d8cc-4189-94af-02f6f1160210 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:23.709779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9f4f5be2-7a83-49cc-8171-3690acae9a13 req-97539e00-d8cc-4189-94af-02f6f1160210 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:23.729760 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9f4f5be2-7a83-49cc-8171-3690acae9a13 req-97539e00-d8cc-4189-94af-02f6f1160210 service nova] Creating event network-vif-deleted:cc77aa24-6af1-4fd0-a9b9-15f2d3264543 for instance ff9186d1-57ed-48a2-b004-417df2ad0eec on n-h2-862416-2 Oct 22 03:15:23.735310 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9f4f5be2-7a83-49cc-8171-3690acae9a13 req-97539e00-d8cc-4189-94af-02f6f1160210 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065706 Oct 22 03:15:23.736275 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1338/2683] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:15:23.757022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:23.766724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:23.786163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:23.787081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:23.787758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:23.788845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:23.789577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:23.790240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:23.966454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:23.975418 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1bbc6624-a346-4bbc-bc5d-9820e7cb82f1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1266 microversion: 2.1 time: 0.232555 Oct 22 03:15:23.976487 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1339/2684] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:23 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:24.046943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:24.100089 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-42a8e85d-2b2f-4c44-8ce7-ffff818d5256 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.644967 Oct 22 03:15:24.100938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1346/2685] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:23 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:24.126909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:24.127938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:24.135312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:24.136318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:24.136993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:24.137978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:24.138860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:24.140432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:24.447135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:24.460157 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe631c65-18b6-4bd4-8ee9-af26e04efb95 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.338632 Oct 22 03:15:24.473131 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1340/2686] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:24 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:24.494289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:24.494906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:24.506540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:24.507212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:24.508102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:24.509067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:24.531966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:24.532755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:24.919018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:24.937993 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f134753e-c525-4a3a-8cb7-997dbc4a6983 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.442595 Oct 22 03:15:24.939219 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1347/2687] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:24 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:24.975457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ccbc95b4-9ab3-4b02-a937-d50b9670d610 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:24.987227 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ccbc95b4-9ab3-4b02-a937-d50b9670d610 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 49e53294-b409-4282-99bf-1235abd97234 has no mapping to a cell. Oct 22 03:15:25.000349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:25.005753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ccbc95b4-9ab3-4b02-a937-d50b9670d610 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/49e53294-b409-4282-99bf-1235abd97234/action HTTP/1.1 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 15 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: {"os-stop": {}} Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 49e53294-b409-4282-99bf-1235abd97234 has no mapping to a cell. Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '49e53294-b409-4282-99bf-1235abd97234', 'body': {'os-stop': {}}} Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 49e53294-b409-4282-99bf-1235abd97234 has no mapping to a cell. Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:25.006797 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e53294-b409-4282-99bf-1235abd97234 has no mapping to a cell. Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e53294-b409-4282-99bf-1235abd97234 has no mapping to a cell. Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ccbc95b4-9ab3-4b02-a937-d50b9670d610 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 49e53294-b409-4282-99bf-1235abd97234 has no mapping to a cell. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ccbc95b4-9ab3-4b02-a937-d50b9670d610 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/49e53294-b409-4282-99bf-1235abd97234/action" status: 404 len: 117 microversion: 2.1 time: 0.048458 Oct 22 03:15:25.014470 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1341/2688] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:24 2022] POST /compute/v2.1/servers/49e53294-b409-4282-99bf-1235abd97234/action => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:25.019685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:25.020665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:25.021345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:25.021858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:25.023501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:25.024675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:25.027796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:25.028695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:25.038196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:25.049826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:25.050290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:25.051066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:25.057177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:25.072784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:25.333139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:25.346041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72b55791-9406-4647-b6f3-3a92d12629ac tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.331843 Oct 22 03:15:25.347430 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1342/2689] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:25 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:25.376507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:25.377400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:25.388060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:25.388594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:25.389583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:25.390286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:25.390838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:25.391265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:25.485078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:25.497916 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2823de03-0bd4-4139-a66f-1099b0df9ee0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1308 microversion: 2.1 time: 0.501874 Oct 22 03:15:25.500111 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1348/2690] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:24 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:25.783702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:25.792501 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-17f6b6b4-556d-4ff8-a236-06373b2c41a9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.420565 Oct 22 03:15:25.796365 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1343/2691] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:25 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:25.820495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1937c99c-42a8-4675-aadd-a59113ca45e0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:25.821330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1937c99c-42a8-4675-aadd-a59113ca45e0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: e1bf590e-d9d2-4bf1-a659-ca806b354064] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:25.855583 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1937c99c-42a8-4675-aadd-a59113ca45e0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance e1bf590e-d9d2-4bf1-a659-ca806b354064 could not be found. Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1937c99c-42a8-4675-aadd-a59113ca45e0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/e1bf590e-d9d2-4bf1-a659-ca806b354064/action HTTP/1.1 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 15 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: {"suspend": {}} Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance e1bf590e-d9d2-4bf1-a659-ca806b354064 could not be found. Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'e1bf590e-d9d2-4bf1-a659-ca806b354064', 'body': {'suspend': {}}} Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1bf590e-d9d2-4bf1-a659-ca806b354064 could not be found. Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1bf590e-d9d2-4bf1-a659-ca806b354064 could not be found. Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:25.857545 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:25.862781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:25.862781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:25.862781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1bf590e-d9d2-4bf1-a659-ca806b354064 could not be found. Oct 22 03:15:25.862781 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:25.865290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1937c99c-42a8-4675-aadd-a59113ca45e0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance e1bf590e-d9d2-4bf1-a659-ca806b354064 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:25.867138 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1937c99c-42a8-4675-aadd-a59113ca45e0 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/e1bf590e-d9d2-4bf1-a659-ca806b354064/action" status: 404 len: 111 microversion: 2.1 time: 0.051594 Oct 22 03:15:25.870193 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1349/2692] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:25 2022] POST /compute/v2.1/servers/e1bf590e-d9d2-4bf1-a659-ca806b354064/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:25.879253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:25.887020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:25.910944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:25.918018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:25.921640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:25.924075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:25.925490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:25.930419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:25.931190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.145271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8711d071-330c-4b96-8493-1088149630a6 tempest-AbsoluteLimitsTestJSON-578502403 tempest-AbsoluteLimitsTestJSON-578502403-project] Calling method '.version_select at 0x7f0d1978b160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:26.170235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8711d071-330c-4b96-8493-1088149630a6 tempest-AbsoluteLimitsTestJSON-578502403 tempest-AbsoluteLimitsTestJSON-578502403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.171718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8711d071-330c-4b96-8493-1088149630a6 tempest-AbsoluteLimitsTestJSON-578502403 tempest-AbsoluteLimitsTestJSON-578502403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.172492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8711d071-330c-4b96-8493-1088149630a6 tempest-AbsoluteLimitsTestJSON-578502403 tempest-AbsoluteLimitsTestJSON-578502403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.174000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8711d071-330c-4b96-8493-1088149630a6 tempest-AbsoluteLimitsTestJSON-578502403 tempest-AbsoluteLimitsTestJSON-578502403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.175007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8711d071-330c-4b96-8493-1088149630a6 tempest-AbsoluteLimitsTestJSON-578502403 tempest-AbsoluteLimitsTestJSON-578502403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.175657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8711d071-330c-4b96-8493-1088149630a6 tempest-AbsoluteLimitsTestJSON-578502403 tempest-AbsoluteLimitsTestJSON-578502403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.219378 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8711d071-330c-4b96-8493-1088149630a6 tempest-AbsoluteLimitsTestJSON-578502403 tempest-AbsoluteLimitsTestJSON-578502403-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.395208 Oct 22 03:15:26.220612 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1344/2693] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Oct 22 03:15:25 2022] GET /compute/v2.1/limits => generated 511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:15:26.238585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1be8b393-f9d2-4e86-9e18-46c0db2c6eaa req-a6ae6e26-e02a-476e-ab2e-fcf54fe95890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc010b5d-a6fb-4846-96e8-debf6bbc4509", "tag": "6aecee5c-b4c7-4bf0-8c05-f36d011934ba"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:26.261839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1be8b393-f9d2-4e86-9e18-46c0db2c6eaa req-a6ae6e26-e02a-476e-ab2e-fcf54fe95890 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.262481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1be8b393-f9d2-4e86-9e18-46c0db2c6eaa req-a6ae6e26-e02a-476e-ab2e-fcf54fe95890 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.263907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1be8b393-f9d2-4e86-9e18-46c0db2c6eaa req-a6ae6e26-e02a-476e-ab2e-fcf54fe95890 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.277516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1be8b393-f9d2-4e86-9e18-46c0db2c6eaa req-a6ae6e26-e02a-476e-ab2e-fcf54fe95890 service nova] Creating event network-changed:6aecee5c-b4c7-4bf0-8c05-f36d011934ba for instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 on n-h1-862416-2 Oct 22 03:15:26.283011 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1be8b393-f9d2-4e86-9e18-46c0db2c6eaa req-a6ae6e26-e02a-476e-ab2e-fcf54fe95890 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060169 Oct 22 03:15:26.284331 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1345/2694] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:26.314613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:26.315866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:26.329810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.334963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.337195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.338329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.341954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.343776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.722778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:26.731419 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3039adb-ef70-4622-a2e2-c9600dc8d01d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.855898 Oct 22 03:15:26.736751 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1350/2695] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:25 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:26.744479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:26.747656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:26.762992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.763727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.765344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.766706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.767379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.768935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.864546 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-815fa35b-7270-4680-9b6c-f55e1c18807d tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1811 microversion: 2.1 time: 0.555877 Oct 22 03:15:26.872830 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1346/2696] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:26 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1811 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:26.878493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:26.892605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:26.915450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.916068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.916764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:26.917727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:26.921048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:26.921721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:27.294082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:27.323995 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f17f694e-db82-4954-9dbe-c996fc7fcd57 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1308 microversion: 2.1 time: 0.580082 Oct 22 03:15:27.330535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1351/2697] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:26 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:27.347109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-383fb9ba-8a5d-4d4e-8a32-09705e3b479e tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:27.366203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-383fb9ba-8a5d-4d4e-8a32-09705e3b479e tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:27.369887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-383fb9ba-8a5d-4d4e-8a32-09705e3b479e tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:27.371436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-383fb9ba-8a5d-4d4e-8a32-09705e3b479e tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:27.372443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-383fb9ba-8a5d-4d4e-8a32-09705e3b479e tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:27.375110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-383fb9ba-8a5d-4d4e-8a32-09705e3b479e tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:27.376832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-383fb9ba-8a5d-4d4e-8a32-09705e3b479e tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:27.428168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:27.438389 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd09f394-56b4-43b0-beea-381dac0fc975 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.563670 Oct 22 03:15:27.441575 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1347/2698] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:26 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:27.452977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-383fb9ba-8a5d-4d4e-8a32-09705e3b479e tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.118091 Oct 22 03:15:27.455408 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1352/2699] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:15:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:27.474059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:27.479145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:27.493699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:27.493699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:27.494127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:27.500030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:27.500161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:27.502987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:27.572823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lazy-loading 'flavor' on Instance uuid 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:15:27.734252 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90a7c717-25cf-4f4f-8454-60f7bf5f6cca tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 202 len: 0 microversion: 2.1 time: 0.273713 Oct 22 03:15:27.735368 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1348/2700] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:27 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:15:27.744456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:27.745040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:27.753494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:27.755360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:27.755837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:27.756592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:27.758177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:27.758809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:28.124133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f96455e2-54ae-4a9b-9078-fdd982f71e30"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:28.131923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:28.160716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:28.161223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:28.161671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:28.162391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:28.163095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:28.163685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:28.606133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:28.647629 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d4db79fc-fd7a-4ac1-a5d3-56109eaa8e52 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1514 microversion: 2.1 time: 0.907679 Oct 22 03:15:28.653732 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1353/2701] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:27 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1514 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:28.670661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:28.671651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:28.679244 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1901806e-efe3-40e1-88e6-c6625661a273 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "POST /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.560189 Oct 22 03:15:28.680202 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1349/2702] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:15:28 2022] POST /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:28.690989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:28.692415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:28.693625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:28.694967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:28.698730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:28.699291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:29.235035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:29.254916 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-00d7e603-b2b8-442c-8258-3e89410d0f26 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1308 microversion: 2.1 time: 0.599849 Oct 22 03:15:29.257017 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1354/2703] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:28 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1308 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:29.678558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:29.679178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:29.689248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:29.689738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:29.690171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:29.690877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:29.700739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:29.701992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:29.786235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f29866a7-5143-46c4-a851-03afcf67c033 tempest-AZV2TestJSON-1083615905 tempest-AZV2TestJSON-1083615905-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:29.788532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f29866a7-5143-46c4-a851-03afcf67c033 tempest-AZV2TestJSON-1083615905 tempest-AZV2TestJSON-1083615905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:29.789027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f29866a7-5143-46c4-a851-03afcf67c033 tempest-AZV2TestJSON-1083615905 tempest-AZV2TestJSON-1083615905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:29.789465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f29866a7-5143-46c4-a851-03afcf67c033 tempest-AZV2TestJSON-1083615905 tempest-AZV2TestJSON-1083615905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:29.790200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f29866a7-5143-46c4-a851-03afcf67c033 tempest-AZV2TestJSON-1083615905 tempest-AZV2TestJSON-1083615905-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:29.790755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f29866a7-5143-46c4-a851-03afcf67c033 tempest-AZV2TestJSON-1083615905 tempest-AZV2TestJSON-1083615905-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:29.791114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f29866a7-5143-46c4-a851-03afcf67c033 tempest-AZV2TestJSON-1083615905 tempest-AZV2TestJSON-1083615905-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:29.912841 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f29866a7-5143-46c4-a851-03afcf67c033 tempest-AZV2TestJSON-1083615905 tempest-AZV2TestJSON-1083615905-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.404177 Oct 22 03:15:29.917317 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1350/2704] 10.222.0.25 () {58 vars in 1164 bytes} [Sat Oct 22 03:15:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:15:30.173893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:30.197343 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fffcff0e-146b-425a-a361-14ce85e54152 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1497 microversion: 2.1 time: 0.523342 Oct 22 03:15:30.197939 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1355/2705] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:29 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1497 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:30.225550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:30.226467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:30.254025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:30.254830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:30.255751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:30.256805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:30.257527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:30.258239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:30.289231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:30.290988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:30.302598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:30.307515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:30.309348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:30.310243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:30.312559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:30.314370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:30.337094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lazy-loading 'flavor' on Instance uuid 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:15:30.403635 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Cannot 'suspend' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state suspended Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action HTTP/1.1 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 15 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: {"suspend": {}} Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: exception: Cannot 'suspend' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state suspended Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'suspend': {}}} Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 22 03:15:30.413862 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state suspended Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state suspended Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 409 to user: Cannot 'suspend' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state suspended {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:30.418262 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23f789fa-f7ef-491e-b619-6b116974ffb9 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 409 len: 148 microversion: 2.1 time: 0.194392 Oct 22 03:15:30.429535 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1351/2706] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:30 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 148 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:30.445894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73db6dc6-1101-485f-afc7-ce308a4eab4f", "device": "/dev/xvdb"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:30.448543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:30.476671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:30.477095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:30.477540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:30.478564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:30.479356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:30.479356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:30.494681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:30.610956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:30.624536 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73b8dbd1-c6b8-45a6-b3b5-990e4e17291c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1308 microversion: 2.1 time: 0.337036 Oct 22 03:15:30.625870 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1356/2707] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:30 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:30.634202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:30.636414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:30.647402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:30.647900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:30.648372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:30.652832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:30.656532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:30.657200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:30.828072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:30.858313 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d61bb42d-5e21-4424-a528-9ec7c52665a8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 202 len: 0 microversion: 2.1 time: 0.228987 Oct 22 03:15:30.859506 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1357/2708] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:30 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:15:31.118714 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-073dec76-55d6-4b22-b791-b028681f1420 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "POST /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687793 Oct 22 03:15:31.129227 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1352/2709] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:15:30 2022] POST /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:31.144728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:31.156199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4fa2730d-63d9-4aa7-b305-a20ac9bca6a4 tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] Calling method '.version_select at 0x7f0d1a0b5b80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:31.167181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:31.185079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:31.185971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:31.187242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:31.188524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:31.189441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:31.190795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:31.345809 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4fa2730d-63d9-4aa7-b305-a20ac9bca6a4 tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.482351 Oct 22 03:15:31.346575 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1358/2710] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:15:30 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:15:31.362231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7872ac93-4c15-460e-91f6-8bafce0eaf8d tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] Action: 'create', calling method: .version_select at 0x7f0d1a08fca0>, body: {"pool": "non_exist_pool"} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:31.416045 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-7872ac93-4c15-460e-91f6-8bafce0eaf8d tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] HTTP exception thrown: Floating IP pool not found. Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7872ac93-4c15-460e-91f6-8bafce0eaf8d tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] Request method failure captured: Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 26 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BSD6IzWwpGIH84nKdx_oKEBVTtCwyQ2uhf2LoDjpJKAV9m3Jx0BgaKLBikuOkl7gMlcpcz_DAIasqBXMjQ6pRHV_i_4AE4LnIjUWLpDr8YaUC6jo01UNSjlq715mG-M1q60Kh0nAOC9KSwOjvnI3L_juh7fpMAOc4wglXSZHM_Ucc Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8ff5fb47a52a4f99b8152ffd71aca683 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1097677123 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8ff5fb47a52a4f99b8152ffd71aca683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ff5fb47a52a4f99b8152ffd71aca683"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8ff5fb47a52a4f99b8152ffd71aca683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ff5fb47a52a4f99b8152ffd71aca683"}]}] Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1097677123 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8ff5fb47a52a4f99b8152ffd71aca683 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1097677123 Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FloatingIPsNegativeTestJSON-1097677123-project Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d971caadc97e4088a033d0528f2caf8f Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1097677123-project Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: {"pool": "non_exist_pool"} Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: exception: Floating IP pool not found. Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:31.418105 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:31.423299 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 22 03:15:31.423299 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.427181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7872ac93-4c15-460e-91f6-8bafce0eaf8d tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] Returning 404 to user: Floating IP pool not found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:31.429655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7872ac93-4c15-460e-91f6-8bafce0eaf8d tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.071584 Oct 22 03:15:31.430887 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1359/2711] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:15:31 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:31.442533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6236474a-2307-478f-a34d-31311c41bc66 tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] Calling method '.version_select at 0x7f0d1e5480d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:31.546778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-6236474a-2307-478f-a34d-31311c41bc66 tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3758a769-18c9-46ae-8548-b8332a9ae57f could not be found", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:15:31.547902 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-6236474a-2307-478f-a34d-31311c41bc66 tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] HTTP exception thrown: Floating IP not found for ID 3758a769-18c9-46ae-8548-b8332a9ae57f Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6236474a-2307-478f-a34d-31311c41bc66 tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] Request method failure captured: Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-floating-ips/3758a769-18c9-46ae-8548-b8332a9ae57f HTTP/1.1 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BSD6IzWwpGIH84nKdx_oKEBVTtCwyQ2uhf2LoDjpJKAV9m3Jx0BgaKLBikuOkl7gMlcpcz_DAIasqBXMjQ6pRHV_i_4AE4LnIjUWLpDr8YaUC6jo01UNSjlq715mG-M1q60Kh0nAOC9KSwOjvnI3L_juh7fpMAOc4wglXSZHM_Ucc Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8ff5fb47a52a4f99b8152ffd71aca683 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1097677123 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8ff5fb47a52a4f99b8152ffd71aca683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ff5fb47a52a4f99b8152ffd71aca683"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8ff5fb47a52a4f99b8152ffd71aca683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ff5fb47a52a4f99b8152ffd71aca683"}]}] Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1097677123 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8ff5fb47a52a4f99b8152ffd71aca683 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1097677123 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FloatingIPsNegativeTestJSON-1097677123-project Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d971caadc97e4088a033d0528f2caf8f Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1097677123-project Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: exception: Floating IP not found for ID 3758a769-18c9-46ae-8548-b8332a9ae57f Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '3758a769-18c9-46ae-8548-b8332a9ae57f'} Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3758a769-18c9-46ae-8548-b8332a9ae57f could not be found Oct 22 03:15:31.549957 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b7092e-482f-4a1e-96b7-4aa86a9d165b'] Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3758a769-18c9-46ae-8548-b8332a9ae57f. Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3758a769-18c9-46ae-8548-b8332a9ae57f Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3758a769-18c9-46ae-8548-b8332a9ae57f Oct 22 03:15:31.554042 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:31.557694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6236474a-2307-478f-a34d-31311c41bc66 tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] Returning 404 to user: Floating IP not found for ID 3758a769-18c9-46ae-8548-b8332a9ae57f {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:31.557694 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6236474a-2307-478f-a34d-31311c41bc66 tempest-FloatingIPsNegativeTestJSON-1097677123 tempest-FloatingIPsNegativeTestJSON-1097677123-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/3758a769-18c9-46ae-8548-b8332a9ae57f" status: 404 len: 111 microversion: 2.1 time: 0.119380 Oct 22 03:15:31.564400 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1360/2712] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:15:31 2022] DELETE /compute/v2.1/os-floating-ips/3758a769-18c9-46ae-8548-b8332a9ae57f => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:31.655210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:31.655992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:31.688577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:31.690178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:31.691049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:31.693739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:31.698746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:31.699670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:31.877916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:31.887923 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cff81430-7213-4bb4-8684-07eb35186329 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1503 microversion: 2.1 time: 0.757107 Oct 22 03:15:31.891067 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1353/2713] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:31 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1503 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:32.062227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=20 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:32.216312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:32.227245 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a6c40f5d-8c15-4ee9-995d-0dcb17667c2a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1308 microversion: 2.1 time: 0.577558 Oct 22 03:15:32.232977 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1361/2714] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:31 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:32.922425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:32.923945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:32.946707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:32.947519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:32.948733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:32.950122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:32.951176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:32.951915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:33.257320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b0221b1d-fa96-48de-bc45-34c068431468 req-597f90f8-b092-44ec-86c9-483a0d6dadc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc010b5d-a6fb-4846-96e8-debf6bbc4509", "name": "network-vif-plugged", "status": "completed", "tag": "6aecee5c-b4c7-4bf0-8c05-f36d011934ba"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:33.292474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b0221b1d-fa96-48de-bc45-34c068431468 req-597f90f8-b092-44ec-86c9-483a0d6dadc8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:33.292908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b0221b1d-fa96-48de-bc45-34c068431468 req-597f90f8-b092-44ec-86c9-483a0d6dadc8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:33.293350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b0221b1d-fa96-48de-bc45-34c068431468 req-597f90f8-b092-44ec-86c9-483a0d6dadc8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:33.317647 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b0221b1d-fa96-48de-bc45-34c068431468 req-597f90f8-b092-44ec-86c9-483a0d6dadc8 service nova] Creating event network-vif-plugged:6aecee5c-b4c7-4bf0-8c05-f36d011934ba for instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 on n-h1-862416-2 Oct 22 03:15:33.340147 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b0221b1d-fa96-48de-bc45-34c068431468 req-597f90f8-b092-44ec-86c9-483a0d6dadc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086313 Oct 22 03:15:33.340825 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1362/2715] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:15:33.363152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:33.364159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:33.381512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:33.382012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:33.382833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:33.383568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:33.384026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:33.385934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:33.778049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:33.786508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c68f98e-0560-4232-a13a-74a5cc6b86f3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1308 microversion: 2.1 time: 0.444482 Oct 22 03:15:33.787101 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1363/2716] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:33 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:33.803328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:33.816234 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9cf436aa-71fe-4a70-9f8b-93d5c50e9766 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1503 microversion: 2.1 time: 0.899690 Oct 22 03:15:33.820515 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1354/2717] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:32 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1503 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:34.816825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:34.818878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:34.833149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:34.834130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:34.836643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:34.847992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:34.849229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:34.856057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:34.864992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:34.865898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:34.869154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:34.870004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:34.872117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:34.872940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:34.873726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:34.874270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:35.756713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:35.783516 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61b8b02b-6192-4167-be9e-cc4818bce328 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1308 microversion: 2.1 time: 0.972454 Oct 22 03:15:35.784149 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1364/2718] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:34 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1308 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:35.905225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:35.914870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf95b4ad-9ec2-40fb-b166-d63a979da394 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 1.072275 Oct 22 03:15:35.933181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1355/2719] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:34 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:35.951398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:35.951983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:35.969859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:35.974749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:35.979007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:35.979872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:35.983894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:35.984621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:36.271459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:36.285189 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f6acef81-b95b-4789-86ac-4e6a802d2346 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.338548 Oct 22 03:15:36.300676 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1365/2720] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:35 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:36.313770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-926cb11b-55ea-4ce7-a62a-643bd6f43c02 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:36.315383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-926cb11b-55ea-4ce7-a62a-643bd6f43c02 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 7d05a327-d9da-40c9-ad29-0f6c33b6d4e1] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:36.317777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=14 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:36.330423 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-926cb11b-55ea-4ce7-a62a-643bd6f43c02 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 7d05a327-d9da-40c9-ad29-0f6c33b6d4e1 could not be found. Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-926cb11b-55ea-4ce7-a62a-643bd6f43c02 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/7d05a327-d9da-40c9-ad29-0f6c33b6d4e1/action HTTP/1.1 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 15 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: {"unpause": {}} Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 7d05a327-d9da-40c9-ad29-0f6c33b6d4e1 could not be found. Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '7d05a327-d9da-40c9-ad29-0f6c33b6d4e1', 'body': {'unpause': {}}} Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d05a327-d9da-40c9-ad29-0f6c33b6d4e1 could not be found. Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d05a327-d9da-40c9-ad29-0f6c33b6d4e1 could not be found. Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:36.335638 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:36.340167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:36.340167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:36.340167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d05a327-d9da-40c9-ad29-0f6c33b6d4e1 could not be found. Oct 22 03:15:36.340167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:36.344109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-926cb11b-55ea-4ce7-a62a-643bd6f43c02 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 7d05a327-d9da-40c9-ad29-0f6c33b6d4e1 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:36.346481 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-926cb11b-55ea-4ce7-a62a-643bd6f43c02 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/7d05a327-d9da-40c9-ad29-0f6c33b6d4e1/action" status: 404 len: 111 microversion: 2.1 time: 0.038204 Oct 22 03:15:36.352718 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1356/2721] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:36 2022] POST /compute/v2.1/servers/7d05a327-d9da-40c9-ad29-0f6c33b6d4e1/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:36.360821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:36.361461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:36.376830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:36.378030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:36.378708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:36.379624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:36.380277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:36.389509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:36.588198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:36.600386 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04fa5e25-ac6c-4737-befa-a5b3f10bdf38 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.246575 Oct 22 03:15:36.601312 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1366/2722] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:36 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:36.625540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:36.626160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:36.648368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:36.648910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:36.649416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:36.650196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:36.650819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:36.651360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:36.808930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:36.811888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:36.823617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:36.824060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:36.824524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:36.827724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:36.828229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:36.828672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:37.052098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:37.062551 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea2d144f-d589-431e-9fb0-c4fc598ad5b8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1489 microversion: 2.1 time: 0.257996 Oct 22 03:15:37.077890 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1367/2723] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:36 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1489 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:37.091454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b05ee058-176a-4967-ab67-63530b20f08a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:37.098809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b05ee058-176a-4967-ab67-63530b20f08a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:37.099301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b05ee058-176a-4967-ab67-63530b20f08a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:37.100135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b05ee058-176a-4967-ab67-63530b20f08a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:37.179684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b05ee058-176a-4967-ab67-63530b20f08a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Going to try to stop instance {{(pid=120582) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:15:37.247211 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b05ee058-176a-4967-ab67-63530b20f08a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509/action" status: 202 len: 0 microversion: 2.1 time: 0.161383 Oct 22 03:15:37.249017 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1368/2724] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:37 2022] POST /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:15:37.258292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:37.259365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:37.266697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:37.267523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:37.268317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:37.269315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:37.270167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:37.270852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:37.327549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:37.347627 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a2cf2e9f-38ff-46ef-ba32-69f5f7d92d20 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.726699 Oct 22 03:15:37.348262 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1357/2725] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:36 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:37.380426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:37.381531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:37.390864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:37.393527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:37.394111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:37.395154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:37.395486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:37.395826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:37.403756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:37.456959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Cannot 'unpause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action HTTP/1.1 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 15 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: {"unpause": {}} Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: exception: Cannot 'unpause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'unpause': {}}} Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 in vm_state active. Cannot unpause while the instance is in this state. Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:37.462533 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:37.466130 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:37.466130 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:37.466130 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:37.466130 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:15:37.466130 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:37.466130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 409 to user: Cannot 'unpause' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:37.466130 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e096a404-0e42-43a5-a31a-f16d0a18d52d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 409 len: 145 microversion: 2.1 time: 0.094590 Oct 22 03:15:37.468061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1358/2726] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:37 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 145 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:15:37.483618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:37.492464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:37.500960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:37.503843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:37.506105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:37.507511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:37.511492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:37.512063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:37.575223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:37.591994 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fc2f5d32-1c9e-413d-b72d-84305f747cfe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.333492 Oct 22 03:15:37.604706 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1369/2727] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:37 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:37.997500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:38.007968 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-828c5ba2-0b11-43e0-9af1-e09ee6c14fc2 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.533981 Oct 22 03:15:38.020651 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1359/2728] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:37 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:38.033663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:38.034671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:38.050741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:38.051795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:38.053418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:38.055566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:38.056112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:38.056630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:38.230316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:38.239131 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a359d1c3-4f2f-488b-be61-923d05061b44 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.210632 Oct 22 03:15:38.240196 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1370/2729] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:38 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:38.262961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0322709-d2dd-477d-addf-e5b1257b33e3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:38.263553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0322709-d2dd-477d-addf-e5b1257b33e3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: b249261b-7028-411a-86f3-977a86e8f057] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:38.271291 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c0322709-d2dd-477d-addf-e5b1257b33e3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance b249261b-7028-411a-86f3-977a86e8f057 could not be found. Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0322709-d2dd-477d-addf-e5b1257b33e3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/b249261b-7028-411a-86f3-977a86e8f057/action HTTP/1.1 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 18 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: {"unshelve": null} Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance b249261b-7028-411a-86f3-977a86e8f057 could not be found. Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'b249261b-7028-411a-86f3-977a86e8f057', 'body': {'unshelve': None}} Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b249261b-7028-411a-86f3-977a86e8f057 could not be found. Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b249261b-7028-411a-86f3-977a86e8f057 could not be found. Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:38.272932 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:38.277076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:38.277076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:38.277076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:38.277076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:38.277076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:38.277076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:38.277076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b249261b-7028-411a-86f3-977a86e8f057 could not be found. Oct 22 03:15:38.277076 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:38.278427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0322709-d2dd-477d-addf-e5b1257b33e3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance b249261b-7028-411a-86f3-977a86e8f057 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:38.280059 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0322709-d2dd-477d-addf-e5b1257b33e3 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/b249261b-7028-411a-86f3-977a86e8f057/action" status: 404 len: 111 microversion: 2.1 time: 0.020359 Oct 22 03:15:38.280894 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1360/2730] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:38 2022] POST /compute/v2.1/servers/b249261b-7028-411a-86f3-977a86e8f057/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:38.289580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:38.290793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:38.298503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:38.298992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:38.299446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:38.300126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:38.301161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:38.301803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:38.531178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:38.542689 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e5fbb79-e84a-497b-a754-387283241c91 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.256995 Oct 22 03:15:38.557425 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1371/2731] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:38 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:38.567857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:38.569384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:38.583504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:38.584531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:38.585165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:38.586103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:38.586763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:38.587291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:38.618997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:38.619712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:38.631900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:38.633200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:38.634236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:38.635002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:38.635473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:38.635914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:38.870329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:38.881184 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-059df32a-62c7-4054-a876-19ddded88674 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.266032 Oct 22 03:15:38.882529 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1372/2732] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:38 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:39.046766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:39.061136 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c93d067-7c71-400a-aad7-ac264b823f3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.494729 Oct 22 03:15:39.062898 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1361/2733] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:38 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:39.086526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:39.087881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:39.098726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.099543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.100242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.101173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.101841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.102509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.140800 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Cannot 'unshelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action HTTP/1.1 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 18 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: {"unshelve": null} Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot 'unshelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'unshelve': None}} Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 in vm_state active. Cannot unshelve while the instance is in this state. Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:15:39.143242 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active Oct 22 03:15:39.147587 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.152603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 409 to user: Cannot 'unshelve' instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 while it is in vm_state active {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:39.154024 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43ad4659-f790-4073-a811-bae87a81658a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action" status: 409 len: 146 microversion: 2.1 time: 0.073114 Oct 22 03:15:39.157791 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1373/2734] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:39 2022] POST /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3/action => generated 146 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:39.169062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:39.169684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:39.186215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.189254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.189736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.190488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.191099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.191987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.507892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:39.545028 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e8303ae-40ff-4ca9-ba38-c55f1ea4f91c tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.382786 Oct 22 03:15:39.549867 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1362/2735] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:39 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:39.578075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:39.578710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:39.599224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.600035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.604933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.607173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.611122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.611675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.812860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:39.826012 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ddc3b04-d393-4041-9b28-11a9b4f1848d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.253660 Oct 22 03:15:39.828007 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1374/2736] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:39 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:39.852577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94cecec4-1160-4c1d-8895-2f5b30675b8d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1879631713_updated"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:39.855492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-94cecec4-1160-4c1d-8895-2f5b30675b8d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 686de3b7-712b-4765-b4ce-826e7f595f77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:39.864191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:39.865438 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-94cecec4-1160-4c1d-8895-2f5b30675b8d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 686de3b7-712b-4765-b4ce-826e7f595f77 could not be found. Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94cecec4-1160-4c1d-8895-2f5b30675b8d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/servers/686de3b7-712b-4765-b4ce-826e7f595f77 HTTP/1.1 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 81 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1879631713_updated"}} Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 686de3b7-712b-4765-b4ce-826e7f595f77 could not be found. Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '686de3b7-712b-4765-b4ce-826e7f595f77', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1879631713_updated'}}} Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 686de3b7-712b-4765-b4ce-826e7f595f77 could not be found. Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 22 03:15:39.868399 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 686de3b7-712b-4765-b4ce-826e7f595f77 could not be found. Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 686de3b7-712b-4765-b4ce-826e7f595f77 could not be found. Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94cecec4-1160-4c1d-8895-2f5b30675b8d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 686de3b7-712b-4765-b4ce-826e7f595f77 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:39.872060 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-94cecec4-1160-4c1d-8895-2f5b30675b8d tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "PUT /compute/v2.1/servers/686de3b7-712b-4765-b4ce-826e7f595f77" status: 404 len: 111 microversion: 2.1 time: 0.021825 Oct 22 03:15:39.880993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:39.881625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:39.887956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.888556 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1363/2737] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:15:39 2022] PUT /compute/v2.1/servers/686de3b7-712b-4765-b4ce-826e7f595f77 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:39.888892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.889350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.890834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.891579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.892265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.910517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:39.911285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:39.921301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.922372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.924104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:39.925675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:39.926394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:39.928553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:40.067554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:40.077109 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb956132-77ca-4a15-8db0-887b07df4553 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.201220 Oct 22 03:15:40.078007 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1375/2738] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:39 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:40.104283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:40.105153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:40.119341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:40.120100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:40.120628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:40.121417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:40.121945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:40.122457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:40.257658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:40.270018 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2d2d0ba-e826-4248-8585-cbebcc2100de tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.366187 Oct 22 03:15:40.284995 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1364/2739] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:39 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:40.292693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:40.301592 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97acd953-8b58-432d-b928-a60b24ca20f8 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.201372 Oct 22 03:15:40.316268 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1376/2740] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:40 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:40.334003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06aca32a-b2d6-4ac0-95a9-966c7016c50e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06aca32a-b2d6-4ac0-95a9-966c7016c50e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 HTTP/1.1 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 280 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.338971 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06aca32a-b2d6-4ac0-95a9-966c7016c50e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-06aca32a-b2d6-4ac0-95a9-966c7016c50e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "PUT /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 400 len: 619 microversion: 2.1 time: 0.011001 Oct 22 03:15:40.345851 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1365/2741] 10.222.0.25 () {60 vars in 1257 bytes} [Sat Oct 22 03:15:40 2022] PUT /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:15:40.350357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:40.351516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:40.359727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:40.360248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:40.360758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:40.362116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:40.362710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:40.363144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:40.390566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:40.584250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:40.594477 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8bade21-6244-4e0f-9a7c-989f2fb498fe tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.248051 Oct 22 03:15:40.608444 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1377/2742] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:40 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:40.619854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:40.621471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:40.629290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:40.629837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:40.630443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:40.631318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:40.631984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:40.632739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:40.771895 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1040b1de-aadd-40f8-b1e9-2649b35659c5 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.170142 Oct 22 03:15:40.779046 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1366/2743] 10.222.0.25 () {58 vars in 1128 bytes} [Sat Oct 22 03:15:40 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 03:15:40.784909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb5921bb-a662-499f-b88b-362660df1385 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Calling method '.version_select at 0x7f0d19652d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:40.812991 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-cb5921bb-a662-499f-b88b-362660df1385 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] HTTP exception thrown: Image not found. Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb5921bb-a662-499f-b88b-362660df1385 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Request method failure captured: Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BcP8ZYh8P6yVOewheXDnTr5WMhXHlE1vokAqD0OiRQZj3FGyjQeegghn1xrHcmCjbnUq-Sf7cFA-BV0yf2X-z8JpKMLFt853Owbu_ZufA4Sa1gtfJ1zaNLGgyX5NcUcONkZA40fPW6h8i1K1chBHLUzbV8d25NjBNWAvhecp9Vuyo Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c044c124e53483491f70b5094792417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c044c124e53483491f70b5094792417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}] Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 830988e7c8034508bf0331581faf25c9 Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '-1'} Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.815627 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:15:40.820042 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.825221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb5921bb-a662-499f-b88b-362660df1385 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:40.826815 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb5921bb-a662-499f-b88b-362660df1385 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.046076 Oct 22 03:15:40.834176 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1367/2744] 10.222.0.25 () {58 vars in 1134 bytes} [Sat Oct 22 03:15:40 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:40.839620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c51f466a-92d9-4e3f-a03f-78c7ac2a0a6b tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Calling method '.version_select at 0x7f0d19657af0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:40.869810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c51f466a-92d9-4e3f-a03f-78c7ac2a0a6b tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] HTTP exception thrown: Image not found. Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c51f466a-92d9-4e3f-a03f-78c7ac2a0a6b tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Request method failure captured: Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/33722d9a-8436-45dd-80fb-b1b3e6c2a10j HTTP/1.1 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BcP8ZYh8P6yVOewheXDnTr5WMhXHlE1vokAqD0OiRQZj3FGyjQeegghn1xrHcmCjbnUq-Sf7cFA-BV0yf2X-z8JpKMLFt853Owbu_ZufA4Sa1gtfJ1zaNLGgyX5NcUcONkZA40fPW6h8i1K1chBHLUzbV8d25NjBNWAvhecp9Vuyo Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c044c124e53483491f70b5094792417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c044c124e53483491f70b5094792417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}] Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 830988e7c8034508bf0331581faf25c9 Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '33722d9a-8436-45dd-80fb-b1b3e6c2a10j'} Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 33722d9a-8436-45dd-80fb-b1b3e6c2a10j to delete Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33722d9a-8436-45dd-80fb-b1b3e6c2a10j could not be found. Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.872352 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:15:40.877247 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.881337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c51f466a-92d9-4e3f-a03f-78c7ac2a0a6b tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:40.881337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c51f466a-92d9-4e3f-a03f-78c7ac2a0a6b tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] 10.222.0.25 "DELETE /compute/v2.1/images/33722d9a-8436-45dd-80fb-b1b3e6c2a10j" status: 404 len: 62 microversion: 2.1 time: 0.045386 Oct 22 03:15:40.881337 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1368/2745] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:40 2022] DELETE /compute/v2.1/images/33722d9a-8436-45dd-80fb-b1b3e6c2a10j => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:40.895180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7639f51-cccc-4685-806d-f599fc21340c tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Calling method '.version_select at 0x7f0d1963ae50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:40.928116 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e7639f51-cccc-4685-806d-f599fc21340c tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] HTTP exception thrown: Image not found. Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7639f51-cccc-4685-806d-f599fc21340c tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Request method failure captured: Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/ccdfaf38-892f-469b-a99a-72da400886e11 HTTP/1.1 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BcP8ZYh8P6yVOewheXDnTr5WMhXHlE1vokAqD0OiRQZj3FGyjQeegghn1xrHcmCjbnUq-Sf7cFA-BV0yf2X-z8JpKMLFt853Owbu_ZufA4Sa1gtfJ1zaNLGgyX5NcUcONkZA40fPW6h8i1K1chBHLUzbV8d25NjBNWAvhecp9Vuyo Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c044c124e53483491f70b5094792417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c044c124e53483491f70b5094792417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}] Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 830988e7c8034508bf0331581faf25c9 Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ccdfaf38-892f-469b-a99a-72da400886e11'} Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ccdfaf38-892f-469b-a99a-72da400886e11 to delete Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ccdfaf38-892f-469b-a99a-72da400886e11 could not be found. Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.929997 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7639f51-cccc-4685-806d-f599fc21340c tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7639f51-cccc-4685-806d-f599fc21340c tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] 10.222.0.25 "DELETE /compute/v2.1/images/ccdfaf38-892f-469b-a99a-72da400886e11" status: 404 len: 62 microversion: 2.1 time: 0.043336 Oct 22 03:15:40.936475 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1369/2746] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:15:40 2022] DELETE /compute/v2.1/images/ccdfaf38-892f-469b-a99a-72da400886e11 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:40.945660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-71894fdb-1b88-440b-b6ce-4be05ddb3824 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Calling method '.version_select at 0x7f0d196c75e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:40.972286 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-71894fdb-1b88-440b-b6ce-4be05ddb3824 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] HTTP exception thrown: Image not found. Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-71894fdb-1b88-440b-b6ce-4be05ddb3824 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Request method failure captured: Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/tempest-invalid-1779025198 HTTP/1.1 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BcP8ZYh8P6yVOewheXDnTr5WMhXHlE1vokAqD0OiRQZj3FGyjQeegghn1xrHcmCjbnUq-Sf7cFA-BV0yf2X-z8JpKMLFt853Owbu_ZufA4Sa1gtfJ1zaNLGgyX5NcUcONkZA40fPW6h8i1K1chBHLUzbV8d25NjBNWAvhecp9Vuyo Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c044c124e53483491f70b5094792417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c044c124e53483491f70b5094792417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}] Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 830988e7c8034508bf0331581faf25c9 Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'tempest-invalid-1779025198'} Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1779025198 to delete Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1779025198 could not be found. Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.974314 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:40.978704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-71894fdb-1b88-440b-b6ce-4be05ddb3824 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:40.980035 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-71894fdb-1b88-440b-b6ce-4be05ddb3824 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-1779025198" status: 404 len: 62 microversion: 2.1 time: 0.036726 Oct 22 03:15:40.980485 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1370/2747] 10.222.0.25 () {58 vars in 1206 bytes} [Sat Oct 22 03:15:40 2022] DELETE /compute/v2.1/images/tempest-invalid-1779025198 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:15:40.991170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32e8a297-b5e7-4019-93ef-9f84acf4a182 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Calling method '.version_select at 0x7f0d196ebf70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:41.016489 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-32e8a297-b5e7-4019-93ef-9f84acf4a182 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] HTTP exception thrown: Image not found. Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32e8a297-b5e7-4019-93ef-9f84acf4a182 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Request method failure captured: Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/68ded746-a4a0-4bd1-81f5-d7e499c26791 HTTP/1.1 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BcP8ZYh8P6yVOewheXDnTr5WMhXHlE1vokAqD0OiRQZj3FGyjQeegghn1xrHcmCjbnUq-Sf7cFA-BV0yf2X-z8JpKMLFt853Owbu_ZufA4Sa1gtfJ1zaNLGgyX5NcUcONkZA40fPW6h8i1K1chBHLUzbV8d25NjBNWAvhecp9Vuyo Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c044c124e53483491f70b5094792417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c044c124e53483491f70b5094792417"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c044c124e53483491f70b5094792417"}]}] Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5c044c124e53483491f70b5094792417 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-416969438 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 830988e7c8034508bf0331581faf25c9 Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-416969438-project Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '68ded746-a4a0-4bd1-81f5-d7e499c26791'} Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 68ded746-a4a0-4bd1-81f5-d7e499c26791 to delete Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 68ded746-a4a0-4bd1-81f5-d7e499c26791 could not be found. Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:41.019098 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:15:41.022904 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.033271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32e8a297-b5e7-4019-93ef-9f84acf4a182 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:41.033271 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32e8a297-b5e7-4019-93ef-9f84acf4a182 tempest-ImagesDeleteNegativeTestJSON-416969438 tempest-ImagesDeleteNegativeTestJSON-416969438-project] 10.222.0.25 "DELETE /compute/v2.1/images/68ded746-a4a0-4bd1-81f5-d7e499c26791" status: 404 len: 62 microversion: 2.1 time: 0.040769 Oct 22 03:15:41.033826 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1371/2748] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:40 2022] DELETE /compute/v2.1/images/68ded746-a4a0-4bd1-81f5-d7e499c26791 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:15:41.180934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:41.206593 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41c5ea2e-74aa-480f-839c-276056c4e159 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.590512 Oct 22 03:15:41.222436 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1378/2749] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:40 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:41.233362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-780b9c1d-b98c-445a-b9d0-f700ca7eb49e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-780b9c1d-b98c-445a-b9d0-f700ca7eb49e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 HTTP/1.1 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 24 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": ""}} Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3', 'body': {'server': {'name': ''}}} Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '' Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:15:41.238105 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-780b9c1d-b98c-445a-b9d0-f700ca7eb49e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:41.242139 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-780b9c1d-b98c-445a-b9d0-f700ca7eb49e tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "PUT /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 400 len: 108 microversion: 2.1 time: 0.011081 Oct 22 03:15:41.249959 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1372/2750] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:15:41 2022] PUT /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:15:41.252113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:41.252790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:41.260622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:41.261125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:41.261568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:41.262297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:41.262758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:41.263190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:41.299090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:41.299784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:41.314039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:41.314539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:41.314981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:41.315704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:41.316237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:41.337323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:41.563925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:41.574703 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc33aca9-fe8d-4794-a486-e227dbc8c751 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.280730 Oct 22 03:15:41.603758 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1373/2751] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:41 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:41.669052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:41.680261 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b656a362-9ce7-4195-b32c-3a63173bc3a5 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1506 microversion: 2.1 time: 0.433991 Oct 22 03:15:41.681385 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1379/2752] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:41 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:42.604143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:42.605103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:42.616769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:42.617406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:42.618514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:42.621129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:42.621830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:42.624687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:42.941306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:42.949769 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-609f87fa-bce3-4a88-9470-e9ddfd30caf8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.349639 Oct 22 03:15:42.950353 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1374/2753] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:42 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:43.974946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:43.975631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:43.988677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:43.989168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:43.989607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:43.991566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:43.992051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:43.992516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:44.157161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1357813950", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "636a4e0f-2dc3-4c83-88d5-b5568cafac2d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:44.245826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] validate_networks() for [('636a4e0f-2dc3-4c83-88d5-b5568cafac2d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:15:44.360861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:44.377185 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f01e7d1c-99e8-485e-85a8-39bfed203e28 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.405990 Oct 22 03:15:44.385801 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1375/2754] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:43 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:44.963794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:15:44.964551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:15:44.965342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:15:44.966076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:15:44.966574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:15:45.005220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:45.006200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:45.006863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:45.007833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:45.010027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:45.011667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:45.072315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:15:45.082421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for user 7bd4c44f32a04da48b34c9c888f36fa6 and project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:15:45.101723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:15:45.110273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:15:45.221800 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-95e1b885-6589-4fc2-9df0-8334e8d6c587 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.301573 Oct 22 03:15:45.222778 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1380/2755] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:15:45.238111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bde01f16-6223-4c86-a68d-6388d6268d19 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:45.238809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bde01f16-6223-4c86-a68d-6388d6268d19 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:45.370682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bde01f16-6223-4c86-a68d-6388d6268d19 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:45.378457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bde01f16-6223-4c86-a68d-6388d6268d19 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1215 microversion: 2.1 time: 0.148165 Oct 22 03:15:45.392692 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1376/2756] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:45 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:45.410144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:45.418663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:45.432077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:45.434345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:45.437403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:45.438503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:45.440114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:45.441875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:45.755825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:45.769835 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-befb7973-73ad-481b-89c8-5083912bdd2f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.365697 Oct 22 03:15:45.771224 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1381/2757] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:45 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:46.411954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:46.412483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:46.422274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:46.423123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:46.423770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:46.424657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:46.425939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:46.426531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:46.533956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:46.542443 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb8d657b-f97e-4028-8bcd-a4aa5ea1bf09 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1219 microversion: 2.1 time: 0.134844 Oct 22 03:15:46.543322 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1377/2758] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:46 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:46.800447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:46.802717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:46.834801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:46.837830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:46.838499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:46.839462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:46.840747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:46.842055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:47.410603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:47.423507 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49d69785-f151-4736-b6d9-58815a70242b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.628197 Oct 22 03:15:47.424643 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1382/2759] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:46 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:47.567756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:47.568975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:47.585252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:47.586038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:47.586476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:47.587185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:47.587803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:47.588261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:47.684969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:47.695488 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87437613-c214-4ad6-96f7-1fb6d5936e4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1267 microversion: 2.1 time: 0.131685 Oct 22 03:15:47.696249 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1378/2760] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:47 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:48.266601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:48.271400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:48.295946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:48.296735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:48.297355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:48.298253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:48.300857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:48.301535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:48.376581 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d7eb83d2-db54-4ad9-a515-ec0a72670e59 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118829 Oct 22 03:15:48.386080 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1383/2761] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:15:48 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:48.389367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:48.390646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:48.403258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:48.410118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:48.411901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:48.415034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:48.415909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:48.416861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:48.417629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:48.454873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:48.455492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:48.470416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:48.471185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:48.471791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:48.472705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:48.473338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:48.473922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:48.608587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:48.616151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lazy-loading 'services' on Instance uuid 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:15:49.115934 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69e6bb36-a653-4c72-ac1b-d8f64f3cfd62 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments/f96455e2-54ae-4a9b-9078-fdd982f71e30" status: 202 len: 0 microversion: 2.1 time: 0.731748 Oct 22 03:15:49.117074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1379/2762] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:15:48 2022] DELETE /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments/f96455e2-54ae-4a9b-9078-fdd982f71e30 => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:15:49.125734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:49.126436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:49.144001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:49.144544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:49.144983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:49.145700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:49.146152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:49.153725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:49.425641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:49.454248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-58e883c3-293e-4b32-9909-ebf85f488f32 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.995849 Oct 22 03:15:49.455279 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1384/2763] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:48 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:49.737132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:49.737729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:49.753092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:49.761340 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6dd00b1d-e114-4e9f-84df-e1119b177f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.639918 Oct 22 03:15:49.761563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:49.768610 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1380/2764] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:49 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:49.780220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:49.780926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:49.781777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:49.782349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:49.784728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:49.835078 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 HTTP/1.1 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'a83f771c-10b0-428a-b06e-dc6ff3241110'} Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:49.840643 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.847618 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.853231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:49.856919 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-abb22fc9-aaf2-4188-b095-ec0154f0efaa tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 404 len: 111 microversion: 2.1 time: 0.125137 Oct 22 03:15:49.864331 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1385/2765] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:15:49 2022] DELETE /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:15:49.869161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:49.869783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: a83f771c-10b0-428a-b06e-dc6ff3241110] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:49.894140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:49.894646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:49.895139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:49.895787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:49.896268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:49.909757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:49.964311 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 HTTP/1.1 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a83f771c-10b0-428a-b06e-dc6ff3241110'} Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:49.966038 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance a83f771c-10b0-428a-b06e-dc6ff3241110 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce7a75ff-3b1d-46e9-a75a-51b75da6db63 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110" status: 404 len: 111 microversion: 2.1 time: 0.103090 Oct 22 03:15:49.975729 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1381/2766] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:49 2022] GET /compute/v2.1/servers/a83f771c-10b0-428a-b06e-dc6ff3241110 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:49.982317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:49.983414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:49.994946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:49.996929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:50.001506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:50.002836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:50.004777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:50.006456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:50.081880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:15:50.302611 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73091b8c-d197-4a84-b951-ce0f1a6d2d3a tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "DELETE /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 204 len: 0 microversion: 2.1 time: 0.325429 Oct 22 03:15:50.310072 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1386/2767] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:15:49 2022] DELETE /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:15:50.312518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:50.313133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:50.322263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:50.322764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:50.323198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:50.323904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:50.324401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:50.324826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:50.503744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:50.504626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:50.518265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:50.519138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:50.519754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:50.520665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:50.523414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:50.524063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:50.792570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:50.801031 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f1250c6-f7aa-4531-816f-88f208656a59 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.321518 Oct 22 03:15:50.804560 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1387/2768] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:50 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:50.820418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:50.821177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:50.846981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:50.847489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:50.847935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:50.848810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:50.849652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:50.850239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:51.006775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:51.023135 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bbf7372f-5567-4d7f-a4fd-6b87bc255ed6 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.714933 Oct 22 03:15:51.023709 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1382/2769] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:50 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:51.053429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:51.065241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:51.078744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:51.080295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:51.086594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:51.087680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:51.088755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:51.090127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:51.191146 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9058a29-a570-4237-8a1f-d38e39ac3394 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1857 microversion: 2.1 time: 0.385449 Oct 22 03:15:51.191762 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1388/2770] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:50 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1857 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:51.216276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:51.219136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:51.248949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:51.249461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:51.250098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:51.253148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:51.253994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:51.254747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:51.364127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lazy-loading 'flavor' on Instance uuid 88d5af8e-154b-4a08-bb37-0a1947b49d82 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:15:51.388257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Going to try to live migrate instance to n-h2-862416-2 {{(pid=120582) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:15:51.612011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:51.623736 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-014c2209-8518-44b7-b6ac-b81d1753be97 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.574857 Oct 22 03:15:51.626534 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1383/2771] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:51 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:51.826170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:51.827023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:51.839209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:51.840032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:51.840856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:51.841805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:51.843844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:51.844511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:52.648247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:52.666941 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4fec6c1-8ff4-48f8-9c52-6962c05955ab tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.843482 Oct 22 03:15:52.679180 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1384/2772] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:51 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:52.698607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:52.705343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:52.727529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:52.739029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:52.739544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:52.743209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:52.746828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:52.747316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:53.552744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9b091b268443498d66f34cd397c8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1d7beed3948dda94437d6f7b8bb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:53.567412 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb4c8d83-ec84-4531-bff4-542306f8b715 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 200 len: 1512 microversion: 2.1 time: 0.886938 Oct 22 03:15:53.571853 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1385/2773] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:52 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 1512 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:53.585791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:53.586872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:53.637484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:53.638203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:53.639499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:53.640647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:53.641632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:53.642237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:54.091534 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-03ebe041-25c0-40d3-a3c5-5f8ecc3dbccc tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/action" status: 202 len: 0 microversion: 2.1 time: 2.880873 Oct 22 03:15:54.097091 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1389/2774] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:15:51 2022] POST /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/action => generated 0 bytes in 2884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:15:54.104166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:54.115370 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b308a771-a652-42d5-80e1-55b50e733f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.542181 Oct 22 03:15:54.129038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-169180a0-2c6f-4ca6-9e03-080132af5191 req-1bc70b79-de05-40bd-8fee-10b660568bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938f6f66-f2cf-4acd-8470-fa0df1b62f1c", "tag": "848e4c1c-9dc5-491f-a12f-7d794548c7de"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:54.130436 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1386/2775] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:53 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:54.141170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:54.142157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:54.150723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:54.152069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:54.152754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:54.153699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:54.154426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:54.155060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:54.179962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-169180a0-2c6f-4ca6-9e03-080132af5191 req-1bc70b79-de05-40bd-8fee-10b660568bba service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:54.182250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-169180a0-2c6f-4ca6-9e03-080132af5191 req-1bc70b79-de05-40bd-8fee-10b660568bba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:54.184666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-169180a0-2c6f-4ca6-9e03-080132af5191 req-1bc70b79-de05-40bd-8fee-10b660568bba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:54.231556 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-169180a0-2c6f-4ca6-9e03-080132af5191 req-1bc70b79-de05-40bd-8fee-10b660568bba service nova] Creating event network-changed:848e4c1c-9dc5-491f-a12f-7d794548c7de for instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c on n-h2-862416-2 Oct 22 03:15:54.247204 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-169180a0-2c6f-4ca6-9e03-080132af5191 req-1bc70b79-de05-40bd-8fee-10b660568bba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148356 Oct 22 03:15:54.251120 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1390/2776] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:15:54.267080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:54.268597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:54.279318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:54.293398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:54.293930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:54.295418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:54.296194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:54.297612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:54.298057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:54.540912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:54.553302 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38c50d87-f5b6-4b76-bdf2-0174ba385fa8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.413547 Oct 22 03:15:54.554138 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1387/2777] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:54 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:54.595187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:54.595795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] [instance: 83aea4f8-aff9-49b1-9fac-7fa0c254fea3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:54.607840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:54.608365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:54.608801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:54.609512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:54.609965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:54.610386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:54.621529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:54.644543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5800df1a-4e32-4fcc-96db-c3ac1218c906 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.388800 Oct 22 03:15:54.645543 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1391/2778] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:54 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:54.652429 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] HTTP exception thrown: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 could not be found. Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Request method failure captured: Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 HTTP/1.1 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU19o-wvfADJGsssw3KpSw1YjoDPUO97Uel1_YJsNSYU7rDMtTGvB6KP8OPAdJMecox4zbjLaWa18wATHG_Ol0kwjUUah8pXx-mVSzUYqhXVHvJtQemfCsCKkb3FpfrTFTBAN0zIRWBLUpEcLlr0JFJp3G5CneIXfNm7pjoFSgA0oT2I Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f2a1d7beed3948dda94437d6f7b8bb42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f2a1d7beed3948dda94437d6f7b8bb42"}]}] Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f2a1d7beed3948dda94437d6f7b8bb42 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2078792385 Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 5d9b091b268443498d66f34cd397c8dc Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-2078792385-project Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 could not be found. Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '83aea4f8-aff9-49b1-9fac-7fa0c254fea3'} Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 could not be found. Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 could not be found. Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:15:54.660192 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 could not be found. Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] Returning 404 to user: Instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:15:54.664255 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abe1b33b-ab31-4680-a6fb-82406f78ff96 tempest-ServersNegativeTestJSON-2078792385 tempest-ServersNegativeTestJSON-2078792385-project] 10.222.0.25 "GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3" status: 404 len: 111 microversion: 2.1 time: 0.072745 Oct 22 03:15:54.668930 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1388/2779] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:54 2022] GET /compute/v2.1/servers/83aea4f8-aff9-49b1-9fac-7fa0c254fea3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:15:55.143906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:55.144918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:55.150337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:55.151542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:55.165449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:55.169288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:55.175466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:55.176743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:55.177459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:55.178170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:55.217638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:55.495402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:55.507900 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e196085e-fd23-4364-adf3-cda0806d47b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.366927 Oct 22 03:15:55.508769 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1392/2780] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:55 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:55.578027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:55.578656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:55.586073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:15:55.588202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:55.588696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:55.589170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:55.590051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:55.600271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:55.600953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:55.671679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:55.672390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:55.686818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:55.691377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:55.691861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:55.692719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:55.693128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:55.693555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:55.944496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:55.953392 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28e36896-eb66-4b48-9845-a12c149f0909 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.286674 Oct 22 03:15:55.974777 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1393/2781] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:55 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:56.125360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:56.138753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc4b388b-201a-48ca-8a07-c7653f025ed5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.565291 Oct 22 03:15:56.141597 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1389/2782] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:55 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:56.286697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8d28858c-f9da-4940-a55c-4918705878d5 req-e5c5737b-e69f-4ac9-91c1-54ddb2bb300a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83aea4f8-aff9-49b1-9fac-7fa0c254fea3", "name": "network-vif-deleted", "tag": "cfaf4bdc-ec50-406c-ba43-5295b1573af3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:15:56.311045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8d28858c-f9da-4940-a55c-4918705878d5 req-e5c5737b-e69f-4ac9-91c1-54ddb2bb300a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:56.312093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8d28858c-f9da-4940-a55c-4918705878d5 req-e5c5737b-e69f-4ac9-91c1-54ddb2bb300a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:56.314499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8d28858c-f9da-4940-a55c-4918705878d5 req-e5c5737b-e69f-4ac9-91c1-54ddb2bb300a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:56.351174 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8d28858c-f9da-4940-a55c-4918705878d5 req-e5c5737b-e69f-4ac9-91c1-54ddb2bb300a service nova] Creating event network-vif-deleted:cfaf4bdc-ec50-406c-ba43-5295b1573af3 for instance 83aea4f8-aff9-49b1-9fac-7fa0c254fea3 on n-h1-862416-2 Oct 22 03:15:56.363648 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8d28858c-f9da-4940-a55c-4918705878d5 req-e5c5737b-e69f-4ac9-91c1-54ddb2bb300a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090703 Oct 22 03:15:56.364288 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1394/2783] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:15:56.534342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:56.534866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:56.581765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:56.582939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:56.583558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:56.585113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:56.585788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:56.586415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:56.971980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:56.984406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:56.985402 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4eaa51a-bea5-49f6-a470-59d1c23458b1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.455053 Oct 22 03:15:56.985897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:57.000312 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1390/2784] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:56 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:57.017550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:57.023743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:57.024302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:57.025075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:57.026163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:57.026611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:57.174436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:57.175439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:57.188628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:57.191677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:57.192364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:57.194434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:57.197193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:57.197797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:57.797213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:57.805932 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-443c80d6-18f0-44fa-83e8-963212e16ec0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.639199 Oct 22 03:15:57.816087 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1391/2785] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:57 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:57.975754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:57.992410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c6d5b7b4-ad8f-4ebd-8ccf-198633d7fa70 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 1.011793 Oct 22 03:15:57.993096 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1395/2786] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:56 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:58.018464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:58.019956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:58.038914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.039324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.039758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.040506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.040966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.041394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.251099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:58.253338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:58.264758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.268899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.269539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.270560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.275495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.276251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.358840 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46ab3510-d940-4930-823c-e55a9786884d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112430 Oct 22 03:15:58.362214 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1396/2787] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:15:58 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:15:58.493639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:58.495586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:58.509714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.510218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.511780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.513753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.515763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.516101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:58.517733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.530487 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7e85005e-baf2-414e-8d55-904f2bba6569 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.517119 Oct 22 03:15:58.534170 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1392/2788] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:58 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:58.586779 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-52788e5c-62bf-4e6d-9bbb-1253bc2e918b tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090005 Oct 22 03:15:58.587607 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1397/2789] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:15:58 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:15:58.703959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:58.704494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:58.718217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.718860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.719303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.720007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.720491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.720922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.783722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:15:58.844168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:58.845006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:58.860190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.862964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.863570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.865139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.867242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.867692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.957233 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72158455-44ca-40a0-ab3b-8b92e7cc4e85 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 204 len: 0 microversion: 2.1 time: 0.257271 Oct 22 03:15:58.961276 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1393/2790] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:15:58 2022] DELETE /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:15:58.969091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:58.969808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:58.989033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.989987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:58.994387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:58.998404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:58.999504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:59.000324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:59.194557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:59.203432 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-57559d9d-f27a-4c36-a103-1e9d9947d9c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 0.366475 Oct 22 03:15:59.220269 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1398/2791] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:58 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:59.225475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:59.226673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:59.241816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:59.242789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:59.243414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:59.244333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:59.244947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:59.245529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:59.547909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:59.565223 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d1b4ed3-95cc-4977-932c-df8c9789bb07 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.334839 Oct 22 03:15:59.568625 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1399/2792] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:59 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:15:59.582188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:15:59.583184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:15:59.593066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:59.593688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:59.594235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:59.595178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:15:59.595746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:15:59.596350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:15:59.602712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:59.629574 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f19c6477-d635-4ee7-96e1-e9786abbfa1f tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1680 microversion: 2.1 time: 0.666858 Oct 22 03:15:59.638211 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1394/2793] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:58 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1680 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:15:59.848070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:15:59.856839 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7456b019-0b4c-421c-aea8-aa307aa99895 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.286914 Oct 22 03:15:59.857667 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1400/2794] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:15:59 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:00.226986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:00.227612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:00.243425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:00.243927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:00.244408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:00.245128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:00.245582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:00.246014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:00.297440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:00.597934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:00.600176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:00.614709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:00.617924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:00.621024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:00.627442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:00.629011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:00.629686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:01.027060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:01.036959 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5ab80b2a-6ac9-4b8b-a78c-40ac0bbc03ea tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.447715 Oct 22 03:16:01.037569 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1401/2795] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:00 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:01.058992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:01.059941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:01.073445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:01.077464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:01.087810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:01.088639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:01.089122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:01.089555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:01.431040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:01.447352 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d3a3208-9ca6-41ea-b51d-19673dc2f4a8 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1680 microversion: 2.1 time: 0.396759 Oct 22 03:16:01.447352 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1402/2796] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:01 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1680 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:01.453467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:01.455991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:01.470783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:01.471370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:01.471789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:01.479678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:01.480271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:01.480736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:01.834342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:01.845714 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0640b467-4f26-42c0-9145-f59c598977fe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1499 microversion: 2.1 time: 1.622496 Oct 22 03:16:01.846322 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1395/2797] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:00 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1499 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:02.072562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:02.073453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:02.088196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:02.088952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:02.102709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:02.110524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:02.127061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:02.127857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:02.129641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:02.136759 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-747ad762-11e3-4e78-b1d3-14f167867ee0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.688333 Oct 22 03:16:02.157939 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1403/2798] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:01 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:02.476499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:02.476914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:02.500671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:02.502876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:02.504091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:02.506161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:02.506813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:02.507436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:02.637757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:02.653984 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8bc2e20b-e721-482f-9dac-abeded57362b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.593016 Oct 22 03:16:02.658897 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1396/2799] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:02 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:02.681179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:02.699046 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d6739ad-7cf9-4aff-b9e6-c750cb88d51d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1613 microversion: 2.1 time: 0.226116 Oct 22 03:16:02.735599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1404/2800] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:02 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1613 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:02.871643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:02.872564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:02.887224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:02.895400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:02.898850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:02.901383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:02.906447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:02.908928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:03.163873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:03.164597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:03.178185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:03.178688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:03.179126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:03.179844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:03.180329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:03.180764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:03.479686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:03.504866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bcba090b-4ceb-4e6e-8ae4-9a92d7e4ef2c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 200 len: 1476 microversion: 2.1 time: 0.630209 Oct 22 03:16:03.504866 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1397/2801] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:02 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 1476 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:03.528504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-befc49ea-cba6-4c3a-b408-f2df2976a3b8 req-239cef4b-78a0-477b-828b-1fbae6690d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bcace45-2b9b-4d3f-b68c-06ca98c4a3df", "name": "network-vif-deleted", "tag": "5dc7dda7-0c84-47ba-b8e3-ffc2f5a98839"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:03.539655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-befc49ea-cba6-4c3a-b408-f2df2976a3b8 req-239cef4b-78a0-477b-828b-1fbae6690d7c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:03.540479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-befc49ea-cba6-4c3a-b408-f2df2976a3b8 req-239cef4b-78a0-477b-828b-1fbae6690d7c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:03.541082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-befc49ea-cba6-4c3a-b408-f2df2976a3b8 req-239cef4b-78a0-477b-828b-1fbae6690d7c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:03.554403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:03.554807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-befc49ea-cba6-4c3a-b408-f2df2976a3b8 req-239cef4b-78a0-477b-828b-1fbae6690d7c service nova] Creating event network-vif-deleted:5dc7dda7-0c84-47ba-b8e3-ffc2f5a98839 for instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df on n-h2-862416-2 Oct 22 03:16:03.560858 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-befc49ea-cba6-4c3a-b408-f2df2976a3b8 req-239cef4b-78a0-477b-828b-1fbae6690d7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054713 Oct 22 03:16:03.562690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1398/2802] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:03.566683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80b741de-8c91-40fe-9245-2506ba3179a4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.406281 Oct 22 03:16:03.575378 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1405/2803] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:03 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:03.586565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1363072718"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:03.589410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:03.596909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:03.597650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:03.598240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:03.599777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:03.600410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:03.600989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:03.682299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:03.683320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:03.723939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:03.724470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:03.726991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:03.728484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:03.729408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:03.729878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:03.992915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:04.009060 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-022303e9-2409-44d4-90db-6c823ebace9f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.330571 Oct 22 03:16:04.011179 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1406/2804] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:03 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:04.021965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:04.023120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:04.031773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:04.032641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:04.033390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:04.034409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:04.035091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:04.035864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:04.092685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:04.093441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:04.094116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:04.094732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lazy-loading 'fault' on Instance uuid 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:16:04.111074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-512ea5e9-799b-410c-b0ca-de71b3903f9c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509/action" status: 202 len: 0 microversion: 2.1 time: 0.546718 Oct 22 03:16:04.134667 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1399/2805] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:16:03 2022] POST /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 03:16:04.147738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-38a596e9-1da4-48ac-9775-11f6d85dc321 req-085e587d-c519-41db-a7c7-8e3080604c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f6f66-f2cf-4acd-8470-fa0df1b62f1c", "name": "network-vif-plugged", "status": "completed", "tag": "848e4c1c-9dc5-491f-a12f-7d794548c7de"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:04.180630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-38a596e9-1da4-48ac-9775-11f6d85dc321 req-085e587d-c519-41db-a7c7-8e3080604c84 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:04.181484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-38a596e9-1da4-48ac-9775-11f6d85dc321 req-085e587d-c519-41db-a7c7-8e3080604c84 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:04.182097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-38a596e9-1da4-48ac-9775-11f6d85dc321 req-085e587d-c519-41db-a7c7-8e3080604c84 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:04.204082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-38a596e9-1da4-48ac-9775-11f6d85dc321 req-085e587d-c519-41db-a7c7-8e3080604c84 service nova] Creating event network-vif-plugged:848e4c1c-9dc5-491f-a12f-7d794548c7de for instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c on n-h2-862416-2 Oct 22 03:16:04.214843 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-38a596e9-1da4-48ac-9775-11f6d85dc321 req-085e587d-c519-41db-a7c7-8e3080604c84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078389 Oct 22 03:16:04.215956 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1400/2806] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:04.223903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ee76cde-6fdc-48ce-80ca-4987cb05df9a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1960e550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:04.264969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513dea8aa0114c2aa365124eb2b302a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90d2937262c4cc2bc0e7fbf770a9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:04.289455 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3d717e20-2f9b-4d41-963c-4be9e40250af tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 200 len: 1330 microversion: 2.1 time: 0.276495 Oct 22 03:16:04.296984 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1407/2807] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:04 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 1330 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:04.351053 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ee76cde-6fdc-48ce-80ca-4987cb05df9a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3" status: 200 len: 1414 microversion: 2.1 time: 0.126720 Oct 22 03:16:04.354209 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1401/2808] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:04 2022] GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:04.601726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:04.603152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:04.625664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:04.626496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:04.627650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:04.630686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:04.631924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:04.634168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:04.984949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:04.996775 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2424826-5370-4e2a-a698-19f3d6acac22 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1315 microversion: 2.1 time: 0.404730 Oct 22 03:16:04.998908 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1408/2809] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:04 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:05.043732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:05.045325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:05.066262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:05.073029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:05.073758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:05.075057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:05.075701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:05.080321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:05.320455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:05.322321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:05.336675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:05.337346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:05.339862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:05.340685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:05.341317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:05.341836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:05.391357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:05.397410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] HTTP exception thrown: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:05.405588 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0d70657c-021c-4ece-9a54-0c3ac289a31d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.369879 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Request method failure captured: Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df HTTP/1.1 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1-NoGf7eQ6syumQZoKB3OpG5HUHGabMXdw0xJQb1cZYV_3VCHrhR-5039fc52OOWf5LQv29jwXOqoABL1yASSejWbDsa6LPMJUeVNzxl29tzZTAtU7RBhkfClDAGFIaIzWEm6nMQnVkkMaEh14Hkoth2Ocdwn6oR21W09lQPsaTy1Y Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f90d2937262c4cc2bc0e7fbf770a9c49 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90d2937262c4cc2bc0e7fbf770a9c49"}]}] Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f90d2937262c4cc2bc0e7fbf770a9c49 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachSCSIVolumeTestJSON-183643994-project Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 513dea8aa0114c2aa365124eb2b302a1 Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-183643994-project Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '8bcace45-2b9b-4d3f-b68c-06ca98c4a3df'} Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:05.406414 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:05.411290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:05.411290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:05.411290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:05.411290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:16:05.411290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:16:05.411290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:05.411290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:05.411860 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1402/2810] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:05 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:05.413403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Returning 404 to user: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:16:05.414452 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ff34a8c-f972-4e5e-8075-4d5551dbf71d tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 404 len: 111 microversion: 2.1 time: 0.098927 Oct 22 03:16:05.417534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de0e69a3-6998-42a4-92e7-8c451e09694d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196c15e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:05.418261 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1409/2811] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:05 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:16:05.428300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4a63be0-cfd1-45a7-b3d2-768f0f03dfa4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '.version_select at 0x7f0d19aa75e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:05.460667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4a63be0-cfd1-45a7-b3d2-768f0f03dfa4 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843982101" status: 202 len: 0 microversion: 2.1 time: 0.037233 Oct 22 03:16:05.462722 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1410/2812] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:16:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843982101 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:16:05.499720 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de0e69a3-6998-42a4-92e7-8c451e09694d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3" status: 200 len: 1414 microversion: 2.1 time: 0.084602 Oct 22 03:16:05.500367 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1403/2813] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:05 2022] GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:06.027928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:06.032475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:06.061787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:06.066544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:06.068254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:06.074094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:06.077896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:06.078387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:06.129735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:06.365630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:06.380387 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9fe24c50-d6fa-4cd2-90b7-ce212794ef2e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1502 microversion: 2.1 time: 0.360923 Oct 22 03:16:06.387871 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1411/2814] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:06 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:06.417172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:06.417729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:06.431015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:06.432661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:06.433308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:06.433765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:06.433936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:06.434843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:06.436493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:06.437227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:06.452530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:06.453693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:06.454177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:06.454912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:06.455374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:06.455809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:06.522115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:16:06.744467 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad4c2089-486a-4c1c-bf15-367cc2402b4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 204 len: 0 microversion: 2.1 time: 0.331805 Oct 22 03:16:06.759042 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1404/2815] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:16:06 2022] DELETE /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:16:06.765671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7bc2b8ed-a2fe-4c01-bd34-7eb52b87267a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196c1ee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:06.872510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7bc2b8ed-a2fe-4c01-bd34-7eb52b87267a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3" status: 200 len: 1414 microversion: 2.1 time: 0.115239 Oct 22 03:16:06.873210 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1405/2816] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:06 2022] GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:06.882604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:06.889485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:06.899412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:06.903324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:06.903994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:06.905093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:06.905733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:06.907611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:06.974527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:06.990498 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6b6acc33-4ed1-488e-bd11-edf323c953d8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.561916 Oct 22 03:16:06.999279 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1412/2817] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:06 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:07.332531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:07.341923 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-128f468b-0291-44a0-b538-8e4bec045f4a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1508 microversion: 2.1 time: 0.466902 Oct 22 03:16:07.348008 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1406/2818] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:06 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:07.889741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dc974da8-cbaa-4be4-b888-0f54484c6827 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1ab22310>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:08.032014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:08.033642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:08.043746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:08.044584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:08.045224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:08.049067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:08.049800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:08.051904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:08.531761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:08.545070 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f22f1010-853b-450d-85e0-37f687d0e485 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.519536 Oct 22 03:16:08.551404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1407/2819] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:08 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:08.562223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:08.575002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:08.595599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:08.596098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:08.596567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:08.597285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:08.597741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:08.598171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:08.776962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dc974da8-cbaa-4be4-b888-0f54484c6827 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3" status: 200 len: 1414 microversion: 2.1 time: 0.892859 Oct 22 03:16:08.780663 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1413/2820] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:07 2022] GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 => generated 1414 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:09.026691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:09.034839 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d6e8da23-887b-422c-bba1-5fd7e49feae7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1508 microversion: 2.1 time: 0.480193 Oct 22 03:16:09.051068 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1408/2821] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:08 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:09.410702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-96319e53-1136-44f8-a7d4-51ff17363ee7 req-28bc20c0-cbe0-433f-aaf2-c293ea337f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc010b5d-a6fb-4846-96e8-debf6bbc4509", "name": "network-vif-plugged", "status": "completed", "tag": "6aecee5c-b4c7-4bf0-8c05-f36d011934ba"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:09.455602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96319e53-1136-44f8-a7d4-51ff17363ee7 req-28bc20c0-cbe0-433f-aaf2-c293ea337f8c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:09.457992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96319e53-1136-44f8-a7d4-51ff17363ee7 req-28bc20c0-cbe0-433f-aaf2-c293ea337f8c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:09.459472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96319e53-1136-44f8-a7d4-51ff17363ee7 req-28bc20c0-cbe0-433f-aaf2-c293ea337f8c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:09.496122 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-96319e53-1136-44f8-a7d4-51ff17363ee7 req-28bc20c0-cbe0-433f-aaf2-c293ea337f8c service nova] Creating event network-vif-plugged:6aecee5c-b4c7-4bf0-8c05-f36d011934ba for instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 on n-h1-862416-2 Oct 22 03:16:09.511191 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-96319e53-1136-44f8-a7d4-51ff17363ee7 req-28bc20c0-cbe0-433f-aaf2-c293ea337f8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106515 Oct 22 03:16:09.515474 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1414/2822] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:16:09.579271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:09.579869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:09.594720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:09.595281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:09.598371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:09.601096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:09.603613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:09.606195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:09.795620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5fdbbfb9-3512-497c-9e0b-f2532744da1d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a545430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:10.026846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:10.041306 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8f2806a-73d8-4505-9aec-99fe8c98af38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.467224 Oct 22 03:16:10.047975 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1409/2823] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:09 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:10.058987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:10.062039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:10.080732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:10.081712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:10.082476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:10.083965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:10.088373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:10.089228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:10.287085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:10.306873 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-54393a0e-3ddd-44c4-9584-5063f87b611f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 200 len: 1466 microversion: 2.1 time: 0.246298 Oct 22 03:16:10.308450 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1410/2824] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:10 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 1466 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:10.361704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b359a5dc-dd71-4d28-8204-f957e744cccc req-3944c521-6d5f-4aac-a95b-ca34c838b0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f6f66-f2cf-4acd-8470-fa0df1b62f1c", "name": "network-vif-deleted", "tag": "848e4c1c-9dc5-491f-a12f-7d794548c7de"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:10.396734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b359a5dc-dd71-4d28-8204-f957e744cccc req-3944c521-6d5f-4aac-a95b-ca34c838b0f4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:10.397686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b359a5dc-dd71-4d28-8204-f957e744cccc req-3944c521-6d5f-4aac-a95b-ca34c838b0f4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:10.399008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b359a5dc-dd71-4d28-8204-f957e744cccc req-3944c521-6d5f-4aac-a95b-ca34c838b0f4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:10.433075 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b359a5dc-dd71-4d28-8204-f957e744cccc req-3944c521-6d5f-4aac-a95b-ca34c838b0f4 service nova] Creating event network-vif-deleted:848e4c1c-9dc5-491f-a12f-7d794548c7de for instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c on n-h2-862416-2 Oct 22 03:16:10.438783 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b359a5dc-dd71-4d28-8204-f957e744cccc req-3944c521-6d5f-4aac-a95b-ca34c838b0f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108621 Oct 22 03:16:10.440598 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1411/2825] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:11.075825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:11.077069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:11.094596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:11.095102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:11.095550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:11.105141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:11.107381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:11.108750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:11.741886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:11.757252 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e5ef3e4-99b1-4200-8dd2-a0999566e9f0 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.687072 Oct 22 03:16:11.760719 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1412/2826] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:11 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:11.789790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:11.791334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:11.814843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:11.815726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:11.817835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:11.818788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:11.821460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:11.823448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:11.871768 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c HTTP/1.1 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '938f6f66-f2cf-4acd-8470-fa0df1b62f1c'} Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:11.876326 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:16:11.881113 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:11.881113 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:11.881113 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:11.881113 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:16:11.881113 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:16:11.881113 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:16:11.881113 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:16:11.882591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:16:11.886418 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-127e6439-7661-46e7-8680-e63f1d2ff028 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 404 len: 111 microversion: 2.1 time: 0.122393 Oct 22 03:16:11.888437 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1413/2827] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:11 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:16:12.121314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2086575117", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "636a4e0f-2dc3-4c83-88d5-b5568cafac2d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:19.429040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:19.481100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=13 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:21.842160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:22.177648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:25.702012 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5fdbbfb9-3512-497c-9e0b-f2532744da1d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3" status: 200 len: 1423 microversion: 2.1 time: 15.912635 Oct 22 03:16:25.702684 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1415/2828] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:09 2022] GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 => generated 1423 bytes in 15914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:25.704554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] validate_networks() for [('636a4e0f-2dc3-4c83-88d5-b5568cafac2d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:16:25.707439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:25.708425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:25.715497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:25.716070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:25.717167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:25.717884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:25.718357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:25.718794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:25.873470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:25.884860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-14183622-7e01-4f43-affa-6cfa0362359f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.180987 Oct 22 03:16:25.885814 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1416/2829] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:25 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:25.891253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:25.892035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:25.898229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:25.898797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:25.899330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:25.900116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:25.900676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:25.901180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:25.916796 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] HTTP exception thrown: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Request method failure captured: Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df HTTP/1.1 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1-NoGf7eQ6syumQZoKB3OpG5HUHGabMXdw0xJQb1cZYV_3VCHrhR-5039fc52OOWf5LQv29jwXOqoABL1yASSejWbDsa6LPMJUeVNzxl29tzZTAtU7RBhkfClDAGFIaIzWEm6nMQnVkkMaEh14Hkoth2Ocdwn6oR21W09lQPsaTy1Y Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f90d2937262c4cc2bc0e7fbf770a9c49 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90d2937262c4cc2bc0e7fbf770a9c49"}]}] Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f90d2937262c4cc2bc0e7fbf770a9c49 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachSCSIVolumeTestJSON-183643994-project Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 513dea8aa0114c2aa365124eb2b302a1 Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-183643994-project Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '8bcace45-2b9b-4d3f-b68c-06ca98c4a3df'} Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:16:25.918457 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Returning 404 to user: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 404 len: 111 microversion: 2.1 time: 0.033810 Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1417/2830] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:16:25 2022] DELETE /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:16:25.924536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:25.926403 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0ff7d15-bd39-4ab3-9f6a-966c30909bbe tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003354 Oct 22 03:16:25.932364 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1418/2831] 10.222.0.25 () {56 vars in 886 bytes} [Sat Oct 22 03:16:25 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 03:16:25.938981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-93099f3a-56bd-4d9b-91b2-fd94c3aeb54e req-b09821af-ec9a-4b83-9ca9-af20f8f0f23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d5af8e-154b-4a08-bb37-0a1947b49d82", "name": "network-vif-unplugged", "status": "completed", "tag": "ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:25.948678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93099f3a-56bd-4d9b-91b2-fd94c3aeb54e req-b09821af-ec9a-4b83-9ca9-af20f8f0f23e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:25.949163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93099f3a-56bd-4d9b-91b2-fd94c3aeb54e req-b09821af-ec9a-4b83-9ca9-af20f8f0f23e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:25.949600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93099f3a-56bd-4d9b-91b2-fd94c3aeb54e req-b09821af-ec9a-4b83-9ca9-af20f8f0f23e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:25.965628 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-93099f3a-56bd-4d9b-91b2-fd94c3aeb54e req-b09821af-ec9a-4b83-9ca9-af20f8f0f23e service nova] Creating event network-vif-unplugged:ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3 for instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 on n-h1-862416-2 Oct 22 03:16:25.971941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-93099f3a-56bd-4d9b-91b2-fd94c3aeb54e req-b09821af-ec9a-4b83-9ca9-af20f8f0f23e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037781 Oct 22 03:16:25.973089 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1419/2832] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:25.978579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:25.979416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:25.985784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:25.986279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:25.986721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:25.987618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:25.988278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:25.988874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:26.048805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:16:26.199445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:16:26.200353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:16:26.201089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:16:26.201738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:16:26.202477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:16:26.204092 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-64b26925-cccf-4321-940d-67ec9990ed7e tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 204 len: 0 microversion: 2.1 time: 0.227811 Oct 22 03:16:26.204756 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1420/2833] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:16:25 2022] DELETE /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:16:26.221331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-582250d1-cbb6-4566-ba24-0b5fbb052cf9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1e4b31f0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:26.226639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:26.227488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:26.228805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:26.229984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:26.230766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:26.231382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:26.257293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:16:26.263575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for user 7bd4c44f32a04da48b34c9c888f36fa6 and project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:16:26.278351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:16:26.281402 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-582250d1-cbb6-4566-ba24-0b5fbb052cf9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3" status: 200 len: 1423 microversion: 2.1 time: 0.072183 Oct 22 03:16:26.281565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:16:26.291984 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1421/2834] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:26 2022] GET /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:26.291984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:26.291984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] [instance: 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:26.301416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:26.303561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:26.305096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:26.306693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:26.307555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:26.308721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:26.328166 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] HTTP exception thrown: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Request method failure captured: Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df HTTP/1.1 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1-NoGf7eQ6syumQZoKB3OpG5HUHGabMXdw0xJQb1cZYV_3VCHrhR-5039fc52OOWf5LQv29jwXOqoABL1yASSejWbDsa6LPMJUeVNzxl29tzZTAtU7RBhkfClDAGFIaIzWEm6nMQnVkkMaEh14Hkoth2Ocdwn6oR21W09lQPsaTy1Y Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f90d2937262c4cc2bc0e7fbf770a9c49 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f90d2937262c4cc2bc0e7fbf770a9c49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f90d2937262c4cc2bc0e7fbf770a9c49"}]}] Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f90d2937262c4cc2bc0e7fbf770a9c49 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-183643994 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachSCSIVolumeTestJSON-183643994-project Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 513dea8aa0114c2aa365124eb2b302a1 Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-183643994-project Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '8bcace45-2b9b-4d3f-b68c-06ca98c4a3df'} Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:26.330313 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] Returning 404 to user: Instance 8bcace45-2b9b-4d3f-b68c-06ca98c4a3df could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:16:26.334281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4b9c033-7cf1-4f54-aa21-205cd36eabd0 tempest-AttachSCSIVolumeTestJSON-183643994 tempest-AttachSCSIVolumeTestJSON-183643994-project] 10.222.0.25 "GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df" status: 404 len: 111 microversion: 2.1 time: 0.048826 Oct 22 03:16:26.336241 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1422/2835] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:26 2022] GET /compute/v2.1/servers/8bcace45-2b9b-4d3f-b68c-06ca98c4a3df => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:16:26.340356 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-adf7ffe4-004b-41f8-af7a-478e8e6eeb0d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.224047 Oct 22 03:16:26.341735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:26.342607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:26.348472 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1414/2836] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:16:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 14233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:16:26.349769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:26.350269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:26.350719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:26.351488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:26.351947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:26.354289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:26.361143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6da51d52-c821-4514-b835-450a5c27b245 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196a9700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:26.724834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:26.741005 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17d2f9ae-5427-40ee-a0f7-b29806321a5d tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1666 microversion: 2.1 time: 0.403343 Oct 22 03:16:26.753155 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1423/2837] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:26 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1666 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:26.761235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b299294-9512-447d-94f9-95bc49a7bbbf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:26.761774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8b299294-9512-447d-94f9-95bc49a7bbbf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:26.921238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8b299294-9512-447d-94f9-95bc49a7bbbf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:26.931423 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b299294-9512-447d-94f9-95bc49a7bbbf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1215 microversion: 2.1 time: 0.183814 Oct 22 03:16:26.931985 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1424/2838] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:26 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:26.943040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:26.946327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:26.963198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:26.965103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:26.967989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:26.968777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:26.969223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:26.969654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:27.021800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6da51d52-c821-4514-b835-450a5c27b245 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3" status: 204 len: 0 microversion: 2.1 time: 0.671551 Oct 22 03:16:27.022939 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1415/2839] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:26 2022] DELETE /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:16:27.034018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:27.035119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:27.054107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:27.056024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:27.058375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:27.061347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:27.062080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:27.063228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:27.114777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:16:27.318781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:27.335926 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a7ac925-6f4f-45ef-9a68-f7c3eed9dc18 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.401298 Oct 22 03:16:27.337236 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1425/2840] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:26 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:27.348082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aeb8b359-6999-4341-8eab-5653f16b87bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 204 len: 0 microversion: 2.1 time: 0.320887 Oct 22 03:16:27.355036 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1416/2841] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:16:27 2022] DELETE /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:16:27.480865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1669678780", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "49c953fb-5979-4a50-be05-1edf628aca16"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:27.557503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] validate_networks() for [('49c953fb-5979-4a50-be05-1edf628aca16', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:16:27.775844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:27.776856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:27.784307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:27.784957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:27.785570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:27.786454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:27.787052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:27.787611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:28.079249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:28.088048 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-403c1ef9-cddb-4864-9eb1-62b642131119 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1666 microversion: 2.1 time: 0.316485 Oct 22 03:16:28.106045 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1417/2842] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:27 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1666 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:28.131604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:28.132595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:28.145306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:28.146782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:28.155386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:28.159708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:28.161164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:28.161870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:28.246817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:28.261254 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e79c5b5c-5779-4b5a-ae53-3e111ef90f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1211 microversion: 2.1 time: 0.146125 Oct 22 03:16:28.263116 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1418/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:28 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1211 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:28.281478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9c1b1c70-dfe8-4f84-8fa1-f97a481805d8 req-f1c13fe5-97f0-4087-9be9-40dab4aa523d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d5af8e-154b-4a08-bb37-0a1947b49d82", "tag": "ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:28.300910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9c1b1c70-dfe8-4f84-8fa1-f97a481805d8 req-f1c13fe5-97f0-4087-9be9-40dab4aa523d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:28.301422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9c1b1c70-dfe8-4f84-8fa1-f97a481805d8 req-f1c13fe5-97f0-4087-9be9-40dab4aa523d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:28.302049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9c1b1c70-dfe8-4f84-8fa1-f97a481805d8 req-f1c13fe5-97f0-4087-9be9-40dab4aa523d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:28.336445 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9c1b1c70-dfe8-4f84-8fa1-f97a481805d8 req-f1c13fe5-97f0-4087-9be9-40dab4aa523d service nova] Creating event network-changed:ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3 for instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 on n-h1-862416-2 Oct 22 03:16:28.360107 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9c1b1c70-dfe8-4f84-8fa1-f97a481805d8 req-f1c13fe5-97f0-4087-9be9-40dab4aa523d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094452 Oct 22 03:16:28.360802 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1419/2844] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:28.369008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:28.369714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:28.377429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:28.378022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:28.378684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:28.379398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:28.379860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:28.380338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:28.629323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:28.642380 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-918cfd67-7237-43c0-81b3-f42cb1f1c025 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.280298 Oct 22 03:16:28.648941 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1420/2845] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:28 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:28.945251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:16:28.945657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:16:28.946144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:16:28.946842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:16:28.947403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:16:28.968427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:28.971574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:28.972029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:28.972853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:28.973317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:28.973750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:29.006541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:16:29.017045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for user 2468c1f92230450db3397e1f0e97b5e0 and project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:16:29.051467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:16:29.055134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:16:29.111828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:29.113154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:29.135071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:29.135576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:29.136015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:29.141648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:29.142181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:29.142640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:29.173129 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a005d12-ac71-4adc-b9bf-ea1575739845 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694643 Oct 22 03:16:29.184191 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1426/2846] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:16:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:16:29.206073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:29.206686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:29.226076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:29.230934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:29.231393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:29.244047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:29.245085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:29.245833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:29.257010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:16:29.487881 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11b090d1-5764-49b5-a1d7-5023bfcd229c tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 204 len: 0 microversion: 2.32 time: 0.836961 Oct 22 03:16:29.488837 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1421/2847] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:16:28 2022] DELETE /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:16:29.497690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7abbc808-7fc6-4c0d-9f6d-327eedaceda9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:29.498842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7abbc808-7fc6-4c0d-9f6d-327eedaceda9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:30.541421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7abbc808-7fc6-4c0d-9f6d-327eedaceda9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:30.552654 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7abbc808-7fc6-4c0d-9f6d-327eedaceda9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1208 microversion: 2.1 time: 1.062392 Oct 22 03:16:30.554313 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1422/2848] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:29 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1208 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:30.588091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:30.588992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:30.596611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:30.597990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:30.598592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:30.599469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:30.600650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:30.601425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:30.728379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:30.740776 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15d49093-64fa-4be8-a918-b140e9d1d9e8 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1666 microversion: 2.1 time: 1.555164 Oct 22 03:16:30.747806 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1427/2849] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:29 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1666 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:30.759756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:30.800756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:30.826880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:30.829336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:30.835071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:30.844331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:30.846170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:30.847357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:30.893602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:30.924470 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b2564d41-7708-4f42-a81a-dd57fff5163c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1267 microversion: 2.1 time: 0.344112 Oct 22 03:16:30.930645 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1423/2850] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:30 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1267 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:30.951945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:30.955041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:30.964883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:30.965382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:30.966158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:30.966933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:30.967417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:30.967937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:31.340021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:31.354522 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0179ddf4-37de-43e0-ba70-2c1a0b722f35 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.420452 Oct 22 03:16:31.355423 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1424/2851] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:30 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:31.534652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7347b116-23e3-4a58-a7d4-1d70657cc155 req-371baa82-2495-479e-b50d-071e1dc0c5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc010b5d-a6fb-4846-96e8-debf6bbc4509", "name": "network-vif-unplugged", "status": "completed", "tag": "6aecee5c-b4c7-4bf0-8c05-f36d011934ba"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:31.563572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7347b116-23e3-4a58-a7d4-1d70657cc155 req-371baa82-2495-479e-b50d-071e1dc0c5ae service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:31.564814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7347b116-23e3-4a58-a7d4-1d70657cc155 req-371baa82-2495-479e-b50d-071e1dc0c5ae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:31.565454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7347b116-23e3-4a58-a7d4-1d70657cc155 req-371baa82-2495-479e-b50d-071e1dc0c5ae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:31.594878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7347b116-23e3-4a58-a7d4-1d70657cc155 req-371baa82-2495-479e-b50d-071e1dc0c5ae service nova] Creating event network-vif-unplugged:6aecee5c-b4c7-4bf0-8c05-f36d011934ba for instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 on n-h1-862416-2 Oct 22 03:16:31.608687 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7347b116-23e3-4a58-a7d4-1d70657cc155 req-371baa82-2495-479e-b50d-071e1dc0c5ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076649 Oct 22 03:16:31.609978 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1425/2852] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:16:31.617341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:31.624149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:31.627899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:31.631672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:31.638620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:31.640732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:31.641228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:31.641452 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-889be918-d516-4257-8900-e4f6675ac76f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2956 microversion: 2.32 time: 0.884568 Oct 22 03:16:31.642149 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1428/2853] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:30 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2956 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:31.645052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:31.645862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:31.646338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:31.646774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:31.771308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:31.771792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:31.783752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:31.790056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:31.790519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:31.791268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:31.791726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:31.792155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:32.075584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:32.092408 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bebdfbb7-6c0f-43f1-bbab-54ca1eb4e0fa tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1598 microversion: 2.1 time: 0.324924 Oct 22 03:16:32.104581 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1429/2854] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:31 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1598 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:32.113330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:32.113330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:32.145322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:32.145910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:32.146368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:32.147123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:32.147585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:32.148017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:32.201537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:32.233807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4ce5381-ff1c-4c33-87df-3da81cfc6d89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1212 microversion: 2.1 time: 0.620726 Oct 22 03:16:32.237026 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1426/2855] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:31 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1212 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:32.362576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:32.370512 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ca16a70-79d3-499e-87df-f7bc2d54500a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1267 microversion: 2.1 time: 0.273442 Oct 22 03:16:32.371102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1430/2856] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:32 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:32.392430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:32.392928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:32.400579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:32.401348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:32.402050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:32.403111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:32.403758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:32.404382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:32.566540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-bff4d28c-dcfa-44a8-99a4-064192031d18 req-d0989429-6cfb-4b28-a354-ad38b4ab3a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a060e0-503f-4872-9fef-4f919a12ebd9", "name": "network-vif-deleted", "tag": "15602e98-f74c-4c56-b0d3-4eb8b025a109"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:32.587742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bff4d28c-dcfa-44a8-99a4-064192031d18 req-d0989429-6cfb-4b28-a354-ad38b4ab3a02 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:32.589093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bff4d28c-dcfa-44a8-99a4-064192031d18 req-d0989429-6cfb-4b28-a354-ad38b4ab3a02 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:32.589756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bff4d28c-dcfa-44a8-99a4-064192031d18 req-d0989429-6cfb-4b28-a354-ad38b4ab3a02 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:32.612053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-bff4d28c-dcfa-44a8-99a4-064192031d18 req-d0989429-6cfb-4b28-a354-ad38b4ab3a02 service nova] Creating event network-vif-deleted:15602e98-f74c-4c56-b0d3-4eb8b025a109 for instance f4a060e0-503f-4872-9fef-4f919a12ebd9 on n-h2-862416-2 Oct 22 03:16:32.619465 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-bff4d28c-dcfa-44a8-99a4-064192031d18 req-d0989429-6cfb-4b28-a354-ad38b4ab3a02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056015 Oct 22 03:16:32.622548 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1431/2857] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:16:32.679467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:32.680447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:32.697629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:32.698402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:32.698998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:32.703430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:32.705619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:32.723476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:32.997134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:33.011998 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-503e4766-1aee-4d0e-8383-8d8e2b594586 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.625970 Oct 22 03:16:33.026808 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1427/2858] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:32 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:33.120480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:33.121112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:33.136108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:33.136892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:33.137494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:33.139079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:33.139706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:33.148741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:33.226377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:33.227163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:33.227787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:33.228444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lazy-loading 'fault' on Instance uuid f4a060e0-503f-4872-9fef-4f919a12ebd9 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:16:33.616580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b451a429e97450aabad0f31a00dd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0f26b39545436ab7f8653d75dd1473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:33.626677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0acf1c50-c97c-4bbb-97f1-824469a0150c tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 200 len: 1316 microversion: 2.1 time: 0.510122 Oct 22 03:16:33.630332 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1428/2859] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:33 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:33.640585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:33.644332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:33.658311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:33.658930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:33.659576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:33.660821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:33.661387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:33.661918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:33.861532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:33.878001 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e62ce12-ff0c-48b2-85bd-000d3f7b6a4b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1260 microversion: 2.1 time: 0.237391 Oct 22 03:16:33.879351 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1429/2860] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:33 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:33.884329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:33.894020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:33.907035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:33.920612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:33.921323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:33.925231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:33.927916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:33.928530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:34.267540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:34.274422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:34.276999 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42afb283-88c0-4aa1-9c88-0196efc08447 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1273 microversion: 2.1 time: 0.396409 Oct 22 03:16:34.280787 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1430/2861] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:33 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1273 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:34.294043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:34.301957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:34.331688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:34.332583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:34.333594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:34.335441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:34.336088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:34.336806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:34.812522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:34.830494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:34.831952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:34.840917 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af5a8433-b7cc-423c-8a1f-69cbc735d07e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2956 microversion: 2.32 time: 2.168169 Oct 22 03:16:34.841825 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1432/2862] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:32 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2956 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:16:34.850855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:34.851318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] [instance: f4a060e0-503f-4872-9fef-4f919a12ebd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:34.865262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:34.865999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:34.866595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:34.867494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:34.873173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:34.873632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:34.910351 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] HTTP exception thrown: Instance f4a060e0-503f-4872-9fef-4f919a12ebd9 could not be found. Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Request method failure captured: Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 HTTP/1.1 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2AYCwQ1t6Snfkma34oDpk9q6QGk-lN-fLBSfThvvH7DBwnnxKmKKJjgb-eKdIxyCAHRBx3glupF5hVkgQ9llLHbQJv71QZR_3gYqCJAlkcWQRtknsxyneVuRQMqpbg9KfNUhBWAOsLovRwFNr1-7P7z28Zsx_DV8vJ6CBAtb5duNpI Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fc0f26b39545436ab7f8653d75dd1473 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestFqdnHostnames-421765806 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc0f26b39545436ab7f8653d75dd1473"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc0f26b39545436ab7f8653d75dd1473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc0f26b39545436ab7f8653d75dd1473"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc0f26b39545436ab7f8653d75dd1473"}]}] Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestFqdnHostnames-421765806 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fc0f26b39545436ab7f8653d75dd1473 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-421765806 Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestFqdnHostnames-421765806-project Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0b451a429e97450aabad0f31a00dd88f Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestFqdnHostnames-421765806-project Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f4a060e0-503f-4872-9fef-4f919a12ebd9 could not be found. Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f4a060e0-503f-4872-9fef-4f919a12ebd9'} Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a060e0-503f-4872-9fef-4f919a12ebd9 could not be found. Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a060e0-503f-4872-9fef-4f919a12ebd9 could not be found. Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:16:34.912046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a060e0-503f-4872-9fef-4f919a12ebd9 could not be found. Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Returning 404 to user: Instance f4a060e0-503f-4872-9fef-4f919a12ebd9 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:16:34.916684 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e7203cad-5e81-4ecc-b51a-b59923180124 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9" status: 404 len: 111 microversion: 2.1 time: 0.070714 Oct 22 03:16:34.918799 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1433/2863] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:34 2022] GET /compute/v2.1/servers/f4a060e0-503f-4872-9fef-4f919a12ebd9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:16:34.930651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:34.934626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:34.947645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:34.953938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:34.954643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:34.958083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:34.962212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:34.962885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:35.198430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:35.211902 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d1ee4794-5607-48c9-a200-ac734d76cbee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1266 microversion: 2.1 time: 0.289827 Oct 22 03:16:35.214964 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1434/2864] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:34 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:35.226743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4acee645-8db9-4d79-a12a-76204eb0ef34 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] Calling method '.version_select at 0x7f0d1a08f940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:35.271837 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4acee645-8db9-4d79-a12a-76204eb0ef34 tempest-ServersTestFqdnHostnames-421765806 tempest-ServersTestFqdnHostnames-421765806-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997247212" status: 202 len: 0 microversion: 2.1 time: 0.054556 Oct 22 03:16:35.272807 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1435/2865] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:16:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997247212 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:16:35.309515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:35.310254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:35.317939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:35.322711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:35.323341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:35.326650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:35.327570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:35.330288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:35.455644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:35.474166 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e149f08a-42d9-48b6-999c-dd60707e6c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 1.192251 Oct 22 03:16:35.475031 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1431/2866] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:34 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:35.709937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2f3ed6cf-1282-4766-a812-cb972b86497e req-cb1a0b5c-f343-443e-badd-3945264241c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc010b5d-a6fb-4846-96e8-debf6bbc4509", "name": "network-vif-deleted", "tag": "6aecee5c-b4c7-4bf0-8c05-f36d011934ba"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:35.728642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f3ed6cf-1282-4766-a812-cb972b86497e req-cb1a0b5c-f343-443e-badd-3945264241c7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:35.730072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f3ed6cf-1282-4766-a812-cb972b86497e req-cb1a0b5c-f343-443e-badd-3945264241c7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:35.730741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f3ed6cf-1282-4766-a812-cb972b86497e req-cb1a0b5c-f343-443e-badd-3945264241c7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:35.746642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2f3ed6cf-1282-4766-a812-cb972b86497e req-cb1a0b5c-f343-443e-badd-3945264241c7 service nova] Creating event network-vif-deleted:6aecee5c-b4c7-4bf0-8c05-f36d011934ba for instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 on n-h1-862416-2 Oct 22 03:16:35.774704 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2f3ed6cf-1282-4766-a812-cb972b86497e req-cb1a0b5c-f343-443e-badd-3945264241c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235535 Oct 22 03:16:35.777247 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1432/2867] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:35.887813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:35.893177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:35.912510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:35.916520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:35.918504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:35.921085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:35.923008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:35.923686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:35.946852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:35.963212 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6bb13c8-76e6-4ea9-8301-110e7916e186 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1273 microversion: 2.1 time: 0.653281 Oct 22 03:16:35.964390 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1436/2868] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:35 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1273 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:36.248126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:36.249131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:36.249470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:36.260024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:36.260757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:36.261251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:36.262062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:36.262766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:36.263731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:36.560992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:36.617080 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d984a21-7550-41d5-a99f-c3dc3e287c89 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1266 microversion: 2.1 time: 0.372663 Oct 22 03:16:36.625989 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1437/2869] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:36 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:36.645861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:36.647304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:36.672628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:36.673839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:36.674987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:36.676105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:36.677153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:36.678153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:37.135610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:37.164196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:37.166862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:37.168892 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6201a75e-bfd7-4624-bd89-289d1d356230 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2956 microversion: 2.32 time: 1.297344 Oct 22 03:16:37.170586 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1433/2870] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:35 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2956 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:37.177155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:37.178998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:37.190541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:37.191790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:37.192642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:37.193764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:37.194661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:37.196748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:37.363096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:37.376625 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2cf7edde-7375-47c7-b6d5-b539329f4289 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1273 microversion: 2.1 time: 0.204588 Oct 22 03:16:37.379982 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1434/2871] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:37 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:37.385818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-73e642ab-3851-438b-8111-d79b87aae2ee req-7e11cc6f-7074-41c4-95e1-bc0317151a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "b0488e2a-8772-4d06-8539-71f4d3e87f13"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:37.425455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73e642ab-3851-438b-8111-d79b87aae2ee req-7e11cc6f-7074-41c4-95e1-bc0317151a20 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:37.430090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73e642ab-3851-438b-8111-d79b87aae2ee req-7e11cc6f-7074-41c4-95e1-bc0317151a20 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:37.430607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-73e642ab-3851-438b-8111-d79b87aae2ee req-7e11cc6f-7074-41c4-95e1-bc0317151a20 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:37.459151 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-73e642ab-3851-438b-8111-d79b87aae2ee req-7e11cc6f-7074-41c4-95e1-bc0317151a20 service nova] Creating event network-vif-unplugged:b0488e2a-8772-4d06-8539-71f4d3e87f13 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:37.467082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-73e642ab-3851-438b-8111-d79b87aae2ee req-7e11cc6f-7074-41c4-95e1-bc0317151a20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084888 Oct 22 03:16:37.475828 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1435/2872] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:37.489145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:37.496566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:37.510489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5235108c-b7ea-467e-b716-0c8ce7c13683 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.873288 Oct 22 03:16:37.526199 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1438/2873] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:36 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:37.647208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:37.647839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:37.662269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:37.665759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:37.666214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:37.666970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:37.667442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:37.670328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:38.211385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:38.213040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:38.250340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:38.250883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:38.252921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:38.256462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:38.259082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:38.260636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:38.405976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:38.415888 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a2cf16c6-ba3a-4ac4-9551-a5dfa74d3695 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1308 microversion: 2.1 time: 0.773990 Oct 22 03:16:38.424064 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1436/2874] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:37 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1308 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:38.429098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:38.445070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:38.466950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:38.468715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:38.469352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:38.470836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:38.472557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:38.473348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:38.989830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:39.034243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:39.123726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:39.132502 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-afe9a1a6-656e-41c9-bce9-84391d9d1f4e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.707159 Oct 22 03:16:39.137183 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1437/2875] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:38 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:39.141982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:39.142763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:39.149304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:39.149955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:39.150554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:39.151428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:39.152040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:39.152647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:39.195131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:39.206139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:39.207583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:39.208881 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c4e63130-244a-412d-8b88-7a4e527ad7f5 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2935 microversion: 2.32 time: 1.010006 Oct 22 03:16:39.209447 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1439/2876] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:38 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2935 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:39.447044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:39.447657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:39.462529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:39.463773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:39.464794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:39.468345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:39.469952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:39.470892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:40.170694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:40.181305 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd84a419-8270-464a-a044-77c72e2706c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 1.043048 Oct 22 03:16:40.193038 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1438/2877] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:39 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:40.198292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c8fb37e7-6e50-407e-9b0d-1e89b76b8c47 req-a2391151-e009-4b5b-b19f-816c5a9530e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "eace4bce-f550-4e2e-bc11-00a14552db28"}, {"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "6f7d0505-1709-46d1-b6ba-10387663e348"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:40.220355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c8fb37e7-6e50-407e-9b0d-1e89b76b8c47 req-a2391151-e009-4b5b-b19f-816c5a9530e7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:40.221093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c8fb37e7-6e50-407e-9b0d-1e89b76b8c47 req-a2391151-e009-4b5b-b19f-816c5a9530e7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:40.221680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c8fb37e7-6e50-407e-9b0d-1e89b76b8c47 req-a2391151-e009-4b5b-b19f-816c5a9530e7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:40.250735 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c8fb37e7-6e50-407e-9b0d-1e89b76b8c47 req-a2391151-e009-4b5b-b19f-816c5a9530e7 service nova] Creating event network-vif-unplugged:eace4bce-f550-4e2e-bc11-00a14552db28 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:40.251552 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c8fb37e7-6e50-407e-9b0d-1e89b76b8c47 req-a2391151-e009-4b5b-b19f-816c5a9530e7 service nova] Creating event network-vif-unplugged:6f7d0505-1709-46d1-b6ba-10387663e348 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:40.259792 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c8fb37e7-6e50-407e-9b0d-1e89b76b8c47 req-a2391151-e009-4b5b-b19f-816c5a9530e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.065053 Oct 22 03:16:40.260790 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1439/2878] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:40.266225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:40.267133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:40.274522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:40.275306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:40.275896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:40.276835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:40.277480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:40.278055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:40.412672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:40.433624 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9ba8ff6-c08d-491e-8fdf-16fc7dda1b71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1308 microversion: 2.1 time: 0.990339 Oct 22 03:16:40.452037 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1440/2879] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:39 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1308 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:40.458221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:40.459025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:40.477337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:40.478781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:40.480220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:40.482739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:40.484518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:40.485078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:40.551933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:40.765439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:40.781222 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c12cc87a-4f7a-46ca-bbd3-0e531889541f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.518984 Oct 22 03:16:40.784107 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1440/2880] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:40 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:41.223240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:41.224031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:41.231518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:41.232055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:41.232694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:41.233792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:41.235001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:41.235929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:41.326781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:41.345106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:41.349794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:41.351111 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a6b677a4-61f1-413b-8625-d843f9bfbd3e tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2914 microversion: 2.32 time: 0.897690 Oct 22 03:16:41.351691 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1441/2881] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:40 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2914 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:41.458821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:41.459475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:41.465609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:41.477235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:41.478417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:41.479606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:41.480260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:41.480866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:41.591057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:41.599642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ea7c12f-cf1f-4ef7-abbf-73eaca78db91 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.380459 Oct 22 03:16:41.613230 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1441/2882] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:41 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:41.717525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0847f782-0560-46d5-a553-47be2b0af5f7 req-01081de6-979d-49cd-826f-a055b6b9f137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fed450-5b11-447a-a5e9-e0e51183adc7", "tag": "cdff561d-5650-4b7e-85be-5e84b989c594"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:41.745540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0847f782-0560-46d5-a553-47be2b0af5f7 req-01081de6-979d-49cd-826f-a055b6b9f137 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:41.746012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0847f782-0560-46d5-a553-47be2b0af5f7 req-01081de6-979d-49cd-826f-a055b6b9f137 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:41.746629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0847f782-0560-46d5-a553-47be2b0af5f7 req-01081de6-979d-49cd-826f-a055b6b9f137 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:41.764148 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0847f782-0560-46d5-a553-47be2b0af5f7 req-01081de6-979d-49cd-826f-a055b6b9f137 service nova] Creating event network-changed:cdff561d-5650-4b7e-85be-5e84b989c594 for instance f0fed450-5b11-447a-a5e9-e0e51183adc7 on n-h1-862416-2 Oct 22 03:16:41.771888 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0847f782-0560-46d5-a553-47be2b0af5f7 req-01081de6-979d-49cd-826f-a055b6b9f137 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061766 Oct 22 03:16:41.773141 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1442/2883] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:41.808335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:41.809039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:41.832571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:41.835015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:41.835740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:41.837098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:41.837592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:41.838314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:42.162016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:42.173160 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b92f827-385f-4a2d-92e1-884a67c74304 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1308 microversion: 2.1 time: 0.718095 Oct 22 03:16:42.177230 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1442/2884] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:41 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:42.187913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:42.198598 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d492bc12-a433-4e76-b932-ae9f2c971591 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.394363 Oct 22 03:16:42.199657 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1443/2885] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:41 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:42.207422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ec7db001-a9ad-491b-afa6-bdb43c66aa29 req-2f4441ae-83f7-49eb-9617-49849cd62cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-deleted", "tag": "eace4bce-f550-4e2e-bc11-00a14552db28"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:42.236384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec7db001-a9ad-491b-afa6-bdb43c66aa29 req-2f4441ae-83f7-49eb-9617-49849cd62cdd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:42.238759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec7db001-a9ad-491b-afa6-bdb43c66aa29 req-2f4441ae-83f7-49eb-9617-49849cd62cdd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:42.240509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec7db001-a9ad-491b-afa6-bdb43c66aa29 req-2f4441ae-83f7-49eb-9617-49849cd62cdd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:42.271350 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ec7db001-a9ad-491b-afa6-bdb43c66aa29 req-2f4441ae-83f7-49eb-9617-49849cd62cdd service nova] Creating event network-vif-deleted:eace4bce-f550-4e2e-bc11-00a14552db28 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:42.281030 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ec7db001-a9ad-491b-afa6-bdb43c66aa29 req-2f4441ae-83f7-49eb-9617-49849cd62cdd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079782 Oct 22 03:16:42.282344 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1444/2886] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:42.322589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c7576654-2485-4b62-a7fb-a4293cf6ec16 req-5bafa7d4-0fb3-4d1d-8c11-4d437877f536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "f1b84afb-a2c3-4cc5-93fe-295646ed55e0"}, {"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "ff3ee566-ef16-479d-ac0f-49bce2732089"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:42.339315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c7576654-2485-4b62-a7fb-a4293cf6ec16 req-5bafa7d4-0fb3-4d1d-8c11-4d437877f536 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:42.340160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c7576654-2485-4b62-a7fb-a4293cf6ec16 req-5bafa7d4-0fb3-4d1d-8c11-4d437877f536 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:42.340801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c7576654-2485-4b62-a7fb-a4293cf6ec16 req-5bafa7d4-0fb3-4d1d-8c11-4d437877f536 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:42.360525 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c7576654-2485-4b62-a7fb-a4293cf6ec16 req-5bafa7d4-0fb3-4d1d-8c11-4d437877f536 service nova] Creating event network-vif-unplugged:f1b84afb-a2c3-4cc5-93fe-295646ed55e0 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:42.361219 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c7576654-2485-4b62-a7fb-a4293cf6ec16 req-5bafa7d4-0fb3-4d1d-8c11-4d437877f536 service nova] Creating event network-vif-unplugged:ff3ee566-ef16-479d-ac0f-49bce2732089 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:42.375357 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c7576654-2485-4b62-a7fb-a4293cf6ec16 req-5bafa7d4-0fb3-4d1d-8c11-4d437877f536 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.060926 Oct 22 03:16:42.381755 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1445/2887] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:42.404875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:42.405907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:42.424584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:42.426045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:42.427542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:42.431676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:42.433815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:42.434486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:42.460312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-096cbcee-9253-4fa2-94bd-b3a8b10d7b80 tempest-ExtensionsTest-1073548304 tempest-ExtensionsTest-1073548304-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:42.464076 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-096cbcee-9253-4fa2-94bd-b3a8b10d7b80 tempest-ExtensionsTest-1073548304 tempest-ExtensionsTest-1073548304-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.285595 Oct 22 03:16:42.464983 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1443/2888] 10.222.0.25 () {58 vars in 1170 bytes} [Sat Oct 22 03:16:42 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:42.502572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e340191-1cf0-45ef-897a-76b17256d0ee tempest-ExtensionsTest-1073548304 tempest-ExtensionsTest-1073548304-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:42.518433 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1e340191-1cf0-45ef-897a-76b17256d0ee tempest-ExtensionsTest-1073548304 tempest-ExtensionsTest-1073548304-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.033820 Oct 22 03:16:42.519125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1444/2889] 10.222.0.25 () {58 vars in 1134 bytes} [Sat Oct 22 03:16:42 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:16:42.626783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:42.631065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:42.645121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:42.645613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:42.647341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:42.651005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:42.651655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:42.652345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:42.939298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:42.953038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:42.954702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:42.956699 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6416f9bf-9982-4850-8cae-cd9294bda886 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2753 microversion: 2.32 time: 0.572898 Oct 22 03:16:42.957750 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1446/2890] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:42 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2753 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:43.208121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:43.209081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:43.232140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:43.233035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:43.233552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:43.234297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:43.234766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:43.235182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:43.358342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:43.371525 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9a66659-c62f-459d-b91c-acb005d7484d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1716 microversion: 2.1 time: 0.749526 Oct 22 03:16:43.393385 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1445/2891] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:42 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1716 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:43.398480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:43.408918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:43.415206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:43.415986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:43.416637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:43.417538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:43.421015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:43.421699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:44.267593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:44.280628 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5aacf1ea-ba1f-4d60-9c3a-bca54070399e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1308 microversion: 2.1 time: 1.078742 Oct 22 03:16:44.281639 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1447/2892] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:43 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1308 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:44.288777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:44.290494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:44.299216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:44.300877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:44.301569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:44.302556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:44.303372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:44.303972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:44.614277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:44.627311 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac5fb75d-bc64-4437-88d1-824895cebca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 1.232683 Oct 22 03:16:44.642925 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1446/2893] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:43 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:44.651436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d2b8ed55-8c0d-4b90-8d03-dbbd7a061ab4 req-a46e9541-9ab1-426a-af84-cefe62b8fbdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f44efb-8009-4ced-ac1e-ff47e2ab67ef", "tag": "e594792f-1cca-4659-8791-0acba7f6facc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:44.668191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d2b8ed55-8c0d-4b90-8d03-dbbd7a061ab4 req-a46e9541-9ab1-426a-af84-cefe62b8fbdf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:44.668782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d2b8ed55-8c0d-4b90-8d03-dbbd7a061ab4 req-a46e9541-9ab1-426a-af84-cefe62b8fbdf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:44.669753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d2b8ed55-8c0d-4b90-8d03-dbbd7a061ab4 req-a46e9541-9ab1-426a-af84-cefe62b8fbdf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:44.688311 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d2b8ed55-8c0d-4b90-8d03-dbbd7a061ab4 req-a46e9541-9ab1-426a-af84-cefe62b8fbdf service nova] Creating event network-changed:e594792f-1cca-4659-8791-0acba7f6facc for instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef on n-h1-862416-2 Oct 22 03:16:44.693848 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d2b8ed55-8c0d-4b90-8d03-dbbd7a061ab4 req-a46e9541-9ab1-426a-af84-cefe62b8fbdf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049243 Oct 22 03:16:44.695936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1447/2894] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:44.703307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:44.706639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:44.714056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:44.714551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:44.715180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:44.717599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:44.718894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:44.719502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:44.864013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:44.879375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:44.881028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:44.882404 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa75309f-aec7-41c7-877d-844ea1b96bf3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2753 microversion: 2.32 time: 0.599445 Oct 22 03:16:44.882993 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1448/2895] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:44 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2753 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:45.306247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:45.306919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:45.311503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:45.317345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:45.317851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:45.318318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:45.326473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:45.327243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:45.327928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:45.329710 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b9806570-3c54-4e17-8caa-097e84141341 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1706 microversion: 2.1 time: 0.628131 Oct 22 03:16:45.333823 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1448/2896] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:44 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1706 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:45.359288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f2b27d8e-9f72-4236-8d9b-952498e4bda3 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '.version_select at 0x7f0d1992fa60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:45.369744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2b27d8e-9f72-4236-8d9b-952498e4bda3 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:45.371406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2b27d8e-9f72-4236-8d9b-952498e4bda3 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:45.373416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2b27d8e-9f72-4236-8d9b-952498e4bda3 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:45.418397 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f2b27d8e-9f72-4236-8d9b-952498e4bda3 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.065599 Oct 22 03:16:45.433087 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1449/2897] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:16:45 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:45.442951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:45.449623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:45.472108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:45.472898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:45.483140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:45.485550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:45.485979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:45.487522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:45.916007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:45.928589 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ee0683d-376d-4e99-904d-5bec287620e9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1308 microversion: 2.1 time: 0.626976 Oct 22 03:16:45.931389 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1449/2898] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:45 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:45.939688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:45.942507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:45.965427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:45.967688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:45.968288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:45.968831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:45.969740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:45.970268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:45.970772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:46.326799 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d703fad-9cbf-4718-a0ab-a4c3947d2361 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1857 microversion: 2.1 time: 0.890866 Oct 22 03:16:46.340378 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1450/2899] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:45 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1857 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:46.346690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:46.355123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:46.379183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:46.380770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:46.381893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:46.383588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:46.384442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:46.385250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:46.488666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:46.500374 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8b7f047-f320-4c12-afb6-b6304e56328a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.567535 Oct 22 03:16:46.501029 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1450/2900] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:45 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:46.505967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:46.507506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:46.514837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:46.515533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:46.516151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:46.517068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:46.517678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:46.518251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:46.542227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:46.834529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47e44a33-c9a4-4d03-b7be-8709be801b29 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1857 microversion: 2.1 time: 0.332031 Oct 22 03:16:46.836064 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1451/2901] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:46 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1857 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:46.852595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8be4a80d-f790-4847-baf1-7d44e0454ef4 req-8bad743e-9007-418c-83c2-868424035965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-deleted", "tag": "b0488e2a-8772-4d06-8539-71f4d3e87f13"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:46.879709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8be4a80d-f790-4847-baf1-7d44e0454ef4 req-8bad743e-9007-418c-83c2-868424035965 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:46.880194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8be4a80d-f790-4847-baf1-7d44e0454ef4 req-8bad743e-9007-418c-83c2-868424035965 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:46.885998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8be4a80d-f790-4847-baf1-7d44e0454ef4 req-8bad743e-9007-418c-83c2-868424035965 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:46.920601 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8be4a80d-f790-4847-baf1-7d44e0454ef4 req-8bad743e-9007-418c-83c2-868424035965 service nova] Creating event network-vif-deleted:b0488e2a-8772-4d06-8539-71f4d3e87f13 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:46.943931 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8be4a80d-f790-4847-baf1-7d44e0454ef4 req-8bad743e-9007-418c-83c2-868424035965 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104623 Oct 22 03:16:46.945204 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1452/2902] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:46.956945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:46.957648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:46.966911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:46.974880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:46.980086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:46.981968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:46.985084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:46.987198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:47.162313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:47.188610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:47.190716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:47.192643 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-864471de-94a1-4a26-90e2-75eabdc94ea2 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2706 microversion: 2.32 time: 0.863492 Oct 22 03:16:47.193739 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1451/2903] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:46 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2706 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:47.203474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:47.204221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:47.211297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:47.212045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:47.212800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:47.216429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:47.217448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:47.218250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:47.350811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:47.359616 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-60a8bf0b-ea75-4039-8068-f88ab89f8283 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1308 microversion: 2.1 time: 0.406757 Oct 22 03:16:47.360238 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1453/2904] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:46 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:47.396747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lazy-loading 'services' on Instance uuid 88d5af8e-154b-4a08-bb37-0a1947b49d82 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:16:47.531171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:47.531874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:47.542906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:47.543464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:47.545124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:47.548651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:47.549446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:47.550862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:47.591556 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ae96ca0-53b9-4fda-9488-e1b900fe14d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments/73db6dc6-1101-485f-afc7-ce308a4eab4f" status: 202 len: 0 microversion: 2.1 time: 0.394017 Oct 22 03:16:47.593485 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1452/2905] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:16:47 2022] DELETE /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments/73db6dc6-1101-485f-afc7-ce308a4eab4f => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:16:47.607745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:47.612922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:47.625541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:47.626613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:47.641789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:47.643072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:47.643565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:47.646177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:47.744249 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-58d3d97a-3137-4152-b4a9-1e44692bd03d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145558 Oct 22 03:16:47.748098 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1453/2906] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:16:47 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:16:47.767441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a1b95391-a94a-4ac3-9383-1f69f288c8cd req-1951b894-15d0-433f-a0a8-b27cb9098c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fed450-5b11-447a-a5e9-e0e51183adc7", "name": "network-vif-plugged", "status": "completed", "tag": "cdff561d-5650-4b7e-85be-5e84b989c594"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:47.787064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a1b95391-a94a-4ac3-9383-1f69f288c8cd req-1951b894-15d0-433f-a0a8-b27cb9098c32 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:47.787682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a1b95391-a94a-4ac3-9383-1f69f288c8cd req-1951b894-15d0-433f-a0a8-b27cb9098c32 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:47.788444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a1b95391-a94a-4ac3-9383-1f69f288c8cd req-1951b894-15d0-433f-a0a8-b27cb9098c32 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:47.802498 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a1b95391-a94a-4ac3-9383-1f69f288c8cd req-1951b894-15d0-433f-a0a8-b27cb9098c32 service nova] Creating event network-vif-plugged:cdff561d-5650-4b7e-85be-5e84b989c594 for instance f0fed450-5b11-447a-a5e9-e0e51183adc7 on n-h1-862416-2 Oct 22 03:16:47.812079 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a1b95391-a94a-4ac3-9383-1f69f288c8cd req-1951b894-15d0-433f-a0a8-b27cb9098c32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052846 Oct 22 03:16:47.812882 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1454/2907] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:48.012269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:48.021244 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27e27b6e-7041-4d0b-ba06-98af5c54161d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.494206 Oct 22 03:16:48.026933 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1454/2908] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:47 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:48.226743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:48.227390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:48.241712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:48.242244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:48.242771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:48.244143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:48.244566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:48.245006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:48.383410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:48.384086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:48.402296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:48.402820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:48.403350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:48.404304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:48.404944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:48.405540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:48.742802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:48.758858 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-83697882-69dd-499d-8164-8a4d6f0b4c0a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1308 microversion: 2.1 time: 0.380044 Oct 22 03:16:48.764095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1455/2909] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:48 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:48.793357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:48.800868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:48.816104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:48.819275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:48.819743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:48.823500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:48.823985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:48.831364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:48.908643 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f2ef1fa-c165-40ed-a54d-eed987b8ff2f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140079 Oct 22 03:16:48.909309 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1456/2910] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:16:48 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:49.055351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:49.056244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:49.063477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:49.069621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:49.070460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:49.071546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:49.077751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:49.078309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:49.371054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:49.382848 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f311361f-b9d1-4c24-9e23-de542c1312ea tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.331469 Oct 22 03:16:49.386692 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1457/2911] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:49 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:49.404973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e6b50ff4-b503-4675-9c6f-2f3fd1722ca5 req-69d46ed6-4133-49fd-823d-00cc1eac0d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-deleted", "tag": "ff3ee566-ef16-479d-ac0f-49bce2732089"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:49.420991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e6b50ff4-b503-4675-9c6f-2f3fd1722ca5 req-69d46ed6-4133-49fd-823d-00cc1eac0d6f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:49.422792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:49.423762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e6b50ff4-b503-4675-9c6f-2f3fd1722ca5 req-69d46ed6-4133-49fd-823d-00cc1eac0d6f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:49.424503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e6b50ff4-b503-4675-9c6f-2f3fd1722ca5 req-69d46ed6-4133-49fd-823d-00cc1eac0d6f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:49.439754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:49.443678 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e6b50ff4-b503-4675-9c6f-2f3fd1722ca5 req-69d46ed6-4133-49fd-823d-00cc1eac0d6f service nova] Creating event network-vif-deleted:ff3ee566-ef16-479d-ac0f-49bce2732089 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:49.445866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:49.447694 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d7e85e63-0a58-4f6e-b86f-e5ebae5cb8f3 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2545 microversion: 2.32 time: 1.225426 Oct 22 03:16:49.452349 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1455/2912] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:48 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2545 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:49.458544 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e6b50ff4-b503-4675-9c6f-2f3fd1722ca5 req-69d46ed6-4133-49fd-823d-00cc1eac0d6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070163 Oct 22 03:16:49.460861 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1458/2913] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:49.787073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:49.788514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:49.799955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:49.803893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:49.807201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:49.807937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:49.813288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:49.814050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:49.815807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:49.922340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:49.925426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:49.938788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:49.939572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:49.940196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:49.941135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:49.941754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:49.942344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:50.004219 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e187d4e-011d-4837-8041-0a66e49e634a tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083777 Oct 22 03:16:50.004866 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1459/2914] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:16:49 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:16:50.411366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:50.412527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:50.427437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:50.428556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:50.429190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:50.431655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:50.433305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:50.435349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:50.645632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:50.655219 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1e5fb537-8bfa-4990-836e-5690bdc6c966 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1489 microversion: 2.1 time: 0.872565 Oct 22 03:16:50.660918 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1456/2915] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:49 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1489 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:50.697173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:50.697842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:50.736055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:50.738310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:50.738765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:50.739508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:50.739969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:50.740436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:51.432755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:51.434236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:51.444080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:51.445621 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11658373-ee81-40e0-b463-bc71dac26410 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 1.036992 Oct 22 03:16:51.449132 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1460/2916] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:50 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:51.455871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:51.457221 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61f756f9-5f30-4bce-bcbc-68c6b45d965f tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 2432 microversion: 2.32 time: 0.794626 Oct 22 03:16:51.460630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:51.464840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:51.476232 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1457/2917] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:50 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 2432 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:51.476232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:51.476232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:51.481347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:51.486615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:51.486615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:51.486615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:51.489675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:51.490203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:51.490648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:51.491365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:51.491828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:51.492458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:51.492603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:51.497675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:51.535924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:51.539359 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9d09ba34-fec2-4c86-8e93-df4bd92f2135 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072602 Oct 22 03:16:51.541002 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1458/2918] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:16:51 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:51.562462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lazy-loading 'flavor' on Instance uuid f0fed450-5b11-447a-a5e9-e0e51183adc7 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:16:51.699978 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f64ba06-3bc1-4a1d-80af-2f5872830b06 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7/action" status: 202 len: 0 microversion: 2.1 time: 0.248034 Oct 22 03:16:51.701937 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1461/2919] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:16:51 2022] POST /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:16:51.727659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:51.729796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:51.739427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:51.741274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:51.742545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:51.744355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:51.745141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:51.747133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:51.846318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cc17cb4e-5341-4017-93f6-d6c44078296a req-006be544-df6f-49c3-94ec-9c365be4acc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-deleted", "tag": "6f7d0505-1709-46d1-b6ba-10387663e348"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:51.874945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cc17cb4e-5341-4017-93f6-d6c44078296a req-006be544-df6f-49c3-94ec-9c365be4acc7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:51.876802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cc17cb4e-5341-4017-93f6-d6c44078296a req-006be544-df6f-49c3-94ec-9c365be4acc7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:51.877846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cc17cb4e-5341-4017-93f6-d6c44078296a req-006be544-df6f-49c3-94ec-9c365be4acc7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:51.907271 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cc17cb4e-5341-4017-93f6-d6c44078296a req-006be544-df6f-49c3-94ec-9c365be4acc7 service nova] Creating event network-vif-deleted:6f7d0505-1709-46d1-b6ba-10387663e348 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:51.921034 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cc17cb4e-5341-4017-93f6-d6c44078296a req-006be544-df6f-49c3-94ec-9c365be4acc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082807 Oct 22 03:16:51.928135 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1462/2920] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:52.481219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:52.482945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:52.505089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:52.506988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:52.509403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:52.511764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:52.516684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:52.517441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:53.023503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:53.039059 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2dd20d41-87e3-4011-b154-41e27e678669 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1497 microversion: 2.1 time: 1.330637 Oct 22 03:16:53.044409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:53.044942 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1459/2921] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:51 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1497 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:53.057401 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bf1afc64-0695-4896-8891-0158ee140ee9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.584331 Oct 22 03:16:53.060005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:53.064254 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1463/2922] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:52 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:53.069284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:53.085254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:53.087742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:53.089593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:53.091497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:53.096325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:53.099888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:53.101996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:53.102648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:53.127496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:53.127925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:53.128602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:53.145475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:53.148150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:53.148827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:53.270432 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-262fee30-40bb-491a-a24a-73f5e3de4e38 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204725 Oct 22 03:16:53.274666 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1464/2923] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:16:53 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:53.352757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:53.370491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:53.385155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:53.386838 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5f4d31f-1638-48ec-b196-5ce6b2fc2219 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.339929 Oct 22 03:16:53.391087 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1460/2924] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:53 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:54.017835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-46a274a8-6ed8-4f11-b3ee-eca3657915b4 req-07f297e2-8c5f-4b72-96a4-211004521b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5ee4f0-59b4-4574-8707-d14317cd0d4e", "name": "network-vif-deleted", "tag": "f1b84afb-a2c3-4cc5-93fe-295646ed55e0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:54.069183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-46a274a8-6ed8-4f11-b3ee-eca3657915b4 req-07f297e2-8c5f-4b72-96a4-211004521b91 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.069945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-46a274a8-6ed8-4f11-b3ee-eca3657915b4 req-07f297e2-8c5f-4b72-96a4-211004521b91 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.070565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-46a274a8-6ed8-4f11-b3ee-eca3657915b4 req-07f297e2-8c5f-4b72-96a4-211004521b91 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:54.096510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:54.097154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:54.130855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.136902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.139551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:54.144448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.144944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.145388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:54.156087 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-46a274a8-6ed8-4f11-b3ee-eca3657915b4 req-07f297e2-8c5f-4b72-96a4-211004521b91 service nova] Creating event network-vif-deleted:f1b84afb-a2c3-4cc5-93fe-295646ed55e0 for instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e on n-h1-862416-2 Oct 22 03:16:54.184136 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-46a274a8-6ed8-4f11-b3ee-eca3657915b4 req-07f297e2-8c5f-4b72-96a4-211004521b91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181681 Oct 22 03:16:54.185902 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1465/2925] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:54.191447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:54.192314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:54.216099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.216757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.217697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:54.218429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.218892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.219440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:54.704071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:54.712607 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0d0dab65-cb73-4d63-887a-134c7f041ab6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.525963 Oct 22 03:16:54.739520 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1466/2926] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:54 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:54.745484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:54.750409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:54.772056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.772541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.772988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:54.773708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.774169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.774597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:54.835299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f0aed1a-cb63-4324-8363-e4cc8365a51e tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093835 Oct 22 03:16:54.848622 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1467/2927] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:16:54 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:54.853964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:54.854918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:54.865190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.865672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.877119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:54.877899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:54.878380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:54.878815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:55.259281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:55.276725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:55.278992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:55.280410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7e7139cc-edca-465e-94aa-c3eaf104f98a tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.430660 Oct 22 03:16:55.289846 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1468/2928] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:54 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:55.754290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:55.754914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:55.755389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:55.767953 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-242543c4-a62b-4dcc-805d-351850452575 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 200 len: 1480 microversion: 2.1 time: 1.691093 Oct 22 03:16:55.771274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:55.771779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:55.772240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:55.772782 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1461/2929] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:54 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 1480 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:55.789213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:55.791603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:55.792065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:55.798628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-346233133"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:55.802910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:16:55.806486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:55.823026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:55.823539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:55.823984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:55.830250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:55.831695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:55.833431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:56.240320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:56.254182 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4edf612d-4593-4988-b7b0-8536ec4840f5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 0.510971 Oct 22 03:16:56.255182 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1469/2930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:55 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:16:56.268863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:56.272464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:56.285875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:56.287811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:56.290595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:56.291665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:56.292358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:56.297305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:56.318897 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b03216ee-5c50-4e53-9d7c-001df2ba8a1c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7/action" status: 202 len: 0 microversion: 2.1 time: 0.525769 Oct 22 03:16:56.322302 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1462/2931] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:16:55 2022] POST /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 03:16:56.330751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:56.333384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:56.345379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:56.347318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:56.347999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:56.349013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:56.349688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:56.350396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:56.437950 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93e31664-1830-493d-8dbc-927c13f6f251 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181384 Oct 22 03:16:56.442796 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1470/2932] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:16:56 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:56.457140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-011854f6-a764-430c-951a-a1238ad14216 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a2d50d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:56.563447 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-011854f6-a764-430c-951a-a1238ad14216 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7" status: 200 len: 1439 microversion: 2.1 time: 0.110118 Oct 22 03:16:56.564043 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1471/2933] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:56 2022] GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 => generated 1439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:56.659528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:56.682680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:56.690080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:56.693265 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f993dc57-4b2b-4e88-81d7-9123116d5fa4 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.368746 Oct 22 03:16:56.695862 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1463/2934] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:56 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:57.147703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-950812e8-465d-46fe-831c-13e4a5cfcbfa req-92087927-fda3-40df-b291-7934088ed818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f44efb-8009-4ced-ac1e-ff47e2ab67ef", "name": "network-vif-plugged", "status": "completed", "tag": "e594792f-1cca-4659-8791-0acba7f6facc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:57.165508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-950812e8-465d-46fe-831c-13e4a5cfcbfa req-92087927-fda3-40df-b291-7934088ed818 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:57.168107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-950812e8-465d-46fe-831c-13e4a5cfcbfa req-92087927-fda3-40df-b291-7934088ed818 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:57.170323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-950812e8-465d-46fe-831c-13e4a5cfcbfa req-92087927-fda3-40df-b291-7934088ed818 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:57.204090 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-950812e8-465d-46fe-831c-13e4a5cfcbfa req-92087927-fda3-40df-b291-7934088ed818 service nova] Creating event network-vif-plugged:e594792f-1cca-4659-8791-0acba7f6facc for instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef on n-h1-862416-2 Oct 22 03:16:57.216989 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-950812e8-465d-46fe-831c-13e4a5cfcbfa req-92087927-fda3-40df-b291-7934088ed818 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072839 Oct 22 03:16:57.217916 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1472/2935] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:16:57.279991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:57.282409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:57.295050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:57.304977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:57.305708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:57.306637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:57.307314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:57.307901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:57.458797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:57.461302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:57.476937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:57.477442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:57.477883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:57.481532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:57.483099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:57.483699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:57.554644 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f42574ef-a4c5-4b89-bbc0-c408361d563b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102690 Oct 22 03:16:57.576965 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1473/2936] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:16:57 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:16:57.593398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57e7d545-8031-4355-a607-0f761e11662d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d19fe9d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:57.668359 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57e7d545-8031-4355-a607-0f761e11662d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7" status: 200 len: 1439 microversion: 2.1 time: 0.089590 Oct 22 03:16:57.670096 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1474/2937] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:57 2022] GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:57.952726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-54743607-c83c-40ec-9788-08018a38f8b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'create', calling method: .version_select at 0x7f0d19fe9670>, body: {"keypair": {"name": "tempest-keypair-761533599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPZKdC17RAuJOiltvROT4/eZk74Fpu2T0dnAXwi/o7dFHvCImPreWDqNDwd0CM0mDYL07QlE4prayJxFrREWq90sFXsZDI1/it7yX4vYSyBOkQY09fFcacjHm+A7HIbVg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:57.999881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-54743607-c83c-40ec-9788-08018a38f8b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Getting quotas for project 0acbea2993cb4d1d81f171c1b7f07443. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:16:58.025462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-54743607-c83c-40ec-9788-08018a38f8b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Getting quotas for user 538f74faf48e4343b1794378636552d2 and project 0acbea2993cb4d1d81f171c1b7f07443. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:16:58.094796 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-54743607-c83c-40ec-9788-08018a38f8b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.414898 Oct 22 03:16:58.096290 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1475/2938] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:16:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 417 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 03:16:58.131510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:58.133757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:58.152925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:58.154034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:58.155963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:58.156934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:58.157618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:58.158956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:58.363224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:58.382696 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-71975504-f10b-4baa-91da-75ce643c8fa1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 1.107785 Oct 22 03:16:58.385267 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1464/2939] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:57 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:58.448192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:58.469958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:58.477661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:16:58.482221 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f558489-1859-4421-b85a-10deee2fd285 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.381165 Oct 22 03:16:58.486451 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1476/2940] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:58 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:16:58.685803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc32d810-9760-4cca-a31b-794115c6ae71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1e3ffee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:58.786173 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cc32d810-9760-4cca-a31b-794115c6ae71 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7" status: 200 len: 1439 microversion: 2.1 time: 0.104466 Oct 22 03:16:58.786764 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1465/2941] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:16:58 2022] GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:16:59.334515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94ee5468-375a-4d86-abc1-5f5797b0da6f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Action: 'create', calling method: .version_select at 0x7f0d1a23da60>, body: {"keypair": {"name": "tempest-keypair-2017535961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTn0ANRaOP/GWEet6lgzDPmUWdCwbDcnvs8KOcOrjofbwGg2sVxMTBHdgwRVDRXvwbaYbYZNiPDTr1AM4wSP4Pm89xgZ9vsdPISo9+S+Bdc5/Gwu/tHSGYPaVGrowQnjg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:16:59.408368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-94ee5468-375a-4d86-abc1-5f5797b0da6f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Getting quotas for project 42016e2241264da88579fb9b9192087c. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:16:59.409941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:59.411069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:59.431324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-94ee5468-375a-4d86-abc1-5f5797b0da6f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Getting quotas for user 0f85a274b68543fbbbc0a97d7cb6b8a6 and project 42016e2241264da88579fb9b9192087c. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:16:59.432877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:59.433377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:59.433824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:59.445047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:59.445608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:59.446081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:59.542658 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-94ee5468-375a-4d86-abc1-5f5797b0da6f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.220819 Oct 22 03:16:59.546093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1477/2942] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:16:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 226 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 03:16:59.564536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:16:59.566627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:16:59.598253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:59.599111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:59.600146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:59.602227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:16:59.603275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:16:59.613178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:16:59.992414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:00.003722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:00.015210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:00.016513 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40b334f6-d02a-4ed4-87c4-3f231b30d8bd tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.469108 Oct 22 03:17:00.017094 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1478/2943] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:16:59 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:00.063571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4e6714e-dfd5-4c07-ab2c-1de71b60f839 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196a9700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:00.809973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:00.823225 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79ef6120-0e74-4279-a5f7-cb378d9bb666 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1315 microversion: 2.1 time: 1.418537 Oct 22 03:17:00.824546 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1466/2944] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:16:59 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1315 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:01.047127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:01.047746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:01.062797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:01.063298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:01.063735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:01.064495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:01.064954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:01.065382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:01.272595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:01.299292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:01.306301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:01.314077 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f569796f-df2c-4c81-8864-8d9cd7a2daaf tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.271632 Oct 22 03:17:01.328614 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1467/2945] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:01 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:17:01.860837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:01.861366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:01.899031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:01.902468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:01.904961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:01.929255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:01.930091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:01.930546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:03.255051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:03.270590 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d61e2ca-d783-4ec6-ba86-303956bef011 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1501 microversion: 2.1 time: 1.417901 Oct 22 03:17:03.298543 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1468/2946] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:01 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1501 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:03.351187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:03.354325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:03.376283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:03.379689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:03.381301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:03.382396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:03.383621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:03.386451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:03.837470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:03.862553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:03.875841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:03.882363 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f3547abd-20c5-447c-bdec-d68a98b93689 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.577450 Oct 22 03:17:03.885281 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1469/2947] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:03 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:04.810432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c0ea7af-ea8b-44ce-b60f-370a44d5fed7 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:04.827770 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c0ea7af-ea8b-44ce-b60f-370a44d5fed7 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.396152 Oct 22 03:17:04.829001 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1470/2948] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:17:04.842158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af9e9b05-1734-4d44-8d9d-0070c74ccf1f tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:04.892508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af9e9b05-1734-4d44-8d9d-0070c74ccf1f tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.054185 Oct 22 03:17:04.895271 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1471/2949] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:17:04 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:04.910369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2f0522d0-54d2-451a-aa9d-3b802854008c tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:04.931376 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2f0522d0-54d2-451a-aa9d-3b802854008c tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024876 Oct 22 03:17:04.935116 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1472/2950] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:17:04.947758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:04.948170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:04.961569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:04.966212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:04.972079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:04.973279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:04.974306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:04.974912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:05.219682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:05.239056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:05.248502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:05.253883 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eac91825-53c2-4480-b7b0-4650013fbbf8 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.317415 Oct 22 03:17:05.280665 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1473/2951] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:04 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:05.289162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93704389-3fdb-45ea-9e63-3e9bc713729d tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:05.308045 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93704389-3fdb-45ea-9e63-3e9bc713729d tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025421 Oct 22 03:17:05.313285 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1474/2952] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:05.337036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b15f3d3c-d3e6-483b-90ce-ab7162f59625 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:05.495166 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b15f3d3c-d3e6-483b-90ce-ab7162f59625 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.161668 Oct 22 03:17:05.498704 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1475/2953] 10.222.0.25 () {58 vars in 1165 bytes} [Sat Oct 22 03:17:05 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:05.513803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b9db0506-008e-419a-aa4e-f1e76e0383b4 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:05.560744 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b9db0506-008e-419a-aa4e-f1e76e0383b4 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051413 Oct 22 03:17:05.568297 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1476/2954] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:05.587680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e94bd84-0732-4470-b278-dd40be55e3b0 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:05.677990 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e94bd84-0732-4470-b278-dd40be55e3b0 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.103919 Oct 22 03:17:05.689673 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1477/2955] 10.222.0.25 () {58 vars in 1169 bytes} [Sat Oct 22 03:17:05 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:05.705053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6219dd86-c39b-48ce-b12f-3bd30a983f55 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:05.737905 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6219dd86-c39b-48ce-b12f-3bd30a983f55 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.046962 Oct 22 03:17:05.742484 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1478/2956] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:17:05 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:05.753659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-50741842-39f4-4be1-b80e-7f7993c8d1f9 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:05.773934 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-50741842-39f4-4be1-b80e-7f7993c8d1f9 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024840 Oct 22 03:17:05.775076 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1479/2957] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:05.789001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed6f397e-0000-4fc0-b54e-d75b78f1c2d5 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:05.929494 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ed6f397e-0000-4fc0-b54e-d75b78f1c2d5 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.145178 Oct 22 03:17:05.944606 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1480/2958] 10.222.0.25 () {58 vars in 1167 bytes} [Sat Oct 22 03:17:05 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:05.958611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-204fc63e-d385-483f-916e-414855df7d0c tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:05.996670 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-204fc63e-d385-483f-916e-414855df7d0c tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043198 Oct 22 03:17:06.011565 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1481/2959] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:17:06.026523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d61628e3-ba09-4141-99b0-7884cb43d141 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:06.080745 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d61628e3-ba09-4141-99b0-7884cb43d141 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.060272 Oct 22 03:17:06.095178 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1482/2960] 10.222.0.25 () {58 vars in 1144 bytes} [Sat Oct 22 03:17:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:06.119312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed34530f-d7dc-4284-982d-15d81ed1fec5 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:06.147870 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ed34530f-d7dc-4284-982d-15d81ed1fec5 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042438 Oct 22 03:17:06.156441 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1483/2961] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:06.167714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d54d688e-4ea0-427f-9221-dd0aed9a63db tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:06.209457 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d54d688e-4ea0-427f-9221-dd0aed9a63db tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.047086 Oct 22 03:17:06.225775 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1484/2962] 10.222.0.25 () {58 vars in 1148 bytes} [Sat Oct 22 03:17:06 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:06.244993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30ef5084-8539-4407-bcf6-b20bbab58fbd tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:06.327404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30ef5084-8539-4407-bcf6-b20bbab58fbd tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.091674 Oct 22 03:17:06.340292 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1485/2963] 10.222.0.25 () {58 vars in 1140 bytes} [Sat Oct 22 03:17:06 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:06.354921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:06.362323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:06.409464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:06.409966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:06.410413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:06.411166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:06.411621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:06.412048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:06.978010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:07.023636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:07.026859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:07.031188 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19e04eda-98c7-47c2-9b53-82d3b484c353 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.687621 Oct 22 03:17:07.032368 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1486/2964] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:06 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:07.055768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba1bf680-a91c-4f05-9dad-97fb003a3fed tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:07.078690 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba1bf680-a91c-4f05-9dad-97fb003a3fed tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041127 Oct 22 03:17:07.094758 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1487/2965] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:07.106869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1740753215", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bae3ff0-f144-4ed3-bbbc-59fa25cecb10"}], "security_groups": [{"name": "tempest-securitygroup--1773940921"}], "key_name": "tempest-keypair-761533599", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:09.474064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:09.595255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:09.997768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=30 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:16.998331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:17.172068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=64 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:20.141068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4e6714e-dfd5-4c07-ab2c-1de71b60f839 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7" status: 200 len: 1439 microversion: 2.1 time: 20.090744 Oct 22 03:17:20.149375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1479/2966] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:00 2022] GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 => generated 1439 bytes in 20132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:20.158906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eac7572e-61da-4205-b5b7-58c661af66a6 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:20.207156 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eac7572e-61da-4205-b5b7-58c661af66a6 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.056349 Oct 22 03:17:20.208038 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1480/2967] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:17:20 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:20.223865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ca7ae0d-7a17-4710-b16c-9a56bb171eea"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:20.226791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:20.236423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:20.239043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:20.241419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:20.242033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] validate_networks() for [('6bae3ff0-f144-4ed3-bbbc-59fa25cecb10', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:17:20.243093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:20.243800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:20.245314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:20.760311 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55a22ca6-ff0d-4c66-ad6d-e76abf8c2293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540339 Oct 22 03:17:20.762560 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1481/2968] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:17:20 2022] POST /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef/os-volume_attachments => generated 194 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:20.786487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:20.787640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:20.803442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:20.804326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:20.804996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:20.806496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:20.810799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:20.811534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:20.991299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:17:20.992186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:17:20.993227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:17:20.993956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:17:20.994589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:17:21.011866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:21.012783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:21.013461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:21.014448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:21.017150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:21.019994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:21.063489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Getting quotas for project 0acbea2993cb4d1d81f171c1b7f07443. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:17:21.076807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Getting quotas for user 538f74faf48e4343b1794378636552d2 and project 0acbea2993cb4d1d81f171c1b7f07443. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:17:21.105384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:17:21.112507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:17:21.219128 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dd8698c5-1519-4a11-9260-c75e7f38a1d7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 14.122886 Oct 22 03:17:21.220085 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1488/2969] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:17:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 14124 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:17:21.225134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-942450622", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a3aeab69-9cd2-4587-ba5f-fefe2f689d85"}, {"port": "6d3eca57-341f-44a5-8d5c-6b4ad5b49b6f", "tag": "port-1"}, {"port": "e509da0c-c791-4c06-ac72-984dbf14fd51", "tag": "port-2"}, {"uuid": "8bd33e2d-bb34-410b-a2b0-008c0735e170", "tag": "net-1"}, {"uuid": "8bd33e2d-bb34-410b-a2b0-008c0735e170"}, {"uuid": "a3d1017b-0f31-4ca6-9726-37f33f86e6a6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a3d1017b-0f31-4ca6-9726-37f33f86e6a6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "244ba8cf-4002-41ef-8a6b-992625fcd1c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "edc27dd9-848e-4403-9e67-18df8142aded", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "40c29022-a064-4156-82cc-02368d57627e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1177477009"}], "key_name": "tempest-keypair-2017535961", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:21.469452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] validate_networks() for [('a3aeab69-9cd2-4587-ba5f-fefe2f689d85', None, None, None, None, None), (None, None, '6d3eca57-341f-44a5-8d5c-6b4ad5b49b6f', None, None, None), (None, None, 'e509da0c-c791-4c06-ac72-984dbf14fd51', None, None, None), ('8bd33e2d-bb34-410b-a2b0-008c0735e170', None, None, None, None, None), ('8bd33e2d-bb34-410b-a2b0-008c0735e170', None, None, None, None, None), ('a3d1017b-0f31-4ca6-9726-37f33f86e6a6', '10.2.2.100', None, None, None, None), ('a3d1017b-0f31-4ca6-9726-37f33f86e6a6', '10.2.2.200', None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:17:21.503535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:21.556244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:21.564766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27c111294f5042d3a07812a8f7cd316e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b44f72118d44569a1d524edcd3fbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:21.566365 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a15759b4-f970-4f97-b71e-88b5f9306b21 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 200 len: 1604 microversion: 2.32 time: 0.802319 Oct 22 03:17:21.570034 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1482/2970] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:20 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 1604 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:21.737957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-29125471", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "3562332b-563f-4110-a622-fceabc5a2780"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:21.826038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] validate_networks() for [('3562332b-563f-4110-a622-fceabc5a2780', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:17:22.972053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:17:22.972781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:17:22.973269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:17:22.973688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:17:22.974103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:17:22.995524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:22.996019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:22.997049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:22.998097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:22.998635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:22.999072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:23.027068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Getting quotas for project 6e11664c867b4d08b961a0613160c3cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:17:23.035066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Getting quotas for user 0acb8d942d09476994afa9a647132e5c and project 6e11664c867b4d08b961a0613160c3cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:17:23.052185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:17:23.055138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:17:23.132390 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-469775d5-8b4e-4c6d-81af-547229dda6e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.559430 Oct 22 03:17:23.132932 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1483/2971] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:17:23.143689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8facb5cd-cb73-461b-a97e-813528883eac req-9327bfa4-83bb-46f5-8cfd-c7b63809b06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fed450-5b11-447a-a5e9-e0e51183adc7", "name": "network-vif-plugged", "status": "completed", "tag": "cdff561d-5650-4b7e-85be-5e84b989c594"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:23.203320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8facb5cd-cb73-461b-a97e-813528883eac req-9327bfa4-83bb-46f5-8cfd-c7b63809b06d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:23.206465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8facb5cd-cb73-461b-a97e-813528883eac req-9327bfa4-83bb-46f5-8cfd-c7b63809b06d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:23.208631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8facb5cd-cb73-461b-a97e-813528883eac req-9327bfa4-83bb-46f5-8cfd-c7b63809b06d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:23.243560 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8facb5cd-cb73-461b-a97e-813528883eac req-9327bfa4-83bb-46f5-8cfd-c7b63809b06d service nova] Creating event network-vif-plugged:cdff561d-5650-4b7e-85be-5e84b989c594 for instance f0fed450-5b11-447a-a5e9-e0e51183adc7 on n-h1-862416-2 Oct 22 03:17:23.254499 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8facb5cd-cb73-461b-a97e-813528883eac req-9327bfa4-83bb-46f5-8cfd-c7b63809b06d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116786 Oct 22 03:17:23.265114 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1484/2972] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:23.279338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-932da574-b624-4dfa-891b-247b9bd170aa tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:23.312522 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-932da574-b624-4dfa-891b-247b9bd170aa tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046037 Oct 22 03:17:23.313776 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1485/2973] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:17:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:23.318867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e523eede-46c9-4433-b217-0873bfd9a2b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d19954e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:23.375855 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e523eede-46c9-4433-b217-0873bfd9a2b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7" status: 200 len: 1448 microversion: 2.1 time: 0.060779 Oct 22 03:17:23.376485 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1486/2974] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:23 2022] GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 => generated 1448 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:23.382168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:23.383157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:23.391958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:23.392480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:23.393136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:23.393864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:23.394324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:23.394757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:23.475004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:23.503982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:23.505694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:23.506863 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f12a0ecd-b509-4455-8046-c48c874178a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1333 microversion: 2.20 time: 0.129241 Oct 22 03:17:23.507433 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1487/2975] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:23 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:23.522097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:23.522927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:23.529683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:23.532915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:23.533595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:23.534603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:23.535257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:23.535890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:23.552841 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] HTTP exception thrown: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Request method failure captured: Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e HTTP/1.1 Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU18SwWoOiVNwgr_FATYskWr0W9-oK4MMyO9-szLBDFzJensYa7GT8iVjDtLUUeoBmf8nQjTu3l7sAT8bKMRg3lBOLJeQFWJZUz_X0_kZejCEPTMBfDhP7hKUlR45LR4iMu53s7Fu-iP9c8DCq-gtI3opIUrk0W0PmP90ZzsQMWWy-4c Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.32 Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 37b44f72118d44569a1d524edcd3fbba Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b44f72118d44569a1d524edcd3fbba"}]}] Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 37b44f72118d44569a1d524edcd3fbba Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TaggedBootDevicesTest-1311972818-project Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 27c111294f5042d3a07812a8f7cd316e Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TaggedBootDevicesTest-1311972818-project Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '6e5ee4f0-59b4-4574-8707-d14317cd0d4e'} Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:23.555686 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:17:23.560475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:23.560475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:23.560475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:17:23.560475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:17:23.560475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:17:23.560475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:17:23.560475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:23.560475 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:23.561679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Returning 404 to user: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:17:23.562409 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33df66c3-4e52-4fa1-86ed-1501d24a3422 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 404 len: 111 microversion: 2.32 time: 0.054031 Oct 22 03:17:23.566897 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1488/2976] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:23 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:17:23.572182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c7338c77-6544-417b-994b-cb408c5f7d35 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:23.573139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c7338c77-6544-417b-994b-cb408c5f7d35 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:23.693911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c7338c77-6544-417b-994b-cb408c5f7d35 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:23.705070 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c7338c77-6544-417b-994b-cb408c5f7d35 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1216 microversion: 2.1 time: 0.136738 Oct 22 03:17:23.724104 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1489/2977] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:23 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:23.724104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c183872f-a8d5-43dd-9305-ba80899658f3 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:23.749015 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c183872f-a8d5-43dd-9305-ba80899658f3 tempest-FlavorsV2TestJSON-880984948 tempest-FlavorsV2TestJSON-880984948-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038544 Oct 22 03:17:23.750437 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1490/2978] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:17:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:23.756263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69cb3ccd-ef39-44d0-b708-496876deebd2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a291430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:23.846957 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69cb3ccd-ef39-44d0-b708-496876deebd2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7" status: 200 len: 1448 microversion: 2.1 time: 0.095101 Oct 22 03:17:23.848151 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1491/2979] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:23 2022] GET /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 => generated 1448 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:23.854359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33e8bf9f-bb1e-4e39-9930-9a28b3312108 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '.version_select at 0x7f0d1aca6ee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:23.886210 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33e8bf9f-bb1e-4e39-9930-9a28b3312108 tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889818454" status: 204 len: 0 microversion: 2.32 time: 0.036449 Oct 22 03:17:23.888185 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1492/2980] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:17:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889818454 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:17:23.897159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7c208b9-fe46-4ab7-8f34-da9eee8c5976 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a2d50d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:25.320776 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a7c208b9-fe46-4ab7-8f34-da9eee8c5976 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7" status: 204 len: 0 microversion: 2.1 time: 1.431075 Oct 22 03:17:25.321604 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1493/2981] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:23 2022] DELETE /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 => generated 0 bytes in 1432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:17:25.328153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:25.329178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:25.342636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:25.345470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:25.348179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:25.350333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:25.350848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:25.351880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:26.604281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:26.616281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:26.618140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:26.620506 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e3b9e11-06e8-40ea-9de8-5e1ae9bb50d5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1407 microversion: 2.20 time: 1.297487 Oct 22 03:17:26.633102 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1494/2982] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:25 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1407 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:26.646326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:26.646872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:26.665607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:26.666401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:26.667613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:26.669348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:26.670020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:26.670803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:27.101931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:27.115511 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-79637f35-b2aa-40cb-ab1c-c9f0802b4644 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1316 microversion: 2.1 time: 0.481279 Oct 22 03:17:27.135129 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1495/2983] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:26 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:27.150350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:27.151363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:27.169272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:27.171385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:27.177636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:27.179318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:27.180005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:27.180771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:27.261242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:17:27.505645 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fcb749f3-64e3-46c2-bd6c-bc7cef75d32b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 204 len: 0 microversion: 2.1 time: 0.359585 Oct 22 03:17:27.510176 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1496/2984] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:17:27 2022] DELETE /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:17:27.528081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8af5551b-3ea2-459a-aa3f-ca32995cc135 req-8aaac62e-9915-40c5-b16e-b2c005440620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fed450-5b11-447a-a5e9-e0e51183adc7", "name": "network-vif-unplugged", "status": "completed", "tag": "cdff561d-5650-4b7e-85be-5e84b989c594"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:27.557311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8af5551b-3ea2-459a-aa3f-ca32995cc135 req-8aaac62e-9915-40c5-b16e-b2c005440620 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:27.558097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8af5551b-3ea2-459a-aa3f-ca32995cc135 req-8aaac62e-9915-40c5-b16e-b2c005440620 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:27.558825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8af5551b-3ea2-459a-aa3f-ca32995cc135 req-8aaac62e-9915-40c5-b16e-b2c005440620 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:27.593121 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8af5551b-3ea2-459a-aa3f-ca32995cc135 req-8aaac62e-9915-40c5-b16e-b2c005440620 service nova] Creating event network-vif-unplugged:cdff561d-5650-4b7e-85be-5e84b989c594 for instance f0fed450-5b11-447a-a5e9-e0e51183adc7 on n-h1-862416-2 Oct 22 03:17:27.609278 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8af5551b-3ea2-459a-aa3f-ca32995cc135 req-8aaac62e-9915-40c5-b16e-b2c005440620 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097365 Oct 22 03:17:27.617090 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1497/2985] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:27.662745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:27.663914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:27.681304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:27.683555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:27.690239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:27.695974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:27.698902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:27.699521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:27.795240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:17:27.795729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:17:27.796130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:17:27.796588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:17:27.797005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:17:27.815680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:27.816182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:27.816659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:27.817393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:27.817905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:27.821542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:27.861453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Getting quotas for project 42016e2241264da88579fb9b9192087c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:17:27.875170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Getting quotas for user 0f85a274b68543fbbbc0a97d7cb6b8a6 and project 42016e2241264da88579fb9b9192087c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:17:28.141611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:28.153858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:28.158101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:28.159517 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01f9b43f-e874-4aa3-89e8-fe15e67d5bb2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1407 microversion: 2.20 time: 0.501074 Oct 22 03:17:28.177805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:17:28.180641 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1498/2986] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:27 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:28.182639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='244ba8cf-4002-41ef-8a6b-992625fcd1c1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='edc27dd9-848e-4403-9e67-18df8142aded',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40c29022-a064-4156-82cc-02368d57627e',volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:17:28.194979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1822855658", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "49c953fb-5979-4a50-be05-1edf628aca16"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:28.323760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] validate_networks() for [('49c953fb-5979-4a50-be05-1edf628aca16', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:17:28.927365 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a908af31-c45f-49b5-9779-5d3e10ae0d35 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.702450 Oct 22 03:17:28.928083 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1489/2987] 10.222.0.25 () {62 vars in 1189 bytes} [Sat Oct 22 03:17:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 7707 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:17:28.958930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:28.962628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:28.994285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:28.998395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:28.998893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:29.000762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:29.005224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:29.005865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:29.457657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:29.482933 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27f49bf7-038d-4342-b995-282cf9b462e0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1316 microversion: 2.1 time: 0.539108 Oct 22 03:17:29.487283 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1490/2988] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:28 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:29.508602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-83bca6e6-0d85-4557-ad80-036be3bba251 req-28954be3-c72e-4cc5-b8c0-7b278c3bba6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb680fc8-0d54-4742-b649-b82abbf4884e", "tag": "d85d1270-815c-43e2-aa88-748b7e3a2c72"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:29.520760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-83bca6e6-0d85-4557-ad80-036be3bba251 req-28954be3-c72e-4cc5-b8c0-7b278c3bba6c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:29.521492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-83bca6e6-0d85-4557-ad80-036be3bba251 req-28954be3-c72e-4cc5-b8c0-7b278c3bba6c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:29.522108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-83bca6e6-0d85-4557-ad80-036be3bba251 req-28954be3-c72e-4cc5-b8c0-7b278c3bba6c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:29.536164 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-83bca6e6-0d85-4557-ad80-036be3bba251 req-28954be3-c72e-4cc5-b8c0-7b278c3bba6c service nova] Creating event network-changed:d85d1270-815c-43e2-aa88-748b7e3a2c72 for instance eb680fc8-0d54-4742-b649-b82abbf4884e on n-h2-862416-2 Oct 22 03:17:29.545137 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-83bca6e6-0d85-4557-ad80-036be3bba251 req-28954be3-c72e-4cc5-b8c0-7b278c3bba6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054679 Oct 22 03:17:29.546500 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1491/2989] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:29.553137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f30b686b-6238-44ba-9ffc-ca8ca22ba985 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:29.554032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f30b686b-6238-44ba-9ffc-ca8ca22ba985 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:29.772368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f30b686b-6238-44ba-9ffc-ca8ca22ba985 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:29.796705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f30b686b-6238-44ba-9ffc-ca8ca22ba985 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:29.799888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f30b686b-6238-44ba-9ffc-ca8ca22ba985 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:29.803768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:17:29.804901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:17:29.805651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:17:29.806323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:17:29.806968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:17:29.822231 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f30b686b-6238-44ba-9ffc-ca8ca22ba985 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1285 microversion: 2.42 time: 0.271772 Oct 22 03:17:29.835756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:29.838295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:29.839503 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1492/2990] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:29 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:29.841002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:29.844573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:29.845330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:29.846801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:29.863107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:29.866779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:29.895559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:29.900752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:29.901548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:29.903533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:29.905090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:29.907518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:29.980428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:17:30.005420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for user 2468c1f92230450db3397e1f0e97b5e0 and project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:17:30.065171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:17:30.076843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:17:30.248221 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4714be51-e880-43a7-a655-954937eb77b3 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.066020 Oct 22 03:17:30.260354 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1499/2991] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:17:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:17:30.282798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-03eae245-c217-4d4f-9bb1-df5ee22190cd req-0b159d01-8982-4a15-8102-14aca4bc3802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e062bf-a697-4a20-aeda-260c6517a642", "tag": "5239c0bb-27a6-4165-99e2-b35fe986107c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:30.302613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-03eae245-c217-4d4f-9bb1-df5ee22190cd req-0b159d01-8982-4a15-8102-14aca4bc3802 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:30.303401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-03eae245-c217-4d4f-9bb1-df5ee22190cd req-0b159d01-8982-4a15-8102-14aca4bc3802 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:30.304137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-03eae245-c217-4d4f-9bb1-df5ee22190cd req-0b159d01-8982-4a15-8102-14aca4bc3802 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:30.321623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-03eae245-c217-4d4f-9bb1-df5ee22190cd req-0b159d01-8982-4a15-8102-14aca4bc3802 service nova] Creating event network-changed:5239c0bb-27a6-4165-99e2-b35fe986107c for instance 54e062bf-a697-4a20-aeda-260c6517a642 on n-h2-862416-2 Oct 22 03:17:30.331214 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-03eae245-c217-4d4f-9bb1-df5ee22190cd req-0b159d01-8982-4a15-8102-14aca4bc3802 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066128 Oct 22 03:17:30.333140 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1500/2992] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:30.346044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-829f9387-57b0-4e25-9a20-8b276e6d8a94 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:30.348780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-829f9387-57b0-4e25-9a20-8b276e6d8a94 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:30.558592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-829f9387-57b0-4e25-9a20-8b276e6d8a94 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:30.567013 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-829f9387-57b0-4e25-9a20-8b276e6d8a94 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1208 microversion: 2.1 time: 0.231748 Oct 22 03:17:30.582566 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1501/2993] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:30 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1208 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:30.589956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:30.593809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:30.603873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:30.607609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:30.608101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:30.608952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:30.609423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:30.610042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:30.968783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:30.980110 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44f4bd5c-bfd7-4de6-901f-e46c2c9ebd4d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1316 microversion: 2.1 time: 0.404901 Oct 22 03:17:30.981647 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1502/2994] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:30 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:30.987087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:30.988134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:30.995345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:30.996300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:30.998231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:30.999211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:30.999893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:31.000537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:31.071997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:31.083942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:31.085471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:31.086644 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-935df97a-0b56-4fa2-8de4-c055a5452be6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1519 microversion: 2.42 time: 0.103736 Oct 22 03:17:31.087399 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1503/2995] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:30 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1519 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:31.092822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-21953fb5-7465-4152-a54e-8aff53c02af3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a47df70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:31.160325 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-21953fb5-7465-4152-a54e-8aff53c02af3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/d8c754b5-a5ab-44d0-9971-b0d2a023aa4c" status: 200 len: 662 microversion: 2.1 time: 0.071359 Oct 22 03:17:31.160869 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1504/2996] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:31 2022] GET /compute/v2.1/images/d8c754b5-a5ab-44d0-9971-b0d2a023aa4c => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:31.176516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-207b7f80-9b52-43e3-8926-1d1fcf7dc1a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a8ae040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:31.237134 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-207b7f80-9b52-43e3-8926-1d1fcf7dc1a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/d8c754b5-a5ab-44d0-9971-b0d2a023aa4c" status: 200 len: 662 microversion: 2.1 time: 0.064695 Oct 22 03:17:31.247998 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1505/2997] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:31 2022] GET /compute/v2.1/images/d8c754b5-a5ab-44d0-9971-b0d2a023aa4c => generated 662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:31.427686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:31.438728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:31.440518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:31.443370 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3393e662-2e61-49a9-95ae-0466fd1fcddf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1407 microversion: 2.20 time: 1.598140 Oct 22 03:17:31.444846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1493/2998] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:29 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1407 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:31.593749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:31.597760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:31.607716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:31.610457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:31.611115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:31.612024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:31.614605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:31.615093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:31.687359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:31.696470 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eefb5c87-4f33-4a97-8e05-09b3fee3c591 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1204 microversion: 2.1 time: 0.107217 Oct 22 03:17:31.697560 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1506/2999] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:31 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1204 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:31.832684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a87a427b-080f-4f4d-8279-7a810fc0d49b req-bc757645-fee5-4d7b-bcd9-b6bf96fb380f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fed450-5b11-447a-a5e9-e0e51183adc7", "name": "network-vif-deleted", "tag": "cdff561d-5650-4b7e-85be-5e84b989c594"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:31.869463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a87a427b-080f-4f4d-8279-7a810fc0d49b req-bc757645-fee5-4d7b-bcd9-b6bf96fb380f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:31.869972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a87a427b-080f-4f4d-8279-7a810fc0d49b req-bc757645-fee5-4d7b-bcd9-b6bf96fb380f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:31.870423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a87a427b-080f-4f4d-8279-7a810fc0d49b req-bc757645-fee5-4d7b-bcd9-b6bf96fb380f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:31.910439 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a87a427b-080f-4f4d-8279-7a810fc0d49b req-bc757645-fee5-4d7b-bcd9-b6bf96fb380f service nova] Creating event network-vif-deleted:cdff561d-5650-4b7e-85be-5e84b989c594 for instance f0fed450-5b11-447a-a5e9-e0e51183adc7 on n-h1-862416-2 Oct 22 03:17:31.917223 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a87a427b-080f-4f4d-8279-7a810fc0d49b req-bc757645-fee5-4d7b-bcd9-b6bf96fb380f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088181 Oct 22 03:17:31.918997 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1494/3000] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:32.007463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:32.008546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:32.025907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:32.027408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:32.034991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:32.035893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:32.036482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:32.036997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:32.125511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:32.127376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:32.143879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:32.145562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:32.146431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:32.167012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:32.167946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:32.169056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:32.350701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:32.374410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:32.378633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:32.383732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15735c30-7a09-48d9-87d6-3532636760f0 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1583 microversion: 2.42 time: 0.269164 Oct 22 03:17:32.389873 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1495/3001] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:32 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1583 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:32.472315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:32.473623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:32.481390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:32.489218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:32.498187 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74aa3a9e-669b-45bf-a8ed-8d49d09b9471 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1316 microversion: 2.1 time: 0.496473 Oct 22 03:17:32.499184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:32.499646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:32.500470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:32.500937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:32.501330 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1507/3002] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:31 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:32.501454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:32.722288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:32.722910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:32.741146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:32.743707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:32.744916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:32.747133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:32.747761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:32.748198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:32.822924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:32.952268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:32.974208 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74476405-4d06-4990-9bcf-12b95fc1dcde tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1260 microversion: 2.1 time: 0.255393 Oct 22 03:17:32.990659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1508/3003] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:32 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:32.999974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-507424606", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e05de320-3bab-4c23-a4a6-0a3d411f4dd6"}], "block_device_mapping_v2": [{"uuid": "8c0da00e-6994-4a77-839e-85f900e83092", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:33.211027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] validate_networks() for [('e05de320-3bab-4c23-a4a6-0a3d411f4dd6', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:17:33.380826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:33.392192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:33.394242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:33.395609 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab9abfba-0fca-45c6-aaf5-416a5bcd2dec tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1407 microversion: 2.20 time: 0.929156 Oct 22 03:17:33.396780 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1496/3004] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:32 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1407 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:17:33.402071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b89a831-c34f-4f1c-b25c-81e425416cea tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19aa7b80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:33.456285 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b89a831-c34f-4f1c-b25c-81e425416cea tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/aa676023-2bb9-4a10-a38e-ebea284e5c12" status: 200 len: 662 microversion: 2.1 time: 0.057884 Oct 22 03:17:33.457153 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1497/3005] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:33 2022] GET /compute/v2.1/images/aa676023-2bb9-4a10-a38e-ebea284e5c12 => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:33.462490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:33.463445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:33.473510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:33.474145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:33.474660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:33.475383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:33.476293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:33.477025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:33.737741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:33.762387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:33.763940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:33.765149 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a8975c8-04b8-499b-99ea-5209a8bfe6a2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1593 microversion: 2.42 time: 0.306829 Oct 22 03:17:33.769668 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1498/3006] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:33 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1593 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:33.778061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-06f56e30-f3c7-4d08-ad67-432745d633ac tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d198de670>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:33.838902 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-06f56e30-f3c7-4d08-ad67-432745d633ac tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/aa676023-2bb9-4a10-a38e-ebea284e5c12" status: 200 len: 662 microversion: 2.1 time: 0.065089 Oct 22 03:17:33.840030 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1499/3007] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:33 2022] GET /compute/v2.1/images/aa676023-2bb9-4a10-a38e-ebea284e5c12 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:33.844699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:33.845523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:33.868456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:33.869241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:33.870030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:33.871133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:33.872645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:33.873323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:34.350799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:34.365589 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dc4f8937-357c-4d1b-bd9d-41c1f4554b49 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1316 microversion: 2.1 time: 0.520354 Oct 22 03:17:34.366532 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1500/3008] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:33 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:34.377063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:34.377985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:34.398128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:34.400446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:34.402410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:34.404668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:34.406858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:34.408598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:34.596531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:34.614099 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ceebb2a6-c303-42c3-8a14-0bca923f4144 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1266 microversion: 2.1 time: 0.246250 Oct 22 03:17:34.616161 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1501/3009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:34 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:34.641115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:34.642136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:34.649840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:34.650775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:34.651469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:34.652787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:34.653478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:34.654208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:34.950774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:17:34.951815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:17:34.953941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:17:34.954593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:17:34.960020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:17:34.982373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:34.984290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:34.986116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:34.988334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:34.989123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:34.990639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:35.042432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:17:35.049879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Getting quotas for user 92523f18567441589dba5548bb33eb9e and project 0ce9ee0e663b4740a49c5bb01f4d85d6. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:17:35.072539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:35.091542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:35.106393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:35.107912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:35.115217 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4d852350-733f-4874-9c1c-471d57489924 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1407 microversion: 2.20 time: 0.497671 Oct 22 03:17:35.119666 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1502/3010] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:34 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:35.127704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:35.132403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:35.146462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:35.146974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:35.147420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:35.148150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:35.148637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:35.149070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:35.198498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:17:35.200966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c0da00e-6994-4a77-839e-85f900e83092',volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:17:35.442112 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20fb863e-70b6-4f57-9b8d-e530bc1b8db3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.447078 Oct 22 03:17:35.452996 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1509/3011] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:17:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:17:35.465216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:35.465951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:35.502853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:35.504055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:35.505821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:35.509478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:35.511614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:35.515606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:36.133266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:36.152591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:36.154443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:36.155669 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-81c3efcb-29b1-4af8-bc2c-920e8640ca0a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1661 microversion: 2.42 time: 1.033152 Oct 22 03:17:36.182147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1503/3012] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:35 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1661 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:36.193894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13abc0ee-d508-4590-8b13-8fcafb19c9d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:36.197289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13abc0ee-d508-4590-8b13-8fcafb19c9d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:36.360641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-13abc0ee-d508-4590-8b13-8fcafb19c9d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:36.368811 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13abc0ee-d508-4590-8b13-8fcafb19c9d3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1052 microversion: 2.1 time: 0.185204 Oct 22 03:17:36.373356 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1504/3013] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:36 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1052 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:36.383649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff29b51f-f047-40d6-9bd0-c78a3de78be3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e53d5e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:36.481689 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff29b51f-f047-40d6-9bd0-c78a3de78be3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/f2a9c875-be55-42fd-9c0b-f5b4c94fe080" status: 200 len: 662 microversion: 2.1 time: 0.106036 Oct 22 03:17:36.486592 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1505/3014] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:36 2022] GET /compute/v2.1/images/f2a9c875-be55-42fd-9c0b-f5b4c94fe080 => generated 662 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:36.495977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:36.497116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:36.518203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:36.519269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:36.521103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:36.522031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:36.522679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:36.523270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:36.744392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:36.763693 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8dffef88-9761-42e2-8854-3ccc87fb0d0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1316 microversion: 2.1 time: 1.313555 Oct 22 03:17:36.764324 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1510/3015] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:35 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1316 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:36.772407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:36.793066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:36.800471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:36.802610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:36.803149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:36.805549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:36.806097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:36.812243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:36.853890 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] HTTP exception thrown: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Request method failure captured: Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e HTTP/1.1 Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU18SwWoOiVNwgr_FATYskWr0W9-oK4MMyO9-szLBDFzJensYa7GT8iVjDtLUUeoBmf8nQjTu3l7sAT8bKMRg3lBOLJeQFWJZUz_X0_kZejCEPTMBfDhP7hKUlR45LR4iMu53s7Fu-iP9c8DCq-gtI3opIUrk0W0PmP90ZzsQMWWy-4c Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.32 Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 37b44f72118d44569a1d524edcd3fbba Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b44f72118d44569a1d524edcd3fbba"}]}] Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 37b44f72118d44569a1d524edcd3fbba Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TaggedBootDevicesTest-1311972818-project Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 27c111294f5042d3a07812a8f7cd316e Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TaggedBootDevicesTest-1311972818-project Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '6e5ee4f0-59b4-4574-8707-d14317cd0d4e'} Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:17:36.862767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:36.867642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Returning 404 to user: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:17:36.869209 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d59f0015-acc8-4340-9539-b6631229511d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 404 len: 111 microversion: 2.32 time: 0.100565 Oct 22 03:17:36.869915 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1511/3016] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:17:36 2022] DELETE /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:17:36.885308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:36.886043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:36.895611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:36.908090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:36.911515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:36.914051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:36.917483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:36.918778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.247689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:37.258055 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5cd024a-2468-460a-aacc-c524886843a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1308 microversion: 2.1 time: 0.769936 Oct 22 03:17:37.263171 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1506/3017] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:36 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1308 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:37.268324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-226b0dc1-b845-4be9-bac1-8928959c2279 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19933670>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:37.329497 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-226b0dc1-b845-4be9-bac1-8928959c2279 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/f2a9c875-be55-42fd-9c0b-f5b4c94fe080" status: 200 len: 662 microversion: 2.1 time: 0.064976 Oct 22 03:17:37.330196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:37.330547 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1507/3018] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:37 2022] GET /compute/v2.1/images/f2a9c875-be55-42fd-9c0b-f5b4c94fe080 => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:37.335377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:37.335942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:37.343052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:37.345244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:37.347029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:37.347288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:37.349501 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2c5c641-9083-465f-81e8-858f017a9491 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1407 microversion: 2.20 time: 0.477627 Oct 22 03:17:37.350682 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1512/3019] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:36 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:37.355317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.357534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:37.357676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:37.358191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] [instance: 6e5ee4f0-59b4-4574-8707-d14317cd0d4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:37.358545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:37.359823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.366059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:37.366838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:37.367442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.368368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:37.368995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:37.369619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.388983 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] HTTP exception thrown: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Request method failure captured: Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e HTTP/1.1 Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU18SwWoOiVNwgr_FATYskWr0W9-oK4MMyO9-szLBDFzJensYa7GT8iVjDtLUUeoBmf8nQjTu3l7sAT8bKMRg3lBOLJeQFWJZUz_X0_kZejCEPTMBfDhP7hKUlR45LR4iMu53s7Fu-iP9c8DCq-gtI3opIUrk0W0PmP90ZzsQMWWy-4c Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.32 Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 37b44f72118d44569a1d524edcd3fbba Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37b44f72118d44569a1d524edcd3fbba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37b44f72118d44569a1d524edcd3fbba"}]}] Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 37b44f72118d44569a1d524edcd3fbba Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1311972818 Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TaggedBootDevicesTest-1311972818-project Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 27c111294f5042d3a07812a8f7cd316e Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TaggedBootDevicesTest-1311972818-project Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '6e5ee4f0-59b4-4574-8707-d14317cd0d4e'} Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:37.390842 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:17:37.395469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:37.395469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:17:37.395469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:17:37.395469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:17:37.395469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:17:37.395469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:17:37.395469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. Oct 22 03:17:37.395469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:17:37.398326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] Returning 404 to user: Instance 6e5ee4f0-59b4-4574-8707-d14317cd0d4e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:17:37.399428 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31e26494-1a4e-4150-af8e-33fb0163873d tempest-TaggedBootDevicesTest-1311972818 tempest-TaggedBootDevicesTest-1311972818-project] 10.222.0.25 "GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e" status: 404 len: 111 microversion: 2.32 time: 0.047696 Oct 22 03:17:37.400691 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1513/3020] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:37 2022] GET /compute/v2.1/servers/6e5ee4f0-59b4-4574-8707-d14317cd0d4e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:17:37.406852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:37.408293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:37.415909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:37.416880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:37.417731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.419060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:37.419709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:37.420328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.425904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:17:37.643122 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82249009-c256-465a-89a8-89f4f8f41c21 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 204 len: 0 microversion: 2.1 time: 0.311265 Oct 22 03:17:37.644042 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1508/3021] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:17:37 2022] DELETE /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:17:37.654741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:37.658557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:37.672676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:37.674441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:37.675666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.676541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:37.678563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:37.679099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:37.836467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:37.857484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:37.867513 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9fc43230-f70e-42e2-9189-b1379f96d250 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1158 microversion: 2.1 time: 0.221999 Oct 22 03:17:37.869170 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1509/3022] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:37 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1158 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:37.875653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-987621220", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:37.990602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:17:38.017335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:38.031189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:38.034916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:38.036579 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db5993fb-72f0-456c-8f03-ca014968b249 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1708 microversion: 2.42 time: 0.634527 Oct 22 03:17:38.037798 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1514/3023] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:37 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1708 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:38.044444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:38.045277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:38.056652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:38.057177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:38.059698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:38.061744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:38.062241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:38.063726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:38.331488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:38.348521 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef2d26c5-fe0b-4355-ae29-d37fabf96b70 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1553 microversion: 2.1 time: 0.309123 Oct 22 03:17:38.349499 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1515/3024] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:38 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1553 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:38.359373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:38.363122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:38.370855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:38.377871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:38.378642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:38.379406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:38.379884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:38.380349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:38.643077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:38.652135 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16c16bc9-ae3e-4137-b245-e2bc25b9a0ef tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1316 microversion: 2.1 time: 0.301380 Oct 22 03:17:38.653834 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1516/3025] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:38 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:38.658813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6092a04b-c4b4-4f7b-866b-70b130e1549e req-65fa87d1-8f09-47b3-aad4-909acef664f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e062bf-a697-4a20-aeda-260c6517a642", "name": "network-vif-plugged", "status": "completed", "tag": "5239c0bb-27a6-4165-99e2-b35fe986107c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:38.670917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6092a04b-c4b4-4f7b-866b-70b130e1549e req-65fa87d1-8f09-47b3-aad4-909acef664f9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:38.671665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6092a04b-c4b4-4f7b-866b-70b130e1549e req-65fa87d1-8f09-47b3-aad4-909acef664f9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:38.672301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6092a04b-c4b4-4f7b-866b-70b130e1549e req-65fa87d1-8f09-47b3-aad4-909acef664f9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:38.687416 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6092a04b-c4b4-4f7b-866b-70b130e1549e req-65fa87d1-8f09-47b3-aad4-909acef664f9 service nova] Creating event network-vif-plugged:5239c0bb-27a6-4165-99e2-b35fe986107c for instance 54e062bf-a697-4a20-aeda-260c6517a642 on n-h2-862416-2 Oct 22 03:17:38.696305 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6092a04b-c4b4-4f7b-866b-70b130e1549e req-65fa87d1-8f09-47b3-aad4-909acef664f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041036 Oct 22 03:17:38.703362 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1517/3026] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:38.709265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:38.710245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:38.719573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:38.720278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:38.720914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:38.722417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:38.723098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:38.723690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.032569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:17:39.034454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:17:39.045398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:17:39.047156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:17:39.048747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:17:39.061543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.063572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.078778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.084269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.085013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.085806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.128398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Getting quotas for project cdacaef127174c85b0bd5f08efe26952. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:17:39.142033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Getting quotas for user ae5ded1762834d11ab671efdb1d373b7 and project cdacaef127174c85b0bd5f08efe26952. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:17:39.161277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:39.174063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:17:39.174420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce235e73-66b1-4da2-a5fb-d9fa9e03688c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1308 microversion: 2.1 time: 0.469426 Oct 22 03:17:39.175106 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1518/3027] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:38 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:39.183338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:39.184252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:39.189582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:17:39.192910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.194259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.194976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.196289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.198127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.198912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.252429 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-22dffbf9-c553-4320-a60d-3145c2a4ccc3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381712 Oct 22 03:17:39.253856 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1510/3028] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:17:39.260518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-25979000-876f-45f1-9518-b88d9da53199 req-462c52e3-7d9c-4c97-9d93-342019f91195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b06bdd-b429-4660-b50e-6d2d40d3daf2", "tag": "d9629050-6517-484c-96f2-fe2f4be5ac6d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:39.282812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-25979000-876f-45f1-9518-b88d9da53199 req-462c52e3-7d9c-4c97-9d93-342019f91195 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.298863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-25979000-876f-45f1-9518-b88d9da53199 req-462c52e3-7d9c-4c97-9d93-342019f91195 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.299509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-25979000-876f-45f1-9518-b88d9da53199 req-462c52e3-7d9c-4c97-9d93-342019f91195 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.334766 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-25979000-876f-45f1-9518-b88d9da53199 req-462c52e3-7d9c-4c97-9d93-342019f91195 service nova] Creating event network-changed:d9629050-6517-484c-96f2-fe2f4be5ac6d for instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 on n-h1-862416-2 Oct 22 03:17:39.348674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-25979000-876f-45f1-9518-b88d9da53199 req-462c52e3-7d9c-4c97-9d93-342019f91195 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088901 Oct 22 03:17:39.352182 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1511/3029] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:39.363011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:39.363957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:39.373970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.375614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.376244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.377144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.377761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.378503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.589030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:39.607776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:39.614034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:39.615982 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c4a122e-1cca-451d-9ceb-d28aeb699653 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1407 microversion: 2.20 time: 0.437726 Oct 22 03:17:39.617767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:39.618878 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1519/3030] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:39 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:39.625474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:39.627705 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd17c2aa-d714-45ad-be33-b7f934864914 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1168 microversion: 2.1 time: 0.270450 Oct 22 03:17:39.631032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:39.635403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:39.637116 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1512/3031] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:39 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1168 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:39.651961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.653273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.656714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.658273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1954072480", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:39.660396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:39.661067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:39.670128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:39.790247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:17:40.235913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:40.250701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:40.252645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:40.256551 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a23ac94-f331-463c-be7f-1d0d1a009c7e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1755 microversion: 2.42 time: 0.636418 Oct 22 03:17:40.267194 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1520/3032] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:39 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1755 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:40.285112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:40.286708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:40.344493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:40.345870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:40.347586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:40.349026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:40.351962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:40.352634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.014279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:41.028187 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c9a31d1-e9d8-469e-b063-df1fb2a28a3b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1553 microversion: 2.1 time: 0.757103 Oct 22 03:17:41.041987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:17:41.043003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:17:41.043681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:17:41.044265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:17:41.044441 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1521/3033] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:40 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1553 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:41.045016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:17:41.049785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:41.063062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.063567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.070063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.071792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.072542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:41.073220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:41.077613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.084128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.100254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.101485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.103993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.106918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.109849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.112503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.156994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Getting quotas for project cdacaef127174c85b0bd5f08efe26952. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:17:41.175166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Getting quotas for user ae5ded1762834d11ab671efdb1d373b7 and project cdacaef127174c85b0bd5f08efe26952. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:17:41.203904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:17:41.206276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:17:41.316190 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ab03e07-c10b-486d-a73b-d5d760eee399 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677661 Oct 22 03:17:41.322843 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1513/3034] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:17:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:17:41.328993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:41.332827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:41.347654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.351632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.352375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.353283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.353985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.354697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.710137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:41.728187 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9eb5622f-61ea-4bac-8dc4-c007ac9fa7bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1506 microversion: 2.1 time: 0.674733 Oct 22 03:17:41.729245 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1522/3035] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:41 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:41.745926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:41.754911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:41.784931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.787097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.788383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.792009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.793061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.794430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.876546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:41.907165 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f56872b9-bdff-43e0-8ce7-b3be9560ca78 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1308 microversion: 2.1 time: 0.582878 Oct 22 03:17:41.908045 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1514/3036] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:41 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:41.925156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:41.940130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:41.956141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.964356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.965549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:41.984819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:41.986819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:41.987468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:42.619388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:42.634028 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e098573-cb64-40c8-a7e9-8c7678071745 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1210 microversion: 2.1 time: 0.900382 Oct 22 03:17:42.636371 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1523/3037] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:41 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1210 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:42.661408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-91dbca36-bfd8-4b89-8aaf-4bc81b4b307a req-bcd71641-b8b7-4f79-b59f-a8e748dbbf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb680fc8-0d54-4742-b649-b82abbf4884e", "name": "network-vif-plugged", "status": "completed", "tag": "d85d1270-815c-43e2-aa88-748b7e3a2c72"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:42.697528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-91dbca36-bfd8-4b89-8aaf-4bc81b4b307a req-bcd71641-b8b7-4f79-b59f-a8e748dbbf90 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:42.698286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-91dbca36-bfd8-4b89-8aaf-4bc81b4b307a req-bcd71641-b8b7-4f79-b59f-a8e748dbbf90 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:42.700042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-91dbca36-bfd8-4b89-8aaf-4bc81b4b307a req-bcd71641-b8b7-4f79-b59f-a8e748dbbf90 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:42.717702 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-91dbca36-bfd8-4b89-8aaf-4bc81b4b307a req-bcd71641-b8b7-4f79-b59f-a8e748dbbf90 service nova] Creating event network-vif-plugged:d85d1270-815c-43e2-aa88-748b7e3a2c72 for instance eb680fc8-0d54-4742-b649-b82abbf4884e on n-h2-862416-2 Oct 22 03:17:42.723723 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-91dbca36-bfd8-4b89-8aaf-4bc81b4b307a req-bcd71641-b8b7-4f79-b59f-a8e748dbbf90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085407 Oct 22 03:17:42.725052 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1524/3038] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:42.732837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:42.733826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:42.740925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:42.741714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:42.742338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:42.743212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:42.743824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:42.744498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:43.075712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:43.092812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:43.094800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:43.100443 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46ae1725-34e4-4dc6-93c3-5ba775c90472 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1407 microversion: 2.20 time: 1.187755 Oct 22 03:17:43.101643 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1515/3039] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:41 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1407 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:43.113469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:43.114367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:43.130549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:43.134218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:43.135196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:43.136172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:43.137086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:43.137873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:43.294646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:43.311277 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b8c31318-30fa-4613-9fa7-e580fe510f0e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1270 microversion: 2.1 time: 0.205548 Oct 22 03:17:43.311926 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1516/3040] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:43 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:43.323361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-eb9f734d-0a02-40b7-b800-f06310a2a9fa req-9a13b89c-b9bd-49c2-a22b-02092f2147e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f44efb-8009-4ced-ac1e-ff47e2ab67ef", "name": "network-vif-deleted", "tag": "e594792f-1cca-4659-8791-0acba7f6facc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:43.357238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eb9f734d-0a02-40b7-b800-f06310a2a9fa req-9a13b89c-b9bd-49c2-a22b-02092f2147e4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:43.358285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eb9f734d-0a02-40b7-b800-f06310a2a9fa req-9a13b89c-b9bd-49c2-a22b-02092f2147e4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:43.360750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eb9f734d-0a02-40b7-b800-f06310a2a9fa req-9a13b89c-b9bd-49c2-a22b-02092f2147e4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:43.394399 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-eb9f734d-0a02-40b7-b800-f06310a2a9fa req-9a13b89c-b9bd-49c2-a22b-02092f2147e4 service nova] Creating event network-vif-deleted:e594792f-1cca-4659-8791-0acba7f6facc for instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef on n-h1-862416-2 Oct 22 03:17:43.405457 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-eb9f734d-0a02-40b7-b800-f06310a2a9fa req-9a13b89c-b9bd-49c2-a22b-02092f2147e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091996 Oct 22 03:17:43.408675 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1517/3041] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:43.422749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:43.423458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:43.441120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:43.447355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:43.448722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:43.449887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:43.450700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:43.451312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:43.814424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:43.837917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:43.839925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:43.841926 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90f6a955-6bed-4d01-906e-72d33cc88647 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1802 microversion: 2.42 time: 1.115480 Oct 22 03:17:43.844115 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1525/3042] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:42 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1802 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:43.850308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:43.851126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:43.861224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:43.862153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:43.862739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:43.863595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:43.864192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:43.864820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:44.012554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:44.021861 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e236ee9-756f-49e6-9e4f-20a5c70d15e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.176325 Oct 22 03:17:44.028419 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1526/3043] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:43 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:44.041681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:44.043891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:44.060127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:44.060936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:44.061658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:44.062574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:44.063981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:44.064715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:44.414455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:44.428970 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-beaad2d3-cc03-45b3-8f00-ef5551da959e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1506 microversion: 2.1 time: 1.011919 Oct 22 03:17:44.429875 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1518/3044] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:43 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1506 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:44.438666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:44.449255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:44.466766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:44.467550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:44.468154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:44.469172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:44.469796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:44.470412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:44.595809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:44.604698 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa1c0aee-cf8c-461f-b55e-47c647daa896 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1308 microversion: 2.1 time: 0.574783 Oct 22 03:17:44.607101 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1527/3045] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:44 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1308 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:44.626219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:44.627177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:44.637947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:44.640837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:44.641461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:44.642439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:44.644966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:44.645579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:44.692983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:44.957010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:44.970583 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-732becfc-8456-4dde-9cc0-77ceee832396 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1210 microversion: 2.1 time: 0.539386 Oct 22 03:17:44.971179 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1519/3046] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:44 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1210 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:44.975905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:44.976547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:44.994764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:44.995254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:44.995687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:44.997641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:44.998290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:44.998867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.024310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:45.063127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=22 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:45.094946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:45.103129 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2c12a93-53b0-4114-8a3d-ccba8c4f5030 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1276 microversion: 2.1 time: 0.130886 Oct 22 03:17:45.116584 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1520/3047] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:44 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:45.123253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:45.127033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:45.145090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.145875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.146472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.147357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.147970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.148808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.256678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:45.274339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:45.277337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:17:45.277755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:45.278354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:17:45.279207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:17:45.279853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:17:45.280547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:17:45.280912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-79b2036e-6759-4b11-8da7-b47b74915a0b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1598 microversion: 2.20 time: 0.666460 Oct 22 03:17:45.296416 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1528/3048] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:44 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1598 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:45.310653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5f4d92c9-e12c-4d41-b12b-5d4348306ed2 req-5c661226-63c7-41bc-96a4-f83537014423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b06bdd-b429-4660-b50e-6d2d40d3daf2", "name": "network-vif-plugged", "status": "completed", "tag": "d9629050-6517-484c-96f2-fe2f4be5ac6d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:45.325613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5f4d92c9-e12c-4d41-b12b-5d4348306ed2 req-5c661226-63c7-41bc-96a4-f83537014423 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.327551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5f4d92c9-e12c-4d41-b12b-5d4348306ed2 req-5c661226-63c7-41bc-96a4-f83537014423 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.328018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5f4d92c9-e12c-4d41-b12b-5d4348306ed2 req-5c661226-63c7-41bc-96a4-f83537014423 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.350009 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5f4d92c9-e12c-4d41-b12b-5d4348306ed2 req-5c661226-63c7-41bc-96a4-f83537014423 service nova] Creating event network-vif-plugged:d9629050-6517-484c-96f2-fe2f4be5ac6d for instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 on n-h1-862416-2 Oct 22 03:17:45.357372 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5f4d92c9-e12c-4d41-b12b-5d4348306ed2 req-5c661226-63c7-41bc-96a4-f83537014423 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059152 Oct 22 03:17:45.359358 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1529/3049] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:45.368155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:45.369165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:45.378185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.379606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.380258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.381294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.382619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.383221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.385206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:45.404128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.405199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.406223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.407206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.407893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.410887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.493049 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fbb18474-36db-4551-9765-a31916e6e73f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "POST /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642/action" status: 202 len: 1108 microversion: 2.1 time: 0.374820 Oct 22 03:17:45.495657 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1521/3050] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:17:45 2022] POST /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642/action => generated 1108 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 03:17:45.519605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:45.520926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:45.530335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.531563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.532604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.533715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.534348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.535059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.785288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:45.813701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-23bc8629-7ad5-495f-957f-457d38ac6b58 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.298669 Oct 22 03:17:45.834652 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1522/3051] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:45 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:45.859016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:45.860705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:45.870750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.871697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.873900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:45.875722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:45.877342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:45.878989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:46.078728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:46.095477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:46.100776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:46.102211 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4f52e6c-7e20-4f21-96c6-cb71dd34f675 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1849 microversion: 2.42 time: 0.739937 Oct 22 03:17:46.106204 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1530/3052] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:45 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1849 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:46.125435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:46.126327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:46.133312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:46.137173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:46.137859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:46.139970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:46.142707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:46.143336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:46.183359 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1251eb73-d399-47ae-be58-eba01dc6c079 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.345005 Oct 22 03:17:46.184917 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1523/3053] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Oct 22 03:17:45 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-interface => generated 284 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:17:46.190403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:46.191487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:46.210734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:46.211915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:46.235789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:46.236716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:46.243850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:46.248864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:46.650632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:46.660606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f8f1bce-7da4-4848-870b-0e9e5ec14b89 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.550749 Oct 22 03:17:46.664443 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1531/3054] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:46 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:46.673192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:46.674963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:46.688061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:46.690058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:46.691847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:46.693047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:46.694222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:46.694812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:46.910105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:46.919157 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-899bc362-d766-48de-8c56-23649a148f5f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1210 microversion: 2.1 time: 0.253242 Oct 22 03:17:46.920696 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1532/3055] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:46 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1210 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:46.925757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:46.926735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:46.933762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:46.934509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:46.935112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:46.936011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:46.936866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:46.937468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.014591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:47.020456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:47.045449 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72dba154-b852-45c6-b7ec-73775e6677b7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1276 microversion: 2.1 time: 0.123184 Oct 22 03:17:47.046274 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c3e449b-bbd4-4907-a568-6eb90cfa6f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1308 microversion: 2.1 time: 0.857922 Oct 22 03:17:47.060232 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1533/3057] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:46 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:47.060592 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1524/3056] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:46 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1308 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:47.060704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e38afe06-71e8-4dd0-bbf6-817e61802edc req-fcad2ae8-416e-4936-b1f3-867e2eb7b7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7148fe4-73ad-4a88-bec8-4a2f3b8c048c", "tag": "e4a97d34-19eb-4cea-a921-73201896b2ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:47.064936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:47.067880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:47.074653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.078253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.079641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.080553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.081166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.081708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.083681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e38afe06-71e8-4dd0-bbf6-817e61802edc req-fcad2ae8-416e-4936-b1f3-867e2eb7b7a5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.084742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e38afe06-71e8-4dd0-bbf6-817e61802edc req-fcad2ae8-416e-4936-b1f3-867e2eb7b7a5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.086259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e38afe06-71e8-4dd0-bbf6-817e61802edc req-fcad2ae8-416e-4936-b1f3-867e2eb7b7a5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.110611 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e38afe06-71e8-4dd0-bbf6-817e61802edc req-fcad2ae8-416e-4936-b1f3-867e2eb7b7a5 service nova] Creating event network-changed:e4a97d34-19eb-4cea-a921-73201896b2ac for instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c on n-h1-862416-2 Oct 22 03:17:47.117130 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e38afe06-71e8-4dd0-bbf6-817e61802edc req-fcad2ae8-416e-4936-b1f3-867e2eb7b7a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067599 Oct 22 03:17:47.118296 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1534/3058] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:47.139203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:47.140169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:47.149867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.150434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.151048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.151774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.152797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.153297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.249748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:47.265236 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01d31a55-b8ec-4a1d-b19f-cd6a38b546e6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.214562 Oct 22 03:17:47.266426 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1525/3059] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:47 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:47.476865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:47.501238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:47.503937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:47.505468 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5853f65-1655-42d0-9276-0b61dd266e19 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1849 microversion: 2.42 time: 0.373607 Oct 22 03:17:47.517333 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1535/3060] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:47 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1849 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:47.700620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:47.702483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:47.722393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.726119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.726670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.727721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.731586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.732134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.944340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:47.945331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:47.957903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.963106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.970081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:47.971216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:47.971875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:47.972582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:48.201122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:48.216944 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-48dda6c8-a53d-495d-94dc-4e6b4ab067e1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.526190 Oct 22 03:17:48.217577 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1526/3061] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:47 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:48.237131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:48.243544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:48.255150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:48.256124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:48.258075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:48.267872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:48.268411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:48.269028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:48.397241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:48.408680 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75793d7b-5f69-4b42-a80b-97b13dea38df tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1210 microversion: 2.1 time: 0.468791 Oct 22 03:17:48.409995 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1536/3062] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:47 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1210 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:48.419055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:48.420249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:48.434004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:48.435004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:48.436195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:48.437572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:48.438358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:48.439804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:48.795457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:48.831628 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1f07f83-e40c-4e7e-9808-680340a7c17f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.420055 Oct 22 03:17:48.833017 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1537/3063] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:48 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:48.841330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:48.842428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:48.856920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:48.857674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:48.858347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:48.861731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:48.863318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:48.863905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.024759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:49.043587 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6c6b9ff-8c1a-4501-95f3-42169a9ef945 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.208228 Oct 22 03:17:49.045770 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1538/3064] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:48 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:49.055748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:49.057068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:49.065477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:49.067094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.067802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.069607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.071224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.071956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.072654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.075357 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-456be2ce-19f0-4863-995c-92b4e8918929 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 200 len: 1488 microversion: 2.1 time: 0.853855 Oct 22 03:17:49.081323 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1527/3065] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:48 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 1488 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:49.108029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-526779078"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:49.111100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:49.143275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.144218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.145718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.146723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.147515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.148678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.366985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:49.445603 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e09390d-f58e-4262-b546-994a50600a96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2/action" status: 202 len: 0 microversion: 2.1 time: 0.339617 Oct 22 03:17:49.451673 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1528/3066] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:17:49 2022] POST /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 22 03:17:49.465409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8bbcd7db-f930-41ef-8061-a47a2b730504 req-807059f5-34ab-4a13-b115-c35d6851e89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "tag": "68f3580a-51db-4299-85ac-3cbfb72ad4d5"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:49.491960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8bbcd7db-f930-41ef-8061-a47a2b730504 req-807059f5-34ab-4a13-b115-c35d6851e89b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.494486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8bbcd7db-f930-41ef-8061-a47a2b730504 req-807059f5-34ab-4a13-b115-c35d6851e89b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.495237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8bbcd7db-f930-41ef-8061-a47a2b730504 req-807059f5-34ab-4a13-b115-c35d6851e89b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.532844 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8bbcd7db-f930-41ef-8061-a47a2b730504 req-807059f5-34ab-4a13-b115-c35d6851e89b service nova] Creating event network-changed:68f3580a-51db-4299-85ac-3cbfb72ad4d5 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:17:49.546073 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8bbcd7db-f930-41ef-8061-a47a2b730504 req-807059f5-34ab-4a13-b115-c35d6851e89b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089130 Oct 22 03:17:49.550512 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1529/3067] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:49.563732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:49.564779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:49.572524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.573246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.573900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.574980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.575671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.576412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.843408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:49.860630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:49.862960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:49.866770 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08c661f3-ec29-4b74-8514-423033f2a0bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1849 microversion: 2.42 time: 0.817126 Oct 22 03:17:49.868866 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1539/3068] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:49 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1849 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:49.895966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:49.901908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:49.913511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.915407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.916879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:49.919255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:49.919953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:49.920858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:50.119450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:50.131019 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-569ea3ef-152a-42e7-bc12-ba1fa0f1fad3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1210 microversion: 2.1 time: 0.259790 Oct 22 03:17:50.132464 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1540/3069] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:49 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1210 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:50.134462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:50.137539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8e662585-4f73-4716-84c5-c31b217f90bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d19954e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:50.143193 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-430db3ec-a189-4a1e-8743-bdc4192ff7a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.587677 Oct 22 03:17:50.156056 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1530/3070] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:49 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:50.157616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9a4fcd45-9d16-4f66-97fd-08d427c7caa3 req-34ad715d-aa9d-4ad7-80e7-e8304ded95b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413d7cde-ec29-4239-968e-6524df522977", "tag": "790776fd-bbd7-4ed1-b035-1ab433bbea5c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:50.206578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9a4fcd45-9d16-4f66-97fd-08d427c7caa3 req-34ad715d-aa9d-4ad7-80e7-e8304ded95b3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:50.207068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9a4fcd45-9d16-4f66-97fd-08d427c7caa3 req-34ad715d-aa9d-4ad7-80e7-e8304ded95b3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:50.207496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9a4fcd45-9d16-4f66-97fd-08d427c7caa3 req-34ad715d-aa9d-4ad7-80e7-e8304ded95b3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:50.208390 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8e662585-4f73-4716-84c5-c31b217f90bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.074556 Oct 22 03:17:50.209328 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1541/3071] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:50 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:50.228287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:50.229716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:50.237859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:50.238696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:50.240475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:50.241293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:50.241840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:50.242351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:50.250045 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9a4fcd45-9d16-4f66-97fd-08d427c7caa3 req-34ad715d-aa9d-4ad7-80e7-e8304ded95b3 service nova] Creating event network-changed:790776fd-bbd7-4ed1-b035-1ab433bbea5c for instance 413d7cde-ec29-4239-968e-6524df522977 on n-h2-862416-2 Oct 22 03:17:50.262173 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9a4fcd45-9d16-4f66-97fd-08d427c7caa3 req-34ad715d-aa9d-4ad7-80e7-e8304ded95b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117112 Oct 22 03:17:50.262788 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1531/3072] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:50.267832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:50.289947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:50.298879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:50.299376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:50.299892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:50.301137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:50.301614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:50.302046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:50.430149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:50.439529 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-874b8b0a-7b7b-49e0-8c8b-e746fe2ad2f6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.175553 Oct 22 03:17:50.440131 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1532/3073] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:50 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:50.630076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:50.655805 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e548dd67-d183-4022-af9a-71339408ea32 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.434306 Oct 22 03:17:50.656940 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1542/3074] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:50 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:50.899483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:50.901235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:50.912769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:50.913724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:50.914390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:50.915616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:50.916560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:50.917494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.111121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:51.158604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:51.160034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:51.172274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.173074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.173848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.174999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.176261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.176652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.185542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=28 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:51.280758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:51.300803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:51.303116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:51.305516 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9a6145e-c0a2-40e7-afb9-f7eacfc2134f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1870 microversion: 2.42 time: 0.412201 Oct 22 03:17:51.307499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1533/3075] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:50 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1870 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:51.325967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:51.327237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:51.358202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.359871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.363408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.364362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.365636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.366391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:51.368569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.376483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-14e7177d-a444-4eac-9f8c-771d291e0c54 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1210 microversion: 2.1 time: 0.221583 Oct 22 03:17:51.388978 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1543/3076] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:51 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1210 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:51.391195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af37fa97-0148-47c3-8a5e-5e13d5ea01f4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d19954ca0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:51.448292 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af37fa97-0148-47c3-8a5e-5e13d5ea01f4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.063827 Oct 22 03:17:51.457925 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1544/3077] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:51 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:51.467534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:51.468147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:51.479893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.480634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.481092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.481911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.482365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.482888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.555643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:51.566362 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-22ca242b-46dd-4d72-8624-a2233b4f059b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.102799 Oct 22 03:17:51.576855 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1545/3078] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:51 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:51.591548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5f0715f1-8b1d-48b4-94f2-5d2ce81e5e32 req-6fa40951-7aa4-453e-96b1-53713f03ef36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb680fc8-0d54-4742-b649-b82abbf4884e", "tag": "d85d1270-815c-43e2-aa88-748b7e3a2c72"}, {"name": "network-changed", "server_uuid": "74de4a13-4c74-449e-97da-d93bc3215451", "tag": "12c5b67b-a6f5-4bf2-a486-6a04eed55ee9"}, {"name": "network-changed", "server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "tag": "6d3eca57-341f-44a5-8d5c-6b4ad5b49b6f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:51.608309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5f0715f1-8b1d-48b4-94f2-5d2ce81e5e32 req-6fa40951-7aa4-453e-96b1-53713f03ef36 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.608926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5f0715f1-8b1d-48b4-94f2-5d2ce81e5e32 req-6fa40951-7aa4-453e-96b1-53713f03ef36 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.609532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5f0715f1-8b1d-48b4-94f2-5d2ce81e5e32 req-6fa40951-7aa4-453e-96b1-53713f03ef36 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.626304 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5f0715f1-8b1d-48b4-94f2-5d2ce81e5e32 req-6fa40951-7aa4-453e-96b1-53713f03ef36 service nova] Creating event network-changed:d85d1270-815c-43e2-aa88-748b7e3a2c72 for instance eb680fc8-0d54-4742-b649-b82abbf4884e on n-h2-862416-2 Oct 22 03:17:51.627833 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5f0715f1-8b1d-48b4-94f2-5d2ce81e5e32 req-6fa40951-7aa4-453e-96b1-53713f03ef36 service nova] Creating event network-changed:12c5b67b-a6f5-4bf2-a486-6a04eed55ee9 for instance 74de4a13-4c74-449e-97da-d93bc3215451 on n-h1-862416-2 Oct 22 03:17:51.629024 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5f0715f1-8b1d-48b4-94f2-5d2ce81e5e32 req-6fa40951-7aa4-453e-96b1-53713f03ef36 service nova] Creating event network-changed:6d3eca57-341f-44a5-8d5c-6b4ad5b49b6f for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:17:51.640745 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5f0715f1-8b1d-48b4-94f2-5d2ce81e5e32 req-6fa40951-7aa4-453e-96b1-53713f03ef36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.062477 Oct 22 03:17:51.642240 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1546/3079] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:51.682353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:51.684222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:51.693510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.694366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.695161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:51.695783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.696835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:51.697524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:51.698177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:51.703108 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d7c36cd-95ca-41bc-9e94-84caed2b87c9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.392703 Oct 22 03:17:51.703697 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1534/3080] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:51 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:51.851165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:51.863595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3cc92a5a-107d-419c-a61c-b43956338fe9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.187046 Oct 22 03:17:51.864338 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1547/3081] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:51 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:52.339038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:52.340011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:52.347189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.347980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.348723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.349477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.350073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.350670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.400864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:52.401532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:52.410595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.411010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.411452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.412441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.413064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.413762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.591041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:52.602463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb220f7e-424d-4298-8bb4-661eab460241 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1210 microversion: 2.1 time: 0.205570 Oct 22 03:17:52.604713 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1548/3082] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:52 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1210 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:52.610043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8234ab7f-692b-452c-a8c1-2badf5c9e032 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a23d160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:52.660489 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8234ab7f-692b-452c-a8c1-2badf5c9e032 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.056326 Oct 22 03:17:52.661069 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1549/3083] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:52 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:52.665861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:52.667226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:52.674369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.675054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.675714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.676653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.677270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.677862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.703751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:52.737320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:52.750214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:52.752408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:52.753903 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1e747df4-a6b7-4b60-b225-ea8bb6890b5e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.419078 Oct 22 03:17:52.756912 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1535/3084] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:52 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:52.762517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:52.763384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:52.769770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.770529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.771183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.772099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.772785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.773397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.801135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:52.810461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dceafe25-85eb-4722-b4d7-c057d15b5c8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.148084 Oct 22 03:17:52.811525 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1550/3085] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:52 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:52.893032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:52.893767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:52.913331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.913937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.915406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:52.916893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:52.918852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:52.919539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:53.317277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:53.332430 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6cd1dfb0-7fa9-4709-8e40-4978d2bb5991 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.448820 Oct 22 03:17:53.348311 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1551/3086] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:52 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:53.634869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:53.635489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:53.646538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:53.649873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:53.650525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:53.651587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:53.653501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:53.656672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:53.688618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:53.731192 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-401a90a1-16f5-4e9b-b7e8-1485c949d700 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.969260 Oct 22 03:17:53.736560 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1536/3087] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:52 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:53.760655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b21ac895-f38f-4218-8d87-cb5ed9ddd1e4 req-ebbf74ae-276e-4908-b808-1d548d4e8cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "tag": "e509da0c-c791-4c06-ac72-984dbf14fd51"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:53.783511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b21ac895-f38f-4218-8d87-cb5ed9ddd1e4 req-ebbf74ae-276e-4908-b808-1d548d4e8cec service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:53.784144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b21ac895-f38f-4218-8d87-cb5ed9ddd1e4 req-ebbf74ae-276e-4908-b808-1d548d4e8cec service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:53.784700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b21ac895-f38f-4218-8d87-cb5ed9ddd1e4 req-ebbf74ae-276e-4908-b808-1d548d4e8cec service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:53.798098 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b21ac895-f38f-4218-8d87-cb5ed9ddd1e4 req-ebbf74ae-276e-4908-b808-1d548d4e8cec service nova] Creating event network-changed:e509da0c-c791-4c06-ac72-984dbf14fd51 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:17:53.804332 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b21ac895-f38f-4218-8d87-cb5ed9ddd1e4 req-ebbf74ae-276e-4908-b808-1d548d4e8cec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060370 Oct 22 03:17:53.806649 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1537/3088] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:53.837094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5db95665-7902-48c3-beab-5704f25020bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1993db80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:53.879795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:53.891151 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c86a4187-6bc7-421f-8d32-da48fbb561c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1210 microversion: 2.1 time: 0.264308 Oct 22 03:17:53.900032 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5db95665-7902-48c3-beab-5704f25020bd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.091519 Oct 22 03:17:53.900982 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1538/3089] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:53 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:53.909304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:53.912888 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1552/3090] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:53 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1210 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:53.914963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:53.919605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:53.920614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:53.928421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:53.929488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:53.930167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:53.930582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:53.931080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:53.931662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:53.931800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:53.932576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:53.933032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:53.934106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:53.935185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:53.937605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:54.032833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:54.044144 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fccb6913-a92a-4c17-832d-6be074fa15e0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.128878 Oct 22 03:17:54.045726 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1553/3091] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:53 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:54.366160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:54.367052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:54.389258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:54.390702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:54.393306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:54.396307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:54.397026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:54.397778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:54.734930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:54.763547 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1b7f114-195b-4e00-87bb-7a2aa014809f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.402644 Oct 22 03:17:54.764835 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1554/3092] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:54 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:54.776785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:54.783362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:54.817966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:54.819045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:54.819511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:54.820271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:54.820744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:54.821179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:54.875817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:54.885487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:54.887055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:54.900739 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65bd90b3-6d95-45dc-8f79-86111dc73eaf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.998366 Oct 22 03:17:54.901351 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1539/3093] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:53 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:54.925759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1d6dd8a-4389-46ee-bcd9-15fc560bed42 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1988d670>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:54.976126 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1d6dd8a-4389-46ee-bcd9-15fc560bed42 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.054668 Oct 22 03:17:54.977018 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1540/3094] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:54 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:54.990753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:54.991608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:55.000372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:55.001090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:55.001682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:55.002564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:55.003160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:55.003765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:55.119713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:55.131576 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb6f6ef5-2dbd-41aa-bdb1-0caf607e8574 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.365435 Oct 22 03:17:55.141851 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1555/3095] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:54 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:55.154842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:55.155785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:55.162745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:55.163608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:55.164312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:55.165258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:55.165981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:55.166946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:55.285403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:55.294997 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6def3357-8cb8-4b52-85ba-e0a9ffa360bd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.150626 Oct 22 03:17:55.296191 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1556/3096] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:55 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:55.688884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:55.720566 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a56ceaea-3fa8-4bd8-96b4-fda5db37c935 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.742191 Oct 22 03:17:55.744821 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1541/3097] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:54 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:55.789202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:55.790163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:55.802731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:55.803379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:55.803922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:55.804767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:55.806720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:55.816613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:55.933154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:55.934068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:55.946763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:55.948746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:55.950484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:55.952617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:55.957271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:55.958068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:56.106938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:56.127647 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d46357e-94be-4bcc-a210-3e8dbb9ff021 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.342396 Oct 22 03:17:56.129114 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1557/3098] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:55 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:56.134136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b0724c6-04c3-48d6-af19-8284374f48c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a291d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:56.186864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b0724c6-04c3-48d6-af19-8284374f48c4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.056410 Oct 22 03:17:56.187827 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1558/3099] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:56 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:56.197381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:56.200680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:56.213781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:56.214282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:56.215746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:56.216717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:56.217320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:56.217762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:56.481190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:56.495515 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abbf46f6-c6ab-4769-9c93-8eaa65a60f0f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.305858 Oct 22 03:17:56.521873 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1559/3100] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:56 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:56.527770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:56.528698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:56.544049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:56.544743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:56.545198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:56.545912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:56.546375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:56.546805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:56.676669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:56.682329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:56.693621 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5218b2bc-37c5-4334-a01b-700a7bc0c1d6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.170630 Oct 22 03:17:56.694594 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1560/3101] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:56 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:56.698197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:56.702802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:56.709701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d7d8bcb2-8361-4eb1-ab91-9d5bf7c93154 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.780471 Oct 22 03:17:56.710812 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1542/3102] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:55 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:17:56.710942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-aeae64ed-5771-4af7-8ccb-7c0b61b6e12b req-44c7d934-6dfd-4f42-a50b-845af39428a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "tag": "d5499ec1-d470-43a9-917f-7d60133064b3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:56.717042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:56.726510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aeae64ed-5771-4af7-8ccb-7c0b61b6e12b req-44c7d934-6dfd-4f42-a50b-845af39428a7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:56.726994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aeae64ed-5771-4af7-8ccb-7c0b61b6e12b req-44c7d934-6dfd-4f42-a50b-845af39428a7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:56.727429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aeae64ed-5771-4af7-8ccb-7c0b61b6e12b req-44c7d934-6dfd-4f42-a50b-845af39428a7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:56.759224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:56.760237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:56.762822 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-aeae64ed-5771-4af7-8ccb-7c0b61b6e12b req-44c7d934-6dfd-4f42-a50b-845af39428a7 service nova] Creating event network-changed:d5499ec1-d470-43a9-917f-7d60133064b3 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:17:56.768644 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-aeae64ed-5771-4af7-8ccb-7c0b61b6e12b req-44c7d934-6dfd-4f42-a50b-845af39428a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072757 Oct 22 03:17:56.771850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:56.774550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:56.775197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:56.776111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:56.776755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:56.779155 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1561/3103] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:56.779831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.064834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0cf7775f-ccac-4d88-881d-f012ad199d35 req-e7a470cd-6773-4807-9f61-8719d709f4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b06bdd-b429-4660-b50e-6d2d40d3daf2", "name": "network-vif-plugged", "status": "completed", "tag": "d9629050-6517-484c-96f2-fe2f4be5ac6d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:57.092501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0cf7775f-ccac-4d88-881d-f012ad199d35 req-e7a470cd-6773-4807-9f61-8719d709f4da service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.093202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0cf7775f-ccac-4d88-881d-f012ad199d35 req-e7a470cd-6773-4807-9f61-8719d709f4da service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.093669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0cf7775f-ccac-4d88-881d-f012ad199d35 req-e7a470cd-6773-4807-9f61-8719d709f4da service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.114962 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0cf7775f-ccac-4d88-881d-f012ad199d35 req-e7a470cd-6773-4807-9f61-8719d709f4da service nova] Creating event network-vif-plugged:d9629050-6517-484c-96f2-fe2f4be5ac6d for instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 on n-h1-862416-2 Oct 22 03:17:57.120527 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0cf7775f-ccac-4d88-881d-f012ad199d35 req-e7a470cd-6773-4807-9f61-8719d709f4da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062196 Oct 22 03:17:57.121831 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1562/3104] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:17:57.153487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:57.155261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:57.163958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.164831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.165338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.166059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.166517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.166945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.339609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:57.359087 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c13105ea-a43c-42eb-9c41-ed51382a2419 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.599162 Oct 22 03:17:57.379536 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1543/3105] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:56 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:17:57.393506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ecc70440-494c-44d8-9411-90e41111fc56 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1986bb80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:57.409557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:57.419408 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-84218206-1ab6-4865-8789-46dfaba324b4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.271238 Oct 22 03:17:57.438339 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1563/3106] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:57 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:57.489712 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ecc70440-494c-44d8-9411-90e41111fc56 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.108588 Oct 22 03:17:57.499053 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1544/3107] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:57 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:57.528554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:57.529225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:57.546370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.547915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.547915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.548092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.548507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.549293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.728831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:57.729901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:57.746818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.747566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.748236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.749168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.749935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.750538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.769819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:57.780647 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-475b3624-3a69-4882-b822-dd85ab0b40c2 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.257181 Oct 22 03:17:57.801495 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1564/3108] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:57 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:57.806932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:57.809675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:57.817502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.818105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.818620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.819397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:57.819929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:57.820837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:57.898082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:57.912527 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30fb25e0-60e1-4542-baca-f9eaf7f19a9d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.187596 Oct 22 03:17:57.913244 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1545/3109] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:57 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:58.243577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:58.298515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:58.312519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:58.320912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e994a7d-4265-40ad-a228-b73d05a22843 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.516453 Oct 22 03:17:58.324556 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1565/3110] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:57 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:58.383054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:58.383617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:58.394851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:58.398607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:58.401230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:58.405130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:58.407822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:58.408496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:58.445522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:58.446405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:58.461630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:58.463169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:58.463742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:58.467026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:58.468127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:58.469751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:58.787386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:58.800476 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-61fbb263-0843-415a-9909-7221ed9626bd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.359830 Oct 22 03:17:58.819633 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1566/3111] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:58 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:58.830406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-17a37022-2b54-439e-b6f3-a3fc70c7cbd2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a1e3820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:58.912274 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-17a37022-2b54-439e-b6f3-a3fc70c7cbd2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.091094 Oct 22 03:17:58.921010 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1567/3112] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:58 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:58.926424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:58.927051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:58.942424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:58.942938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:58.943388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:58.944103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:58.944601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:58.945035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.134576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:59.147020 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79dbb49b-c848-47a8-b6f2-231b65cd0de3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.767837 Oct 22 03:17:59.162968 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1546/3113] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:58 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:59.171677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:59.172635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:59.178947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:59.179718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:59.180422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.181389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:59.182053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:59.182687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.199998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:59.209965 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d77957b6-02be-4626-891d-893d926ae4bc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.287759 Oct 22 03:17:59.210563 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1568/3114] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:58 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:59.215799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-dc4c1619-05e4-4391-8ce8-615bed257809 req-bb00ecab-50ca-489d-901c-92099e53d6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "tag": "43dc5922-98fe-4209-b3a5-149d285766a6"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:59.226577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc4c1619-05e4-4391-8ce8-615bed257809 req-bb00ecab-50ca-489d-901c-92099e53d6d5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:59.227065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc4c1619-05e4-4391-8ce8-615bed257809 req-bb00ecab-50ca-489d-901c-92099e53d6d5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:59.227501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dc4c1619-05e4-4391-8ce8-615bed257809 req-bb00ecab-50ca-489d-901c-92099e53d6d5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.246048 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-dc4c1619-05e4-4391-8ce8-615bed257809 req-bb00ecab-50ca-489d-901c-92099e53d6d5 service nova] Creating event network-changed:43dc5922-98fe-4209-b3a5-149d285766a6 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:17:59.254677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-dc4c1619-05e4-4391-8ce8-615bed257809 req-bb00ecab-50ca-489d-901c-92099e53d6d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042748 Oct 22 03:17:59.255590 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1569/3115] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:59.262665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-522a5371-7558-4202-bcc5-3d4c6c94e4ff req-36700bdd-be05-46b9-86f0-51ea5f9cfdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413d7cde-ec29-4239-968e-6524df522977", "name": "network-vif-plugged", "status": "completed", "tag": "790776fd-bbd7-4ed1-b035-1ab433bbea5c"}, {"server_uuid": "74de4a13-4c74-449e-97da-d93bc3215451", "name": "network-vif-plugged", "status": "completed", "tag": "12c5b67b-a6f5-4bf2-a486-6a04eed55ee9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:17:59.275830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-522a5371-7558-4202-bcc5-3d4c6c94e4ff req-36700bdd-be05-46b9-86f0-51ea5f9cfdf6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:59.276377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-522a5371-7558-4202-bcc5-3d4c6c94e4ff req-36700bdd-be05-46b9-86f0-51ea5f9cfdf6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:59.276797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-522a5371-7558-4202-bcc5-3d4c6c94e4ff req-36700bdd-be05-46b9-86f0-51ea5f9cfdf6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.296880 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-522a5371-7558-4202-bcc5-3d4c6c94e4ff req-36700bdd-be05-46b9-86f0-51ea5f9cfdf6 service nova] Creating event network-vif-plugged:790776fd-bbd7-4ed1-b035-1ab433bbea5c for instance 413d7cde-ec29-4239-968e-6524df522977 on n-h2-862416-2 Oct 22 03:17:59.297746 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-522a5371-7558-4202-bcc5-3d4c6c94e4ff req-36700bdd-be05-46b9-86f0-51ea5f9cfdf6 service nova] Creating event network-vif-plugged:12c5b67b-a6f5-4bf2-a486-6a04eed55ee9 for instance 74de4a13-4c74-449e-97da-d93bc3215451 on n-h1-862416-2 Oct 22 03:17:59.310444 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-522a5371-7558-4202-bcc5-3d4c6c94e4ff req-36700bdd-be05-46b9-86f0-51ea5f9cfdf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053055 Oct 22 03:17:59.312426 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1570/3116] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:17:59.315649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:59.324776 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-48de3257-310f-4a44-bf7d-72c6a7f12a6e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.157240 Oct 22 03:17:59.329116 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1547/3117] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:59 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:17:59.369836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:59.370644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:59.381111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:59.381613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:59.382060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.387446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:59.388147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:59.389620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.429052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:17:59.680182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:59.693882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:59.696571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:17:59.697917 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f7538a13-3572-43af-a5cb-b365a95e7df1 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.347504 Oct 22 03:17:59.714191 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1571/3118] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:17:59 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:17:59.826506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:59.827707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:17:59.848399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:59.849215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:59.849931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.850904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:17:59.851575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:17:59.852244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:17:59.929278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f56e25a-7f40-4bda-ad24-86a6f06b3624 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a05a160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:17:59.985138 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f56e25a-7f40-4bda-ad24-86a6f06b3624 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.060028 Oct 22 03:17:59.993616 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1572/3119] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:17:59 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:00.172627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:00.176638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:00.177258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:00.180127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2546c9e-08ec-4105-961a-1639ced809d7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.358436 Oct 22 03:18:00.208495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:00.208495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:00.208495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:00.208495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:00.208495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:00.208495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:00.210599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1548/3120] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:17:59 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:00.238189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:00.239145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:00.248137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:00.249552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:00.250269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:00.253415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:00.254111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:00.255837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:00.290876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:00.426043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:00.437624 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ea5adaf-559d-4d44-ac63-f09ee0f8a6f2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.267340 Oct 22 03:18:00.442705 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1573/3121] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:00 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:00.453090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:00.459996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:00.468201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:00.470405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:00.473750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:00.474841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:00.476375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:00.479284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:00.589427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:00.617456 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b667a8b-c754-47d9-abcc-5c13f3a7de67 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.383707 Oct 22 03:18:00.618984 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1549/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:00 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:00.642297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:00.655162 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-82890cb3-c286-4640-90bc-9ca1649cc0f2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1346 microversion: 2.1 time: 0.211006 Oct 22 03:18:00.670595 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1574/3123] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:00 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1346 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:00.731339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:00.732387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:00.739171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:00.739954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:00.740640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:00.741578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:00.742262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:00.742915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.002674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25a695a9-ff61-4fcc-904d-54229064838b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a01c8b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:01.015459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:01.031606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:01.033387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:01.034560 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5526288-68e5-4ced-b57e-d92df873d1d9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.308427 Oct 22 03:18:01.035131 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1550/3124] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:00 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:01.062506 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25a695a9-ff61-4fcc-904d-54229064838b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.065074 Oct 22 03:18:01.063510 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1575/3125] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:00 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:01.221871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:01.222923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:01.238355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.244431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.245191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.246733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.248615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.249879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.309817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e7da53ac-de40-48f8-be04-2700269b15bf req-d88f9a92-088d-4ee3-8da8-cd9f7cfe3da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "tag": "1803c5cf-d162-456c-9d47-fbf742cc2117"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:01.357957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e7da53ac-de40-48f8-be04-2700269b15bf req-d88f9a92-088d-4ee3-8da8-cd9f7cfe3da1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.360881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e7da53ac-de40-48f8-be04-2700269b15bf req-d88f9a92-088d-4ee3-8da8-cd9f7cfe3da1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.366116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e7da53ac-de40-48f8-be04-2700269b15bf req-d88f9a92-088d-4ee3-8da8-cd9f7cfe3da1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.414463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e7da53ac-de40-48f8-be04-2700269b15bf req-d88f9a92-088d-4ee3-8da8-cd9f7cfe3da1 service nova] Creating event network-changed:1803c5cf-d162-456c-9d47-fbf742cc2117 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:01.425915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e7da53ac-de40-48f8-be04-2700269b15bf req-d88f9a92-088d-4ee3-8da8-cd9f7cfe3da1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122543 Oct 22 03:18:01.432653 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1576/3126] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:18:01.464072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:01.465982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:01.487544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.489721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.492456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.493302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.495685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.501855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.809322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:01.820389 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25a6241d-d8db-45fe-88a8-e1e1474d6958 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.360721 Oct 22 03:18:01.821113 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1577/3127] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:01 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:01.831282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:01.831902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:01.848588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.852651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.853142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.854036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.854513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.854944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.864739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:01.873876 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3f70d13-bbbd-4430-9444-4e0977dac33c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1318 microversion: 2.1 time: 0.655883 Oct 22 03:18:01.874986 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1551/3128] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:01 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:01.879634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:01.880518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:01.887940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.888751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.889402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.890329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.890992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.891612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.944092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:01.944943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:01.945577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:01.946187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lazy-loading 'fault' on Instance uuid c9f44efb-8009-4ced-ac1e-ff47e2ab67ef {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:18:02.123848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:02.132810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-146ebd03-d41c-44d9-ba96-32f0968e685c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.310848 Oct 22 03:18:02.155923 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1578/3129] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:01 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:02.167200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:02.168499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:02.186555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:02.187051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:02.187492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:02.188633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:02.189092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:02.189524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:02.205656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:02.229659 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c40a08ca-7360-42dd-a7b3-d1b4e5201258 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 200 len: 1351 microversion: 2.1 time: 0.352721 Oct 22 03:18:02.231758 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1552/3130] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:01 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 1351 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:02.249290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7df0c111-1baa-4a55-9fc2-d570eb508f11 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d199335e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:02.401231 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7df0c111-1baa-4a55-9fc2-d570eb508f11 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.163667 Oct 22 03:18:02.409890 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1553/3131] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:02 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:02.634781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:02.650822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:02.654489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:02.656031 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a7be560-3cdf-4873-8782-00c443b3a234 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.492818 Oct 22 03:18:02.659249 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1579/3132] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:02 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:02.847957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:02.848858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:02.862750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:02.864248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:02.865347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:02.866250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:02.867585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:02.868244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:02.908559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:02.909220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:02.929483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:02.932399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:02.944648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:02.945395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:02.951900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:02.952385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.195288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:03.205101 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d40b2556-557a-4a92-917d-b8f488d10536 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1467 microversion: 2.1 time: 0.308071 Oct 22 03:18:03.206262 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1580/3133] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:02 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1467 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:03.211833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:03.212844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:03.220043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.221259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.222273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.223659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.224335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.224929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.402140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:03.407924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:03.411671 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57164dfd-6b41-4669-a54d-96107f7bc97c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.204161 Oct 22 03:18:03.423927 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1581/3134] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:03 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:03.424592 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7b899c8f-5494-4c03-ad55-f81e8818ec2b tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.577886 Oct 22 03:18:03.425201 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1554/3135] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:02 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:03.442506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:03.443657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:03.444001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:03.444655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:03.459604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.460540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.461244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.462255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.462608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.463057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.463684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.463801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.464252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.465377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.465643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.467011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.504320 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef HTTP/1.1 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'c9f44efb-8009-4ced-ac1e-ff47e2ab67ef'} Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:18:03.506530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:03.513439 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:03.513439 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:18:03.513439 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:18:03.513439 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:18:03.513439 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:18:03.513439 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:03.513439 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:03.515732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:18:03.517367 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c8a741d3-0f88-4d5e-862f-b3392df86b28 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 404 len: 111 microversion: 2.1 time: 0.088063 Oct 22 03:18:03.518497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1555/3136] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:03 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:18:03.524449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a5deab6-0a97-4d9f-a6eb-66fd20e73d02 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1e4b30d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:03.593869 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a5deab6-0a97-4d9f-a6eb-66fd20e73d02 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.072790 Oct 22 03:18:03.595000 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1556/3137] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:03 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:03.601928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-93956cd8-5099-4847-933e-14cd34484a86 req-af734b65-4375-40ec-be83-d354f6e9a1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "tag": "e8806837-4020-40fd-8dd1-cf247a8a5b36"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:03.614853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93956cd8-5099-4847-933e-14cd34484a86 req-af734b65-4375-40ec-be83-d354f6e9a1da service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.615690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93956cd8-5099-4847-933e-14cd34484a86 req-af734b65-4375-40ec-be83-d354f6e9a1da service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.616908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93956cd8-5099-4847-933e-14cd34484a86 req-af734b65-4375-40ec-be83-d354f6e9a1da service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.635158 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-93956cd8-5099-4847-933e-14cd34484a86 req-af734b65-4375-40ec-be83-d354f6e9a1da service nova] Creating event network-changed:e8806837-4020-40fd-8dd1-cf247a8a5b36 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:03.649050 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-93956cd8-5099-4847-933e-14cd34484a86 req-af734b65-4375-40ec-be83-d354f6e9a1da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050272 Oct 22 03:18:03.649798 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1557/3138] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:03.693864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:03.694996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:03.711033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:03.711998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.711998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.713306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.716586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.717451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.721804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.725327 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ef20e4f-2241-4987-8ce9-be59a5a69355 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 200 len: 1467 microversion: 2.1 time: 0.300183 Oct 22 03:18:03.726967 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1582/3139] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:03 2022] GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 1467 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:03.763092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-620290517"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:03.763092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:03.770489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.770969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.771427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:03.772176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:03.774158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:03.774807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:04.103934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:04.115239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:04.119662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:04.125340 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9861cbab-d3ec-45e7-9e84-61e89993fb45 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.438094 Oct 22 03:18:04.128116 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1558/3140] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:03 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:18:04.133532 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f33697f7-09d9-4442-94a3-344b51c4ceca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "POST /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977/action" status: 202 len: 0 microversion: 2.1 time: 0.386909 Oct 22 03:18:04.134840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:04.137883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1583/3141] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:18:03 2022] POST /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 22 03:18:04.143270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:04.155376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:04.157921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:04.159335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:04.159952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:04.160878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:04.161494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:04.162081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:04.164009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc45d0c7-b2d2-452d-af09-223b35e54990 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e5db280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:04.212602 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef/os-volume_attachments HTTP/1.1 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': 'c9f44efb-8009-4ced-ac1e-ff47e2ab67ef'} Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:18:04.219407 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:18:04.224080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:18:04.226689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:18:04.229817 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-67bef6da-57d4-453a-9f8a-11487298d771 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.100514 Oct 22 03:18:04.233481 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1559/3142] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:18:04 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef/os-volume_attachments => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:18:04.270831 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc45d0c7-b2d2-452d-af09-223b35e54990 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.114117 Oct 22 03:18:04.273414 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1584/3143] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:04 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:04.437767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:04.438301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:04.447332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:04.448922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:04.449827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:04.454978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:04.457168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:04.458917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:04.462281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:04.465831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:04.469841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:04.470365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:04.471849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:04.472675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:04.473140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:04.473582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:04.688477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:04.699591 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a4e8e3e-b059-4e47-8bda-0117369a6ad2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.254903 Oct 22 03:18:04.717302 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1585/3144] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:04 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:04.722378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1057088499", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "636a4e0f-2dc3-4c83-88d5-b5568cafac2d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:04.790829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] validate_networks() for [('636a4e0f-2dc3-4c83-88d5-b5568cafac2d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:18:04.999940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:05.009354 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd127c81-82d8-40af-8a76-307f4957d988 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.575665 Oct 22 03:18:05.039451 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1560/3145] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:04 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:05.044847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a9e0e3b-9e19-45c1-b0fe-14794cc6bd6d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a0f9940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:05.151159 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a9e0e3b-9e19-45c1-b0fe-14794cc6bd6d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.110128 Oct 22 03:18:05.158807 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1561/3146] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:05 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:05.164354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:05.169526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:05.177658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:05.178577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:05.179281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:05.180277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:05.180980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:05.181642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:05.400922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:18:05.402814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:18:05.404350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:18:05.404991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:18:05.405650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:18:05.460280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:05.463752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:05.465105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:05.483597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:05.484447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:05.486391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:05.530275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:05.541042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:18:05.549137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:05.555407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:05.556674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a40dd42f-93e5-4d01-8150-f47fa281f300 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.396487 Oct 22 03:18:05.560114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for user 7bd4c44f32a04da48b34c9c888f36fa6 and project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:18:05.588028 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1562/3147] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:05 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:05.591474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:18:05.594118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 9622909e-5004-46d0-975d-c3643aec6b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:18:05.595223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de09830a-68ff-4355-a144-231fcc83737b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a0f94c0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:05.689662 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-de09830a-68ff-4355-a144-231fcc83737b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.100358 Oct 22 03:18:05.692441 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1563/3148] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:05 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:05.719046 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-764f16c8-e3b0-44c5-b452-46dae7fcfe32 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998231 Oct 22 03:18:05.726889 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1586/3149] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:18:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:18:05.732817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:05.733743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:05.734379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8edec3d3-b424-4852-bddd-1ea003c9b6fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:05.737329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8edec3d3-b424-4852-bddd-1ea003c9b6fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 9622909e-5004-46d0-975d-c3643aec6b67] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:05.760540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:05.764887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:05.771117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:05.772198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:05.772901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:05.773536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:05.840243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8edec3d3-b424-4852-bddd-1ea003c9b6fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:05.850695 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8edec3d3-b424-4852-bddd-1ea003c9b6fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67" status: 200 len: 1215 microversion: 2.1 time: 0.122405 Oct 22 03:18:05.871461 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1587/3150] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:05 2022] GET /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67 => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:05.877740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d601391c-4124-4ff1-af8a-8e3a0b6624dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:05.878305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d601391c-4124-4ff1-af8a-8e3a0b6624dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 9622909e-5004-46d0-975d-c3643aec6b67] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:05.899536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d601391c-4124-4ff1-af8a-8e3a0b6624dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 9622909e-5004-46d0-975d-c3643aec6b67] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:18:06.140574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:06.150327 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8cf2835c-8a9b-472d-942f-2669699b7bf5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.421573 Oct 22 03:18:06.157687 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1564/3151] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:05 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:06.163196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:06.175848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:06.194525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:06.195606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:06.197759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:06.203077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:06.203480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:06.205099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:06.302510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d601391c-4124-4ff1-af8a-8e3a0b6624dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67" status: 204 len: 0 microversion: 2.1 time: 0.426012 Oct 22 03:18:06.309232 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1588/3152] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:18:05 2022] DELETE /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:18:06.317357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c356f11-af59-4bcb-8ab9-b2f792509e29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d19ffc940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:06.426930 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c356f11-af59-4bcb-8ab9-b2f792509e29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.116524 Oct 22 03:18:06.428154 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1589/3153] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:06 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:06.435956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a966cc7e-95c6-402a-8ab3-c450bdcfb5e3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:06.438953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a966cc7e-95c6-402a-8ab3-c450bdcfb5e3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 9622909e-5004-46d0-975d-c3643aec6b67] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:06.451318 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a966cc7e-95c6-402a-8ab3-c450bdcfb5e3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a966cc7e-95c6-402a-8ab3-c450bdcfb5e3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67 HTTP/1.1 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9622909e-5004-46d0-975d-c3643aec6b67'} Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:06.457052 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:18:06.461402 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:18:06.461402 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:18:06.461402 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:18:06.461402 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:18:06.461402 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:06.461402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a966cc7e-95c6-402a-8ab3-c450bdcfb5e3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:18:06.461402 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a966cc7e-95c6-402a-8ab3-c450bdcfb5e3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67" status: 404 len: 111 microversion: 2.1 time: 0.030031 Oct 22 03:18:06.462325 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1590/3154] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:06 2022] GET /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:18:06.500994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-27e8c159-2ad5-4036-a3c5-e1f1847a0706 req-383f32bd-1e46-46f0-bc76-0da2043c7062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7148fe4-73ad-4a88-bec8-4a2f3b8c048c", "name": "network-vif-plugged", "status": "completed", "tag": "e4a97d34-19eb-4cea-a921-73201896b2ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:06.539560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-27e8c159-2ad5-4036-a3c5-e1f1847a0706 req-383f32bd-1e46-46f0-bc76-0da2043c7062 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:06.540251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-27e8c159-2ad5-4036-a3c5-e1f1847a0706 req-383f32bd-1e46-46f0-bc76-0da2043c7062 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:06.546357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-27e8c159-2ad5-4036-a3c5-e1f1847a0706 req-383f32bd-1e46-46f0-bc76-0da2043c7062 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:06.577068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-27e8c159-2ad5-4036-a3c5-e1f1847a0706 req-383f32bd-1e46-46f0-bc76-0da2043c7062 service nova] Creating event network-vif-plugged:e4a97d34-19eb-4cea-a921-73201896b2ac for instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c on n-h1-862416-2 Oct 22 03:18:06.584009 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-27e8c159-2ad5-4036-a3c5-e1f1847a0706 req-383f32bd-1e46-46f0-bc76-0da2043c7062 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088658 Oct 22 03:18:06.587860 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1591/3155] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:06.593924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1174336271", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "636a4e0f-2dc3-4c83-88d5-b5568cafac2d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:06.708631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] validate_networks() for [('636a4e0f-2dc3-4c83-88d5-b5568cafac2d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:18:07.305191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:07.324019 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-58c9efe7-d65a-43a4-8ec9-c1be16b14dd8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 1.160990 Oct 22 03:18:07.326218 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1565/3156] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:06 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:07.349446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:07.350447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:07.377588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:07.378619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:07.379299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:07.382554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:07.383490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:07.384162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:07.399495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:18:07.400048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:18:07.400780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:18:07.401220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:18:07.401638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:18:07.415051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:07.415548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:07.415990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:07.416846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:07.417391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:07.418410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:07.439166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:18:07.454127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for user 7bd4c44f32a04da48b34c9c888f36fa6 and project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:18:07.470783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:18:07.473412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:18:07.554465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-121a4241-92dd-403d-af34-f19b9cf8975e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965188 Oct 22 03:18:07.555952 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1592/3157] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:18:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:18:07.567480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4153293a-8078-46ed-ab25-f35a5e6a46b1 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a47daf0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:07.663311 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4153293a-8078-46ed-ab25-f35a5e6a46b1 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.106206 Oct 22 03:18:07.665723 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1593/3158] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:07 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:07.683493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:07.691512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:07.722294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:07.724823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:07.725403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:07.726174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:07.732671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:07.733227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:07.926360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:07.960630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:07.966937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:07.974764 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dbcbbecf-4615-45b3-9122-bc5f5b191872 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.645801 Oct 22 03:18:07.989844 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1566/3159] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:07 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:08.001826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c7a4210e-7762-4028-98e5-fcff477b8764 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1985c430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:08.032888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:08.040868 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55d86b7b-60eb-4d33-96c8-861a1918b13c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1198 microversion: 2.1 time: 0.374124 Oct 22 03:18:08.041447 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1594/3160] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:07 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1198 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:08.050547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-78f445bc-7ea4-48dc-8f3d-4d59c9708c17 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:08.051477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-78f445bc-7ea4-48dc-8f3d-4d59c9708c17 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:08.058038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:08.100109 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c7a4210e-7762-4028-98e5-fcff477b8764 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.108778 Oct 22 03:18:08.101392 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1567/3161] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:07 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:08.216198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-78f445bc-7ea4-48dc-8f3d-4d59c9708c17 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:08.223541 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-78f445bc-7ea4-48dc-8f3d-4d59c9708c17 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1215 microversion: 2.1 time: 0.177133 Oct 22 03:18:08.224168 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1595/3162] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:08 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:08.354132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:08.355464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:08.370099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:08.372929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:08.376624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:08.378572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:08.379269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:08.381035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:08.680328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2ce1e68-20ce-468d-9db6-965135cce595 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e56d1f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:08.755379 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e2ce1e68-20ce-468d-9db6-965135cce595 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.079071 Oct 22 03:18:08.764247 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1596/3163] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:08 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:08.787284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:08.805757 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b0b3525f-4f4a-4165-989c-16cb2dd3088f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.456340 Oct 22 03:18:08.809078 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1568/3164] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:08 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:09.007956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:09.008976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:09.023569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.024489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.025125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.026055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.060820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.061314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.070950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:09.071623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:09.095909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.096458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.101879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.102728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.105905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.106387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.372480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:09.385780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:09.387952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:09.389461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-910736fb-8328-414e-a9d1-2307f318518a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1891 microversion: 2.42 time: 0.386828 Oct 22 03:18:09.390585 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1597/3165] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:09 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1891 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:09.405341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9483beb5-62cb-4870-8c92-2c2ff1cff8ff tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a05a1f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:09.410391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:09.426430 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b611fc27-377b-41f3-8d9a-7adfd2f2c529 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1381 microversion: 2.1 time: 0.359222 Oct 22 03:18:09.429740 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1569/3166] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:09 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1381 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:09.439327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:09.440352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:09.467372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.474108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.476900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.484505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.486904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.487038 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9483beb5-62cb-4870-8c92-2c2ff1cff8ff tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.095139 Oct 22 03:18:09.488081 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1598/3167] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:09 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:09.498112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.710084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:09.720997 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5dc10b21-1f5d-4e11-af6e-9b69104213dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1267 microversion: 2.1 time: 0.289983 Oct 22 03:18:09.724292 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1570/3168] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:09 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:09.767821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:09.770028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:09.771136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27fd0c48-f66b-48b9-9bec-71294f4c7363 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e516ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:09.796036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.796746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.797379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.799889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.800415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.800859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.852177 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27fd0c48-f66b-48b9-9bec-71294f4c7363 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.085053 Oct 22 03:18:09.856257 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1571/3169] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:09 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:09.872592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:09.874271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:09.881338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.882273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.882962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:09.884867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:09.885572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:09.886377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:10.079135 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3acd663f-a840-4dc3-963d-3f6ea09dbad1 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1532 microversion: 2.1 time: 0.589570 Oct 22 03:18:10.081348 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1599/3170] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:09 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1532 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:10.112228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:10.113581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:10.124131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:10.125296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:10.126073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:10.127216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:10.128177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:10.129998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:10.161228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:10.416516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e9f63d2-4793-4b7f-977d-a918a54cd148 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1532 microversion: 2.1 time: 0.313714 Oct 22 03:18:10.418519 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1600/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:10 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1532 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:10.447251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:10.448553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:10.468432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:10.469338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:10.470172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:10.472195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:10.475365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:10.477446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:10.799665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:10.825435 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db9a04bb-7779-46d5-8047-9e8e0042c3fc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.960356 Oct 22 03:18:10.831473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1572/3172] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:09 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:10.854342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ccdc021d-fbeb-4f49-b2dd-c0af098057f0 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:10.860193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccdc021d-fbeb-4f49-b2dd-c0af098057f0 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:10.865433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccdc021d-fbeb-4f49-b2dd-c0af098057f0 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:10.866146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccdc021d-fbeb-4f49-b2dd-c0af098057f0 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:10.869950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccdc021d-fbeb-4f49-b2dd-c0af098057f0 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:10.878371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccdc021d-fbeb-4f49-b2dd-c0af098057f0 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:10.879072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccdc021d-fbeb-4f49-b2dd-c0af098057f0 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:10.960518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:10.972546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:10.973992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:10.975086 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ccdc021d-fbeb-4f49-b2dd-c0af098057f0 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.142271 Oct 22 03:18:10.975225 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c9e0a9d-daeb-4e6c-ab69-a9bbf135364a tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.554963 Oct 22 03:18:10.978427 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1573/3173] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:18:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:10.993220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43c31ccb-bff3-47e8-9719-80be6ba3fcf7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1985cca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:11.002306 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1601/3174] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:10 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:11.010947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:11.012894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:11.047728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:11.048238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:11.059146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:11.060316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:11.060816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:11.061252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:11.072459 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43c31ccb-bff3-47e8-9719-80be6ba3fcf7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1413 microversion: 2.1 time: 0.092723 Oct 22 03:18:11.073247 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1574/3175] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:10 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:11.079518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd21a91f-0ccc-4eb0-98e6-364060413dbb tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1999cd30>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:11.184992 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd21a91f-0ccc-4eb0-98e6-364060413dbb tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.100540 Oct 22 03:18:11.185691 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1575/3176] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:11 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:11.197339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862416-2", "block_migration": false, "disk_over_commit": false}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:11.211085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:11.228401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:11.231090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:11.233393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:11.234150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:11.234280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:11.234624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:11.235062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:11.249945 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e4d2c78e-f393-444c-8914-1969b92bf75c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1273 microversion: 2.1 time: 0.246446 Oct 22 03:18:11.263692 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1602/3177] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:11 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:11.264498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:11.294675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lazy-loading 'flavor' on Instance uuid a7148fe4-73ad-4a88-bec8-4a2f3b8c048c {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:18:11.310608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Going to try to live migrate instance to n-h2-862416-2 {{(pid=120582) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:18:11.854657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:11.856165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:11.885450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:11.887868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:11.896961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:11.902586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:11.903319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:11.903949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:12.299481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:12.321722 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da58e71e-4a0f-4801-9011-05f7f2d44343 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.459747 Oct 22 03:18:12.322452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1603/3178] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:11 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:12.328672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:12.329290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:12.356813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:12.359612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:12.360071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:12.361778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:12.364575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:12.365353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:12.976457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:12.997921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:13.015121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:13.017333 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3d2f3f5c-186b-4116-a524-c1d86b13f5fe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.693046 Oct 22 03:18:13.037371 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1604/3179] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:12 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:13.045321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-033b4dea-e5cf-4e6e-b301-1c664bc87c39 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a47d3a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:14.578456 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-813e8b7a-58e6-46ef-a5a7-65adb8ba6bbb tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c/action" status: 202 len: 0 microversion: 2.1 time: 3.391204 Oct 22 03:18:14.581643 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1576/3180] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:18:11 2022] POST /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c/action => generated 0 bytes in 3395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:18:14.588152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-adc52b12-a489-4129-976f-35a378237089 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e3ff820>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:14.763845 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-033b4dea-e5cf-4e6e-b301-1c664bc87c39 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1422 microversion: 2.1 time: 1.721789 Oct 22 03:18:14.765037 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1605/3181] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:13 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1422 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:14.778247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:14.779156 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-adc52b12-a489-4129-976f-35a378237089 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.195536 Oct 22 03:18:14.779955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:14.785686 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1577/3182] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:14 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:14.797368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:14.798156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:14.798757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:14.799646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:14.800283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:14.800870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:14.812437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d5b6840a-1171-4607-b03b-1a62d3a714d6 req-287c25d8-e25f-42b1-bd86-46af3096a0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413d7cde-ec29-4239-968e-6524df522977", "name": "network-vif-plugged", "status": "completed", "tag": "790776fd-bbd7-4ed1-b035-1ab433bbea5c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:14.841150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d5b6840a-1171-4607-b03b-1a62d3a714d6 req-287c25d8-e25f-42b1-bd86-46af3096a0d6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:14.842011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d5b6840a-1171-4607-b03b-1a62d3a714d6 req-287c25d8-e25f-42b1-bd86-46af3096a0d6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:14.842664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d5b6840a-1171-4607-b03b-1a62d3a714d6 req-287c25d8-e25f-42b1-bd86-46af3096a0d6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:14.859939 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d5b6840a-1171-4607-b03b-1a62d3a714d6 req-287c25d8-e25f-42b1-bd86-46af3096a0d6 service nova] Creating event network-vif-plugged:790776fd-bbd7-4ed1-b035-1ab433bbea5c for instance 413d7cde-ec29-4239-968e-6524df522977 on n-h2-862416-2 Oct 22 03:18:14.868516 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d5b6840a-1171-4607-b03b-1a62d3a714d6 req-287c25d8-e25f-42b1-bd86-46af3096a0d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070967 Oct 22 03:18:14.869497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1578/3183] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:14.877405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:14.879580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:14.889185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:14.890062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:14.890811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:14.892113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:14.893050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:14.893687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:15.102907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:15.112492 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-64764e4a-8279-42fd-8789-2d43de660be8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1315 microversion: 2.1 time: 0.345719 Oct 22 03:18:15.116859 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1606/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:14 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:15.131530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:15.132158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:15.140137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:15.140693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:15.141131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:15.147222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:15.147897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:15.148531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:15.282869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:15.297543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28b356c2-099c-43c9-ae8a-58f35ea02850 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.425952 Oct 22 03:18:15.298492 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1579/3185] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:14 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:15.303658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:15.308995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:15.325256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:15.325466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:15.326088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:15.326988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:15.332021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:15.332564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:15.545108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:15.564077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:15.565977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:15.586068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe5d9009-d05c-401e-82b2-2f3c402049bf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.467818 Oct 22 03:18:15.586813 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1607/3186] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:15 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:15.597473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f41c77d-b603-496b-931f-621c0983b302 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d19ffcc10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:15.674741 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f41c77d-b603-496b-931f-621c0983b302 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 200 len: 1422 microversion: 2.1 time: 0.086431 Oct 22 03:18:15.690478 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1608/3187] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:15 2022] GET /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 1422 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:15.697329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9e1f462c-62d7-4fa3-8c31-606c5c875cc7 req-19e59c57-94d5-4932-9e83-a5f575ce8249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562b1d73-9053-4f68-95d5-faf97ca3cee9", "tag": "80c4367d-9be3-49b6-bec9-26eb514aa855"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:15.725366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e1f462c-62d7-4fa3-8c31-606c5c875cc7 req-19e59c57-94d5-4932-9e83-a5f575ce8249 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:15.725860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e1f462c-62d7-4fa3-8c31-606c5c875cc7 req-19e59c57-94d5-4932-9e83-a5f575ce8249 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:15.726303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e1f462c-62d7-4fa3-8c31-606c5c875cc7 req-19e59c57-94d5-4932-9e83-a5f575ce8249 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:15.752586 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9e1f462c-62d7-4fa3-8c31-606c5c875cc7 req-19e59c57-94d5-4932-9e83-a5f575ce8249 service nova] Creating event network-changed:80c4367d-9be3-49b6-bec9-26eb514aa855 for instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 on n-h1-862416-2 Oct 22 03:18:15.766402 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9e1f462c-62d7-4fa3-8c31-606c5c875cc7 req-19e59c57-94d5-4932-9e83-a5f575ce8249 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073954 Oct 22 03:18:15.771059 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1609/3188] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:15.800483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2d4627e9-9182-4a62-91c0-d6adb0468f51 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19ffc430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:15.876040 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2d4627e9-9182-4a62-91c0-d6adb0468f51 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.079543 Oct 22 03:18:15.884159 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1610/3189] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:15 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:15.894374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-211110978", "imageRef": "824a6712-7d1c-4c2b-be66-11e5ce574d78", "flavorRef": "452", "networks": [{"uuid": "49c953fb-5979-4a50-be05-1edf628aca16"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:15.942585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:15.956301 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-260d8694-6bfd-464f-a781-ca63cdefcd12 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.656468 Oct 22 03:18:15.965251 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1580/3190] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:15 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:16.012506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] validate_networks() for [('49c953fb-5979-4a50-be05-1edf628aca16', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:18:16.144708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:16.145640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:16.158059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:16.158822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:16.159413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:16.161528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:16.163092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:16.163734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:16.635684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:18:16.637193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:18:16.638064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:18:16.638703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:18:16.639357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:18:16.662786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:16.663650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:16.664487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:16.668964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:16.669754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:16.670437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:16.713507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:18:16.727320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for user 2468c1f92230450db3397e1f0e97b5e0 and project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:18:16.769982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:18:16.773570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='824a6712-7d1c-4c2b-be66-11e5ce574d78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:18:16.932074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31be830d-db3d-4195-9939-09d85bb74285 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052156 Oct 22 03:18:16.940964 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1611/3191] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:18:16.960783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:16.962619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:16.978719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:16.982041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:16.982805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:16.984076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:16.991150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:16.991625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:16.992784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:17.006173 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a95398f-e1e8-494b-81dd-e6bc2af3e439 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1315 microversion: 2.1 time: 0.866385 Oct 22 03:18:17.008086 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1581/3192] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:16 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1315 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:17.020766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:17.021428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:17.042205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:17.046861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:17.047335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:17.048291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:17.048889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:17.049339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:17.293881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:17.303082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5d8c03b-39f8-47dd-b4b5-84974907b44d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1513 microversion: 2.1 time: 0.360621 Oct 22 03:18:17.309723 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1612/3193] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:16 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1513 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:17.322647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5ccf953-974a-4a9e-b43e-ad9a19bb928c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19954a60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:17.437480 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5ccf953-974a-4a9e-b43e-ad9a19bb928c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.126616 Oct 22 03:18:17.438869 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1613/3194] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:17 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:17.455204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a76d2aa8-a5d5-4739-b6aa-71361bb013ee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:17.456013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a76d2aa8-a5d5-4739-b6aa-71361bb013ee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:17.461567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:17.472815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:17.474733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:17.476013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5fd4594c-66bb-4d3b-8e7a-4e0d04f825fc tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.466909 Oct 22 03:18:17.476632 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1582/3195] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:17 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:17.490134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:17.491080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:17.503897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:17.504730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:17.509456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:17.511598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:17.512375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:17.513341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:17.650488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a76d2aa8-a5d5-4739-b6aa-71361bb013ee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:17.664702 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a76d2aa8-a5d5-4739-b6aa-71361bb013ee tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1207 microversion: 2.1 time: 0.214617 Oct 22 03:18:17.678422 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1614/3196] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:17 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1207 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:17.892000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:17.903188 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-810cc8f1-c78f-4ffb-9b86-b66b0c2ab863 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.425343 Oct 22 03:18:17.921320 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1583/3197] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:17 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:18.033978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:18.035038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:18.058228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:18.061222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:18.061971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:18.066752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:18.067662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:18.068558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:18.330366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:18.331730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:18.344284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:18.346611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:18.347299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:18.350339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:18.351122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:18.351847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:18.546941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:18.561316 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b706e475-92f2-493a-b8ce-510e5cde4f1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1315 microversion: 2.1 time: 0.531714 Oct 22 03:18:18.562299 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1615/3198] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:18 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:18.567226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ed05b896-47a4-4148-bfe9-ffa0ee7e86ff tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e5db430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:18.662126 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ed05b896-47a4-4148-bfe9-ffa0ee7e86ff tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.098536 Oct 22 03:18:18.663014 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1616/3199] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:18 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:18.677226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:18.677852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:18.685919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:18.686454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:18.686859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:18.687578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:18.688038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:18.688597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:18.804025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:18.815978 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d71ccfe9-973d-44ec-b7fa-f3098bbedf9e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1519 microversion: 2.1 time: 0.489734 Oct 22 03:18:18.816948 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1584/3200] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:18 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1519 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:18.823452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:18.825974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:18.849261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:18.854163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:18.854631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:18.856157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:18.856658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:18.857094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:19.026086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:19.039871 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1aaf0dc9-4080-46d5-b983-1f1720d41652 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1259 microversion: 2.1 time: 0.221790 Oct 22 03:18:19.040671 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1585/3201] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:18 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:19.057204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:19.057744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:19.077125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:19.081064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:19.081535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:19.082294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:19.082756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:19.083187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:19.334956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:19.350711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:19.364320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:19.365928 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f3cdfe8e-6150-44b9-a772-31fba9d44251 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.701704 Oct 22 03:18:19.367077 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1617/3202] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:18 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:19.442832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:19.462546 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d059a873-906d-46ea-9996-e79ebf26b95f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.420787 Oct 22 03:18:19.465895 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1586/3203] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:19 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:19.609190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:19.610136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:19.621684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:19.624562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:19.625162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:19.628294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:19.628812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:19.630022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:19.680308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b2e2644-0556-478e-996a-49e6b072fe7a tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e53daf0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:19.789324 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b2e2644-0556-478e-996a-49e6b072fe7a tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.113830 Oct 22 03:18:19.798496 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1587/3204] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:19 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:19.846545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:19.847364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:19.859883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:19.861682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:19.864782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:19.865731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:19.867797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:19.868503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:19.934166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:19.943790 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2d0b7b09-3a11-4f79-9cfa-35464a3ba400 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1315 microversion: 2.1 time: 0.340747 Oct 22 03:18:19.947384 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1618/3205] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:19 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:20.069676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:20.070991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:20.088073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:20.088981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:20.090935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:20.097526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:20.098248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:20.098904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:20.099019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:20.119386 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bbc1c64a-d686-4c06-8b5a-858caee611a0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1519 microversion: 2.1 time: 0.276893 Oct 22 03:18:20.139299 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1588/3206] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:19 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1519 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:20.280012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:20.289126 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74d1939a-4d64-46b7-a4b2-b13ea761bdbe tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1259 microversion: 2.1 time: 0.224833 Oct 22 03:18:20.301517 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1619/3207] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:20 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:20.321921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2cb3d482-4b52-4b1a-b4b9-24c5ddf70c8f req-74ace174-aa7a-438c-a292-a0048aaa0acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b06bdd-b429-4660-b50e-6d2d40d3daf2", "name": "network-vif-unplugged", "status": "completed", "tag": "d9629050-6517-484c-96f2-fe2f4be5ac6d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:20.344031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2cb3d482-4b52-4b1a-b4b9-24c5ddf70c8f req-74ace174-aa7a-438c-a292-a0048aaa0acb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:20.344559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2cb3d482-4b52-4b1a-b4b9-24c5ddf70c8f req-74ace174-aa7a-438c-a292-a0048aaa0acb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:20.345044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2cb3d482-4b52-4b1a-b4b9-24c5ddf70c8f req-74ace174-aa7a-438c-a292-a0048aaa0acb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:20.367128 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2cb3d482-4b52-4b1a-b4b9-24c5ddf70c8f req-74ace174-aa7a-438c-a292-a0048aaa0acb service nova] Creating event network-vif-unplugged:d9629050-6517-484c-96f2-fe2f4be5ac6d for instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 on n-h1-862416-2 Oct 22 03:18:20.382514 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2cb3d482-4b52-4b1a-b4b9-24c5ddf70c8f req-74ace174-aa7a-438c-a292-a0048aaa0acb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067105 Oct 22 03:18:20.389394 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1589/3208] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:18:20.395316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:20.396031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:20.412750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:20.417608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:20.419391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:20.420510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:20.421235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:20.421895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:20.490612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:20.491338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:20.501954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:20.504867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:20.505601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:20.509076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:20.509838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:20.510564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:20.825712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:20.836178 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-983bc694-085f-4ab3-9cb7-6de47b1dcf69 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.349883 Oct 22 03:18:20.837535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1590/3209] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:20 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:20.849229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c50de4a-b0ea-4759-a720-35b25f9758df tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e53d8b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:20.890852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:20.944623 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5c50de4a-b0ea-4759-a720-35b25f9758df tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.105406 Oct 22 03:18:20.951526 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1591/3210] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:20 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:20.972735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:20.973402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:21.012441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:21.012994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:21.013450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:21.014283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:21.014911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:21.015346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:21.063283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:21.078046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:21.088909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:21.093209 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ed2f76f9-64d8-4e9b-9240-8d0c5788c955 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.702075 Oct 22 03:18:21.093891 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1620/3211] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:20 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:21.147522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:21.148586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:21.161326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:21.167033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:21.173927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:21.174816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:21.175302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:21.175750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:21.602170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:21.625196 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-141a639d-dbff-448b-969b-dac4cb642417 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1519 microversion: 2.1 time: 0.469865 Oct 22 03:18:21.625876 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1621/3212] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:21 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:21.649545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:21.650186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:21.672808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:21.673303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:21.673745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:21.674452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:21.684641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:21.697760 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e43e4f38-7d93-4b3e-8ea5-49b3b4e55434 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1315 microversion: 2.1 time: 0.730040 Oct 22 03:18:21.708933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:21.709493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:21.721488 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1592/3213] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:20 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:21.862203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:21.862820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:21.888253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:21.890230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:21.891643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:21.892728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:21.893638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:21.894325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:22.008745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:22.039917 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d25f926a-778a-4f9e-b4a0-b4b3039ddaaf tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1259 microversion: 2.1 time: 0.392823 Oct 22 03:18:22.042756 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1622/3214] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:21 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1259 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:22.060091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-49fd8f05-70d1-45da-bf5d-ce794db2d5dd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e4ac160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:22.133677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-49fd8f05-70d1-45da-bf5d-ce794db2d5dd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1452 microversion: 2.1 time: 0.089130 Oct 22 03:18:22.135680 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1623/3215] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:22 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:22.144074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:22.145164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:22.153152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:22.154041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:22.154756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:22.155819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:22.156691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:22.157368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:22.462225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:22.476910 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-99db33cb-4009-45e1-a297-7cc1127f99ab tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.618252 Oct 22 03:18:22.479192 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1593/3216] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:21 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:22.546591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-11ee3c27-2f37-4d2c-9c75-72bdcd8a1751 req-42fad7d6-0037-43d5-9ebf-c2590870d893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e062bf-a697-4a20-aeda-260c6517a642", "name": "network-vif-unplugged", "status": "completed", "tag": "5239c0bb-27a6-4165-99e2-b35fe986107c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:22.579552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-11ee3c27-2f37-4d2c-9c75-72bdcd8a1751 req-42fad7d6-0037-43d5-9ebf-c2590870d893 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:22.580056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-11ee3c27-2f37-4d2c-9c75-72bdcd8a1751 req-42fad7d6-0037-43d5-9ebf-c2590870d893 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:22.583597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-11ee3c27-2f37-4d2c-9c75-72bdcd8a1751 req-42fad7d6-0037-43d5-9ebf-c2590870d893 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:22.594975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:22.608062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:22.610631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:22.611433 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-238c637e-550a-4bc3-ab50-92f58ee1f085 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.474244 Oct 22 03:18:22.612342 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1624/3217] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:22 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:22.649694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:22.653222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:22.662700 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-11ee3c27-2f37-4d2c-9c75-72bdcd8a1751 req-42fad7d6-0037-43d5-9ebf-c2590870d893 service nova] Creating event network-vif-unplugged:5239c0bb-27a6-4165-99e2-b35fe986107c for instance 54e062bf-a697-4a20-aeda-260c6517a642 on n-h2-862416-2 Oct 22 03:18:22.663482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:22.665101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:22.665746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:22.666880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:22.667893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:22.669160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:22.685161 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-11ee3c27-2f37-4d2c-9c75-72bdcd8a1751 req-42fad7d6-0037-43d5-9ebf-c2590870d893 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140389 Oct 22 03:18:22.685856 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1594/3218] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:18:22.705119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:22.727968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:22.728867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:22.759548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:22.763747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:22.764333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:22.765214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:22.765687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:22.766154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:22.935160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:22.945212 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08125c9b-7e38-44c1-835e-7c5eca1b5a60 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1519 microversion: 2.1 time: 0.299835 Oct 22 03:18:22.954096 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1625/3219] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:22 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1519 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:23.067226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:23.068055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:23.080064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:23.080618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:23.081063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:23.081786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:23.082237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:23.082680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:23.247546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:23.260081 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93be7f62-778a-42d2-be1c-32cbe1da7e51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1265 microversion: 2.1 time: 0.193608 Oct 22 03:18:23.264013 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1626/3220] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:23 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:23.274259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-666530b0-0436-4ea2-a2e2-b1b8df7f27a3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e4ac1f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:23.513658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:23.523197 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0862c794-8d61-4505-a061-f0e3f7e59c5a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1315 microversion: 2.1 time: 0.799870 Oct 22 03:18:23.546938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1595/3221] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:22 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:23.556743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:23.566894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:23.582185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:23.583372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:23.584202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:23.585585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:23.586447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:23.589446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:23.661526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:24.210984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:24.225283 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d8c2e966-b2c6-489f-ab66-0d50bb0bb1d2 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.676622 Oct 22 03:18:24.226204 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1596/3222] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:23 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:24.232581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:24.241122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:24.254818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:24.259435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:24.260117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:24.261639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:24.262260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:24.262887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:25.426397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:25.451106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:25.468248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:25.510013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f6827c3d-b047-45e6-9b74-010a67ad9f69 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 1.275417 Oct 22 03:18:25.510935 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1597/3223] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:24 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:25.519386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:25.531728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:25.555843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:25.556626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:25.557436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:25.558906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:25.559690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:25.562064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:26.015765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:26.028595 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0ebdc04-58a2-4505-92db-6bf4b8f7c6bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1519 microversion: 2.1 time: 0.516497 Oct 22 03:18:26.045579 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1598/3224] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:25 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1519 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:26.059840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:26.061100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:26.073660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:26.074658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:26.077698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:26.078761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:26.082185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:26.083395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:26.496720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:26.510407 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b14ba376-df28-47c5-9bb8-a441d5384b09 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.463458 Oct 22 03:18:26.519799 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1599/3225] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:26 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:26.542893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:26.543548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:26.560667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:26.561825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:26.576297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:26.579955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:26.580895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:26.582410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:26.691543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:27.243976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:27.251985 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db2adc66-547e-4439-976b-abf65c38e8a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1315 microversion: 2.1 time: 0.730291 Oct 22 03:18:27.260728 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1600/3226] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:26 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:27.267415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5287a143-56aa-4405-be19-dfe60e54ff26 req-bd499610-c7b2-4378-bef8-aba4b5faa819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562b1d73-9053-4f68-95d5-faf97ca3cee9", "name": "network-vif-plugged", "status": "completed", "tag": "80c4367d-9be3-49b6-bec9-26eb514aa855"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:27.303016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5287a143-56aa-4405-be19-dfe60e54ff26 req-bd499610-c7b2-4378-bef8-aba4b5faa819 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:27.312955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5287a143-56aa-4405-be19-dfe60e54ff26 req-bd499610-c7b2-4378-bef8-aba4b5faa819 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:27.316680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5287a143-56aa-4405-be19-dfe60e54ff26 req-bd499610-c7b2-4378-bef8-aba4b5faa819 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:27.341589 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5287a143-56aa-4405-be19-dfe60e54ff26 req-bd499610-c7b2-4378-bef8-aba4b5faa819 service nova] Creating event network-vif-plugged:80c4367d-9be3-49b6-bec9-26eb514aa855 for instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 on n-h1-862416-2 Oct 22 03:18:27.364619 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5287a143-56aa-4405-be19-dfe60e54ff26 req-bd499610-c7b2-4378-bef8-aba4b5faa819 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100642 Oct 22 03:18:27.367805 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1601/3227] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:27.405500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:27.406570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:27.430416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:27.430924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:27.431378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:27.432097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:27.432590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:27.454614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:27.660870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=26 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:28.696434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:28.708918 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5410016c-53e5-41af-887d-afc7484c9cb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 1.339646 Oct 22 03:18:28.711218 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1602/3228] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:27 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:28.717829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:28.727615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:28.735479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:28.736238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:28.736833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:28.737711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:28.738358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:28.738949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:29.174644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:29.188025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:29.189654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:29.191008 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5bd7bd45-549d-4e52-a024-f01764ae4681 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.478611 Oct 22 03:18:29.202920 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1603/3229] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:28 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:29.212414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:29.213415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:29.226454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:29.233964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:29.234672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:29.235741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:29.236399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:29.237092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:29.509440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:29.522320 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77a98e10-05b4-4173-af02-d4c679d80d28 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1519 microversion: 2.1 time: 0.318221 Oct 22 03:18:29.540643 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1604/3230] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:29 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:29.552741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:29.554996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:29.577379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:29.578061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:29.578741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:29.579832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:29.580593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:29.581219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:30.154528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:30.169383 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d1165a1-00e1-4abe-aec8-643000ac2e96 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.627132 Oct 22 03:18:30.169987 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1605/3231] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:29 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:30.174616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:30.175237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:30.206153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:30.206664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:30.207112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:30.207838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:30.209375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:30.211136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:31.262166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:31.273976 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0758ee8d-b208-4c9d-bd4f-715cfda40132 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1315 microversion: 2.1 time: 1.100692 Oct 22 03:18:31.275250 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1606/3232] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:30 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:31.287418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9c4b777e-3b94-4788-bcc0-210ed44ce0b9 req-b5b52db7-a644-49f0-b1d2-f40e3a9eb46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e062bf-a697-4a20-aeda-260c6517a642", "name": "network-vif-plugged", "status": "completed", "tag": "5239c0bb-27a6-4165-99e2-b35fe986107c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:31.318327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9c4b777e-3b94-4788-bcc0-210ed44ce0b9 req-b5b52db7-a644-49f0-b1d2-f40e3a9eb46c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:31.322875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9c4b777e-3b94-4788-bcc0-210ed44ce0b9 req-b5b52db7-a644-49f0-b1d2-f40e3a9eb46c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:31.323850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9c4b777e-3b94-4788-bcc0-210ed44ce0b9 req-b5b52db7-a644-49f0-b1d2-f40e3a9eb46c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:31.350098 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9c4b777e-3b94-4788-bcc0-210ed44ce0b9 req-b5b52db7-a644-49f0-b1d2-f40e3a9eb46c service nova] Creating event network-vif-plugged:5239c0bb-27a6-4165-99e2-b35fe986107c for instance 54e062bf-a697-4a20-aeda-260c6517a642 on n-h2-862416-2 Oct 22 03:18:31.365475 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9c4b777e-3b94-4788-bcc0-210ed44ce0b9 req-b5b52db7-a644-49f0-b1d2-f40e3a9eb46c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088655 Oct 22 03:18:31.366915 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1607/3233] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:31.372650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:31.373634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:31.381174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:31.381965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:31.382620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:31.383543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:31.384240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:31.384905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:31.703593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:31.720052 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac4056d4-208c-4e94-a9aa-367a30349052 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.343920 Oct 22 03:18:31.721763 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1608/3234] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:31 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:31.727746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:31.731074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:31.744795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:31.751835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:31.754969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:31.755942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:31.762336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:31.763114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:32.231246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:32.247196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:32.251866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:32.254155 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9192773b-a495-4147-aead-7613e8d24c1e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.531119 Oct 22 03:18:32.258401 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1609/3235] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:31 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:32.269871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5619d9ab-4f2f-44bc-873e-59084712b35e req-71cfb484-34e0-4225-a3e6-ce50cfddea2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281a3e2d-131a-4125-9072-43ebd1e60816", "tag": "38221c9d-5a9f-42f9-bfbb-7558934d1926"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:32.284687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5619d9ab-4f2f-44bc-873e-59084712b35e req-71cfb484-34e0-4225-a3e6-ce50cfddea2a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:32.285559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5619d9ab-4f2f-44bc-873e-59084712b35e req-71cfb484-34e0-4225-a3e6-ce50cfddea2a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:32.286233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5619d9ab-4f2f-44bc-873e-59084712b35e req-71cfb484-34e0-4225-a3e6-ce50cfddea2a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:32.306496 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5619d9ab-4f2f-44bc-873e-59084712b35e req-71cfb484-34e0-4225-a3e6-ce50cfddea2a service nova] Creating event network-changed:38221c9d-5a9f-42f9-bfbb-7558934d1926 for instance 281a3e2d-131a-4125-9072-43ebd1e60816 on n-h2-862416-2 Oct 22 03:18:32.312406 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5619d9ab-4f2f-44bc-873e-59084712b35e req-71cfb484-34e0-4225-a3e6-ce50cfddea2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051701 Oct 22 03:18:32.313708 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1610/3236] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:32.320323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:32.321292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:32.330858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:32.333013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:32.336092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:32.338567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:32.340349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:32.342050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:32.688218 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-666530b0-0436-4ea2-a2e2-b1b8df7f27a3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1461 microversion: 2.1 time: 9.422892 Oct 22 03:18:32.689202 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1627/3237] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:23 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1461 bytes in 9424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:32.707679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:32.714759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:32.718345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:32.724713 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bc7b9c45-258e-4786-9ae8-b5a5d3467b80 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1519 microversion: 2.1 time: 0.409281 Oct 22 03:18:32.725312 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1611/3238] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:32 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1519 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:32.734443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:32.735289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:32.744732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:32.746239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:32.746919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:32.747825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:32.748542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:32.749866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:32.753958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:32.758209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:32.758887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:32.761129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:32.761893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:32.764812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:32.948014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:32.956576 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4460c054-5b37-4278-af5b-6f4cb5cf2ca8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1502 microversion: 2.1 time: 0.226841 Oct 22 03:18:32.957166 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1612/3239] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:32 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:32.962365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a4b72ce-5b88-4b43-beb0-29e3e3bec901 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e53d0d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:33.022014 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a4b72ce-5b88-4b43-beb0-29e3e3bec901 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 200 len: 1461 microversion: 2.1 time: 0.063379 Oct 22 03:18:33.031923 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1613/3240] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:32 2022] GET /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 1461 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:33.038239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:33.038239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:33.043254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:33.045875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:33.046385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:33.046840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:33.047551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:33.048013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:33.048478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:33.054667 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03b5086a-b253-49c5-b9a1-0b997f700efb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.351965 Oct 22 03:18:33.055649 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1628/3241] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:32 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:33.061561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:33.062350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:33.069647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:33.070913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:33.071617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:33.072622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:33.073342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:33.074563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:33.159598 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20742133-04b1-4c6f-9981-975356aead29 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9/action" status: 202 len: 0 microversion: 2.1 time: 0.101972 Oct 22 03:18:33.161029 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1629/3242] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:18:33 2022] POST /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:18:33.168566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:33.170482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:33.179943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:33.183417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:33.184444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:33.185376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:33.186120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:33.186715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:33.552556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:33.565952 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1eca6736-291d-45f5-8edb-9c8f202cc5ef tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.535363 Oct 22 03:18:33.569006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1614/3243] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:33 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:33.585941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:33.586810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:33.606231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:33.607310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:33.607989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:33.609018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:33.609729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:33.610440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:33.928042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:33.946489 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01afc771-30dc-458e-a45c-b7808dda8498 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 200 len: 1480 microversion: 2.1 time: 0.783815 Oct 22 03:18:33.962709 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1630/3244] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:33 2022] GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 1480 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:33.980936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:33.981158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:33.981574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:33.991578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:33.995983 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be07da25-5ad7-4bd4-afe5-ab91ac113e4b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1487 microversion: 2.1 time: 0.424546 Oct 22 03:18:34.003298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:34.004062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:34.009782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:34.014487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:34.015391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:34.017143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:34.039063 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1615/3245] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:33 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1487 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:34.068348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:34.072404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:34.096274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:34.101497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:34.102339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:34.104293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:34.105721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:34.112276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:34.577082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:34.592374 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9d10e30a-0beb-4585-959f-54010fb0c383 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1504 microversion: 2.1 time: 0.548765 Oct 22 03:18:34.599090 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1616/3246] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:34 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1504 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:34.609535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:34.611405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:34.626030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=99 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:34.629264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:34.637191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:34.637911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:34.639022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:34.639654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:34.640660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:34.694025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:18:34.821867 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-076942ec-3ee3-4a20-a975-c1a8791f30ca tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 204 len: 0 microversion: 2.1 time: 0.217857 Oct 22 03:18:34.821867 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1617/3247] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:18:34 2022] DELETE /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:18:34.831089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:34.832199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:34.842260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:34.843247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:34.844004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:34.845257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:34.845979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:34.846640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.056840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:35.067556 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e7630c4-486e-4fe0-b908-f7db7b12e50b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.245757 Oct 22 03:18:35.069752 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1618/3248] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:34 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:35.074598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:35.075219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:35.101416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.101921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.102381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.103093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.103551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.104187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.186455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:35.218748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:35.220264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:35.221534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a0602c6-9448-4e7c-b839-d1196f646ed6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 1.257635 Oct 22 03:18:35.222167 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1631/3249] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:33 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:35.228836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:35.257529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:35.277149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.278175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.284412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.285402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.286058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.286650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.354733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:35.384864 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4276309b-87e3-46fc-aaac-687267b2e3ca tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.312084 Oct 22 03:18:35.389856 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1619/3250] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:35 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:35.410149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:35.417518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:35.451861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.452359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.454952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.455858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.456371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.456976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.621170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:35.631109 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-317d2491-f253-4974-8df7-284997f9c737 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 200 len: 1504 microversion: 2.1 time: 0.405634 Oct 22 03:18:35.646826 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1632/3251] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:35 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:35.655291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:35.658122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:35.677251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.679446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.680146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.681808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.684166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.686302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.792408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:35.801964 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d1d459a-faed-4efd-b2f1-43d979cd3827 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1493 microversion: 2.1 time: 0.410816 Oct 22 03:18:35.804862 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1620/3252] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:35 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:35.817089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:35.818501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:35.837244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.838317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.839049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.840313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:35.841133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:35.841800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:35.883962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:18:36.043650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:36.063776 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3763c917-e4ec-4efe-86e3-a492fc0b2247 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 200 len: 1467 microversion: 2.1 time: 0.415498 Oct 22 03:18:36.065067 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1633/3253] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:35 2022] GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 1467 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:36.096260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:36.099012 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a69a9bb8-b015-4388-9786-2db89bbb0c8e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 204 len: 0 microversion: 2.1 time: 0.289538 Oct 22 03:18:36.099914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:36.106045 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1621/3254] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:18:35 2022] DELETE /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:18:36.118279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-314957305"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:36.124853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:36.125400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:36.125846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:36.126578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:36.127032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:36.127519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:36.129685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:36.148025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:36.148581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:36.149034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:36.149770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:36.153058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:36.153508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:36.597429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:36.612986 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-709e30b5-417a-4617-84b8-3b0570992e61 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.521636 Oct 22 03:18:36.628620 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1634/3255] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:36 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:36.635465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:36.637170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:36.659795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:36.660638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:36.661270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:36.662310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:36.662815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:36.663393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:36.678824 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a886b21c-fa5c-459c-9ac4-edbf0ea4c14d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "POST /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451/action" status: 202 len: 0 microversion: 2.1 time: 0.571096 Oct 22 03:18:36.679880 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1622/3256] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:18:36 2022] POST /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 03:18:36.690465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-509974013", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "3562332b-563f-4110-a622-fceabc5a2780"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:36.809443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] validate_networks() for [('3562332b-563f-4110-a622-fceabc5a2780', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:18:37.073354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:37.090274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:37.093008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:37.094937 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fda56eee-df90-43f8-8c29-059fe7ad4490 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.465239 Oct 22 03:18:37.108788 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1635/3257] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:36 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:37.127826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:37.128982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:37.137386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:37.138689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:37.139425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:37.141037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:37.141810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:37.142401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:37.379192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:37.390147 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-58a78b21-7f63-45ac-96d3-f86831fd97c5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.277452 Oct 22 03:18:37.390785 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1636/3258] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:37 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:37.410890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-51c640fe-bb18-433a-936a-072829610eb0 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e4ac310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:37.499628 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-51c640fe-bb18-433a-936a-072829610eb0 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.101783 Oct 22 03:18:37.504362 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1637/3259] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:37 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:37.515508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:37.516962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:37.542820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:37.544781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:37.545464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:37.548197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:37.549070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:37.549682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:37.586893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:18:37.587385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:18:37.587938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:18:37.588447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:18:37.589152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:18:37.616038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:37.616809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:37.617407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:37.618368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:37.622484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:37.623097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:37.679719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Getting quotas for project 6e11664c867b4d08b961a0613160c3cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:18:37.688736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Getting quotas for user 0acb8d942d09476994afa9a647132e5c and project 6e11664c867b4d08b961a0613160c3cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:18:37.721480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:18:37.724670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:18:37.858182 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13c6945d-4b39-4133-8150-e3cf64adb560 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175690 Oct 22 03:18:37.867194 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1623/3260] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:18:37.882045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:37.882891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:37.889492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:37.900528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:37.901021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:37.902230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:37.903561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:37.904023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:37.904490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:37.915745 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4e44bb4-3234-4192-9e4a-2e3d7bb27a33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1451 microversion: 2.1 time: 0.408808 Oct 22 03:18:37.936719 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1638/3261] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:37 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1451 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:37.959268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a5153d80-bcd0-485b-9826-4b0d24e5a393 req-f88c7f4b-fd2b-4065-964a-89613b92f1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562b1d73-9053-4f68-95d5-faf97ca3cee9", "name": "network-vif-deleted", "tag": "80c4367d-9be3-49b6-bec9-26eb514aa855"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:38.018055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a5153d80-bcd0-485b-9826-4b0d24e5a393 req-f88c7f4b-fd2b-4065-964a-89613b92f1a5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:38.020089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a5153d80-bcd0-485b-9826-4b0d24e5a393 req-f88c7f4b-fd2b-4065-964a-89613b92f1a5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:38.021955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a5153d80-bcd0-485b-9826-4b0d24e5a393 req-f88c7f4b-fd2b-4065-964a-89613b92f1a5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:38.132550 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a5153d80-bcd0-485b-9826-4b0d24e5a393 req-f88c7f4b-fd2b-4065-964a-89613b92f1a5 service nova] Creating event network-vif-deleted:80c4367d-9be3-49b6-bec9-26eb514aa855 for instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 on n-h1-862416-2 Oct 22 03:18:38.154684 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a5153d80-bcd0-485b-9826-4b0d24e5a393 req-f88c7f4b-fd2b-4065-964a-89613b92f1a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214899 Oct 22 03:18:38.158343 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1639/3262] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:38.174176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a3fa42a-4a8f-4b7e-aa86-a49aa8025a45 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:38.176542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a3fa42a-4a8f-4b7e-aa86-a49aa8025a45 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:38.186843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:38.297087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a3fa42a-4a8f-4b7e-aa86-a49aa8025a45 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:38.309984 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a3fa42a-4a8f-4b7e-aa86-a49aa8025a45 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1217 microversion: 2.1 time: 0.148689 Oct 22 03:18:38.311597 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1640/3263] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:38 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:38.341794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:38.343215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:38.376820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:38.377651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:38.380224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:38.380445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:38.383675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:38.386535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:38.387611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:38.389521 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-31bb9ab8-3388-481e-8fd0-5c0dfafff586 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.520833 Oct 22 03:18:38.391512 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1624/3264] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:37 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:38.415509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:38.416428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:38.430434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:38.431236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:38.431857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:38.436538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:38.437247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:38.437893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:38.869376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:38.881242 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-980d7257-9780-42ee-a9c0-ce952a19c71f tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.470047 Oct 22 03:18:38.896326 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1625/3265] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:38 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:38.905630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59ab7d1e-ca6d-4d67-a99f-086e01c99eed tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a08f430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:38.990574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:39.011007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:39.012940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:39.023061 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e83a68ce-4bdf-49d9-b8f9-ed033862434d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.707464 Oct 22 03:18:39.037933 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1641/3266] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:38 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:39.038085 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59ab7d1e-ca6d-4d67-a99f-086e01c99eed tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.139001 Oct 22 03:18:39.038085 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1626/3267] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:38 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:39.038285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9859dcba-eee8-4b7b-9862-ad6feaf3731b req-2fd1abc7-38ea-4f95-aa3f-2fffbd8da126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413d7cde-ec29-4239-968e-6524df522977", "name": "network-vif-unplugged", "status": "completed", "tag": "790776fd-bbd7-4ed1-b035-1ab433bbea5c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:39.038440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:39.038440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:39.043927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.044669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.045300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.046277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.046893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.047788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.079689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9859dcba-eee8-4b7b-9862-ad6feaf3731b req-2fd1abc7-38ea-4f95-aa3f-2fffbd8da126 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.080545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9859dcba-eee8-4b7b-9862-ad6feaf3731b req-2fd1abc7-38ea-4f95-aa3f-2fffbd8da126 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.081160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9859dcba-eee8-4b7b-9862-ad6feaf3731b req-2fd1abc7-38ea-4f95-aa3f-2fffbd8da126 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.097185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.098071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.098519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.098971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lazy-loading 'fault' on Instance uuid 562b1d73-9053-4f68-95d5-faf97ca3cee9 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:18:39.100847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9859dcba-eee8-4b7b-9862-ad6feaf3731b req-2fd1abc7-38ea-4f95-aa3f-2fffbd8da126 service nova] Creating event network-vif-unplugged:790776fd-bbd7-4ed1-b035-1ab433bbea5c for instance 413d7cde-ec29-4239-968e-6524df522977 on n-h2-862416-2 Oct 22 03:18:39.107854 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9859dcba-eee8-4b7b-9862-ad6feaf3731b req-2fd1abc7-38ea-4f95-aa3f-2fffbd8da126 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081357 Oct 22 03:18:39.109249 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1642/3268] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:39.148650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:39.170013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a17eed3-17ca-4621-90aa-2b68f992aa2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 200 len: 1305 microversion: 2.1 time: 0.138023 Oct 22 03:18:39.187094 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1627/3269] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:39 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:39.342116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:39.342851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:39.349173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.349859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.350688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.351430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.351949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.352408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.416092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:39.416815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:39.426984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.428479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.432598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.433850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.435604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.438006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.466894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:39.496186 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e30e05ce-102e-4a84-a5ae-b6ece8060130 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1269 microversion: 2.1 time: 0.160183 Oct 22 03:18:39.499559 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1643/3270] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:39 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:39.618271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:39.628449 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-06f0b28b-477d-4f37-8a09-b27e968c50f9 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.217313 Oct 22 03:18:39.640909 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1628/3271] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:39 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:39.907286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:39.908332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:39.918702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.919445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.920052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:39.922577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:39.923436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:39.924313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:40.053725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-213f55f7-8169-4d50-b3d9-adc09aea5ea9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a073430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:40.134863 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-213f55f7-8169-4d50-b3d9-adc09aea5ea9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.085008 Oct 22 03:18:40.135949 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1629/3272] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:40 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:40.147327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:40.156824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:40.164872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:40.166824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:40.173372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:40.174415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:40.175005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:40.175641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:40.184283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:40.189352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:40.195892 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-059a8dd8-9cf5-48a8-89ad-f365b4383dc4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.293298 Oct 22 03:18:40.209001 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1644/3273] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:39 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:40.225881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:40.230339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:40.250100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:40.250766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:40.251310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:40.252142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:40.253729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:40.258114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:40.287869 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 HTTP/1.1 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '562b1d73-9053-4f68-95d5-faf97ca3cee9'} Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:18:40.292850 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:40.297405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:18:40.297405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:18:40.297405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:18:40.297405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:18:40.297405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:18:40.297405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:18:40.297405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:18:40.299675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:18:40.300606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-150c2464-fde8-4c45-8318-1d6a48b27d34 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 404 len: 111 microversion: 2.1 time: 0.090180 Oct 22 03:18:40.312900 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1645/3274] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:40 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:18:40.462055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1493925603", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "636a4e0f-2dc3-4c83-88d5-b5568cafac2d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:40.567575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] validate_networks() for [('636a4e0f-2dc3-4c83-88d5-b5568cafac2d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:18:40.574374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:40.585862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:40.588029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:40.590311 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-40e48e6b-690d-4eb7-9817-d94f4614d1dd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.452817 Oct 22 03:18:40.591166 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1630/3275] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:40 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:40.596479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:40.597192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:40.608875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:40.609740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:40.611439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:40.612263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:40.612730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:40.613162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:40.716732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:40.727933 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-11b1d7f7-6b3a-42d9-882d-f0f8b3684b93 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1275 microversion: 2.1 time: 0.134629 Oct 22 03:18:40.729625 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1631/3276] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:40 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:40.743919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:40.746885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:40.758721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:40.759795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:40.761572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:40.762625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:40.763376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:40.764000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:41.281177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:18:41.281749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:18:41.282066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:18:41.282483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:18:41.282894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:18:41.298990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:41.299484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:41.302919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:41.303760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:41.304257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:41.306977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:41.332114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:41.363329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:18:41.369611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for user 7bd4c44f32a04da48b34c9c888f36fa6 and project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:18:41.397460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:41.402323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:18:41.404878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:18:41.408167 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-865ac2db-e90a-4f8a-a645-9e50cd9ad8ac tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.676198 Oct 22 03:18:41.424784 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1632/3277] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:40 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:41.430714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1e020be8-56ba-44c2-9317-0a36d638dca7 req-ad1acfc0-0d34-4af8-add3-d5e2cb19d571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-plugged", "status": "completed", "tag": "68f3580a-51db-4299-85ac-3cbfb72ad4d5"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-plugged", "status": "completed", "tag": "e509da0c-c791-4c06-ac72-984dbf14fd51"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-plugged", "status": "completed", "tag": "e8806837-4020-40fd-8dd1-cf247a8a5b36"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:41.443073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1e020be8-56ba-44c2-9317-0a36d638dca7 req-ad1acfc0-0d34-4af8-add3-d5e2cb19d571 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:41.450682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1e020be8-56ba-44c2-9317-0a36d638dca7 req-ad1acfc0-0d34-4af8-add3-d5e2cb19d571 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:41.451628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1e020be8-56ba-44c2-9317-0a36d638dca7 req-ad1acfc0-0d34-4af8-add3-d5e2cb19d571 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:41.475389 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1e020be8-56ba-44c2-9317-0a36d638dca7 req-ad1acfc0-0d34-4af8-add3-d5e2cb19d571 service nova] Creating event network-vif-plugged:68f3580a-51db-4299-85ac-3cbfb72ad4d5 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:41.483417 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1e020be8-56ba-44c2-9317-0a36d638dca7 req-ad1acfc0-0d34-4af8-add3-d5e2cb19d571 service nova] Creating event network-vif-plugged:e509da0c-c791-4c06-ac72-984dbf14fd51 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:41.485314 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1e020be8-56ba-44c2-9317-0a36d638dca7 req-ad1acfc0-0d34-4af8-add3-d5e2cb19d571 service nova] Creating event network-vif-plugged:e8806837-4020-40fd-8dd1-cf247a8a5b36 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:41.494807 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1e020be8-56ba-44c2-9317-0a36d638dca7 req-ad1acfc0-0d34-4af8-add3-d5e2cb19d571 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.066934 Oct 22 03:18:41.496974 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1633/3278] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:41.502803 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81388553-610c-47bb-9c7b-34d2d89c77e2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042245 Oct 22 03:18:41.510660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1646/3279] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:18:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:18:41.511062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2b66c45-5965-407c-9470-816b2ffd83f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a3f0ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:41.516504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:41.517116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:41.534647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:41.535146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:41.535584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:41.543425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:41.558387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:41.570597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:41.607540 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2b66c45-5965-407c-9470-816b2ffd83f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.100301 Oct 22 03:18:41.617461 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1634/3280] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:41 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:41.623725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bbdd8d12-279a-4347-84a5-ec98a6bc3da0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:41.624811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bbdd8d12-279a-4347-84a5-ec98a6bc3da0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:41.742605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bbdd8d12-279a-4347-84a5-ec98a6bc3da0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:41.760650 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bbdd8d12-279a-4347-84a5-ec98a6bc3da0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1215 microversion: 2.1 time: 0.141332 Oct 22 03:18:41.776921 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1635/3281] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:41 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:41.776921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:41.776921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:41.794630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:41.795665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:41.796814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:41.799529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:41.800247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:41.801608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:41.961292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:41.970379 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b26dd5e-c3de-4e6b-a780-ee1ab72573f8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.458176 Oct 22 03:18:41.973957 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1647/3282] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:41 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:41.991767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:41.992689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:42.012555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:42.014406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:42.015007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:42.016241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:42.017057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:42.017633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:42.183329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:42.203313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:42.208263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:42.212643 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-636b9e2d-2d48-4dcb-b752-245da92adfbe tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.447004 Oct 22 03:18:42.213470 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1636/3283] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:41 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:42.257146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:42.268881 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-636f3779-7a66-4813-ae15-bfffe7d8e698 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 0.293796 Oct 22 03:18:42.270011 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1648/3284] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:41 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:42.436598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:42.437219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:42.447985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:42.449981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:42.451760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:42.453442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:42.454689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:42.457616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:42.627088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b158c178-c0e3-4643-a4c5-955a7af7f59c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e523820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:42.739015 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b158c178-c0e3-4643-a4c5-955a7af7f59c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.118685 Oct 22 03:18:42.742009 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1649/3285] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:42 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:42.786474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:42.787678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:42.809302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:42.810478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:42.811089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:42.811990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:42.812727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:42.813607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:43.009675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:43.019105 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33621963-56ff-4a0f-9605-cd143604f597 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1267 microversion: 2.1 time: 0.236903 Oct 22 03:18:43.024276 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1650/3286] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:42 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:43.042564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:43.044573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:43.061693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:43.062639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:43.063087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:43.072431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:43.072917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:43.077360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:43.528624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:43.549412 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1de15b8a-3c04-4f56-ab11-bbf838adf5bc tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 1.116621 Oct 22 03:18:43.551716 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1637/3287] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:42 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:43.572670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:43.575799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:43.609793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:43.612008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:43.614308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:43.615769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:43.618538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:43.619325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:43.634413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:43.645742 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4be71c49-73bb-4db2-ad66-16d372af1056 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.615698 Oct 22 03:18:43.651847 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1651/3288] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:43 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:43.667493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:43.668570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:43.685686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:43.686463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:43.687074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:43.688032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:43.692564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:43.693266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:44.680261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:44.702133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:44.708519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:44.710157 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a614da7c-965a-43b0-a816-585f7b0c5d90 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 1.155307 Oct 22 03:18:44.714995 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1638/3289] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:43 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:44.722840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9202cf7b-14c9-4f9a-b9f8-51f835e39628 req-51289e80-383a-4a10-a9ce-8db47b93b8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e062bf-a697-4a20-aeda-260c6517a642", "name": "network-vif-unplugged", "status": "completed", "tag": "5239c0bb-27a6-4165-99e2-b35fe986107c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:44.752807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:44.755043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9202cf7b-14c9-4f9a-b9f8-51f835e39628 req-51289e80-383a-4a10-a9ce-8db47b93b8bc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:44.757263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9202cf7b-14c9-4f9a-b9f8-51f835e39628 req-51289e80-383a-4a10-a9ce-8db47b93b8bc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:44.757967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9202cf7b-14c9-4f9a-b9f8-51f835e39628 req-51289e80-383a-4a10-a9ce-8db47b93b8bc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:44.774255 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce63d49a-93d8-4670-a075-0256c3bda86a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 1.117887 Oct 22 03:18:44.780260 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1652/3290] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:43 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:44.802789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-21ae7233-7a44-48fb-9543-432a48da4472 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19fef280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:44.805242 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9202cf7b-14c9-4f9a-b9f8-51f835e39628 req-51289e80-383a-4a10-a9ce-8db47b93b8bc service nova] Creating event network-vif-unplugged:5239c0bb-27a6-4165-99e2-b35fe986107c for instance 54e062bf-a697-4a20-aeda-260c6517a642 on n-h2-862416-2 Oct 22 03:18:44.818505 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9202cf7b-14c9-4f9a-b9f8-51f835e39628 req-51289e80-383a-4a10-a9ce-8db47b93b8bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099957 Oct 22 03:18:44.821710 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1639/3291] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:44.829903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:44.845598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:44.865616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:44.866392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:44.867012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:44.867994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:44.870836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:44.871607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:44.908375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-21ae7233-7a44-48fb-9543-432a48da4472 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.126475 Oct 22 03:18:44.910709 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1653/3292] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:44 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:44.925695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-92a46e80-3e27-4ba9-8608-3bf464bca980 req-9b65824f-117c-4c8a-bb50-8163094a78a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7148fe4-73ad-4a88-bec8-4a2f3b8c048c", "name": "network-vif-unplugged", "status": "completed", "tag": "e4a97d34-19eb-4cea-a921-73201896b2ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:44.945805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-92a46e80-3e27-4ba9-8608-3bf464bca980 req-9b65824f-117c-4c8a-bb50-8163094a78a7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:44.946377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-92a46e80-3e27-4ba9-8608-3bf464bca980 req-9b65824f-117c-4c8a-bb50-8163094a78a7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:44.946970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-92a46e80-3e27-4ba9-8608-3bf464bca980 req-9b65824f-117c-4c8a-bb50-8163094a78a7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:44.964962 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-92a46e80-3e27-4ba9-8608-3bf464bca980 req-9b65824f-117c-4c8a-bb50-8163094a78a7 service nova] Creating event network-vif-unplugged:e4a97d34-19eb-4cea-a921-73201896b2ac for instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c on n-h1-862416-2 Oct 22 03:18:44.975652 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-92a46e80-3e27-4ba9-8608-3bf464bca980 req-9b65824f-117c-4c8a-bb50-8163094a78a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063232 Oct 22 03:18:44.977759 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1654/3293] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:44.988667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:44.990552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:44.999792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:45.000927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:45.001569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:45.012171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:45.013225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:45.014437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:45.289759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:45.305232 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa2d001a-7e57-49a4-bb94-767db8edfc1a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1273 microversion: 2.1 time: 0.481809 Oct 22 03:18:45.306433 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1640/3294] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:44 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1273 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:45.324084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:45.333806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:45.350076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:45.350719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:45.351352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:45.352871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:45.353508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:45.354258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:45.473828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:45.495400 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6fdd9e60-fed1-4210-b9a7-f3ae1faa2e1a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.515275 Oct 22 03:18:45.507869 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1655/3295] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:44 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:45.743719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:45.744348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:45.758945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:45.760237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:45.764013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:45.765041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:45.765658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:45.766763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:45.865395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:45.965905 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5372e2f-ffcd-4ffc-8d6d-3c102b9bef04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.654155 Oct 22 03:18:45.975810 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1641/3296] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:45 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:46.012562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:46.014888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:46.033444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:46.036351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:46.037009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:46.038399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:46.043120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:46.045405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:46.407763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:46.427620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:46.430101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:46.431647 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42378538-1c5b-4f1f-81e6-a417c16f4983 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.692050 Oct 22 03:18:46.433714 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1656/3297] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:45 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:46.441534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-683ae290-f3ea-4a8c-ab2d-81fa1af2568b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e50f940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:46.534664 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-683ae290-f3ea-4a8c-ab2d-81fa1af2568b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.099061 Oct 22 03:18:46.535987 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1657/3298] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:46 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:46.542526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:46.543524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:46.551655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:46.552697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:46.553375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:46.554332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:46.555370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:46.556237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:46.726828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:46.738149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f77d823a-0b7c-4ff3-966a-98b108a22d4d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1273 microversion: 2.1 time: 0.200661 Oct 22 03:18:46.757298 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1658/3299] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:46 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:46.764259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:46.765723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:46.773659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:46.774502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:46.775119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:46.775997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:46.777206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:46.777995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:46.975392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:46.992878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c37bb65c-f807-4db6-ba59-236a847faef8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.233748 Oct 22 03:18:47.007424 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1659/3300] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:46 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:47.007424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e8a7518b-02e9-42c9-9086-ee534c9a3721 req-8521a3f2-ff47-4b7a-b3f2-c74268028948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-plugged", "status": "completed", "tag": "6d3eca57-341f-44a5-8d5c-6b4ad5b49b6f"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-plugged", "status": "completed", "tag": "d5499ec1-d470-43a9-917f-7d60133064b3"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-plugged", "status": "completed", "tag": "43dc5922-98fe-4209-b3a5-149d285766a6"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:47.038458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e8a7518b-02e9-42c9-9086-ee534c9a3721 req-8521a3f2-ff47-4b7a-b3f2-c74268028948 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.039529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e8a7518b-02e9-42c9-9086-ee534c9a3721 req-8521a3f2-ff47-4b7a-b3f2-c74268028948 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.055038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e8a7518b-02e9-42c9-9086-ee534c9a3721 req-8521a3f2-ff47-4b7a-b3f2-c74268028948 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:47.096120 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e8a7518b-02e9-42c9-9086-ee534c9a3721 req-8521a3f2-ff47-4b7a-b3f2-c74268028948 service nova] Creating event network-vif-plugged:6d3eca57-341f-44a5-8d5c-6b4ad5b49b6f for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:47.097204 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e8a7518b-02e9-42c9-9086-ee534c9a3721 req-8521a3f2-ff47-4b7a-b3f2-c74268028948 service nova] Creating event network-vif-plugged:d5499ec1-d470-43a9-917f-7d60133064b3 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:47.098885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e8a7518b-02e9-42c9-9086-ee534c9a3721 req-8521a3f2-ff47-4b7a-b3f2-c74268028948 service nova] Creating event network-vif-plugged:43dc5922-98fe-4209-b3a5-149d285766a6 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:47.117554 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e8a7518b-02e9-42c9-9086-ee534c9a3721 req-8521a3f2-ff47-4b7a-b3f2-c74268028948 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.113667 Oct 22 03:18:47.120678 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1660/3301] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:47.143407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:47.144715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:47.170243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.170972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.171706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:47.172707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.175131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.176005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:47.542280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:47.563281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4be2ef3-4f9d-49bc-a83b-e7b71f85916d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 1.585976 Oct 22 03:18:47.569696 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1642/3302] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:45 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:47.575483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-bac09687-7900-4d2e-9fdd-19202723fb73 req-d5f9c35c-01f0-4911-acd7-e87bd6cd71e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e062bf-a697-4a20-aeda-260c6517a642", "name": "network-vif-deleted", "tag": "5239c0bb-27a6-4165-99e2-b35fe986107c"}, {"name": "network-changed", "server_uuid": "a7148fe4-73ad-4a88-bec8-4a2f3b8c048c", "tag": "e4a97d34-19eb-4cea-a921-73201896b2ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:47.607158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bac09687-7900-4d2e-9fdd-19202723fb73 req-d5f9c35c-01f0-4911-acd7-e87bd6cd71e4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.620845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bac09687-7900-4d2e-9fdd-19202723fb73 req-d5f9c35c-01f0-4911-acd7-e87bd6cd71e4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.621823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bac09687-7900-4d2e-9fdd-19202723fb73 req-d5f9c35c-01f0-4911-acd7-e87bd6cd71e4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:47.643668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:47.655462 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-bac09687-7900-4d2e-9fdd-19202723fb73 req-d5f9c35c-01f0-4911-acd7-e87bd6cd71e4 service nova] Creating event network-vif-deleted:5239c0bb-27a6-4165-99e2-b35fe986107c for instance 54e062bf-a697-4a20-aeda-260c6517a642 on n-h2-862416-2 Oct 22 03:18:47.658191 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9cd9914e-d578-4ef6-9bcc-59785ff4a9f3 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.534008 Oct 22 03:18:47.658867 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1661/3303] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:47 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:47.659403 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-bac09687-7900-4d2e-9fdd-19202723fb73 req-d5f9c35c-01f0-4911-acd7-e87bd6cd71e4 service nova] Creating event network-changed:e4a97d34-19eb-4cea-a921-73201896b2ac for instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c on n-h1-862416-2 Oct 22 03:18:47.667683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ef0938e8-7f55-4c1d-910a-4b2ea23274f2 req-370a7448-0a49-48de-8659-0652f90a53d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158a3acf-7c48-47fc-868c-3e89b334ccb6", "tag": "3c7caeca-15d0-4a19-a1bf-26b57012359c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:47.668829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:47.679796 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-bac09687-7900-4d2e-9fdd-19202723fb73 req-d5f9c35c-01f0-4911-acd7-e87bd6cd71e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108503 Oct 22 03:18:47.700490 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1643/3304] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:47.705291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ef0938e8-7f55-4c1d-910a-4b2ea23274f2 req-370a7448-0a49-48de-8659-0652f90a53d2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.706561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ef0938e8-7f55-4c1d-910a-4b2ea23274f2 req-370a7448-0a49-48de-8659-0652f90a53d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.710945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:47.712518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ef0938e8-7f55-4c1d-910a-4b2ea23274f2 req-370a7448-0a49-48de-8659-0652f90a53d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:47.725664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:47.751735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.754316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.761806 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ef0938e8-7f55-4c1d-910a-4b2ea23274f2 req-370a7448-0a49-48de-8659-0652f90a53d2 service nova] Creating event network-changed:3c7caeca-15d0-4a19-a1bf-26b57012359c for instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 on n-h1-862416-2 Oct 22 03:18:47.762133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:47.763242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.766444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.771097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:47.784107 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ef0938e8-7f55-4c1d-910a-4b2ea23274f2 req-370a7448-0a49-48de-8659-0652f90a53d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121382 Oct 22 03:18:47.786498 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1662/3305] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:47.817270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05ebfacd-dcc7-4009-bfbb-c8030a67f979 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e523790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:47.932085 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05ebfacd-dcc7-4009-bfbb-c8030a67f979 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.144073 Oct 22 03:18:47.933846 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1663/3306] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:47 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:47.943311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:47.945126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:47.954862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.955646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.956316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:47.957250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:47.957874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:47.958947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:48.081436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:48.095249 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f778655-774d-41da-afd2-d175e29aec33 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1273 microversion: 2.1 time: 0.160146 Oct 22 03:18:48.096434 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1664/3307] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:47 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:48.106531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:48.110104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:48.116703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:48.117450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:48.118233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:48.119126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:48.119750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:48.120488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:48.470435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:48.488797 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55d26a83-9ceb-4840-bf14-cd940d065a4f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.390793 Oct 22 03:18:48.491809 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1665/3308] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:48 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:48.596723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:48.597346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:48.618500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:48.619357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:48.623045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:48.624226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:48.631772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:48.633178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:48.975432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:48.987831 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b9f7e00-ace7-421e-955a-ae8d76b7f11a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 0.396382 Oct 22 03:18:48.988944 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1666/3309] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:48 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:48.994780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:48.996121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:49.002771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:49.003333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:49.003842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:49.004824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:49.005354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:49.005853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:49.041259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:49.058969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:49.061641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:49.065714 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d63b711-a63f-4d43-96bb-050e8a179e46 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 1.361722 Oct 22 03:18:49.066673 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1644/3310] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:47 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:49.086617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f740939a-d86e-4780-b673-9136f83e9011 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a0d10d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:49.169095 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f740939a-d86e-4780-b673-9136f83e9011 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.086493 Oct 22 03:18:49.176408 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1645/3311] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:49 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:49.182104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:49.182799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:49.203909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:49.204477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:49.204925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:49.205654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:49.206113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:49.206553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:49.233564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:49.242366 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b65acec3-3641-4970-b460-de797368dea1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.251998 Oct 22 03:18:49.258337 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1667/3312] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:48 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:49.266797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c9970f0c-c897-4ccf-a770-c5e2508a943c req-0dc0e65b-fc13-43c6-8df8-76a86f8cb8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-plugged", "status": "completed", "tag": "1803c5cf-d162-456c-9d47-fbf742cc2117"}, {"server_uuid": "74de4a13-4c74-449e-97da-d93bc3215451", "name": "network-vif-plugged", "status": "completed", "tag": "12c5b67b-a6f5-4bf2-a486-6a04eed55ee9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:49.300252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c9970f0c-c897-4ccf-a770-c5e2508a943c req-0dc0e65b-fc13-43c6-8df8-76a86f8cb8a0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:49.309865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c9970f0c-c897-4ccf-a770-c5e2508a943c req-0dc0e65b-fc13-43c6-8df8-76a86f8cb8a0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:49.310549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c9970f0c-c897-4ccf-a770-c5e2508a943c req-0dc0e65b-fc13-43c6-8df8-76a86f8cb8a0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:49.337695 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c9970f0c-c897-4ccf-a770-c5e2508a943c req-0dc0e65b-fc13-43c6-8df8-76a86f8cb8a0 service nova] Creating event network-vif-plugged:1803c5cf-d162-456c-9d47-fbf742cc2117 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:49.338690 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c9970f0c-c897-4ccf-a770-c5e2508a943c req-0dc0e65b-fc13-43c6-8df8-76a86f8cb8a0 service nova] Creating event network-vif-plugged:12c5b67b-a6f5-4bf2-a486-6a04eed55ee9 for instance 74de4a13-4c74-449e-97da-d93bc3215451 on n-h1-862416-2 Oct 22 03:18:49.348810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c9970f0c-c897-4ccf-a770-c5e2508a943c req-0dc0e65b-fc13-43c6-8df8-76a86f8cb8a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088691 Oct 22 03:18:49.349721 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1668/3313] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:49.518503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:49.520172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:49.538787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:49.539286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:49.539796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:49.540531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:49.540986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:49.541411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:49.849424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:49.860918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:49.866593 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4ca3a742-64ea-4118-807d-7f8120b4c77a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.688947 Oct 22 03:18:49.867502 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1646/3314] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:49 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:49.894660 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2eb567f0-f737-48b7-9add-353aab1b056d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.384035 Oct 22 03:18:49.895774 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1669/3315] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:49 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:50.013083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:50.014070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:50.022302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.023033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.023969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.024906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.025532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.026163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.095702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:50.096100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:50.104933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.105983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.106617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.107513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.108129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.108758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.134813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:50.271453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:50.281285 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a908b26e-dcd0-4272-af8e-46315b1e60a8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 0.274055 Oct 22 03:18:50.296729 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1647/3316] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:50 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:50.312896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47a6f132-bf18-4106-b1a0-f840ff6528e9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19ae95e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:50.340915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:50.352557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:50.354786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:50.356478 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c1b679f-40c3-485e-9ce7-600fff929db7 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 0.265182 Oct 22 03:18:50.357235 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1670/3317] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:50 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:18:50.362728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:50.363552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:50.370867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.371574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.372174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.373093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.373726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.374310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.391563 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47a6f132-bf18-4106-b1a0-f840ff6528e9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.093396 Oct 22 03:18:50.392501 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1648/3318] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:50 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:50.562350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:50.572773 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8e01e2b7-e7ea-4a90-95f4-c0a1b0f770fa tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.214259 Oct 22 03:18:50.574308 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1671/3319] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:50 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:50.894218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:50.894746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:50.911370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.918826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:50.919557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:50.928148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.928638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.933316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.936843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.938637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.940678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.941494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.942942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:50.943849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:50.947369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:50.948735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:51.192842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:51.216276 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3eb8181f-0da3-4cf1-a5e7-a7fed54c90a8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.301856 Oct 22 03:18:51.223758 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1672/3320] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:50 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:51.313101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:51.313721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:51.321863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:51.331290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:51.332175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:51.333189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:51.333832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:51.334442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:51.335650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:51.388501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:51.542527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:51.552816 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6672db7e-913a-4348-b7a9-1f448550e275 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 0.244007 Oct 22 03:18:51.553521 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1673/3321] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:51 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:51.559997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8c780ddf-39f5-436b-9044-77506e1fe254 req-b7714e46-812b-4c79-8bdc-bd4610549e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281a3e2d-131a-4125-9072-43ebd1e60816", "name": "network-vif-plugged", "status": "completed", "tag": "38221c9d-5a9f-42f9-bfbb-7558934d1926"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:51.579396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8c780ddf-39f5-436b-9044-77506e1fe254 req-b7714e46-812b-4c79-8bdc-bd4610549e39 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:51.579949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8c780ddf-39f5-436b-9044-77506e1fe254 req-b7714e46-812b-4c79-8bdc-bd4610549e39 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:51.580467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8c780ddf-39f5-436b-9044-77506e1fe254 req-b7714e46-812b-4c79-8bdc-bd4610549e39 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:51.595306 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8c780ddf-39f5-436b-9044-77506e1fe254 req-b7714e46-812b-4c79-8bdc-bd4610549e39 service nova] Creating event network-vif-plugged:38221c9d-5a9f-42f9-bfbb-7558934d1926 for instance 281a3e2d-131a-4125-9072-43ebd1e60816 on n-h2-862416-2 Oct 22 03:18:51.601006 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8c780ddf-39f5-436b-9044-77506e1fe254 req-b7714e46-812b-4c79-8bdc-bd4610549e39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045948 Oct 22 03:18:51.601913 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1674/3322] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:51.608686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:51.609388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:51.616467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:51.617462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:51.617907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:51.618630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:51.619225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:51.619663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:51.759326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:51.787326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:51.800679 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79637e0e-74ed-4f51-b502-c7c1097750e1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.911991 Oct 22 03:18:51.801830 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1649/3323] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:50 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:51.812474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee0a4306-cba8-4bb9-897f-0b6fc94535ac tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e4b3940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:51.908653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee0a4306-cba8-4bb9-897f-0b6fc94535ac tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.095479 Oct 22 03:18:51.914122 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1650/3324] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:51 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:51.933895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:51.936582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:51.958882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:51.959762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:51.960504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:51.961564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:51.962308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:51.962996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:52.603210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:52.616802 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e08ea4f-3312-4219-a48f-aa748ae05cf4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.691512 Oct 22 03:18:52.617407 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1651/3325] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:51 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:52.637319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:52.637943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:52.644428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:52.644927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:52.645365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:52.646080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:52.654934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:52.655401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:53.062659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:53.078132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:53.096371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:53.097680 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c83a38da-f7e8-4d95-ad5e-422b00857adf tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1879 microversion: 2.42 time: 1.494642 Oct 22 03:18:53.129389 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1675/3326] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:51 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1879 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:53.147414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:53.148039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:53.185182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:53.185788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:53.189123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:53.196043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:53.198441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:53.201647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:53.319160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:53.334728 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01c80857-4762-42e8-92ba-b0a3f6658c29 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.716231 Oct 22 03:18:53.339588 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1652/3327] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:52 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:53.361975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:53.364519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:53.388895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:53.389410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:53.389871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:53.390591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:53.399964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:53.400506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:53.654197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:53.668975 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63685db6-0262-441a-bb0e-c4fa54f0bc13 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 0.538296 Oct 22 03:18:53.670225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1676/3328] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:53 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:53.686766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-608b63bf-21c1-40ad-a5b4-d7a33e07e42f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19927160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:53.796579 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-608b63bf-21c1-40ad-a5b4-d7a33e07e42f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.123798 Oct 22 03:18:53.826389 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1677/3329] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:53 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:53.842138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:53.847778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:53.867139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:53.868096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:53.868809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:53.884899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:53.887225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:53.889479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.016797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:54.025134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:54.046297 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e15a4c9-5a96-477a-ad73-a800ae988355 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.693877 Oct 22 03:18:54.047789 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1653/3330] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:53 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:54.099088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-76b02463-24d4-4e52-aacc-b61d99081df7 req-2057dcf9-7b62-4cd1-894a-d907c6f6c0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f667e973-b796-44b6-9ab4-9fde79a741ac", "tag": "ad74246e-0c7b-4ede-9595-9b35122dc41a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:54.148649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-76b02463-24d4-4e52-aacc-b61d99081df7 req-2057dcf9-7b62-4cd1-894a-d907c6f6c0d0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.149481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-76b02463-24d4-4e52-aacc-b61d99081df7 req-2057dcf9-7b62-4cd1-894a-d907c6f6c0d0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.150204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-76b02463-24d4-4e52-aacc-b61d99081df7 req-2057dcf9-7b62-4cd1-894a-d907c6f6c0d0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.201059 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-76b02463-24d4-4e52-aacc-b61d99081df7 req-2057dcf9-7b62-4cd1-894a-d907c6f6c0d0 service nova] Creating event network-changed:ad74246e-0c7b-4ede-9595-9b35122dc41a for instance f667e973-b796-44b6-9ab4-9fde79a741ac on n-h1-862416-2 Oct 22 03:18:54.222999 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-76b02463-24d4-4e52-aacc-b61d99081df7 req-2057dcf9-7b62-4cd1-894a-d907c6f6c0d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127953 Oct 22 03:18:54.223950 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1654/3331] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:18:54.236023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:54.241753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:54.257334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.259541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.260196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.267293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.268030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.268755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.328837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:54.342033 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b922177b-0510-41c8-b3f2-f2a33208101c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.508319 Oct 22 03:18:54.350495 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1678/3332] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:53 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:54.365406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:54.374178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:54.392485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.397873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.404245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.406815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.409076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.411828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.712814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:54.738218 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-840acf0d-8705-4291-b690-7dee4ebaf1e5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1307 microversion: 2.1 time: 0.376642 Oct 22 03:18:54.739428 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1679/3333] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:54 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1307 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:54.745599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:54.746904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:54.756992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.757843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.758575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.759663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.760628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.761790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.776689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:54.794974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:54.801432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:54.803310 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ddf6a0bc-dd32-4fce-bfb8-c69c33ddd192 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2835 microversion: 2.42 time: 0.577065 Oct 22 03:18:54.805650 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1655/3334] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:18:54 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2835 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:54.819186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04685727-1e14-4920-9b6f-76736eca7788 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a0433a0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:54.921625 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04685727-1e14-4920-9b6f-76736eca7788 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.105490 Oct 22 03:18:54.933381 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1656/3335] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:54 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:54.945863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:54.947661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:54.969263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.971069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.972678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:54.977513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:54.983060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:54.983915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:55.199460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:55.207726 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf84de42-923b-46d3-95d2-61d844267e5d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 0.466596 Oct 22 03:18:55.208347 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1680/3336] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:54 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:55.237773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:55.238325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:55.253612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:55.254114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:55.254558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:55.255275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:55.255737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:55.256176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:55.377980 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-343ba4bd-b0ef-4a80-8cf8-512b695491ae tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.442210 Oct 22 03:18:55.379180 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1657/3337] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Oct 22 03:18:54 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813/os-interface => generated 1830 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:18:55.384148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:55.385051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:55.404805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:55.405467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:55.406094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:55.412602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:55.413502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:55.414796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:55.507654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:55.516702 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65a8af02-ae2f-4ff5-8d0f-e809bc9f795a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.284574 Oct 22 03:18:55.517299 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1681/3338] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:55 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:55.763811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:55.764617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:55.771022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:55.771985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:55.772759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:55.773703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:55.774395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:55.775068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:55.956736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:55.974525 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9f4394b-b614-4411-83d2-1bd9be2b73b8 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.591774 Oct 22 03:18:55.989766 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1658/3339] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:55 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:55.998792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b32fdc6-ea5d-473e-b8e4-ea44da101204 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1999c700>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:56.039946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:56.057537 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1af4ed8a-ddd9-4d49-bf84-2e6ad279c7d5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1488 microversion: 2.1 time: 0.295963 Oct 22 03:18:56.059082 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1682/3340] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:55 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1488 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:56.068863 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b32fdc6-ea5d-473e-b8e4-ea44da101204 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.077451 Oct 22 03:18:56.069535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1659/3341] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:55 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:56.082338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:56.083072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:56.089895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:56.090387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:56.090828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:56.091525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:56.092979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:56.093586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:56.130106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:18:56.239800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:56.241091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:56.250459 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-287f3228-258d-4bf7-a5b0-41ea21a9dce5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 204 len: 0 microversion: 2.1 time: 0.173414 Oct 22 03:18:56.253538 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1683/3342] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:18:56 2022] DELETE /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:18:56.255605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:56.263006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:56.263800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:56.264447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:56.267427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:56.268092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:56.268618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:56.270277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:56.271702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:56.289231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:56.296579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:56.297361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:56.298989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:56.301278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:56.303498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:56.305290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:56.640657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:56.650934 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e0856dc4-a19c-469d-862d-88dd2cac9d7c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1494 microversion: 2.1 time: 0.392598 Oct 22 03:18:56.653394 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1684/3343] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:56 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1494 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:56.658766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:56.659660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:56.666099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:56.666909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:56.667601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:56.668696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:56.669383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:56.670036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:56.845577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:56.856906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e72a276-70af-4059-b386-52481b8de9bb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.200255 Oct 22 03:18:56.857722 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1685/3344] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:56 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:57.006585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:57.007194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:57.017797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:57.018285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:57.018717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:57.019436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:57.019869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:57.020307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:57.090668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:57.101389 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19c737db-c967-402f-8882-eca663eb59bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 0.868987 Oct 22 03:18:57.101986 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1660/3345] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:56 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:57.117667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-207d4e46-b009-4c80-9bdd-57d9bc813e9e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a4944c0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:57.210081 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-207d4e46-b009-4c80-9bdd-57d9bc813e9e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.104269 Oct 22 03:18:57.224282 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1661/3346] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:57 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:57.240100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:57.245013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:18:57.258319 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fd0627f3-4efe-4ea5-b0a4-5ee6e8261a14 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.252824 Oct 22 03:18:57.272245 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1686/3347] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:57 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:18:57.542018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1215411062", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "c0747e4b-58ef-4848-83fa-65f3a78791a3"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:57.619205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] validate_networks() for [('c0747e4b-58ef-4848-83fa-65f3a78791a3', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:18:57.676732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:57.678028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:57.691983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:57.695160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:57.696572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:57.697355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:57.699118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:57.699743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:58.129701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:58.161049 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-720f8185-b6ba-4631-9b6b-b0ae0ca7843c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1494 microversion: 2.1 time: 0.485241 Oct 22 03:18:58.163815 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1687/3348] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:57 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1494 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:58.175032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-86205a08-b963-4735-8225-e553c18966ba req-13054d91-5458-4628-a3f4-b9a2f315c8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158a3acf-7c48-47fc-868c-3e89b334ccb6", "name": "network-vif-plugged", "status": "completed", "tag": "3c7caeca-15d0-4a19-a1bf-26b57012359c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:58.201033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86205a08-b963-4735-8225-e553c18966ba req-13054d91-5458-4628-a3f4-b9a2f315c8fa service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:58.201520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86205a08-b963-4735-8225-e553c18966ba req-13054d91-5458-4628-a3f4-b9a2f315c8fa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:58.201953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86205a08-b963-4735-8225-e553c18966ba req-13054d91-5458-4628-a3f4-b9a2f315c8fa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:58.233207 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-86205a08-b963-4735-8225-e553c18966ba req-13054d91-5458-4628-a3f4-b9a2f315c8fa service nova] Creating event network-vif-plugged:3c7caeca-15d0-4a19-a1bf-26b57012359c for instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 on n-h1-862416-2 Oct 22 03:18:58.241383 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-86205a08-b963-4735-8225-e553c18966ba req-13054d91-5458-4628-a3f4-b9a2f315c8fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075819 Oct 22 03:18:58.242156 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1688/3349] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:58.257120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:58.257760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:58.290585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:58.291082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:58.291522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:58.292955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:58.293407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:58.293832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:58.739076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:58.754619 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f992e25d-7579-47c8-aae2-60ffb96a0a5b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.509002 Oct 22 03:18:58.764939 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1689/3350] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:58 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:58.771218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:58.771218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:58.783504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:58.785368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:58.786674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:58.787613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:58.790655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:58.791324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.078128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:59.092581 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-738aa0db-f0b9-4a9c-b3a1-8eb7389c1a52 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1317 microversion: 2.1 time: 0.335077 Oct 22 03:18:59.093609 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1690/3351] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:58 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:59.103914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39151964-7aff-45cb-a2f5-bb74409fbed3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19f67e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:59.203514 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39151964-7aff-45cb-a2f5-bb74409fbed3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.108662 Oct 22 03:18:59.212465 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1691/3352] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:18:59 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:59.212465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:59.212465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:59.233294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:59.233898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:59.234151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.240823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:59.241615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:59.243179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.454007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:18:59.455021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:18:59.455701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:18:59.456309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:18:59.456885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:18:59.483627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:59.484142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:59.484623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.485389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:59.485850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:59.486274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.540537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Getting quotas for project dddd83fcb68b40a7980dad9eb74ac6f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:18:59.555638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Getting quotas for user a11814f93de146b2ba7c05b4c27bb7c7 and project dddd83fcb68b40a7980dad9eb74ac6f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:18:59.600282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:18:59.602995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:18:59.701949 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e342d155-ee16-48c2-a904-323da86f1cc5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.341016 Oct 22 03:18:59.709102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1662/3353] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:18:59.720096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7dc0f2ac-3ec8-4fc1-8f8f-1e60d39afc49 req-b4311b1a-0562-422f-816e-e3a7869cae41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "tag": "68f3580a-51db-4299-85ac-3cbfb72ad4d5"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:18:59.744135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7dc0f2ac-3ec8-4fc1-8f8f-1e60d39afc49 req-b4311b1a-0562-422f-816e-e3a7869cae41 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:59.745519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7dc0f2ac-3ec8-4fc1-8f8f-1e60d39afc49 req-b4311b1a-0562-422f-816e-e3a7869cae41 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:59.751967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7dc0f2ac-3ec8-4fc1-8f8f-1e60d39afc49 req-b4311b1a-0562-422f-816e-e3a7869cae41 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.756885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:18:59.771284 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b9d4cfc-a8b6-4334-bdef-bc3bdfc65a98 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1391 microversion: 2.1 time: 0.565750 Oct 22 03:18:59.781707 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7dc0f2ac-3ec8-4fc1-8f8f-1e60d39afc49 req-b4311b1a-0562-422f-816e-e3a7869cae41 service nova] Creating event network-changed:68f3580a-51db-4299-85ac-3cbfb72ad4d5 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:18:59.792278 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1692/3354] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:59 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1391 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:18:59.792278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:59.792278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:59.818288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:59.819688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:59.822299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.824155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:59.825280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:59.831602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.846084 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7dc0f2ac-3ec8-4fc1-8f8f-1e60d39afc49 req-b4311b1a-0562-422f-816e-e3a7869cae41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135336 Oct 22 03:18:59.850134 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1663/3355] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:18:59.878293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c37a007-9f68-4d12-a655-5a37a8d6bdd2 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:18:59.882783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c37a007-9f68-4d12-a655-5a37a8d6bdd2 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:18:59.931402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:18:59.934551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:18:59.935299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:18:59.937988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lazy-loading 'fault' on Instance uuid 281a3e2d-131a-4125-9072-43ebd1e60816 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:19:00.036628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:00.053684 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81d40843-98e1-44d7-bf69-ac2a32f3280c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 200 len: 1297 microversion: 2.1 time: 0.266568 Oct 22 03:19:00.055282 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1693/3356] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:59 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 1297 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:00.069526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:00.074462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:00.097997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:00.100772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:00.103422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:00.107778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:00.109320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:00.111151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:00.266843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6c37a007-9f68-4d12-a655-5a37a8d6bdd2 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:00.275317 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c37a007-9f68-4d12-a655-5a37a8d6bdd2 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1217 microversion: 2.1 time: 0.418459 Oct 22 03:19:00.277858 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1664/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:18:59 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1217 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:00.291287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:00.311205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:00.338146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:00.348322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:00.349519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:00.350491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:00.351289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:00.352328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:00.487535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:00.500650 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a81f98a3-75d1-47c3-bc56-eb5cbb4189ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.441258 Oct 22 03:19:00.504916 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1694/3358] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:00 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:00.528094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03b050b6-8924-4cde-9f7f-ed1b9260d3c7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19a4f0d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:00.672924 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03b050b6-8924-4cde-9f7f-ed1b9260d3c7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.164823 Oct 22 03:19:00.684116 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1695/3359] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:00 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:00.815495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:00.816300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:00.832871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:00.834884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:00.836772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:00.837871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:00.839510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:00.840556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:01.191610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:01.232726 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3f14a7c3-2f64-4ec7-a0f7-efa26f782bb8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1508 microversion: 2.1 time: 0.946018 Oct 22 03:19:01.235822 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1665/3360] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:00 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1508 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:01.249490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:01.252666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:01.287685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:01.290342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:01.291061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:01.294063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:01.294884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:01.295849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:01.342979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:01.345450 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 HTTP/1.1 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '281a3e2d-131a-4125-9072-43ebd1e60816'} Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:01.356135 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:01.360655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:01.360655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:01.360655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:01.360655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:01.360655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:01.360655 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:01.362545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:01.372198 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2640c6bf-cf1b-43d9-a87a-96d14f99d12a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 404 len: 111 microversion: 2.1 time: 0.134790 Oct 22 03:19:01.373463 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1666/3361] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:01 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:01.381058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:01.385597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:01.410854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:01.413982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:01.415520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:01.417915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32dac12a-2dc3-4785-9300-a5ae47c988cf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1381 microversion: 2.1 time: 0.606906 Oct 22 03:19:01.418639 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1696/3362] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:00 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1381 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:01.418763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:01.422579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:01.424004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:01.487920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:01.526926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:01.535086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:01.536132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:01.536810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:01.537702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:01.539003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:01.539636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:01.687328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:01.708984 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e9e7bf7-7c3c-4b86-a236-eb6c598c566a tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1269 microversion: 2.1 time: 0.262929 Oct 22 03:19:01.710630 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1697/3363] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:01 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1269 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:01.718464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35abfd44-e901-4222-99f2-7c6290807392 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1e410040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:02.091023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:02.118139 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8008f812-3b70-4e3d-a72a-b45b0a2e2487 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1508 microversion: 2.1 time: 0.742893 Oct 22 03:19:02.136401 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1667/3364] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:01 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1508 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:02.143370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2c2307ed-58d0-4113-9dc1-6f702c5a64af tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '.version_select at 0x7f0d1a84f8b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:02.172991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c2307ed-58d0-4113-9dc1-6f702c5a64af tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:02.173781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c2307ed-58d0-4113-9dc1-6f702c5a64af tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:02.174610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c2307ed-58d0-4113-9dc1-6f702c5a64af tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:02.186306 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2c2307ed-58d0-4113-9dc1-6f702c5a64af tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.048472 Oct 22 03:19:02.205269 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1668/3365] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:19:02 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:02.211963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:02.212849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:02.223069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:02.223831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:02.224691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:02.226478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:02.227456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:02.228064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:02.623315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:02.636510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04b86007-dbf6-4c3e-8bd4-530d3f8903c7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.429040 Oct 22 03:19:02.638891 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1669/3366] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:02 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:02.653264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9fd9c34b-3cc4-4618-ab52-3496888c55c7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a073700>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:02.926054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35abfd44-e901-4222-99f2-7c6290807392 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 204 len: 0 microversion: 2.1 time: 1.214121 Oct 22 03:19:02.933623 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1698/3367] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:01 2022] DELETE /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 0 bytes in 1217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:02.940411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-32f44994-54bc-4a6a-be0a-f589a6e87ebe req-20ecccb3-97f7-44dd-95c9-6dacddeed5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281a3e2d-131a-4125-9072-43ebd1e60816", "name": "network-vif-deleted", "tag": "38221c9d-5a9f-42f9-bfbb-7558934d1926"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:02.967573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-32f44994-54bc-4a6a-be0a-f589a6e87ebe req-20ecccb3-97f7-44dd-95c9-6dacddeed5b9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:02.968055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-32f44994-54bc-4a6a-be0a-f589a6e87ebe req-20ecccb3-97f7-44dd-95c9-6dacddeed5b9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:02.968522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-32f44994-54bc-4a6a-be0a-f589a6e87ebe req-20ecccb3-97f7-44dd-95c9-6dacddeed5b9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:02.979795 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9fd9c34b-3cc4-4618-ab52-3496888c55c7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.338923 Oct 22 03:19:02.981363 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1670/3368] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:02 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:02.988562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:02.988917 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-32f44994-54bc-4a6a-be0a-f589a6e87ebe req-20ecccb3-97f7-44dd-95c9-6dacddeed5b9 service nova] Creating event network-vif-deleted:38221c9d-5a9f-42f9-bfbb-7558934d1926 for instance 281a3e2d-131a-4125-9072-43ebd1e60816 on n-h2-862416-2 Oct 22 03:19:02.992744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:03.002680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.002991 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-32f44994-54bc-4a6a-be0a-f589a6e87ebe req-20ecccb3-97f7-44dd-95c9-6dacddeed5b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065346 Oct 22 03:19:03.003624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.004300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.004976 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1699/3369] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:03.005199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.005672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.006119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.013075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:03.014002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:03.038249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.039003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.039633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.040570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.041188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.042072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.142351 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-07815bf1-827b-478b-8402-235218c3cda9 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "PUT /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1080 microversion: 2.1 time: 0.159535 Oct 22 03:19:03.143873 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1671/3370] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:19:02 2022] PUT /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1080 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:03.154822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:03.155516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:03.162190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.163232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.163993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.165363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.166078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.167542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.260813 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af634aa3-2aa8-45db-9fef-0e4cd36ba308 tempest-LiveMigrationTest-1525662197 tempest-LiveMigrationTest-1525662197-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1532 microversion: 2.1 time: 0.253010 Oct 22 03:19:03.263870 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1700/3371] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:03 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1532 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:03.268915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:03.269575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:03.277727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.279554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.281116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.282305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.282924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.283701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.330020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:03.346213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:03.359490 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7cb55c8c-2f03-4ec0-8e5d-5b0ceece0f4c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1275 microversion: 2.1 time: 0.214189 Oct 22 03:19:03.374089 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1672/3372] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:03 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:03.391899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:03.392772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:03.405316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.406173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.406858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.407904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.408673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.409327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.514867 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a494347-de79-4aa5-b6b6-8be9ed0ee20f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 204 len: 0 microversion: 2.1 time: 0.249361 Oct 22 03:19:03.515753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1701/3373] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:03 2022] DELETE /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:03.521487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:03.522368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:03.535607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.536396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.545747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.546815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.547488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.548683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.601729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:03.706888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:03.720482 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ed1bbf4a-4d1e-43b8-8c55-356a8fae1ba0 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1506 microversion: 2.1 time: 0.342318 Oct 22 03:19:03.724835 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1673/3374] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:03 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:03.735583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:03.736646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:03.766682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.769131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.773626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.776945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.778334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.779235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.818556 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-440ab4b0-d04c-4523-802c-3130481a1ac4 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 204 len: 0 microversion: 2.1 time: 0.296460 Oct 22 03:19:03.819483 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1702/3375] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:03 2022] DELETE /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:03.841682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:03.843728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:03.862922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.864176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.865464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:03.866416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:03.867048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:03.867782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:04.113483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:04.129232 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7512f72-1048-4bf1-922c-5561de998b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1506 microversion: 2.1 time: 0.307996 Oct 22 03:19:04.130821 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1703/3376] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:03 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:04.139055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-351734446", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "49c953fb-5979-4a50-be05-1edf628aca16"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:04.197372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:04.213285 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6842b7c0-f4a2-4a15-82a5-c0620e87dbe2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.486835 Oct 22 03:19:04.218999 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1674/3377] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:03 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:04.225299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:04.226132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:04.241691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:04.242520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:04.243183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:04.245328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:04.246041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:04.246642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:04.251404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] validate_networks() for [('49c953fb-5979-4a50-be05-1edf628aca16', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:19:04.475475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:04.502484 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2b84a8aa-382c-4e5e-bede-12253f7754c1 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1387 microversion: 2.1 time: 0.281993 Oct 22 03:19:04.503910 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1675/3378] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:04 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1387 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:04.509001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0f310b65-0e18-446f-b769-38e7646361c6 req-f6c3b4ae-d9a3-44bd-8c01-7bd3b5aaea00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667e973-b796-44b6-9ab4-9fde79a741ac", "name": "network-vif-plugged", "status": "completed", "tag": "ad74246e-0c7b-4ede-9595-9b35122dc41a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:04.534122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0f310b65-0e18-446f-b769-38e7646361c6 req-f6c3b4ae-d9a3-44bd-8c01-7bd3b5aaea00 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:04.535431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0f310b65-0e18-446f-b769-38e7646361c6 req-f6c3b4ae-d9a3-44bd-8c01-7bd3b5aaea00 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:04.536384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0f310b65-0e18-446f-b769-38e7646361c6 req-f6c3b4ae-d9a3-44bd-8c01-7bd3b5aaea00 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:04.554885 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0f310b65-0e18-446f-b769-38e7646361c6 req-f6c3b4ae-d9a3-44bd-8c01-7bd3b5aaea00 service nova] Creating event network-vif-plugged:ad74246e-0c7b-4ede-9595-9b35122dc41a for instance f667e973-b796-44b6-9ab4-9fde79a741ac on n-h1-862416-2 Oct 22 03:19:04.566467 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0f310b65-0e18-446f-b769-38e7646361c6 req-f6c3b4ae-d9a3-44bd-8c01-7bd3b5aaea00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060813 Oct 22 03:19:04.579162 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1676/3379] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:04.593802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b69e75b-a64e-48f6-b198-47aa4fd38341 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a073dc0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:04.702527 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b69e75b-a64e-48f6-b198-47aa4fd38341 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1452 microversion: 2.1 time: 0.121416 Oct 22 03:19:04.704497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1677/3380] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:04 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:04.711032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:04.714535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:04.722688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:04.723758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:04.726597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:04.726597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:04.726597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:04.727216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:04.951860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:19:04.952748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:19:04.953485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:19:04.954708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:19:04.955599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:19:05.085009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:05.124722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:05.146264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.146772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.147918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.150327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.150590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.151730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.220689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:19:05.222016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:19:05.222668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:19:05.223249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:19:05.223837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:19:05.243775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.246715 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-26dea500-a178-47b6-a3a8-2017db7d9e6a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "POST /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6/action" status: 202 len: 1112 microversion: 2.1 time: 0.540837 Oct 22 03:19:05.247391 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1678/3381] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:19:04 2022] POST /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6/action => generated 1112 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 03:19:05.260611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:05.260611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:05.261453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.262195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.263406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.263600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.264093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.269815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.270309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.270759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.271461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.271997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.272702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.292169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:05.323973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:19:05.330270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Getting quotas for user 2468c1f92230450db3397e1f0e97b5e0 and project 1a5283f2a2d9463f8974ff02871405f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:19:05.345656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:19:05.348123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:19:05.401037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a001c80c-be41-4024-b476-51d0af758741 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268445 Oct 22 03:19:05.402148 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1704/3382] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:19:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:19:05.406999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:05.407887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:05.415815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.417156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.417894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.418966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.419600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.420339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.599802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:05.615997 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6764b795-b55f-47fd-877a-6a93d96185f5 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.367187 Oct 22 03:19:05.628657 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1679/3383] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:05 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:05.640017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:05.640767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:05.655857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.656427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.656950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:05.657599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:05.658062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:05.658500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.269865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:06.273505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:06.282393 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a385f7cd-eda5-4021-b9d0-a3b6a6da9968 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1315 microversion: 2.1 time: 0.879118 Oct 22 03:19:06.288051 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1705/3384] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:05 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:06.298487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:06.299689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:06.303510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5a9a37f-9e93-4c24-9fd7-e328708963be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.684672 Oct 22 03:19:06.307906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.309517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.310168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.311460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.312154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.312814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.327819 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1680/3385] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:05 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:06.346007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:06.346725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:06.365417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.366232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.366933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.368067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.368876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.369565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.495966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:06.509336 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-539d19dc-3a11-4cb4-940b-975cac530b44 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1183 microversion: 2.1 time: 0.180269 Oct 22 03:19:06.524263 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1681/3386] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:06 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:06.524263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ff229e8-4af4-462e-a301-341e0361010f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a043040>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:06.555701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:06.567201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1ba0e8f7-a700-49ec-9cad-ca5a83da3a23 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1211 microversion: 2.1 time: 0.277740 Oct 22 03:19:06.585919 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ff229e8-4af4-462e-a301-341e0361010f tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1461 microversion: 2.1 time: 0.073665 Oct 22 03:19:06.587056 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1682/3387] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:06 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1461 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:06.593517 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1706/3388] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:06 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1211 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:06.598197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-48ffa35a-2e76-4d01-b41a-30d0f9bd9fed req-f6c395d8-b27b-48d4-9e19-b2be04bca3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7148fe4-73ad-4a88-bec8-4a2f3b8c048c", "name": "network-vif-deleted", "tag": "e4a97d34-19eb-4cea-a921-73201896b2ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:06.599255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9e515832-bf4d-47ac-8812-a233ec8ab086 req-db13029e-0a24-4e2b-9706-47f6bdeb1652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "255c9577-b797-4689-89c1-4e0166ced1f3", "tag": "be5b4207-7744-4cf5-828a-7b5360be6e1f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:06.612463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e515832-bf4d-47ac-8812-a233ec8ab086 req-db13029e-0a24-4e2b-9706-47f6bdeb1652 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.613244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e515832-bf4d-47ac-8812-a233ec8ab086 req-db13029e-0a24-4e2b-9706-47f6bdeb1652 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.614003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9e515832-bf4d-47ac-8812-a233ec8ab086 req-db13029e-0a24-4e2b-9706-47f6bdeb1652 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.626222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-48ffa35a-2e76-4d01-b41a-30d0f9bd9fed req-f6c395d8-b27b-48d4-9e19-b2be04bca3a3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.626816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-48ffa35a-2e76-4d01-b41a-30d0f9bd9fed req-f6c395d8-b27b-48d4-9e19-b2be04bca3a3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.627150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-48ffa35a-2e76-4d01-b41a-30d0f9bd9fed req-f6c395d8-b27b-48d4-9e19-b2be04bca3a3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.629703 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9e515832-bf4d-47ac-8812-a233ec8ab086 req-db13029e-0a24-4e2b-9706-47f6bdeb1652 service nova] Creating event network-changed:be5b4207-7744-4cf5-828a-7b5360be6e1f for instance 255c9577-b797-4689-89c1-4e0166ced1f3 on n-h2-862416-2 Oct 22 03:19:06.634957 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9e515832-bf4d-47ac-8812-a233ec8ab086 req-db13029e-0a24-4e2b-9706-47f6bdeb1652 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040177 Oct 22 03:19:06.637586 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1707/3389] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:06.642934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-216394a8-982f-4e93-b04b-96895fd9cafb tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19ffcdc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:06.661914 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-48ffa35a-2e76-4d01-b41a-30d0f9bd9fed req-f6c395d8-b27b-48d4-9e19-b2be04bca3a3 service nova] Creating event network-vif-deleted:e4a97d34-19eb-4cea-a921-73201896b2ac for instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c on n-h2-862416-2 Oct 22 03:19:06.673149 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-48ffa35a-2e76-4d01-b41a-30d0f9bd9fed req-f6c395d8-b27b-48d4-9e19-b2be04bca3a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084578 Oct 22 03:19:06.674089 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1683/3390] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:06.683480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:06.684406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:06.691691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.692636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.693309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.694277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.694890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.695475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.720147 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-216394a8-982f-4e93-b04b-96895fd9cafb tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 200 len: 1461 microversion: 2.1 time: 0.081049 Oct 22 03:19:06.723158 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1708/3391] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:06 2022] GET /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:06.739634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:06.741251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:06.752649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.753736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.756556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.757404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:06.757800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:06.758262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:06.985299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:06.996173 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-568190ba-64de-45c2-b31c-fdc908935ade tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1467 microversion: 2.1 time: 0.259050 Oct 22 03:19:06.997308 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1709/3392] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:06 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1467 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:07.019491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1269433315"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:07.022090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:07.037749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.039940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.040775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.044314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.044967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.045587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.086787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:07.101042 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-abee7353-5ea8-40a2-a20e-6d33227a3ba1 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.424849 Oct 22 03:19:07.101807 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1684/3393] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:06 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:07.287332 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a3fff47-fd07-4a95-b72a-dd09d9b45abd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "POST /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977/action" status: 202 len: 0 microversion: 2.1 time: 0.271430 Oct 22 03:19:07.288372 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1710/3394] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:19:07 2022] POST /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 22 03:19:07.299364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5aeec950-e7bb-4ea4-ba67-8d334fd76fab tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a03a430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:07.319311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:07.320019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:07.330032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.330760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.331387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.332287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.333058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.333668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.363786 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5aeec950-e7bb-4ea4-ba67-8d334fd76fab tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.068259 Oct 22 03:19:07.373496 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1685/3395] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:07 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:07.378223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:07.378837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:07.386881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.387374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.387993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.389012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.389654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.390242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.553872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:07.566380 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af74df74-0bda-483f-8593-b036dac8915a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1501 microversion: 2.1 time: 0.252598 Oct 22 03:19:07.581798 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1711/3396] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:07 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:07.597507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:07.605810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:07.606686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:07.612061 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-817f7748-66aa-44b4-9dca-bb7e5a47c3d1 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.236347 Oct 22 03:19:07.624730 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1686/3397] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:07 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:07.637464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:07.638137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:07.644138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.645375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.645937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.646994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.646994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.647383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.655896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.667313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.668025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.668993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.669617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.670236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.710877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lazy-loading 'flavor' on Instance uuid f667e973-b796-44b6-9ab4-9fde79a741ac {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:19:07.756752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:07.765782 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1e3bc57-b58d-4d71-a50e-2698a21c089d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1183 microversion: 2.1 time: 0.182614 Oct 22 03:19:07.766434 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1712/3398] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:07 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:07.772057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:07.772929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:07.781060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.781876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.792461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.793419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.795533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.796398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.880536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:07.893714 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb5ce245-1271-4d5c-90c4-6f703e5dd757 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1265 microversion: 2.1 time: 0.125905 Oct 22 03:19:07.894808 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1713/3399] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:07 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:07.953650 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2d1c126-cbe2-46a0-9318-8aac7fd32cfd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac/action" status: 202 len: 0 microversion: 2.1 time: 0.327574 Oct 22 03:19:07.956278 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1687/3400] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:19:07 2022] POST /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:19:07.962608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:07.963219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:07.970029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.970516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.970949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:07.971641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:07.972087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:07.972732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.126860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:08.127851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:08.138278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.139048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.139665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.140579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.141194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.141785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.182725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:08.203217 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39167373-d595-4f45-ae77-55aa1d959d3f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.244417 Oct 22 03:19:08.209225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1714/3401] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:07 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:08.331455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:08.344084 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86cdc3d1-bb77-4ab5-97fb-642f8c82c4cd tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.222115 Oct 22 03:19:08.345048 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1688/3402] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:08 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:08.380161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe315cc5-556c-4398-a7d1-86b1b8417608 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d199df4c0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:08.428552 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe315cc5-556c-4398-a7d1-86b1b8417608 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.052192 Oct 22 03:19:08.429625 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1715/3403] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:08 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:08.638318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:08.638933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:08.649688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.650186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.650625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.656695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.657277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.657737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.707974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ebf00cbd-ecad-438e-b452-4b50e866658a req-16940420-1487-4f81-9408-260f3a8d325a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b06bdd-b429-4660-b50e-6d2d40d3daf2", "name": "network-vif-deleted", "tag": "d9629050-6517-484c-96f2-fe2f4be5ac6d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:08.729681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ebf00cbd-ecad-438e-b452-4b50e866658a req-16940420-1487-4f81-9408-260f3a8d325a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.730086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ebf00cbd-ecad-438e-b452-4b50e866658a req-16940420-1487-4f81-9408-260f3a8d325a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.730522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ebf00cbd-ecad-438e-b452-4b50e866658a req-16940420-1487-4f81-9408-260f3a8d325a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.748048 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ebf00cbd-ecad-438e-b452-4b50e866658a req-16940420-1487-4f81-9408-260f3a8d325a service nova] Creating event network-vif-deleted:d9629050-6517-484c-96f2-fe2f4be5ac6d for instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 on n-h1-862416-2 Oct 22 03:19:08.755848 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ebf00cbd-ecad-438e-b452-4b50e866658a req-16940420-1487-4f81-9408-260f3a8d325a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052946 Oct 22 03:19:08.757036 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1716/3404] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:08.792026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:08.792794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:08.820804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.821706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.822469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.824048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.827311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.827937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.835117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:08.844542 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5311d0a6-d8f6-4643-ad93-f8cbccbc6ffc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.210552 Oct 22 03:19:08.845628 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1689/3405] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:08 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:08.917681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:08.918154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:08.923175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:08.925412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.925955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.926436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.927159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:08.927781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:08.928049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:08.940262 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57d80bce-d105-4b34-88ee-81b1fd58f02c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1183 microversion: 2.1 time: 0.154179 Oct 22 03:19:08.941763 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1717/3406] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:08 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:09.083640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:09.092158 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62e65821-3258-4179-9588-ee7f227161e6 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1307 microversion: 2.1 time: 0.178941 Oct 22 03:19:09.093133 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1690/3407] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:08 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:09.231993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:09.232681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:09.251591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.252081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.252544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:09.253240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.253876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.254300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:09.369055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:09.370655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:09.377335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.377834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.378275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:09.378994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.379453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.379883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:09.491511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:09.514662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:09.515388 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fae1253a-6661-41fe-91a5-b6521917aa53 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.287869 Oct 22 03:19:09.523646 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1718/3408] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:09 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:09.532623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4bdcdc8-e955-47f2-b78f-93eb74bcb954 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d199525e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:09.591891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:09.600956 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f533b3aa-5e07-41a8-a6e0-c5ba55f129be tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.235853 Oct 22 03:19:09.602121 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4bdcdc8-e955-47f2-b78f-93eb74bcb954 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.076782 Oct 22 03:19:09.602702 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1691/3409] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:09 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:09.610413 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1719/3410] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:09 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:09.695381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-64f9fd29-8dff-4b19-8669-33d36a7ca06c req-e775c6c1-a88f-4158-9572-3a5385d54fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74de4a13-4c74-449e-97da-d93bc3215451", "name": "network-vif-unplugged", "status": "completed", "tag": "12c5b67b-a6f5-4bf2-a486-6a04eed55ee9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:09.711948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-64f9fd29-8dff-4b19-8669-33d36a7ca06c req-e775c6c1-a88f-4158-9572-3a5385d54fa7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.712773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-64f9fd29-8dff-4b19-8669-33d36a7ca06c req-e775c6c1-a88f-4158-9572-3a5385d54fa7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.713842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-64f9fd29-8dff-4b19-8669-33d36a7ca06c req-e775c6c1-a88f-4158-9572-3a5385d54fa7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:09.729534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-64f9fd29-8dff-4b19-8669-33d36a7ca06c req-e775c6c1-a88f-4158-9572-3a5385d54fa7 service nova] Creating event network-vif-unplugged:12c5b67b-a6f5-4bf2-a486-6a04eed55ee9 for instance 74de4a13-4c74-449e-97da-d93bc3215451 on n-h1-862416-2 Oct 22 03:19:09.736044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-64f9fd29-8dff-4b19-8669-33d36a7ca06c req-e775c6c1-a88f-4158-9572-3a5385d54fa7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044234 Oct 22 03:19:09.736629 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1720/3411] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:09.870449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:09.871699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:09.878032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.878526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.878969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:09.879673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.880136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.880603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:09.968915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:09.969858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:09.978013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.979525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.980136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:09.981385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:09.982049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:09.982681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:10.061385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:10.070539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-06e91750-2bc4-454f-a742-624f749fc616 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1183 microversion: 2.1 time: 0.107347 Oct 22 03:19:10.072364 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1721/3412] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:09 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:10.116189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:10.116985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:10.121388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:10.124322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:10.124904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:10.125374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:10.126084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:10.126544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:10.127267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:10.134359 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f1d02ed-9a4a-4cc3-b068-dc3d20864533 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.268492 Oct 22 03:19:10.148599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1692/3413] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:09 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:10.274205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:10.282110 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73b4fa99-3245-448d-8bf0-8c3357d26941 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1307 microversion: 2.1 time: 0.169939 Oct 22 03:19:10.282689 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1722/3414] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:10 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:10.538865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:10.539472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:10.542714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:10.547174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:10.547665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:10.548101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:10.549018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:10.549470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:10.550034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:10.617845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-79605a5c-9372-4173-89ad-1f00a2e4764c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19a4f820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:10.667486 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-79605a5c-9372-4173-89ad-1f00a2e4764c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.052750 Oct 22 03:19:10.673398 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1723/3415] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:10 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:10.673398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:10.674030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:10.680470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:10.680963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:10.681410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:10.682845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:10.683452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:10.683892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:10.706060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:10.715016 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-95861f57-71ef-42fd-887c-6645571a234a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.180190 Oct 22 03:19:10.715711 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1693/3416] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:10 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:10.802754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-141aa7b1-24fe-4a7d-8713-ff4c9d3a15b4 req-07d3dfd1-7b56-4234-88c0-4136b7be7163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7475c2-776b-4d56-9d11-4f7ac9cfba81", "tag": "90d83934-4a21-4469-822b-bed916123170"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:10.813505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-141aa7b1-24fe-4a7d-8713-ff4c9d3a15b4 req-07d3dfd1-7b56-4234-88c0-4136b7be7163 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:10.814103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-141aa7b1-24fe-4a7d-8713-ff4c9d3a15b4 req-07d3dfd1-7b56-4234-88c0-4136b7be7163 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:10.814591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-141aa7b1-24fe-4a7d-8713-ff4c9d3a15b4 req-07d3dfd1-7b56-4234-88c0-4136b7be7163 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:10.827645 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-141aa7b1-24fe-4a7d-8713-ff4c9d3a15b4 req-07d3dfd1-7b56-4234-88c0-4136b7be7163 service nova] Creating event network-changed:90d83934-4a21-4469-822b-bed916123170 for instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 on n-h1-862416-2 Oct 22 03:19:10.830269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:10.832590 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-141aa7b1-24fe-4a7d-8713-ff4c9d3a15b4 req-07d3dfd1-7b56-4234-88c0-4136b7be7163 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033699 Oct 22 03:19:10.833597 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1694/3417] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:10.840088 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da04b532-5dfa-47bd-aaac-773e19a7ba0e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.170262 Oct 22 03:19:10.840762 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1724/3418] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:10 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:11.095503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:11.096385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:11.105766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.107377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.107982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.109611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.110907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.111480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.159606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:11.160382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:11.170762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.171399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.171955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.172779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.173882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.174389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.235466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:11.247379 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ff29b63-438e-4a99-869f-57dc3ba8c924 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 200 len: 1183 microversion: 2.1 time: 0.156871 Oct 22 03:19:11.248349 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1695/3419] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:11 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 1183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:11.310957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:11.312469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:11.322270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.324942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.326598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.327648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.327829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.328315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.336147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:11.406682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:11.415344 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-754d0d74-b37b-4932-934b-f3919aaae09d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.260744 Oct 22 03:19:11.432555 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1725/3420] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:11 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:11.550576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:11.570684 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a66c63b3-7483-45d1-8064-2eaaf5a38b73 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1307 microversion: 2.1 time: 0.266003 Oct 22 03:19:11.587535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1696/3421] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:11 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:11.689316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9fab35c7-d060-4b58-953c-807f9f9f8e60 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d199c4160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:11.738990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:11.739608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:11.747857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.748594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.749222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.750098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.750833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.751151 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9fab35c7-d060-4b58-953c-807f9f9f8e60 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.070499 Oct 22 03:19:11.751877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.752194 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1726/3422] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:11 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:11.863715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:11.864576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:11.871625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.872121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.872603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.873979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:11.873979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:11.874398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:11.880464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:11.896673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:11.906669 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f73096c2-b8c0-40ab-8837-67fc06b85b60 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.171685 Oct 22 03:19:11.908256 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1697/3423] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:11 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:12.018506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:12.028554 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ccd004d-c3a6-43e3-85b8-b08670546160 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.168675 Oct 22 03:19:12.044096 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1727/3424] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:11 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:12.270585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:12.271288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: a7148fe4-73ad-4a88-bec8-4a2f3b8c048c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:12.278924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:12.279397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:12.279838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:12.280583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:12.281043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:12.281473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:12.296742 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] HTTP exception thrown: Instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c could not be found. Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Request method failure captured: Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c HTTP/1.1 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1-A_ha3fdig_NEdUDfxNnHwxr_tpHAUppHdD6VXT7NFdiGBJZr_bpMNxEafRDdXYJhvP1Cw4BxaH8zcyZ-LgzjYQfTMRFYWhTe85Pu6MkKc7kUYc2S70xt-A4jcwHaPzAF09NgsyAogMREL-1Q0G9kFCanqXOybSwbNk1VY62s6JlA Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0ce9ee0e663b4740a49c5bb01f4d85d6 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}] Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0ce9ee0e663b4740a49c5bb01f4d85d6 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-LiveMigrationTest-1304500679-project Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92523f18567441589dba5548bb33eb9e Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-LiveMigrationTest-1304500679-project Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c could not be found. Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'a7148fe4-73ad-4a88-bec8-4a2f3b8c048c'} Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c could not be found. Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c could not be found. Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:12.298444 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c could not be found. Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Returning 404 to user: Instance a7148fe4-73ad-4a88-bec8-4a2f3b8c048c could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:12.303404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b84402a1-926a-4013-84aa-a3a88b004fdf tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c" status: 404 len: 111 microversion: 2.1 time: 0.033318 Oct 22 03:19:12.306148 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1698/3425] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:12 2022] GET /compute/v2.1/servers/a7148fe4-73ad-4a88-bec8-4a2f3b8c048c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:12.440347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:12.441055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:12.444109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:12.453373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:12.454175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:12.454854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:12.455787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:12.456265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:12.456714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:12.597105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:12.598813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:12.605701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:12.607703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:12.608735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:12.609423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:12.610183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:12.610827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:12.611417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:12.614223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-51953480-c804-46f5-9faa-80280e46dadd tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.178451 Oct 22 03:19:12.618264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1728/3426] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:12 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:12.759028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:12.768109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b3dee04f-e293-4a26-b9b4-11aa5918bfd8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19952e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:12.769660 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c90d153-1767-46ed-acf6-a35e6cea58e0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1307 microversion: 2.1 time: 0.178583 Oct 22 03:19:12.770771 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1699/3427] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:12 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:12.826611 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b3dee04f-e293-4a26-b9b4-11aa5918bfd8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.063422 Oct 22 03:19:12.832285 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1729/3428] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:12 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:12.931783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:12.933539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:12.941114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:12.941711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:12.942229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:12.943029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:12.943564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:12.944122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:13.052460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:13.053277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:13.062931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:13.063732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:13.064525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:13.065549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:13.066211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:13.067067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:13.106629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:13.115502 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5416c036-44ca-4c9b-9478-39babf649a8b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.188243 Oct 22 03:19:13.125338 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1700/3429] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:12 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:13.244131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:13.258023 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e4817d0-02e0-409d-9e23-c00a8471bfb4 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.208843 Oct 22 03:19:13.258887 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1730/3430] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:13 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:13.638913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:13.640243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:13.647853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:13.648601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:13.649188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:13.650056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:13.650693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:13.651897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:13.795821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:13.796486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:13.815295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:13.815829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:13.816227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:13.816954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:13.817405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:13.817828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:13.818605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:13.827422 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2811871-2f13-4def-9aaa-b3d7fae7cd2c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.193340 Oct 22 03:19:13.831367 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1701/3431] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:13 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:13.851034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2df6b72-0709-4f4f-89c9-7da004674cc9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a44b430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:13.931627 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2df6b72-0709-4f4f-89c9-7da004674cc9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.084326 Oct 22 03:19:13.940764 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1702/3432] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:13 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:13.946461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a937bf74-5754-42a8-8106-bc68cdd42ccd req-9687f46c-71ec-414d-8140-a800e7cd3ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255c9577-b797-4689-89c1-4e0166ced1f3", "name": "network-vif-plugged", "status": "completed", "tag": "be5b4207-7744-4cf5-828a-7b5360be6e1f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:13.960691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a937bf74-5754-42a8-8106-bc68cdd42ccd req-9687f46c-71ec-414d-8140-a800e7cd3ba0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:13.961377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a937bf74-5754-42a8-8106-bc68cdd42ccd req-9687f46c-71ec-414d-8140-a800e7cd3ba0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:13.969082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a937bf74-5754-42a8-8106-bc68cdd42ccd req-9687f46c-71ec-414d-8140-a800e7cd3ba0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:13.985148 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a937bf74-5754-42a8-8106-bc68cdd42ccd req-9687f46c-71ec-414d-8140-a800e7cd3ba0 service nova] Creating event network-vif-plugged:be5b4207-7744-4cf5-828a-7b5360be6e1f for instance 255c9577-b797-4689-89c1-4e0166ced1f3 on n-h2-862416-2 Oct 22 03:19:13.991035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a937bf74-5754-42a8-8106-bc68cdd42ccd req-9687f46c-71ec-414d-8140-a800e7cd3ba0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048660 Oct 22 03:19:13.992514 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1703/3433] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:14.128562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:14.137522 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c76edf63-0ccf-48c1-abbc-533798d8bb86 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1307 microversion: 2.1 time: 0.346156 Oct 22 03:19:14.152515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:14.152515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:14.153310 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1731/3434] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:13 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1307 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:14.156429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:14.157028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:14.158020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:14.158848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:14.159531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:14.160054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:14.296685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:14.297528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:14.304529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:14.305487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:14.306107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:14.307660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:14.311288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:14.312042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:14.321957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:14.332058 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c899c9a6-c022-44b4-a90e-009156ee1b81 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.193984 Oct 22 03:19:14.338497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1704/3435] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:14 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:14.515665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:14.525640 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7cf40e05-ad8c-4ed4-a24f-70fc74298bd0 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.239899 Oct 22 03:19:14.526897 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1732/3436] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:14 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:14.859693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:14.860498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:14.875700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:14.879362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:14.879832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:14.880671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:14.881261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:14.881788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:14.950032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b79461f2-d63b-4eb9-916c-eda4e45ec0fd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1aa1c670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:15.027244 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b79461f2-d63b-4eb9-916c-eda4e45ec0fd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.081673 Oct 22 03:19:15.028401 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1733/3437] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:14 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:15.066159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:15.074923 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a2e670f1-6072-4b92-889b-92ab57db078a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.219302 Oct 22 03:19:15.075850 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1705/3438] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:14 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:15.162879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:15.163500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:15.177514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:15.178020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:15.178468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:15.179200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:15.179649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:15.180081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:15.297587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:15.339671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:15.361917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:15.362912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:15.369727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:15.370694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:15.371403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:15.372387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:15.373071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:15.373727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:15.389515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:15.401819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19402eb6-5a08-4419-98dc-57baf2e9bfb8 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1307 microversion: 2.1 time: 0.242182 Oct 22 03:19:15.402704 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1734/3439] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:15 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:15.551226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:15.551592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:15.553344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:15.565336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:15.567909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:15.568754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:15.571767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:15.572602 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c4bc8ea-22e0-42a8-a377-50c74fa31802 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.214671 Oct 22 03:19:15.584044 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1706/3440] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:15 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:15.589635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:15.590309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:15.827179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:15.840912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8c0df23-6ce2-48b0-ae85-0d7028ecb126 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1317 microversion: 2.1 time: 0.294486 Oct 22 03:19:15.841571 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1735/3441] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:15 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:15.966250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:15.966797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:15.969903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:15.988141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:15.989072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:15.989730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:15.990855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:15.993194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:15.993889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.044121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0d25d9f-a751-478e-adad-baa3afc05905 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19784d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:16.071808 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-100b1276-c009-4ac4-8731-7ecda6691637 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/ips" status: 200 len: 151 microversion: 2.20 time: 0.109659 Oct 22 03:19:16.073023 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1707/3442] 10.222.0.25 () {60 vars in 1289 bytes} [Sat Oct 22 03:19:15 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/ips => generated 151 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:19:16.101125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:16.101752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:16.122257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.131068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.131813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.132922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.137495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.139648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.151839 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0d25d9f-a751-478e-adad-baa3afc05905 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.112560 Oct 22 03:19:16.164539 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1736/3443] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:16 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:16.171852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-84e31a8f-f33c-4dc0-b5aa-525602ae9c40 req-63b9e177-5d9f-4362-b77e-aebe2885e25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7475c2-776b-4d56-9d11-4f7ac9cfba81", "name": "network-vif-plugged", "status": "completed", "tag": "90d83934-4a21-4469-822b-bed916123170"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:16.203585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-84e31a8f-f33c-4dc0-b5aa-525602ae9c40 req-63b9e177-5d9f-4362-b77e-aebe2885e25c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.204151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-84e31a8f-f33c-4dc0-b5aa-525602ae9c40 req-63b9e177-5d9f-4362-b77e-aebe2885e25c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.204731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-84e31a8f-f33c-4dc0-b5aa-525602ae9c40 req-63b9e177-5d9f-4362-b77e-aebe2885e25c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.220022 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-84e31a8f-f33c-4dc0-b5aa-525602ae9c40 req-63b9e177-5d9f-4362-b77e-aebe2885e25c service nova] Creating event network-vif-plugged:90d83934-4a21-4469-822b-bed916123170 for instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 on n-h1-862416-2 Oct 22 03:19:16.225944 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-84e31a8f-f33c-4dc0-b5aa-525602ae9c40 req-63b9e177-5d9f-4362-b77e-aebe2885e25c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059820 Oct 22 03:19:16.227631 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1737/3444] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:16.432962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:16.434995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:16.449619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.450458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.451089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.452052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.452691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.453277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.516612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:16.527585 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-40c53dd3-0a7f-4422-967b-590b893eb663 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.432768 Oct 22 03:19:16.532901 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1708/3445] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:16 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:16.597469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:16.598828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:16.609428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.610046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.610620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.611512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.612053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.622383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.773131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:16.781931 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc4aa317-b887-4c59-844a-57a1605b0af4 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1307 microversion: 2.1 time: 0.356046 Oct 22 03:19:16.783852 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1738/3446] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:16 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:16.790391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:16.790987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:16.799272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.800075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.800753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.801678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.802345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.802984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.834200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:16.863962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:16.874507 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b3e608ab-b0ca-45b6-92be-9804376741b9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.281903 Oct 22 03:19:16.875010 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1709/3447] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:16 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:16.880361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:16.881235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:16.887241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.888127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.888753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.889834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.890522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.890958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.967352 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e19bd956-ae28-416d-86b1-d716359d95f5 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 204 len: 0 microversion: 2.1 time: 0.181828 Oct 22 03:19:16.971936 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1739/3448] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:16 2022] DELETE /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:16.977833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:16.978536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:16.986005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.986466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.986907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:16.987618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:16.988076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:16.988673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.064995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:17.075540 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0df6fb7d-284d-431b-b70a-b4466f80f03e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1506 microversion: 2.1 time: 0.198517 Oct 22 03:19:17.080260 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1710/3449] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:16 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:17.100764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:17.101448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:17.109112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.109745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.110295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.111090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.111623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.112246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.148608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:17.149282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:17.150372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-345a1fc9-fc30-433d-bb59-cc5173b9a39c tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3/os-instance-actions/req-e342d155-ee16-48c2-a904-323da86f1cc5" status: 200 len: 313 microversion: 2.1 time: 0.053909 Oct 22 03:19:17.157516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9af6da6c-39ad-49c9-8315-f53126ea9eb7 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1666 microversion: 2.1 time: 0.184248 Oct 22 03:19:17.159778 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1740/3450] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:16 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1666 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:17.160258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1711/3451] 10.222.0.25 () {58 vars in 1419 bytes} [Sat Oct 22 03:19:17 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3/os-instance-actions/req-e342d155-ee16-48c2-a904-323da86f1cc5 => generated 313 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:17.165524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:17.168497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:17.174936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-343834f0-baed-4d88-83e0-9f267b4462c3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1999c040>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:17.182917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.183592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.184484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.191369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.191923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.192412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.233597 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-343834f0-baed-4d88-83e0-9f267b4462c3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.063469 Oct 22 03:19:17.234211 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1712/3452] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:17 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:17.313841 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b513c46-7abc-440d-a05c-ecd005431611 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "POST /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3/action" status: 202 len: 0 microversion: 2.1 time: 0.152098 Oct 22 03:19:17.317678 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1741/3453] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:19:17 2022] POST /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:19:17.325127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:17.326074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:17.335591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.336370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.337162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.338232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.339155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.339761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.555755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:17.558494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:17.573608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.576155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.576986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.578120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:17.578248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.579096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.579861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.590749 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab620500-404e-47ca-898a-7feb49d00f07 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1508 microversion: 2.1 time: 0.270377 Oct 22 03:19:17.591967 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1713/3454] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:17 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:17.811674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:17.815997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:17.816737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:17.829069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.829608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.830010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.830741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.831201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.831637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.845939 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f791a2a-4b7f-4919-a124-5a6b95284827 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.294637 Oct 22 03:19:17.848386 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1742/3455] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:17 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:17.899880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:17.901088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:17.907723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.908633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.908744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:17.909641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:17.910105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:17.911069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:18.078641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:18.087480 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5cc4b6e4-046c-4aee-9553-e66963d926a9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.192473 Oct 22 03:19:18.088108 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1743/3456] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:17 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:18.108046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:18.116639 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b98f4886-01fd-4df8-b155-eecd07e7a408 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1307 microversion: 2.1 time: 0.304806 Oct 22 03:19:18.117230 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1714/3457] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:17 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:18.184083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:18.184837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:18.190735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:18.191205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:18.191634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:18.192351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:18.192796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:18.193220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:18.249309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-164cbba1-e684-45a8-b3f2-ceac2bb76c1a tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a0fe160>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:18.293263 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-164cbba1-e684-45a8-b3f2-ceac2bb76c1a tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.048671 Oct 22 03:19:18.294121 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1715/3458] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:18 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:18.331312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:18.335131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:18.337892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b49f5ea9-dacc-4f22-8f03-4da0c67046f2 req-03ca53c9-9bda-4514-8e06-67487c4df669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413d7cde-ec29-4239-968e-6524df522977", "name": "network-vif-plugged", "status": "completed", "tag": "790776fd-bbd7-4ed1-b035-1ab433bbea5c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:18.340483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6bd5d970-882c-4987-a632-1aeb43b01d71 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1666 microversion: 2.1 time: 0.161376 Oct 22 03:19:18.341082 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1744/3459] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:18 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:18.352875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b49f5ea9-dacc-4f22-8f03-4da0c67046f2 req-03ca53c9-9bda-4514-8e06-67487c4df669 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:18.353360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b49f5ea9-dacc-4f22-8f03-4da0c67046f2 req-03ca53c9-9bda-4514-8e06-67487c4df669 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:18.354481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b49f5ea9-dacc-4f22-8f03-4da0c67046f2 req-03ca53c9-9bda-4514-8e06-67487c4df669 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:18.365537 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b49f5ea9-dacc-4f22-8f03-4da0c67046f2 req-03ca53c9-9bda-4514-8e06-67487c4df669 service nova] Creating event network-vif-plugged:790776fd-bbd7-4ed1-b035-1ab433bbea5c for instance 413d7cde-ec29-4239-968e-6524df522977 on n-h2-862416-2 Oct 22 03:19:18.371377 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b49f5ea9-dacc-4f22-8f03-4da0c67046f2 req-03ca53c9-9bda-4514-8e06-67487c4df669 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037907 Oct 22 03:19:18.371986 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1716/3460] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:19:18.618534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:18.620320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:18.627555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:18.628785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:18.628785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:18.629368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:18.629867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:18.630332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:18.871926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:18.873238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:18.879386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:18.883711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:18.884199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:18.884659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:18.885884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:18.886313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:18.886738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:18.897651 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96d3faa9-d248-4bde-8fb4-f6294af8f5e9 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1508 microversion: 2.1 time: 0.284505 Oct 22 03:19:18.923401 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1745/3461] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:18 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:19.064729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:19.074294 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4147bfd7-d663-4ed9-a1d9-c22d3900746c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.207964 Oct 22 03:19:19.075066 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1717/3462] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:18 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:19.112178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:19.112809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:19.119826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.120867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.121391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.122100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.122551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.123434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.143558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:19.146125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:19.155902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.156681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.157206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.158008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.158870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.159418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.163935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:19.327452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:19.336707 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d313aa0-dc33-4a06-ad63-25855f6c27cd tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1488 microversion: 2.1 time: 0.198740 Oct 22 03:19:19.337493 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1718/3463] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:19 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1488 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:19.342272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae6aa839-1045-422b-94aa-4f4ab5b4cd37 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a44baf0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:19.351635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:19.364833 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81bb8d09-fd8a-4a5d-9225-8614faab9a87 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.256614 Oct 22 03:19:19.365982 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1746/3464] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:19 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:19.371750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:19.372307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:19.379109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.379800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.380453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.381316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.381967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.382554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.399198 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ae6aa839-1045-422b-94aa-4f4ab5b4cd37 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.060639 Oct 22 03:19:19.400166 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1719/3465] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:19 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:19.415092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-822651514"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:19.418483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:19.433962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.434540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.435366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.439634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.440505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.441859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.478386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:19.493332 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-88c781b2-3f06-4a60-8169-4ffc64fc16ac tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 200 len: 1599 microversion: 2.1 time: 0.126245 Oct 22 03:19:19.494014 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1747/3466] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:19 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 1599 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:19.501196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:19.501196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:19.528172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.529557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.530405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.531570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.532136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.532690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.586516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lazy-loading 'flavor' on Instance uuid eb680fc8-0d54-4742-b649-b82abbf4884e {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:19:19.746695 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-465cb959-5d9c-47a7-bb5a-a52bf026a273 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "POST /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81/action" status: 202 len: 0 microversion: 2.1 time: 0.339486 Oct 22 03:19:19.747786 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1720/3467] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:19:19 2022] POST /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 03:19:19.753115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2351f123-dfea-48a8-94a0-632f41b51774 req-4eb83460-cf24-46ff-8b5c-a3cc3e807e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d5af8e-154b-4a08-bb37-0a1947b49d82", "name": "network-vif-deleted", "tag": "ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:19.763978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2351f123-dfea-48a8-94a0-632f41b51774 req-4eb83460-cf24-46ff-8b5c-a3cc3e807e4e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.764490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2351f123-dfea-48a8-94a0-632f41b51774 req-4eb83460-cf24-46ff-8b5c-a3cc3e807e4e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.764995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2351f123-dfea-48a8-94a0-632f41b51774 req-4eb83460-cf24-46ff-8b5c-a3cc3e807e4e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.778225 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2351f123-dfea-48a8-94a0-632f41b51774 req-4eb83460-cf24-46ff-8b5c-a3cc3e807e4e service nova] Creating event network-vif-deleted:ad9d5b81-7aa3-4c21-bc0a-bcdc918ee5e3 for instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 on n-h2-862416-2 Oct 22 03:19:19.783305 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2351f123-dfea-48a8-94a0-632f41b51774 req-4eb83460-cf24-46ff-8b5c-a3cc3e807e4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034202 Oct 22 03:19:19.784171 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1721/3468] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:19.789744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2b203a8-904b-42e5-afef-31c8e1c5fcf1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a61faf0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:19.850194 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2b203a8-904b-42e5-afef-31c8e1c5fcf1 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414" status: 200 len: 1413 microversion: 2.1 time: 0.064773 Oct 22 03:19:19.850978 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1722/3469] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:19 2022] GET /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414 => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:19.867170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dcc2d5d5-994a-45ea-ad02-ba5e95c817a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a462550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:19.907496 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-376d7010-d78c-4ce4-97df-b05e21cfa2f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/action" status: 202 len: 0 microversion: 2.20 time: 0.409225 Oct 22 03:19:19.912248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1748/3470] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:19:19 2022] POST /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:19.926405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:19.935874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:19.948783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.960439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.964949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.965927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.967622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.968361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.972368 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dcc2d5d5-994a-45ea-ad02-ba5e95c817a7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414" status: 200 len: 1413 microversion: 2.1 time: 0.109561 Oct 22 03:19:19.972960 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1723/3471] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:19 2022] GET /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:19.989228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:19.989965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:19.997015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.997653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:19.998100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:19.998816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:19.999693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.000015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.154808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:20.163590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:20.165343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:20.167296 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ff39542-dba2-4e07-a877-4d66966ef7a8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.252110 Oct 22 03:19:20.168365 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1749/3472] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:19 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:20.173360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e97e6f0-cf4b-4e8d-b6f8-daab8d759f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196758b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.211043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:20.220477 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2da3079-e397-44c1-a3f7-259b81ea313e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1506 microversion: 2.1 time: 0.236070 Oct 22 03:19:20.221600 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1724/3473] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:19 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:20.226456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.227070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:20.234276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.234997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.235612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.236531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.237139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.237738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.366692 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e97e6f0-cf4b-4e8d-b6f8-daab8d759f2d tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414" status: 204 len: 0 microversion: 2.1 time: 0.196954 Oct 22 03:19:20.367826 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1750/3474] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:20 2022] DELETE /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:20.373987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '.version_select at 0x7f0d19675a60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.374753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:20.391180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.391922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.392701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.393603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.395228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.396543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.407421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:20.419562 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8047b05-4b19-465a-98c6-a424dc918fd7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.196624 Oct 22 03:19:20.420621 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1725/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:20 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:20.426238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97e8e427-0f3c-47c4-9ea1-859168062a75 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a473e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.477512 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-97e8e427-0f3c-47c4-9ea1-859168062a75 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Image not found. Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97e8e427-0f3c-47c4-9ea1-859168062a75 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414 HTTP/1.1 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: exception: Image not found. Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '8cfeb3c8-26a9-4619-99ce-f7e01a36e414'} Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8cfeb3c8-26a9-4619-99ce-f7e01a36e414 Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:19:20.486946 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8cfeb3c8-26a9-4619-99ce-f7e01a36e414 could not be found. Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97e8e427-0f3c-47c4-9ea1-859168062a75 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Image not found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:20.491395 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97e8e427-0f3c-47c4-9ea1-859168062a75 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414" status: 404 len: 62 microversion: 2.1 time: 0.069029 Oct 22 03:19:20.499281 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1726/3476] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:20 2022] GET /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:19:20.511575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.512542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:20.527855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.528488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.529508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.530263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.530838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.531285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.533447 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4392437c-77dd-4ad0-97b9-4ca9b4375b2e tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.163931 Oct 22 03:19:20.548292 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1751/3477] 10.222.0.25 () {58 vars in 1296 bytes} [Sat Oct 22 03:19:20 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3/os-instance-actions => generated 611 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:20.558044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0d79709a-6e15-4a8d-817b-8131e5beb738 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19675c10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.633918 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0d79709a-6e15-4a8d-817b-8131e5beb738 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.082381 Oct 22 03:19:20.634795 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1752/3478] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:20 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:20.660926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.661527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:20.683945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.683945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.683945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.684588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.685308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.687443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.731755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:20.750327 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-855422ad-0cc7-41de-a72b-02a5afcffed0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.249735 Oct 22 03:19:20.751028 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1727/3479] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:20 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:20.763351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.764055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 88d5af8e-154b-4a08-bb37-0a1947b49d82] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:20.776583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.777402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.777926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.779260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.780250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.782201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.819401 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] HTTP exception thrown: Instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 could not be found. Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Request method failure captured: Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 HTTP/1.1 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1-A_ha3fdig_NEdUDfxNnHwxr_tpHAUppHdD6VXT7NFdiGBJZr_bpMNxEafRDdXYJhvP1Cw4BxaH8zcyZ-LgzjYQfTMRFYWhTe85Pu6MkKc7kUYc2S70xt-A4jcwHaPzAF09NgsyAogMREL-1Q0G9kFCanqXOybSwbNk1VY62s6JlA Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0ce9ee0e663b4740a49c5bb01f4d85d6 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}] Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0ce9ee0e663b4740a49c5bb01f4d85d6 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-LiveMigrationTest-1304500679-project Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92523f18567441589dba5548bb33eb9e Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-LiveMigrationTest-1304500679-project Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 could not be found. Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '88d5af8e-154b-4a08-bb37-0a1947b49d82'} Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 could not be found. Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 could not be found. Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:20.821034 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 could not be found. Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Returning 404 to user: Instance 88d5af8e-154b-4a08-bb37-0a1947b49d82 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ddc5f48-2cb7-4e65-a3b0-fa93d3a91a97 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82" status: 404 len: 111 microversion: 2.1 time: 0.065128 Oct 22 03:19:20.831534 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1728/3480] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:20 2022] GET /compute/v2.1/servers/88d5af8e-154b-4a08-bb37-0a1947b49d82 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:20.833003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:20.833003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:20.839838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.840889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.852056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.858298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:20.859128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:20.859914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:20.921020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:20.986071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:20.998131 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e48cd11c-80c4-4fc2-9ca2-fd374f766ff7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1500 microversion: 2.1 time: 0.352144 Oct 22 03:19:20.999037 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1753/3481] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:20 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1500 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:21.006475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-050aa93f-ad4c-429e-86b4-4ae2c1b2c59d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '.version_select at 0x7f0d1971aa60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:21.048130 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-050aa93f-ad4c-429e-86b4-4ae2c1b2c59d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627815688" status: 202 len: 0 microversion: 2.1 time: 0.047696 Oct 22 03:19:21.052860 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1754/3482] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:19:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627815688 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:19:21.078002 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7493cc2a-2a05-46c1-b3a2-6dca42f3bf23 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "DELETE /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 204 len: 0 microversion: 2.1 time: 0.248635 Oct 22 03:19:21.078221 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1729/3483] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:20 2022] DELETE /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:21.087473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:21.088877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:21.095289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:21.095785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:21.096340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:21.097104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:21.097681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:21.098066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:21.200969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:21.201682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:21.211573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:21.214715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:21.218101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:21.219333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:21.219819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:21.220298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:21.492009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:21.503951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c4ec1f9-a697-4125-abd7-11329e2f1b62 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1512 microversion: 2.1 time: 0.421101 Oct 22 03:19:21.504883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1755/3484] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:21 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1512 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:21.510849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:21.511828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:21.518175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:21.518641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:21.519075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:21.519762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:21.520485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:21.521148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:21.624042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:21.637673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:21.643808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:21.645459 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bcc5b9ec-8b28-485d-a634-77f782a5a35a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.449593 Oct 22 03:19:21.647915 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1730/3485] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:21 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:19:21.654314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-316cbda9-2dfe-48f4-98e9-e05843bc4f65 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a44b430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:21.719437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:21.736341 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-316cbda9-2dfe-48f4-98e9-e05843bc4f65 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.086725 Oct 22 03:19:21.749528 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8018e5e2-8c54-422a-a2cf-9717de310501 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.243510 Oct 22 03:19:21.750490 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1756/3486] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:21 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:21.750914 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1731/3487] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:21 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:21.775285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:21.776998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:21.784434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:21.785197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:21.785779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:21.786657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:21.787266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:21.787846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.015871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:22.026740 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d0b3ebc7-24c9-4612-ad1b-a069857e6511 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.254313 Oct 22 03:19:22.028725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:22.029760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:22.045082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.045837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.046793 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1732/3488] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:21 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:22.048588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.050713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.052437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.053177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.298535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:22.299876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:22.305214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:22.308510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.310271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.311452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.312903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.313554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.314222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.314812 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfbec1fc-5fa7-47f9-bf69-bc6e7917e7ae tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1506 microversion: 2.1 time: 0.293215 Oct 22 03:19:22.315807 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1757/3489] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:22 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:22.347342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:22.442620 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-096e25da-d533-48c0-92ed-b4e8dc978cee tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 204 len: 0 microversion: 2.1 time: 0.148629 Oct 22 03:19:22.444054 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1733/3490] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:22 2022] DELETE /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:22.457541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:22.458317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:22.472577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.473620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.474582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.475360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.477049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.477805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.530029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:22.530844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:22.537553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.538062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.538581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.539397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.539918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.540448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.655027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:22.665951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b857e744-afeb-4d56-b2e2-23cb56b94c04 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1484 microversion: 2.1 time: 0.213055 Oct 22 03:19:22.668585 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1758/3491] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:22 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1484 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:22.694871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:22.696266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:22.704436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.704998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.705597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.706417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.707867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.708402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.793131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:22.808504 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a68b728d-4202-458c-ba01-866846593117 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1512 microversion: 2.1 time: 0.284524 Oct 22 03:19:22.809757 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1734/3492] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:22 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:22.835096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-753dc555-7676-4f16-a9ac-220521bfe2ca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a61f9d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:22.889147 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-753dc555-7676-4f16-a9ac-220521bfe2ca tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.078055 Oct 22 03:19:22.890314 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1735/3493] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:22 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:22.895761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:22.896600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:22.904804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.905678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.906350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.907441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:22.908080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:22.908676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:22.918782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:22.928375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:22.929878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:22.931289 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bacee1b1-fc92-46ae-929d-2c3c727f4fc1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.255135 Oct 22 03:19:22.940453 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1759/3494] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:22 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:23.055804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:23.058857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:23.074727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:23.076766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:23.077267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:23.078614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:23.078614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:23.078967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:23.139811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:23.150315 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-42955667-fe6b-40f6-8720-780088950cfc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.258744 Oct 22 03:19:23.160362 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1736/3495] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:22 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:23.320450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:23.336498 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b71756a-7659-4984-aed1-f7b84d75fb85 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.286594 Oct 22 03:19:23.337392 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1760/3496] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:23 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:23.349945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:23.359772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:23.368491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:23.372042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:23.373231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:23.375544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:23.376318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:23.376975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:23.404230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:23.661204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:23.675103 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fbce6c9b-b2f4-49ec-9a8d-ed6175367cc7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1488 microversion: 2.1 time: 0.339360 Oct 22 03:19:23.676453 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1737/3497] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:23 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1488 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:23.703008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:23.703693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:23.717053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:23.721248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:23.728430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:23.729386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:23.730850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:23.732141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:23.733790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:23.735274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:23.753456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:23.753955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:23.755395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:23.756126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:23.756624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:23.757049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:23.799658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:23.862422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:23.982069 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-607e4a42-5d26-41fa-907b-3f7b23cae798 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 204 len: 0 microversion: 2.1 time: 0.283018 Oct 22 03:19:23.983450 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1761/3498] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:23 2022] DELETE /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:19:23.991893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:23.993182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:24.006351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.007126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.007960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.009094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.009825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.011635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.139065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:24.150255 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e66d2e6-6be7-4e10-b407-bbb05b562deb tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1484 microversion: 2.1 time: 0.442204 Oct 22 03:19:24.151552 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1738/3499] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:23 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1484 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:24.163983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-87da0dd9-f213-4261-8dd8-fd63e88fb0e5 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a44b3a0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:24.236301 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-87da0dd9-f213-4261-8dd8-fd63e88fb0e5 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.079369 Oct 22 03:19:24.264461 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1739/3500] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:24 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:24.272535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:24.273602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:24.283735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.284048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:24.284808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.285697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.286861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.287570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.288235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.297040 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7df775fd-ab20-4c2b-9132-3b2a3de17903 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1470 microversion: 2.1 time: 0.311078 Oct 22 03:19:24.298452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1762/3501] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:23 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:24.307427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb15d79a-6d04-48d4-81b9-2fdafd67134b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d199a9280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:24.350901 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-eb15d79a-6d04-48d4-81b9-2fdafd67134b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Image not found. Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb15d79a-6d04-48d4-81b9-2fdafd67134b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414 HTTP/1.1 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '8cfeb3c8-26a9-4619-99ce-f7e01a36e414'} Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8cfeb3c8-26a9-4619-99ce-f7e01a36e414 to delete Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8cfeb3c8-26a9-4619-99ce-f7e01a36e414 could not be found. Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:24.352809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb15d79a-6d04-48d4-81b9-2fdafd67134b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb15d79a-6d04-48d4-81b9-2fdafd67134b tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414" status: 404 len: 62 microversion: 2.1 time: 0.055674 Oct 22 03:19:24.357670 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1763/3502] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:24 2022] DELETE /compute/v2.1/images/8cfeb3c8-26a9-4619-99ce-f7e01a36e414 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:19:24.365237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-43c215b8-7b60-4a56-92a7-45fe211d3e71 req-120c453c-18ae-41c5-aaf7-5a79ac4919ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7475c2-776b-4d56-9d11-4f7ac9cfba81", "name": "network-vif-plugged", "status": "completed", "tag": "90d83934-4a21-4469-822b-bed916123170"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:24.409154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-43c215b8-7b60-4a56-92a7-45fe211d3e71 req-120c453c-18ae-41c5-aaf7-5a79ac4919ee service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.410380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-43c215b8-7b60-4a56-92a7-45fe211d3e71 req-120c453c-18ae-41c5-aaf7-5a79ac4919ee service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.412022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-43c215b8-7b60-4a56-92a7-45fe211d3e71 req-120c453c-18ae-41c5-aaf7-5a79ac4919ee service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.455824 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-43c215b8-7b60-4a56-92a7-45fe211d3e71 req-120c453c-18ae-41c5-aaf7-5a79ac4919ee service nova] Creating event network-vif-plugged:90d83934-4a21-4469-822b-bed916123170 for instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 on n-h1-862416-2 Oct 22 03:19:24.469117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-43c215b8-7b60-4a56-92a7-45fe211d3e71 req-120c453c-18ae-41c5-aaf7-5a79ac4919ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111676 Oct 22 03:19:24.470179 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1764/3503] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:24.486290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:24.487007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:24.500064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.500634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.501079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.513877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.514380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.514828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.672227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:24.683213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:24.685034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:24.686247 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-52e6b72b-19e4-4c92-ad78-03878152d256 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.419910 Oct 22 03:19:24.701916 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1740/3504] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:24 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:24.712069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1a20e077-e66d-401e-aa8a-7de62bd02210 req-3942166b-c346-4e9e-a63b-9c43c8ec39e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ac884a-4e4c-46eb-bed5-ff095d21ed4e", "name": "network-vif-deleted", "tag": "e5c48f88-4317-4ffd-8341-8454067bd0fc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:24.731817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1a20e077-e66d-401e-aa8a-7de62bd02210 req-3942166b-c346-4e9e-a63b-9c43c8ec39e8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.732152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1a20e077-e66d-401e-aa8a-7de62bd02210 req-3942166b-c346-4e9e-a63b-9c43c8ec39e8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.733145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1a20e077-e66d-401e-aa8a-7de62bd02210 req-3942166b-c346-4e9e-a63b-9c43c8ec39e8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.751279 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1a20e077-e66d-401e-aa8a-7de62bd02210 req-3942166b-c346-4e9e-a63b-9c43c8ec39e8 service nova] Creating event network-vif-deleted:e5c48f88-4317-4ffd-8341-8454067bd0fc for instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e on n-h2-862416-2 Oct 22 03:19:24.756361 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1a20e077-e66d-401e-aa8a-7de62bd02210 req-3942166b-c346-4e9e-a63b-9c43c8ec39e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053091 Oct 22 03:19:24.761303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1741/3505] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:24.766922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:24.767215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:24.768614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:24.775332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.775871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.776380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.776542 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e279737-c506-4197-b8fc-295c53010012 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.305117 Oct 22 03:19:24.777055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.778456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.778617 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1765/3506] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:24 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:24.779205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.783554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:24.784044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:24.789778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.790481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.790928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.791716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.792382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.792986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.825442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:24.891245 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.compute.api [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Instance is already in deleting state, ignoring this request Oct 22 03:19:24.892103 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db463413-4320-4d44-a9e5-e2a8fa1020d2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 204 len: 0 microversion: 2.1 time: 0.112540 Oct 22 03:19:24.893230 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1766/3507] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:24 2022] DELETE /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:24.899569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4889ca4c-1d6e-4b41-b412-e3ef31ecac8b req-6738f212-5d40-4663-b889-f8f4a35a14c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255c9577-b797-4689-89c1-4e0166ced1f3", "name": "network-vif-deleted", "tag": "be5b4207-7744-4cf5-828a-7b5360be6e1f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:24.914731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4889ca4c-1d6e-4b41-b412-e3ef31ecac8b req-6738f212-5d40-4663-b889-f8f4a35a14c0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.915970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4889ca4c-1d6e-4b41-b412-e3ef31ecac8b req-6738f212-5d40-4663-b889-f8f4a35a14c0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.917231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4889ca4c-1d6e-4b41-b412-e3ef31ecac8b req-6738f212-5d40-4663-b889-f8f4a35a14c0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.926193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:24.931460 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4889ca4c-1d6e-4b41-b412-e3ef31ecac8b req-6738f212-5d40-4663-b889-f8f4a35a14c0 service nova] Creating event network-vif-deleted:be5b4207-7744-4cf5-828a-7b5360be6e1f for instance 255c9577-b797-4689-89c1-4e0166ced1f3 on n-h2-862416-2 Oct 22 03:19:24.936778 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cc5db76e-28b0-42ae-b147-9c23ff06fab7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.174049 Oct 22 03:19:24.937931 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1742/3508] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:24 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:24.940864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4889ca4c-1d6e-4b41-b412-e3ef31ecac8b req-6738f212-5d40-4663-b889-f8f4a35a14c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043742 Oct 22 03:19:24.945389 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1767/3509] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:24.956403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:24.957302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:24.964234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.964804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.965249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:24.965955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:24.966535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:24.967050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.175070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:25.192156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:25.193305 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b545fc7-060e-4349-911f-e66bcbeac73c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1494 microversion: 2.1 time: 0.254059 Oct 22 03:19:25.193429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:25.205411 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1743/3510] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:24 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1494 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:25.205663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.205663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.205663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.205663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.205663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.205663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.250232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.250690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.251144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.251990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lazy-loading 'fault' on Instance uuid 25ac884a-4e4c-46eb-bed5-ff095d21ed4e {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:19:25.260406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e222494d-0c76-40e3-899c-7fa4df1d6bb7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a4738b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:25.314550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:25.325796 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c87f2c9a-fcac-43d5-b706-63ec24541945 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 200 len: 1301 microversion: 2.1 time: 0.140196 Oct 22 03:19:25.326623 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1768/3511] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:25 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 1301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:25.331032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:25.331634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:25.337799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.338880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.339187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.339804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.340344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.340889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.363497 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e222494d-0c76-40e3-899c-7fa4df1d6bb7 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.110018 Oct 22 03:19:25.364199 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1744/3512] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:25 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:25.397547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.398060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.398516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.398965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lazy-loading 'fault' on Instance uuid 255c9577-b797-4689-89c1-4e0166ced1f3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:19:25.441974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11814f93de146b2ba7c05b4c27bb7c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dddd83fcb68b40a7980dad9eb74ac6f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:25.462290 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0fecc7f9-28f6-4610-b65a-067e15609188 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 200 len: 1307 microversion: 2.1 time: 0.134783 Oct 22 03:19:25.463093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1769/3513] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:25 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:25.717309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:25.718966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:25.732390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.733205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.734010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.734963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.735625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.736286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.807608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:25.809266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:25.821119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.824271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.826436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.827904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:25.830767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:25.831938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:25.969339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:25.978589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:25.980605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:25.982511 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-815ebd1e-5e6f-4e1a-8c85-aac924fff2bc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.269565 Oct 22 03:19:25.996253 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1745/3514] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:25 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:25.996253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:25.997521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:26.017945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.021807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.021807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.021807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.021807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.021807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.144197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:26.161580 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5c688706-085a-4e57-b2bb-c2e0950b9cde tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.359526 Oct 22 03:19:26.162366 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1770/3515] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:25 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:26.205310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:26.216644 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-57612ffe-d019-4cec-91af-22822ec04549 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.226433 Oct 22 03:19:26.217812 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1746/3516] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:25 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:26.240986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:26.241669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:26.249996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.250478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.250912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.251657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.252111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.252664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.362955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:26.363967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: 25ac884a-4e4c-46eb-bed5-ff095d21ed4e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:26.370980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.372443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.373313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.375723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.376479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.377133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.398830 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] HTTP exception thrown: Instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e could not be found. Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Request method failure captured: Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e HTTP/1.1 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU1-A_ha3fdig_NEdUDfxNnHwxr_tpHAUppHdD6VXT7NFdiGBJZr_bpMNxEafRDdXYJhvP1Cw4BxaH8zcyZ-LgzjYQfTMRFYWhTe85Pu6MkKc7kUYc2S70xt-A4jcwHaPzAF09NgsyAogMREL-1Q0G9kFCanqXOybSwbNk1VY62s6JlA Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0ce9ee0e663b4740a49c5bb01f4d85d6 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}] Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0ce9ee0e663b4740a49c5bb01f4d85d6 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-LiveMigrationTest-1304500679-project Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 92523f18567441589dba5548bb33eb9e Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-LiveMigrationTest-1304500679-project Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e could not be found. Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '25ac884a-4e4c-46eb-bed5-ff095d21ed4e'} Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e could not be found. Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e could not be found. Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:26.401826 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.406192 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:26.406192 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:26.406192 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:26.406192 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:26.406192 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:26.406192 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e could not be found. Oct 22 03:19:26.406192 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.408155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Returning 404 to user: Instance 25ac884a-4e4c-46eb-bed5-ff095d21ed4e could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:26.409358 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-328ed23a-1559-4d18-b731-ab62bb7b4f4d tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e" status: 404 len: 111 microversion: 2.1 time: 0.050399 Oct 22 03:19:26.410166 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1747/3517] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:26 2022] GET /compute/v2.1/servers/25ac884a-4e4c-46eb-bed5-ff095d21ed4e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:19:26.418528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c090fcde-a54a-4c62-91ee-e433082d9d72 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a51dc10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:26.492266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:26.509104 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c090fcde-a54a-4c62-91ee-e433082d9d72 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.094336 Oct 22 03:19:26.520677 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1748/3518] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:26 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:26.524310 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1b35a36-396e-4de4-afde-927a25fb593c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1494 microversion: 2.1 time: 0.290258 Oct 22 03:19:26.524992 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1771/3519] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:26 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1494 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:26.533297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1c7d319b-d661-4b71-aa4d-98414dc3d4ba req-ca1442a5-0c4a-4c96-9878-113b212edb26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7475c2-776b-4d56-9d11-4f7ac9cfba81", "name": "network-vif-unplugged", "status": "completed", "tag": "90d83934-4a21-4469-822b-bed916123170"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:26.541550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:26.541550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:26.552088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1c7d319b-d661-4b71-aa4d-98414dc3d4ba req-ca1442a5-0c4a-4c96-9878-113b212edb26 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.552640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1c7d319b-d661-4b71-aa4d-98414dc3d4ba req-ca1442a5-0c4a-4c96-9878-113b212edb26 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.553049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1c7d319b-d661-4b71-aa4d-98414dc3d4ba req-ca1442a5-0c4a-4c96-9878-113b212edb26 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.554211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.554763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.555284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.557545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.557545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.557922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.581041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1c7d319b-d661-4b71-aa4d-98414dc3d4ba req-ca1442a5-0c4a-4c96-9878-113b212edb26 service nova] Creating event network-vif-unplugged:90d83934-4a21-4469-822b-bed916123170 for instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 on n-h1-862416-2 Oct 22 03:19:26.589118 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1c7d319b-d661-4b71-aa4d-98414dc3d4ba req-ca1442a5-0c4a-4c96-9878-113b212edb26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062427 Oct 22 03:19:26.590047 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1772/3520] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:26.595328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:26.602442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] [instance: 255c9577-b797-4689-89c1-4e0166ced1f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:26.610005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.610561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.611003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.611478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:26.611776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.612166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.618160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.642464 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] HTTP exception thrown: Instance 255c9577-b797-4689-89c1-4e0166ced1f3 could not be found. Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Request method failure captured: Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 HTTP/1.1 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2EhNXG7LT_L3iX9Jnv0hPjoviuqP5JZx-arcRccNJ-g4dQ7stLwXSuFWkagjUhh6yMW7p3lP8_Vk3HIihIWvZkcXeubz_PJG6vRGV0fKg_ttLJKux8ydxfix0v5t5M56KEcBvGHcbnKqCOsdV0WvFdnykUndSnKrbwlooe-X8WEUkg Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: dddd83fcb68b40a7980dad9eb74ac6f1 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-InstanceActionsTestJSON-1279827312 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dddd83fcb68b40a7980dad9eb74ac6f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dddd83fcb68b40a7980dad9eb74ac6f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dddd83fcb68b40a7980dad9eb74ac6f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dddd83fcb68b40a7980dad9eb74ac6f1"}]}] Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-InstanceActionsTestJSON-1279827312 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: dddd83fcb68b40a7980dad9eb74ac6f1 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1279827312 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-InstanceActionsTestJSON-1279827312-project Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: a11814f93de146b2ba7c05b4c27bb7c7 Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-InstanceActionsTestJSON-1279827312-project Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 255c9577-b797-4689-89c1-4e0166ced1f3 could not be found. Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '255c9577-b797-4689-89c1-4e0166ced1f3'} Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 255c9577-b797-4689-89c1-4e0166ced1f3 could not be found. Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 255c9577-b797-4689-89c1-4e0166ced1f3 could not be found. Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:26.644278 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 255c9577-b797-4689-89c1-4e0166ced1f3 could not be found. Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] Returning 404 to user: Instance 255c9577-b797-4689-89c1-4e0166ced1f3 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ff1caf43-ed0b-443e-b90e-26569db89121 tempest-InstanceActionsTestJSON-1279827312 tempest-InstanceActionsTestJSON-1279827312-project] 10.222.0.25 "GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3" status: 404 len: 111 microversion: 2.1 time: 0.054458 Oct 22 03:19:26.649254 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1773/3521] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:26 2022] GET /compute/v2.1/servers/255c9577-b797-4689-89c1-4e0166ced1f3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:26.718571 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-54576105-84e9-4d4f-93e0-09fd2baa4e2c tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 204 len: 0 microversion: 2.1 time: 0.196280 Oct 22 03:19:26.722426 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1749/3522] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:26 2022] DELETE /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:26.727394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:26.728294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:26.742364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.742782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.743232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.743939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.748682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.749180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.943873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:26.954560 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57204438-e799-46ab-9ffa-42caead47e36 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1499 microversion: 2.1 time: 0.230886 Oct 22 03:19:26.955327 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1774/3523] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:26 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1499 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:26.972504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-26a458cc-ba60-4a9e-8a61-c3d0ebf2f8c1 req-c3b051f1-56ca-44e9-9e75-80c0e635f8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7475c2-776b-4d56-9d11-4f7ac9cfba81", "name": "network-vif-deleted", "tag": "90d83934-4a21-4469-822b-bed916123170"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:26.982853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-26a458cc-ba60-4a9e-8a61-c3d0ebf2f8c1 req-c3b051f1-56ca-44e9-9e75-80c0e635f8ac service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:26.983423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-26a458cc-ba60-4a9e-8a61-c3d0ebf2f8c1 req-c3b051f1-56ca-44e9-9e75-80c0e635f8ac service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:26.983928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-26a458cc-ba60-4a9e-8a61-c3d0ebf2f8c1 req-c3b051f1-56ca-44e9-9e75-80c0e635f8ac service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:26.997331 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-26a458cc-ba60-4a9e-8a61-c3d0ebf2f8c1 req-c3b051f1-56ca-44e9-9e75-80c0e635f8ac service nova] Creating event network-vif-deleted:90d83934-4a21-4469-822b-bed916123170 for instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 on n-h1-862416-2 Oct 22 03:19:27.002653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-26a458cc-ba60-4a9e-8a61-c3d0ebf2f8c1 req-c3b051f1-56ca-44e9-9e75-80c0e635f8ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036474 Oct 22 03:19:27.005356 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1750/3524] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:27.014624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:27.015351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:27.017970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:27.029069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.029869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.030599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.031483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.032113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.032948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.189555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:27.190608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:27.201534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.205049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.205800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.206777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.208898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.209496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.222810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:27.233227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:27.235255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:27.236717 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a8795d6-0b29-48d0-a992-9354e040db73 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.230614 Oct 22 03:19:27.248806 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1775/3525] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:27 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:27.262229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:27.262929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:27.269866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.270422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.270933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.271708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.272253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.272768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.477157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:27.489325 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea1a7853-6b0e-46f0-9e1e-ddf4a6ba35e9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.238953 Oct 22 03:19:27.489934 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1776/3526] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:27 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:27.528889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ebe491e7-be38-4759-b4fe-f1b6f3dba2c1 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1aa1c310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:27.537041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:27.552742 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43a0e941-f73d-481d-a38c-252149b4fe57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.369806 Oct 22 03:19:27.557646 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1751/3527] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:27 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:27.578101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:27.581574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:27.599184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.599959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.600636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.600912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ebe491e7-be38-4759-b4fe-f1b6f3dba2c1 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.078258 Oct 22 03:19:27.601831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.602541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.603330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.610551 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1777/3528] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:27 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:27.662710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.664054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.668185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.668736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lazy-loading 'fault' on Instance uuid 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:19:27.746639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2468c1f92230450db3397e1f0e97b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5283f2a2d9463f8974ff02871405f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:27.758767 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-776b0515-2e92-40d8-adbd-8aced14378f2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 200 len: 1297 microversion: 2.1 time: 0.199946 Oct 22 03:19:27.760433 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1752/3529] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:27 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 1297 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:27.980439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:27.981940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:27.995429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:27.996319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:27.996964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:27.998791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.000671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.001304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.269935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:28.272796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:28.290179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.291709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.292524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.293508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.295891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.299260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.450334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92523f18567441589dba5548bb33eb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9ee0e663b4740a49c5bb01f4d85d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:28.467549 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-878959c4-673e-427f-9ca1-218983ec6937 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 200 len: 1499 microversion: 2.1 time: 0.492457 Oct 22 03:19:28.468799 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1778/3530] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:27 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 1499 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:28.514421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:28.515382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:28.529431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.530155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.530867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.532294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.535807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.536470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.722961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:28.736866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:28.739580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:28.742939 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5211a56e-c07b-44c7-bf87-7e88e41ac73e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.477506 Oct 22 03:19:28.748548 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1753/3531] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:28 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:28.781198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:28.782112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:28.794130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.797251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.797897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.798809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.799431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.800016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.811493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:28.820739 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7936c044-10a2-4c97-a5a9-b851e449335c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.310876 Oct 22 03:19:28.824922 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1779/3532] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:28 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:28.831278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8ed13045-87d2-43f5-9ee9-387cb83273ad tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d196c7670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:28.913102 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8ed13045-87d2-43f5-9ee9-387cb83273ad tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.085883 Oct 22 03:19:28.922431 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1780/3533] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:28 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:28.927744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:28.928400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 6f7475c2-776b-4d56-9d11-4f7ac9cfba81] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:28.937394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.938206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.938534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.939240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:28.939696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:28.940127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:28.944573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:28.966327 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 could not be found. Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 HTTP/1.1 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 could not be found. Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '6f7475c2-776b-4d56-9d11-4f7ac9cfba81'} Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 could not be found. Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 could not be found. Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:28.967931 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:28.973154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:28.973154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:28.973154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:28.973154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:28.973154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 could not be found. Oct 22 03:19:28.973154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:28.975288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance 6f7475c2-776b-4d56-9d11-4f7ac9cfba81 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:28.976249 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0b371aff-32a0-4a6c-b223-5c6bd69759b7 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81" status: 404 len: 111 microversion: 2.1 time: 0.052468 Oct 22 03:19:28.976817 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1781/3534] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:28 2022] GET /compute/v2.1/servers/6f7475c2-776b-4d56-9d11-4f7ac9cfba81 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:28.986264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:28.987438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.000337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.000821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.001256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.001961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.002407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.002830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.039775 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 HTTP/1.1 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '281a3e2d-131a-4125-9072-43ebd1e60816'} Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.041806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a679319-2542-4e6d-8969-4d943838a9f0 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 404 len: 111 microversion: 2.1 time: 0.061352 Oct 22 03:19:29.045892 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1782/3535] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:28 2022] DELETE /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:29.048454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a5417109-cfde-4448-bcf9-0a1852e926ff req-89d575d2-0572-419a-96d7-c390f2f606bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92752bd-36bb-4182-b4d0-6382fd11831f", "name": "network-vif-deleted", "tag": "d821a477-0896-412a-9310-650e2cdea5b2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:29.060682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a5417109-cfde-4448-bcf9-0a1852e926ff req-89d575d2-0572-419a-96d7-c390f2f606bc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.061160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a5417109-cfde-4448-bcf9-0a1852e926ff req-89d575d2-0572-419a-96d7-c390f2f606bc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.061587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a5417109-cfde-4448-bcf9-0a1852e926ff req-89d575d2-0572-419a-96d7-c390f2f606bc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.076592 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a5417109-cfde-4448-bcf9-0a1852e926ff req-89d575d2-0572-419a-96d7-c390f2f606bc service nova] Creating event network-vif-deleted:d821a477-0896-412a-9310-650e2cdea5b2 for instance f92752bd-36bb-4182-b4d0-6382fd11831f on n-h2-862416-2 Oct 22 03:19:29.083953 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a5417109-cfde-4448-bcf9-0a1852e926ff req-89d575d2-0572-419a-96d7-c390f2f606bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038497 Oct 22 03:19:29.091098 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1783/3536] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:29.097137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.098261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: 281a3e2d-131a-4125-9072-43ebd1e60816] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.108064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.109077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.110105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.111208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.111907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.112691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.131094 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 HTTP/1.1 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '281a3e2d-131a-4125-9072-43ebd1e60816'} Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.134079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.138188 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.138188 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.138188 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.138188 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.138188 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. Oct 22 03:19:29.138188 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.141127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance 281a3e2d-131a-4125-9072-43ebd1e60816 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.142264 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b737e819-1eb3-4624-9369-0cba78713e3e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816" status: 404 len: 111 microversion: 2.1 time: 0.049695 Oct 22 03:19:29.143563 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1784/3537] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] GET /compute/v2.1/servers/281a3e2d-131a-4125-9072-43ebd1e60816 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:29.164413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-391d287d-afb6-418b-8183-e44b2a88dc6f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d196c7820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.200708 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-391d287d-afb6-418b-8183-e44b2a88dc6f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Image not found. Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-391d287d-afb6-418b-8183-e44b2a88dc6f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 HTTP/1.1 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '824a6712-7d1c-4c2b-be66-11e5ce574d78'} Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 824a6712-7d1c-4c2b-be66-11e5ce574d78 to delete Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 824a6712-7d1c-4c2b-be66-11e5ce574d78 could not be found. Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.203606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-391d287d-afb6-418b-8183-e44b2a88dc6f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-391d287d-afb6-418b-8183-e44b2a88dc6f tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78" status: 404 len: 62 microversion: 2.1 time: 0.058209 Oct 22 03:19:29.210363 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1785/3538] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] DELETE /compute/v2.1/images/824a6712-7d1c-4c2b-be66-11e5ce574d78 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:19:29.225768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.226510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.238040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.238625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.239103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.240567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.240567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.240777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.257715 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 HTTP/1.1 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a3b06bdd-b429-4660-b50e-6d2d40d3daf2'} Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.259407 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb7f52fc-b177-4e35-8b56-ecf71fa1ee51 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 404 len: 111 microversion: 2.1 time: 0.045824 Oct 22 03:19:29.263939 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1786/3539] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:29 2022] DELETE /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:29.270349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.271151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: a3b06bdd-b429-4660-b50e-6d2d40d3daf2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.281532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.281532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.282147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.283032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.283642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.284227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.304307 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 HTTP/1.1 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a3b06bdd-b429-4660-b50e-6d2d40d3daf2'} Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.306464 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance a3b06bdd-b429-4660-b50e-6d2d40d3daf2 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81a6a660-389a-49c8-ad49-dcc7f407579c tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2" status: 404 len: 111 microversion: 2.1 time: 0.044808 Oct 22 03:19:29.314202 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1787/3540] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] GET /compute/v2.1/servers/a3b06bdd-b429-4660-b50e-6d2d40d3daf2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:29.320367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-773d3813-b37b-487b-9e35-4d8a77c1cbfb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1bb09820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.367664 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-773d3813-b37b-487b-9e35-4d8a77c1cbfb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Image not found. Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-773d3813-b37b-487b-9e35-4d8a77c1cbfb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 HTTP/1.1 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '93e60b11-c789-4b7c-9a7f-04444f595eb7'} Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 93e60b11-c789-4b7c-9a7f-04444f595eb7 to delete Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 93e60b11-c789-4b7c-9a7f-04444f595eb7 could not be found. Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.369612 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:19:29.374657 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.376195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-773d3813-b37b-487b-9e35-4d8a77c1cbfb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.377568 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-773d3813-b37b-487b-9e35-4d8a77c1cbfb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7" status: 404 len: 62 microversion: 2.1 time: 0.061180 Oct 22 03:19:29.381116 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1788/3541] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] DELETE /compute/v2.1/images/93e60b11-c789-4b7c-9a7f-04444f595eb7 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:19:29.387026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.388887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.405591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.406216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.406920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.407759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.408362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.408905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.435029 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 HTTP/1.1 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f0fed450-5b11-447a-a5e9-e0e51183adc7'} Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.437826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.443830 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1d5ef40-32dc-4cd5-b118-bce2e9678a68 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 404 len: 111 microversion: 2.1 time: 0.060893 Oct 22 03:19:29.448255 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1789/3542] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:29 2022] DELETE /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:19:29.460669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.461922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: f0fed450-5b11-447a-a5e9-e0e51183adc7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.489598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.490113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.490612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.491316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.491768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.492186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.507698 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 HTTP/1.1 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f0fed450-5b11-447a-a5e9-e0e51183adc7'} Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.509389 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance f0fed450-5b11-447a-a5e9-e0e51183adc7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-996aff75-8276-4dcd-bafa-2df0e04e961e tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7" status: 404 len: 111 microversion: 2.1 time: 0.055130 Oct 22 03:19:29.515878 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1790/3543] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] GET /compute/v2.1/servers/f0fed450-5b11-447a-a5e9-e0e51183adc7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:29.521103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.521873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] [instance: f92752bd-36bb-4182-b4d0-6382fd11831f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.530568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.531054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.531492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.532303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.532774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.533202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.558193 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] HTTP exception thrown: Instance f92752bd-36bb-4182-b4d0-6382fd11831f could not be found. Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Request method failure captured: Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f HTTP/1.1 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU1-A_ha3fdig_NEdUDfxNnHwxr_tpHAUppHdD6VXT7NFdiGBJZr_bpMNxEafRDdXYJhvP1Cw4BxaH8zcyZ-LgzjYQfTMRFYWhTe85Pu6MkKc7kUYc2S70xt-A4jcwHaPzAF09NgsyAogMREL-1Q0G9kFCanqXOybSwbNk1VY62s6JlA Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0ce9ee0e663b4740a49c5bb01f4d85d6 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ce9ee0e663b4740a49c5bb01f4d85d6"}]}] Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0ce9ee0e663b4740a49c5bb01f4d85d6 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-LiveMigrationTest-1304500679 Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-LiveMigrationTest-1304500679-project Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 92523f18567441589dba5548bb33eb9e Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-LiveMigrationTest-1304500679-project Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f92752bd-36bb-4182-b4d0-6382fd11831f could not be found. Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f92752bd-36bb-4182-b4d0-6382fd11831f'} Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92752bd-36bb-4182-b4d0-6382fd11831f could not be found. Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92752bd-36bb-4182-b4d0-6382fd11831f could not be found. Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.559919 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92752bd-36bb-4182-b4d0-6382fd11831f could not be found. Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] Returning 404 to user: Instance f92752bd-36bb-4182-b4d0-6382fd11831f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eba2afce-447e-440b-9c4c-3a1bd5772397 tempest-LiveMigrationTest-1304500679 tempest-LiveMigrationTest-1304500679-project] 10.222.0.25 "GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f" status: 404 len: 111 microversion: 2.1 time: 0.044528 Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1791/3544] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] GET /compute/v2.1/servers/f92752bd-36bb-4182-b4d0-6382fd11831f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:29.567845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-624f3d97-6044-44d1-a1a9-16cc014f713a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d19ffce50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.593571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:29.596305 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-624f3d97-6044-44d1-a1a9-16cc014f713a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Image not found. Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-624f3d97-6044-44d1-a1a9-16cc014f713a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 HTTP/1.1 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '6949be8b-ed71-4977-9b9d-f30ec99943e3'} Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6949be8b-ed71-4977-9b9d-f30ec99943e3 to delete Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6949be8b-ed71-4977-9b9d-f30ec99943e3 could not be found. Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.599065 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-624f3d97-6044-44d1-a1a9-16cc014f713a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.603582 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-624f3d97-6044-44d1-a1a9-16cc014f713a tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3" status: 404 len: 62 microversion: 2.1 time: 0.037447 Oct 22 03:19:29.607402 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1792/3545] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] DELETE /compute/v2.1/images/6949be8b-ed71-4977-9b9d-f30ec99943e3 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:19:29.610862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.611356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.612146 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ff38849-d0ea-454d-aa09-5ceb25ca1cfb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.859766 Oct 22 03:19:29.614994 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1754/3546] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:28 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:29.620485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.620874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.621309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.622001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.622608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.623187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.646202 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 HTTP/1.1 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'cc010b5d-a6fb-4846-96e8-debf6bbc4509'} Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.648024 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.656027 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.658181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.659229 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ab23db4-8427-4ef3-9032-56412ea3dd77 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 404 len: 111 microversion: 2.1 time: 0.052968 Oct 22 03:19:29.663692 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1793/3547] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:29 2022] DELETE /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:29.668736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.669733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: cc010b5d-a6fb-4846-96e8-debf6bbc4509] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.680539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.681050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.681500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.686069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.686556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.688125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.721137 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 HTTP/1.1 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'cc010b5d-a6fb-4846-96e8-debf6bbc4509'} Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.723225 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.727463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.727463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.727463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.727463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.727463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. Oct 22 03:19:29.727463 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.729279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance cc010b5d-a6fb-4846-96e8-debf6bbc4509 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.731046 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db35fe16-3dbf-4fc4-83b7-bc95656b10f5 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509" status: 404 len: 111 microversion: 2.1 time: 0.066385 Oct 22 03:19:29.732419 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1755/3548] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] GET /compute/v2.1/servers/cc010b5d-a6fb-4846-96e8-debf6bbc4509 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:19:29.740496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ffe0abad-6290-474c-a417-c164cdf641eb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '.version_select at 0x7f0d1a3074c0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.781242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.782634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.795056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.796981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.797987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.798555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ffe0abad-6290-474c-a417-c164cdf641eb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Image not found. Oct 22 03:19:29.799087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.799696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.800310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ffe0abad-6290-474c-a417-c164cdf641eb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 HTTP/1.1 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '7446136c-91f7-4d62-bdfb-9765568cabc0'} Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7446136c-91f7-4d62-bdfb-9765568cabc0 to delete Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7446136c-91f7-4d62-bdfb-9765568cabc0 could not be found. Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.801120 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ffe0abad-6290-474c-a417-c164cdf641eb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.806330 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ffe0abad-6290-474c-a417-c164cdf641eb tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0" status: 404 len: 62 microversion: 2.1 time: 0.069255 Oct 22 03:19:29.809382 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1794/3549] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] DELETE /compute/v2.1/images/7446136c-91f7-4d62-bdfb-9765568cabc0 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:19:29.822121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.828521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.843238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.845681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.846316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.847171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.848068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.850625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.875935 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec HTTP/1.1 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ff9186d1-57ed-48a2-b004-417df2ad0eec'} Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:29.877886 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:29.881940 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:19:29.884523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:29.886332 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-093d20b6-3084-4094-8393-087c965a9265 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 404 len: 111 microversion: 2.1 time: 0.073706 Oct 22 03:19:29.887461 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1795/3550] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:29 2022] DELETE /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:19:29.896461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:29.897457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:29.905020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.905806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.906455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:29.907476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:29.908129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:29.908796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:30.109347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:30.119282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:30.125360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:30.129216 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01646674-9e40-4301-b69f-012eac496619 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.353615 Oct 22 03:19:30.130017 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1756/3551] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:29 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:30.172358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:30.172985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] [instance: ff9186d1-57ed-48a2-b004-417df2ad0eec] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:30.190244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:30.190771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:30.191205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:30.191929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:30.194789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:30.195201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:30.218208 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] HTTP exception thrown: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Request method failure captured: Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec HTTP/1.1 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2AaVLWosWXjcppqiE_OFYjnDljLp4dd3HwzSG63heFcTTPM8AC7ohzV4hbuVkaakJjbZc8PMIICVlvYagHLeq2dHucH9NdhbJGPpk0nwK4Ovw-mE_kI-PyxpgfMbSjIaH4BYOskv8bLHarIATLMPrNrtloZLmt5XiSfuWX7K_PCf28 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a5283f2a2d9463f8974ff02871405f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a5283f2a2d9463f8974ff02871405f7"}]}] Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 1a5283f2a2d9463f8974ff02871405f7 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesTestJSON-1669929926 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 2468c1f92230450db3397e1f0e97b5e0 Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesTestJSON-1669929926-project Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ff9186d1-57ed-48a2-b004-417df2ad0eec'} Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:30.220044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:19:30.224811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:19:30.224811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:19:30.224811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:19:30.224811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:19:30.224811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. Oct 22 03:19:30.224811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:19:30.226833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] Returning 404 to user: Instance ff9186d1-57ed-48a2-b004-417df2ad0eec could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:19:30.228701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b837893-43e7-4763-8889-7af77d592af2 tempest-ImagesTestJSON-1669929926 tempest-ImagesTestJSON-1669929926-project] 10.222.0.25 "GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec" status: 404 len: 111 microversion: 2.1 time: 0.081935 Oct 22 03:19:30.229902 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1757/3552] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:30 2022] GET /compute/v2.1/servers/ff9186d1-57ed-48a2-b004-417df2ad0eec => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:19:30.251805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80b6d1ff-7664-41b8-a095-aca76476121b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a0e08b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:30.327642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:30.340682 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05955255-df21-4993-bbb4-5f43bc6ed05c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.451934 Oct 22 03:19:30.354202 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1796/3553] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:29 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:30.582991 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80b6d1ff-7664-41b8-a095-aca76476121b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.351777 Oct 22 03:19:30.583971 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1758/3554] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:30 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:30.639633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:30.640436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:30.649000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:30.652873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:30.653551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:30.654972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:30.660157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:30.660871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:31.161164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:31.161812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:31.171211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:31.172870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:31.173560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:31.174760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:31.175994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:31.176692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:31.177239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:31.234342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:31.295186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:31.307693 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd609638-7476-446f-8ec3-7d29ba539fc7 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.672618 Oct 22 03:19:31.310223 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1797/3555] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:30 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:31.368002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:31.368727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:31.382512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:31.383562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:31.384828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:31.387382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:31.389056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:31.390960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:31.612818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:31.622860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:31.627527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:31.628763 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8254ce03-86ae-41ef-878c-6d0983d04612 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.472153 Oct 22 03:19:31.633062 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1759/3556] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:31 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:31.642356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-51829369-33c0-4a4f-876a-ab413613edfd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a51d430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:31.709140 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-51829369-33c0-4a4f-876a-ab413613edfd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.074202 Oct 22 03:19:31.718781 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1760/3557] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:31 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:31.851462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:31.862936 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3fb12874-6a31-4639-a8c3-b98b3274f01e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.499365 Oct 22 03:19:31.863545 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1798/3558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:31 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:32.337376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:32.338797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:32.362882 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:19:32.366073 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 03:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 (ip 10.222.0.25) !!! Oct 22 03:19:32.377374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:32.378018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:32.381533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:32.382635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:32.383287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:32.388875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:32.669360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:32.671369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:32.682316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:32.682802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:32.683856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:32.690301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:32.690687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:32.691146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:32.876196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:32.886569 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb64121e-9a55-4a41-b38a-6a5d11ee6a37 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1517 microversion: 2.1 time: 0.555754 Oct 22 03:19:32.890467 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1761/3559] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:32 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1517 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:32.895151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-755cd349-0e4b-4f13-8eea-135228e09697 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a51de50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:32.957706 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-755cd349-0e4b-4f13-8eea-135228e09697 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.066133 Oct 22 03:19:32.977016 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1762/3560] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:32 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:32.985226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:32.987248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:32.994792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:32.995547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:32.996158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:32.997095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:32.997722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:32.998323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:33.230740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:33.243244 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5f2b192-842e-46cd-bb0a-01838aae31c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.264826 Oct 22 03:19:33.247103 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1763/3561] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:32 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:33.911128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:33.927268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:33.940591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:33.946816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:33.948750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:33.953564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:33.955621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:33.960777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:34.071682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:34.081999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:34.090300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:34.093178 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-14bdf40e-1773-46f6-8898-71c7136f7917 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1744 microversion: 2.20 time: 1.430012 Oct 22 03:19:34.096044 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1799/3562] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:32 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1744 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:19:34.102770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca098f0b-2432-4e54-b72a-af4bf831c10e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1957d940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:34.187120 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca098f0b-2432-4e54-b72a-af4bf831c10e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.089134 Oct 22 03:19:34.187459 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1800/3563] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:34 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:34.272068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:34.273068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:34.290166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:34.291818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:34.292573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:34.294067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:34.294747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:34.295582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:34.371495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:34.383406 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6be7fb9f-c346-41f3-b888-5fd3807c7e1c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1523 microversion: 2.1 time: 0.474607 Oct 22 03:19:34.386823 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1764/3564] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:33 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1523 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:34.495219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8e3c858a-5f0d-478c-8ead-23273185c56b req-f5feca70-a12d-4dbc-a547-b7b9191a95d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb680fc8-0d54-4742-b649-b82abbf4884e", "name": "network-vif-plugged", "status": "completed", "tag": "d85d1270-815c-43e2-aa88-748b7e3a2c72"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:34.511482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8e3c858a-5f0d-478c-8ead-23273185c56b req-f5feca70-a12d-4dbc-a547-b7b9191a95d1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:34.520308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8e3c858a-5f0d-478c-8ead-23273185c56b req-f5feca70-a12d-4dbc-a547-b7b9191a95d1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:34.521102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8e3c858a-5f0d-478c-8ead-23273185c56b req-f5feca70-a12d-4dbc-a547-b7b9191a95d1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:34.569972 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8e3c858a-5f0d-478c-8ead-23273185c56b req-f5feca70-a12d-4dbc-a547-b7b9191a95d1 service nova] Creating event network-vif-plugged:d85d1270-815c-43e2-aa88-748b7e3a2c72 for instance eb680fc8-0d54-4742-b649-b82abbf4884e on n-h2-862416-2 Oct 22 03:19:34.585443 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8e3c858a-5f0d-478c-8ead-23273185c56b req-f5feca70-a12d-4dbc-a547-b7b9191a95d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095878 Oct 22 03:19:34.586989 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1765/3565] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:34.960019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:34.969977 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3cee87bd-2e37-49ec-ad14-97e0a5bfc35c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.702154 Oct 22 03:19:34.974038 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1801/3566] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:34 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:35.138456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:35.140354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:35.174764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:35.175619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:35.176304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:35.177435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:35.178786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:35.179389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:35.204774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9395452-d443-4b91-ae8d-8745a9c2f80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1957d5e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:35.327315 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9395452-d443-4b91-ae8d-8745a9c2f80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.126215 Oct 22 03:19:35.328308 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1802/3567] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:35 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:35.414443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:35.415479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:35.428054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:35.433089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:35.435208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:35.436149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:35.439603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:35.442580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:35.713028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:35.730508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:35.740189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:35.742576 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5b25c669-454c-4a55-b66b-fe51d2938cdd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1744 microversion: 2.20 time: 0.617502 Oct 22 03:19:35.755113 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1766/3568] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:35 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1744 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:36.007957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:36.009425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:36.026776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:36.027909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:36.030499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:36.034400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:36.035432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:36.038159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:36.358090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:36.375175 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63711118-5d72-4a1a-b40d-ad324c04cc9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.373059 Oct 22 03:19:36.380620 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1767/3569] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:35 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:19:36.397982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84814034-52b9-4e4a-88b1-f79a2aebcc3c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a043ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:36.469418 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84814034-52b9-4e4a-88b1-f79a2aebcc3c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1453 microversion: 2.1 time: 0.087396 Oct 22 03:19:36.474439 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1768/3570] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:36 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:36.503040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:36.521428 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a14ba5f9-0579-4fb7-88fe-ca46e676d264 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1523 microversion: 2.1 time: 1.112022 Oct 22 03:19:36.532933 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1803/3571] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:35 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1523 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:36.777647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:36.778502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:36.793343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:36.794801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:36.796070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:36.800927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:36.803186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:36.804052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:37.406760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:37.407539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:37.439852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:37.440184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:37.441782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:37.444378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:37.448832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:37.450955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:37.775196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:37.808747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:37.813540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:37.816172 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7f8db310-67b5-4ab8-a87f-8a2b92df28ce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1739 microversion: 2.20 time: 1.045284 Oct 22 03:19:37.835184 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1769/3572] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:36 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1739 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:37.852544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80e17be4-fa08-4d20-87ea-1377c4090e70 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a59c820>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:38.170396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:38.189033 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e5691d31-d47d-4b2d-a3da-56bdc2c9135c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1507 microversion: 2.1 time: 0.786647 Oct 22 03:19:38.191020 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1804/3573] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:37 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1507 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:38.213567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:38.224906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:38.247964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:38.248878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:38.249660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:38.255509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:38.256797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:38.257609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:39.076581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:39.083348 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-62933fac-6ce3-4c6c-9749-6d7889a672dc tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1523 microversion: 2.1 time: 0.890320 Oct 22 03:19:39.100600 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1805/3574] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:38 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1523 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:39.107178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:39.108026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:39.122628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:39.123421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:39.125112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:39.128775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:39.130113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:39.131349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:40.918098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:40.947788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:40.952353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:40.955391 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67920ebe-c0d9-43e9-bd24-29dce05ea179 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1739 microversion: 2.20 time: 1.853362 Oct 22 03:19:40.959616 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1806/3575] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:39 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1739 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:40.972992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:40.977799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:40.989586 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80e17be4-fa08-4d20-87ea-1377c4090e70 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1462 microversion: 2.1 time: 3.153151 Oct 22 03:19:40.990186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:40.991627 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1770/3576] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:37 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1462 bytes in 3156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:40.991861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:40.994955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:40.996826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:40.998613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:40.999167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:41.009717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:41.010644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:41.033952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:41.034985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:41.035800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:41.037050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:41.037681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:41.038278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:41.408156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:41.424956 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e1783b7b-4195-459c-b548-a873c2f877eb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1523 microversion: 2.1 time: 0.427331 Oct 22 03:19:41.427243 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1771/3577] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:40 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:41.454805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e2943f05-26f4-42f8-b87b-c41d053c1832 req-f9737237-3740-4cdb-9a7b-5f44d9456cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158a3acf-7c48-47fc-868c-3e89b334ccb6", "name": "network-vif-plugged", "status": "completed", "tag": "3c7caeca-15d0-4a19-a1bf-26b57012359c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:41.489859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e2943f05-26f4-42f8-b87b-c41d053c1832 req-f9737237-3740-4cdb-9a7b-5f44d9456cc2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:41.490357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e2943f05-26f4-42f8-b87b-c41d053c1832 req-f9737237-3740-4cdb-9a7b-5f44d9456cc2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:41.490818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e2943f05-26f4-42f8-b87b-c41d053c1832 req-f9737237-3740-4cdb-9a7b-5f44d9456cc2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:41.500337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:41.512304 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8e0e5046-4aa1-49ab-9787-d3bdf3b94ced tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1523 microversion: 2.1 time: 0.550794 Oct 22 03:19:41.514878 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1807/3578] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:40 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:41.523623 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e2943f05-26f4-42f8-b87b-c41d053c1832 req-f9737237-3740-4cdb-9a7b-5f44d9456cc2 service nova] Creating event network-vif-plugged:3c7caeca-15d0-4a19-a1bf-26b57012359c for instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 on n-h1-862416-2 Oct 22 03:19:41.543056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-58f16883-1833-44ca-ba5f-a1a1f8bf9ebd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d199df0d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:41.545135 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e2943f05-26f4-42f8-b87b-c41d053c1832 req-f9737237-3740-4cdb-9a7b-5f44d9456cc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114831 Oct 22 03:19:41.555575 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1772/3579] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:41.992251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:41.993112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:42.016762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:42.028768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:42.030485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:42.031566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:42.032038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:42.032495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:43.768534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:43.782942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:43.789371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:43.797950 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c488ee3-bb70-4b23-a41a-31cadb1f8ba6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1739 microversion: 2.20 time: 1.810304 Oct 22 03:19:43.800441 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1773/3580] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:41 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1739 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:43.819634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:43.821129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:43.842364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:43.843162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:43.843917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:43.844841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:43.845478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:43.846399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:45.145741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:45.156982 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8904aefd-7302-40fb-94ac-80aa8b009f15 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1508 microversion: 2.1 time: 1.354877 Oct 22 03:19:45.183159 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1774/3581] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:43 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1508 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:45.195871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:45.197709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:45.228645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:45.233449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:45.234212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:45.237498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:45.240139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:45.241389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:45.773301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:45.787272 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1b58cf0-b579-4905-9a73-0343556a8c52 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1523 microversion: 2.1 time: 0.602512 Oct 22 03:19:45.787881 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1775/3582] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:45 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1523 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:45.820169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7952238d-54a1-4a48-bcad-64be8bc7ca85 req-76df3b9a-ab78-4eee-bdbd-80f76d10c9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413d7cde-ec29-4239-968e-6524df522977", "name": "network-vif-unplugged", "status": "completed", "tag": "790776fd-bbd7-4ed1-b035-1ab433bbea5c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:45.840451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7952238d-54a1-4a48-bcad-64be8bc7ca85 req-76df3b9a-ab78-4eee-bdbd-80f76d10c9c1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:45.841247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7952238d-54a1-4a48-bcad-64be8bc7ca85 req-76df3b9a-ab78-4eee-bdbd-80f76d10c9c1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:45.842010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7952238d-54a1-4a48-bcad-64be8bc7ca85 req-76df3b9a-ab78-4eee-bdbd-80f76d10c9c1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:45.882140 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7952238d-54a1-4a48-bcad-64be8bc7ca85 req-76df3b9a-ab78-4eee-bdbd-80f76d10c9c1 service nova] Creating event network-vif-unplugged:790776fd-bbd7-4ed1-b035-1ab433bbea5c for instance 413d7cde-ec29-4239-968e-6524df522977 on n-h2-862416-2 Oct 22 03:19:45.895785 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7952238d-54a1-4a48-bcad-64be8bc7ca85 req-76df3b9a-ab78-4eee-bdbd-80f76d10c9c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079184 Oct 22 03:19:45.898846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1776/3583] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:45.912940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:45.915247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:45.930377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:45.933217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:45.934847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:45.938272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:45.938919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:45.940810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:46.275951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:46.336416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:46.343134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:46.346248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a627b429-7e60-4f21-9a90-43c63fc37ecf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1739 microversion: 2.20 time: 0.445955 Oct 22 03:19:46.349820 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1777/3584] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:45 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1739 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:46.370683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:46.377523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:46.403675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:46.410643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:46.411806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:46.422622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:46.425054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:46.427045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:46.703574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:46.718184 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9caff26-11c4-4e4b-9278-fe97bf3f425d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 200 len: 1508 microversion: 2.1 time: 0.353323 Oct 22 03:19:46.722950 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1778/3585] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:46 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:46.742511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:46.743174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:46.753786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:46.754213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:46.754662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:46.755398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:46.755863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:46.756338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:46.803636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:19:46.977410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-054b03f4-2000-4232-950c-e1c9b9e17b50 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 204 len: 0 microversion: 2.1 time: 0.238642 Oct 22 03:19:46.982023 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1779/3586] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:19:46 2022] DELETE /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:19:47.011331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:47.013434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:47.021323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:47.022103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:47.022727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:47.023627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:47.024272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:47.024867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:47.092276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:47.512552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:47.527630 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5b11673e-2487-454d-bc43-f6cc154d71de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1523 microversion: 2.1 time: 0.542404 Oct 22 03:19:47.528719 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1780/3587] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:46 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1523 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:47.533903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-80924162", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "3562332b-563f-4110-a622-fceabc5a2780"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:50.989292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=49 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:51.505563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=80 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:57.522426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:57.556815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:19:59.030370 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-58f16883-1833-44ca-ba5f-a1a1f8bf9ebd tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 200 len: 1462 microversion: 2.1 time: 17.513901 Oct 22 03:19:59.033653 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1808/3588] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:19:41 2022] GET /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 1462 bytes in 17517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:19:59.046559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:59.047443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:59.049754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] validate_networks() for [('3562332b-563f-4110-a622-fceabc5a2780', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:19:59.065889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:59.066788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:59.067879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:59.069008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:59.069696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:59.070375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:59.803450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:59.813460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:59.815284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:19:59.816851 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90991dd9-f8c3-4c6e-bed5-2642a5a38356 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1739 microversion: 2.20 time: 0.781996 Oct 22 03:19:59.817564 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1809/3589] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:19:59 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1739 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:19:59.824466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b3540d24-b3d0-4034-8fcb-ce007448f673 req-3cc2bb22-1cd0-4ea1-84e3-1a13a7aba8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667e973-b796-44b6-9ab4-9fde79a741ac", "name": "network-vif-plugged", "status": "completed", "tag": "ad74246e-0c7b-4ede-9595-9b35122dc41a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:19:59.838615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b3540d24-b3d0-4034-8fcb-ce007448f673 req-3cc2bb22-1cd0-4ea1-84e3-1a13a7aba8dc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:59.839486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b3540d24-b3d0-4034-8fcb-ce007448f673 req-3cc2bb22-1cd0-4ea1-84e3-1a13a7aba8dc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:59.840149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b3540d24-b3d0-4034-8fcb-ce007448f673 req-3cc2bb22-1cd0-4ea1-84e3-1a13a7aba8dc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:59.859725 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b3540d24-b3d0-4034-8fcb-ce007448f673 req-3cc2bb22-1cd0-4ea1-84e3-1a13a7aba8dc service nova] Creating event network-vif-plugged:ad74246e-0c7b-4ede-9595-9b35122dc41a for instance f667e973-b796-44b6-9ab4-9fde79a741ac on n-h1-862416-2 Oct 22 03:19:59.892352 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b3540d24-b3d0-4034-8fcb-ce007448f673 req-3cc2bb22-1cd0-4ea1-84e3-1a13a7aba8dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073035 Oct 22 03:19:59.893420 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1810/3590] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:19:59.913778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:19:59.916011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:19:59.937378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:59.938111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:59.940233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:19:59.941645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:19:59.944447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:19:59.948008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:00.633020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:00.651084 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c6c7a1a-a4c0-405b-91a2-ccfbc5ceead0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1523 microversion: 2.1 time: 0.753431 Oct 22 03:20:00.674973 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1811/3591] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:19:59 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1523 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:00.682057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-37c1b104-a552-4153-9a49-4a2e33204c8f req-17b91fa7-8a9e-443d-9537-5659c75aed69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158a3acf-7c48-47fc-868c-3e89b334ccb6", "name": "network-vif-deleted", "tag": "3c7caeca-15d0-4a19-a1bf-26b57012359c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:00.699539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-37c1b104-a552-4153-9a49-4a2e33204c8f req-17b91fa7-8a9e-443d-9537-5659c75aed69 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:00.700357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-37c1b104-a552-4153-9a49-4a2e33204c8f req-17b91fa7-8a9e-443d-9537-5659c75aed69 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:00.702558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-37c1b104-a552-4153-9a49-4a2e33204c8f req-17b91fa7-8a9e-443d-9537-5659c75aed69 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:00.717539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-37c1b104-a552-4153-9a49-4a2e33204c8f req-17b91fa7-8a9e-443d-9537-5659c75aed69 service nova] Creating event network-vif-deleted:3c7caeca-15d0-4a19-a1bf-26b57012359c for instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 on n-h1-862416-2 Oct 22 03:20:00.723309 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-37c1b104-a552-4153-9a49-4a2e33204c8f req-17b91fa7-8a9e-443d-9537-5659c75aed69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045525 Oct 22 03:20:00.724541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1812/3592] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:00.733390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:00.734305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:00.741577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:00.742582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:00.743258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:00.745222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:00.745971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:00.746620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:01.167260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:01.183656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:01.185909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:01.187361 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b118a93-eab1-4e79-a2b9-57a0be5cbf96 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2954 microversion: 2.42 time: 0.461515 Oct 22 03:20:01.187944 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1813/3593] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:00 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2954 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:01.221974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:01.222473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:01.222947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:01.223592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:01.224498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:01.249131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:01.250559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:01.252452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:01.255292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:01.255767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:01.256406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:01.310820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Getting quotas for project 6e11664c867b4d08b961a0613160c3cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:01.339590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Getting quotas for user 0acb8d942d09476994afa9a647132e5c and project 6e11664c867b4d08b961a0613160c3cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:01.414877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:20:01.440381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:20:01.613019 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-745c81d5-9958-4e3a-8a0b-6f4a82a7f80c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.083189 Oct 22 03:20:01.621328 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1781/3594] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:19:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 14092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:20:01.637750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:01.639528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:01.669746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:01.673078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:01.676524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:01.677299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:01.677774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:01.678212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:01.804080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-77169efd-0069-4f5c-9f72-e7532a87f902 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d197844c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-30870249", "description": "tempest-description-506020903"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:02.076322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:02.086954 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a7ba2ec-efde-4ffc-ab53-8077dd67a80d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 200 len: 1467 microversion: 2.1 time: 0.462994 Oct 22 03:20:02.088932 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1782/3595] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:01 2022] GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 1467 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:02.105464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:02.107050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:02.124563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:02.125593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:02.126275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:02.128664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:02.129777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:02.131254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:02.232796 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-77169efd-0069-4f5c-9f72-e7532a87f902 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.043690 Oct 22 03:20:02.233385 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1814/3596] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:01 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:02.240951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:02.241804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:02.263067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:02.263805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:02.264518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:02.265438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:02.266465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:02.267102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:02.447525 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5c7f7f4c-964c-4701-9df6-540c1009c174 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.210476 Oct 22 03:20:02.448230 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1815/3597] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Oct 22 03:20:02 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813/os-interface => generated 1830 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:02.799043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:02.828675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:02.830691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:02.838284 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ac98830-7b5a-4165-8784-f194ad20f0b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1721 microversion: 2.20 time: 0.747905 Oct 22 03:20:02.857907 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1783/3598] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:02 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1721 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:02.881474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b60e6f0-5c9d-446b-a78f-ef6582195c8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'create', calling method: .version_select at 0x7f0d199df0d0>, body: {"keypair": {"name": "tempest-keypair-678950926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe+hL+26v5JOYeMR+GGTjNv9jlSlbkDURRPW5y6bAhikMbFG2NFQuWIDklDeyOyXVqiJaFU9LIfd/F5K3n8L7VibbTvmeYYQPsPE7poYbAs8FcZuOaOElOk+sKiAm6vHg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:02.904012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-89827a4c-ecfc-4efd-aa19-eb6077ec935e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:02.904692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-89827a4c-ecfc-4efd-aa19-eb6077ec935e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:02.981726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2b60e6f0-5c9d-446b-a78f-ef6582195c8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for project 76599914af404f118b425b41a2432291. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:03.015709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2b60e6f0-5c9d-446b-a78f-ef6582195c8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for user f89d04db39be473097b885f7465115a2 and project 76599914af404f118b425b41a2432291. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:03.091310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-89827a4c-ecfc-4efd-aa19-eb6077ec935e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:03.101568 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-89827a4c-ecfc-4efd-aa19-eb6077ec935e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1216 microversion: 2.1 time: 0.233318 Oct 22 03:20:03.102108 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1784/3599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:02 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1216 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:03.135630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:03.138132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:03.146372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:03.147576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:03.148046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:03.149105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:03.149335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:03.150332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:03.154129 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b60e6f0-5c9d-446b-a78f-ef6582195c8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.704153 Oct 22 03:20:03.156478 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1816/3600] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:20:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:03.178184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b5ba82a-26cb-4cd9-873e-5209e0630d14 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1957da60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:03.461549 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0b5ba82a-26cb-4cd9-873e-5209e0630d14 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-10-22T03%3A17%3A34Z" status: 200 len: 1902 microversion: 2.1 time: 0.293966 Oct 22 03:20:03.462685 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1817/3601] 10.222.0.25 () {58 vars in 1199 bytes} [Sat Oct 22 03:20:03 2022] GET /compute/v2.1/images?changes-since=2022-10-22T03%3A17%3A34Z => generated 1902 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:03.481191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5fde255-2d18-4e5f-afa0-1b06cc2d5de9 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1958d790>, body: {"security_group_rule": {"parent_group_id": "f5662bc8-5614-461d-98dc-dde5ae36aee4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:03.488966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:03.514194 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a57a573e-56f5-4d29-92aa-75db6ac9051d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1523 microversion: 2.1 time: 0.393264 Oct 22 03:20:03.516878 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1785/3602] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:03 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:03.531195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-aaade97d-b275-4aad-a1a0-0ea290bda4fe req-7bc2c41b-6864-4bc9-9029-20c4232c3b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb680fc8-0d54-4742-b649-b82abbf4884e", "name": "network-vif-unplugged", "status": "completed", "tag": "d85d1270-815c-43e2-aa88-748b7e3a2c72"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:03.569514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aaade97d-b275-4aad-a1a0-0ea290bda4fe req-7bc2c41b-6864-4bc9-9029-20c4232c3b0b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:03.571193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aaade97d-b275-4aad-a1a0-0ea290bda4fe req-7bc2c41b-6864-4bc9-9029-20c4232c3b0b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:03.572056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aaade97d-b275-4aad-a1a0-0ea290bda4fe req-7bc2c41b-6864-4bc9-9029-20c4232c3b0b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:03.615608 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-aaade97d-b275-4aad-a1a0-0ea290bda4fe req-7bc2c41b-6864-4bc9-9029-20c4232c3b0b service nova] Creating event network-vif-unplugged:d85d1270-815c-43e2-aa88-748b7e3a2c72 for instance eb680fc8-0d54-4742-b649-b82abbf4884e on n-h2-862416-2 Oct 22 03:20:03.632701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-aaade97d-b275-4aad-a1a0-0ea290bda4fe req-7bc2c41b-6864-4bc9-9029-20c4232c3b0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114532 Oct 22 03:20:03.633968 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1786/3603] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:03.641913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4520ba81-d4b4-4cc2-b4f4-2ef06ba0433d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a4ff5e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:03.758890 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4520ba81-d4b4-4cc2-b4f4-2ef06ba0433d tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1003475151" status: 200 len: 485 microversion: 2.1 time: 0.123188 Oct 22 03:20:03.760553 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1787/3604] 10.222.0.25 () {58 vars in 1231 bytes} [Sat Oct 22 03:20:03 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1003475151 => generated 485 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:03.782665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9f6d756-03b5-41f6-92b4-a25f547a82c2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a5280d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:03.949932 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5fde255-2d18-4e5f-afa0-1b06cc2d5de9 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.474352 Oct 22 03:20:03.951066 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1818/3605] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:20:03 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:03.966127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:03.967041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:03.982056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:03.988025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:03.988749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:03.989711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:03.992795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:03.993522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:03.994145 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9f6d756-03b5-41f6-92b4-a25f547a82c2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images?server=413d7cde-ec29-4239-968e-6524df522977" status: 200 len: 957 microversion: 2.1 time: 0.220602 Oct 22 03:20:03.994762 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1788/3606] 10.222.0.25 () {58 vars in 1209 bytes} [Sat Oct 22 03:20:03 2022] GET /compute/v2.1/images?server=413d7cde-ec29-4239-968e-6524df522977 => generated 957 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:04.011029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-010a3dd3-8927-4ba3-bde5-5e9dc379c45b tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1e57ae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-461923337", "description": "tempest-description-1531102890"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:04.287834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:04.297588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:04.299348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:04.300853 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d598ed23-7a89-4e9c-b620-1bf64280e1a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1664 microversion: 2.20 time: 0.348700 Oct 22 03:20:04.301964 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1819/3607] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:03 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1664 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:04.324850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be2d4481-2ccd-4f86-81fd-4134f221e4d4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19569af0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:04.442178 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be2d4481-2ccd-4f86-81fd-4134f221e4d4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 484 microversion: 2.1 time: 0.138883 Oct 22 03:20:04.443152 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1820/3608] 10.222.0.25 () {58 vars in 1317 bytes} [Sat Oct 22 03:20:04 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F74de4a13-4c74-449e-97da-d93bc3215451 => generated 484 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:04.453713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:04.456910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:04.464594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:04.465255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:04.466062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:04.468164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:04.468961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:04.469622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:04.693807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:04.710401 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-010a3dd3-8927-4ba3-bde5-5e9dc379c45b tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.714529 Oct 22 03:20:04.721258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1789/3609] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:04.723295 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2407fea8-5a36-4fe5-aaae-f7062064ee23 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1268 microversion: 2.1 time: 0.277408 Oct 22 03:20:04.726491 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1821/3610] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:04 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1268 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:04.741868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15702773-a8ea-4a2d-9a3e-fb4893a840f4"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:04.746975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a0c0605-2e2b-4496-a80b-46433b5d540b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d199df1f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:04.784566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:04.849238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:04.851989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:04.851989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:04.851989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:04.851989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:04.851989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:04.902313 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a0c0605-2e2b-4496-a80b-46433b5d540b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 484 microversion: 2.1 time: 0.174219 Oct 22 03:20:04.931660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1822/3611] 10.222.0.25 () {58 vars in 1303 bytes} [Sat Oct 22 03:20:04 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F74de4a13-4c74-449e-97da-d93bc3215451 => generated 484 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:04.962906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:04.963867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:05.001626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:05.005090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:05.005708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:05.010394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:05.012877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:05.013993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:05.674305 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-497f643f-2437-4e36-9473-081b0e76fe0a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.951608 Oct 22 03:20:05.676305 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1790/3612] 10.222.0.25 () {62 vars in 1364 bytes} [Sat Oct 22 03:20:04 2022] POST /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 188 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:20:05.693979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3206fae5-1933-4de9-9346-2a7eb38b123a tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1a78b9d0>, body: {"security_group_rule": {"parent_group_id": "d994a085-294f-4b25-a5fc-ce04248b6add", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:05.720761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:05.729387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7db2e31e-3b6e-4366-8ab1-3bb4df9a77bf tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1523 microversion: 2.1 time: 0.785312 Oct 22 03:20:05.738967 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1823/3613] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:04 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1523 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:05.768279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c024bce-3a82-4a9e-bc96-4bbcb72e801c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d199a9c10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:06.126257 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c024bce-3a82-4a9e-bc96-4bbcb72e801c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.386051 Oct 22 03:20:06.142757 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1824/3614] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:20:05 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:06.147837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:06.157330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:06.177417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:06.177962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:06.178413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:06.179346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:06.180005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:06.180929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:06.397207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:06.405881 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0942a6fe-164a-40df-b210-b9f42f47c1bb tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1274 microversion: 2.1 time: 0.261951 Oct 22 03:20:06.406475 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1825/3615] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:06 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:06.439028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:06.439912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:06.487722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:06.488286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:06.493939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:06.493939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:06.493939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:06.493939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:06.581533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120581) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 03:20:06.759443 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-edebca0d-7c6c-4c03-acf8-f666308a6329 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/action" status: 202 len: 0 microversion: 2.20 time: 0.330688 Oct 22 03:20:06.760963 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1826/3616] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:20:06 2022] POST /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:06.771805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f87d792b-593c-4506-8814-19932306a2c8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19591e50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:07.044755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f87d792b-593c-4506-8814-19932306a2c8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.281126 Oct 22 03:20:07.046014 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1827/3617] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:20:06 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:07.060372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3206fae5-1933-4de9-9346-2a7eb38b123a tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.382570 Oct 22 03:20:07.061381 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1791/3618] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:20:05 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:07.065905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:07.066525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:07.080776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:07.091816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:07.093123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:07.098120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:07.098978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:07.099589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:07.321952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab325214-0864-47de-8792-0a29e5db8d9e tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Calling method '.version_select at 0x7f0d19590ca0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:07.425141 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab325214-0864-47de-8792-0a29e5db8d9e tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 371 microversion: 2.1 time: 0.375325 Oct 22 03:20:07.425974 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1828/3619] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:20:07 2022] GET /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 371 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:07.432482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:07.433891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:07.442037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:07.442801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:07.443448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:07.444421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:07.445091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:07.445801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:07.658925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:07.674026 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bca0afdd-a0d1-48bd-887a-7fdcb3554c88 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1523 microversion: 2.1 time: 0.611058 Oct 22 03:20:07.675262 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1792/3620] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:07 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1523 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:07.697589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3d3a0d48-0743-4d6e-960c-b49352336972 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a58d0d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:07.788129 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3d3a0d48-0743-4d6e-960c-b49352336972 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.095585 Oct 22 03:20:07.798513 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1793/3621] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:20:07 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:07.802148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd6d80dc-b864-4648-9635-54bae15793e0 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1a4ffe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-524112624", "description": "tempest-description-19008957"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:08.028554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:08.043135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:08.045794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:08.047207 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50365857-732b-458d-a79c-b4ff30f71379 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1750 microversion: 2.20 time: 0.620060 Oct 22 03:20:08.061918 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1829/3622] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:07 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1750 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:08.077564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:08.078198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:08.096323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:08.097239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:08.097936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:08.099053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:08.101733 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dd6d80dc-b864-4648-9635-54bae15793e0 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.311717 Oct 22 03:20:08.104185 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1794/3623] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:07 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:08.121047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-70049401-09d2-44b9-bde4-94cdb0b0deac tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a4ffb80>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:08.123254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:08.123706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:08.249371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70049401-09d2-44b9-bde4-94cdb0b0deac tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:08.250228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70049401-09d2-44b9-bde4-94cdb0b0deac tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:08.250823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70049401-09d2-44b9-bde4-94cdb0b0deac tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:08.252564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70049401-09d2-44b9-bde4-94cdb0b0deac tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:08.253217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70049401-09d2-44b9-bde4-94cdb0b0deac tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:08.253971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70049401-09d2-44b9-bde4-94cdb0b0deac tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:08.321624 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-70049401-09d2-44b9-bde4-94cdb0b0deac tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 328 microversion: 2.1 time: 0.215145 Oct 22 03:20:08.323270 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1795/3624] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:20:08 2022] PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 328 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:08.328381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-996e91c6-8b6a-46c0-8fd3-1a10c1106f31 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a4ffdc0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:08.415035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-996e91c6-8b6a-46c0-8fd3-1a10c1106f31 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-10-22T03%3A17%3A29Z" status: 200 len: 6328 microversion: 2.1 time: 0.090355 Oct 22 03:20:08.416949 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1796/3625] 10.222.0.25 () {58 vars in 1220 bytes} [Sat Oct 22 03:20:08 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-22T03%3A17%3A29Z => generated 6328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:08.422285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-15172291", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316c23c4-6eda-4626-bced-03168617187b"}], "security_groups": [{"name": "tempest-securitygroup--1915864465"}], "key_name": "tempest-keypair-678950926", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:08.561784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] validate_networks() for [('316c23c4-6eda-4626-bced-03168617187b', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:20:08.632721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:08.649273 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f99896cb-01fb-4d5e-871c-6a8117299248 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1316 microversion: 2.1 time: 0.585949 Oct 22 03:20:08.657284 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1830/3626] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:08 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:08.671313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31a3f07b-2d36-4324-b94a-445fa018b074 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d19569af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-206284602", "description": "tempest-description-1737075495"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:09.015780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:09.016232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:09.016786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:09.017205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:09.017626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:09.026872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:09.027652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:09.028348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:09.029304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:09.029960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:09.030797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:09.051900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:09.058566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for user f89d04db39be473097b885f7465115a2 and project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:09.082823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:20:09.086833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:20:09.155259 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9959f2b5-218c-47a9-a925-42d8cc299302 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.736882 Oct 22 03:20:09.167317 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1797/3627] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:20:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:20:09.174281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97294940-ac3e-4352-b4f0-d17dc7915342 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a58dc10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:09.252286 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31a3f07b-2d36-4324-b94a-445fa018b074 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.593373 Oct 22 03:20:09.261333 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1831/3628] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:09.282089 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97294940-ac3e-4352-b4f0-d17dc7915342 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1003475151" status: 200 len: 665 microversion: 2.1 time: 0.112150 Oct 22 03:20:09.284352 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1798/3629] 10.222.0.25 () {58 vars in 1252 bytes} [Sat Oct 22 03:20:09 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1003475151 => generated 665 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:09.325528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:09.328946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:09.345894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:09.346559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:09.347015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:09.347735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:09.351037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:09.351735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:09.380389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-537969403", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:09.492326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:20:09.631166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:09.644985 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28f02d5c-6d00-42b2-b7e6-809f6c93bb9a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1505 microversion: 2.1 time: 0.338369 Oct 22 03:20:09.645633 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1799/3630] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:09 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:09.651244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:09.651859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:09.697589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:09.702856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:09.703343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:09.704149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:09.704713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:09.705127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:09.905056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:09.923316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:09.929272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:09.930655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5a7f83b-c61a-47b2-b3db-5cc700460baf tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1752 microversion: 2.20 time: 0.283839 Oct 22 03:20:09.931601 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1800/3631] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:09 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1752 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:09.957418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c4885880-f153-48c4-b1e8-e11021d8d095 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:09.958561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c4885880-f153-48c4-b1e8-e11021d8d095 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:10.051869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c4885880-f153-48c4-b1e8-e11021d8d095 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:10.059912 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c4885880-f153-48c4-b1e8-e11021d8d095 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1236 microversion: 2.1 time: 0.109271 Oct 22 03:20:10.060994 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1801/3632] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:09 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1236 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:10.076923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4ac9146-199d-47a2-a9a1-b16e989ee0b3 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1a4ff040>, body: {"security_group_rule": {"parent_group_id": "da3975f4-5e20-444b-854f-a72f23d317fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "116868e3-9651-4580-ac2e-ab1d61a00d07"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:10.329672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:10.330969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:10.332388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:10.334125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:10.334840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:10.349586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.350063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.351134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.351970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.352561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.353195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.375605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Getting quotas for project 1cfdce851f3b41618650813a2ab41462. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:10.387616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Getting quotas for user 42e82cd341d54571a72a96c80a3450f2 and project 1cfdce851f3b41618650813a2ab41462. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:10.403184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.utils [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] cores quota exceeded for 1cfdce851f3b41618650813a2ab41462, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120581) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 22 03:20:10.404301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Request method failure captured: Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 144 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2FkGRhS2V8kr0inn0zjHeqTIOXUEiXIpdOpEamq7wFxxkRnxtVG7JSbUiAIzSb1XCzhfRewl7sE01EWVfNW85SJNgvnhCUrMQjSPlQOgKdKMT5l0VY31XNSdAATLAN_Spqd365Fi9nVGtG3RXoLhDFZQGgs4TgbFvMpwWjaAewyiAM Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1cfdce851f3b41618650813a2ab41462 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cfdce851f3b41618650813a2ab41462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cfdce851f3b41618650813a2ab41462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cfdce851f3b41618650813a2ab41462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cfdce851f3b41618650813a2ab41462"}]}] Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1cfdce851f3b41618650813a2ab41462 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-QuotasAdminNegativeTest-2107633456-project Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 42e82cd341d54571a72a96c80a3450f2 Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-QuotasAdminNegativeTest-2107633456-project Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-537969403", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-537969403', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452'}}} Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 03:20:10.418364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:10.422624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:10.425235 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4ac9146-199d-47a2-a9a1-b16e989ee0b3 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.359857 Oct 22 03:20:10.425235 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1802/3633] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:20:10 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:10.425799 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32e9f343-84e0-4fde-a877-bb222d6f36b4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.162283 Oct 22 03:20:10.426644 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1832/3634] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:20:09 2022] POST /compute/v2.1/servers => generated 111 bytes in 1164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:10.436287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b7d3b978-d1c5-4f41-b807-8b6fbe010c8c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e586b80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:10.438605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c772f285-6888-4ebf-aec0-d32924e8fc88 req-510cafd0-99a0-4ae8-9d1f-ee7c62999b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ea0c89-d7c8-414d-b796-4c45aca5729f", "tag": "9442663e-1ac1-492c-9f56-4eb699b73b0c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:10.464887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c772f285-6888-4ebf-aec0-d32924e8fc88 req-510cafd0-99a0-4ae8-9d1f-ee7c62999b52 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.465379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c772f285-6888-4ebf-aec0-d32924e8fc88 req-510cafd0-99a0-4ae8-9d1f-ee7c62999b52 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.465820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c772f285-6888-4ebf-aec0-d32924e8fc88 req-510cafd0-99a0-4ae8-9d1f-ee7c62999b52 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.490714 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c772f285-6888-4ebf-aec0-d32924e8fc88 req-510cafd0-99a0-4ae8-9d1f-ee7c62999b52 service nova] Creating event network-changed:9442663e-1ac1-492c-9f56-4eb699b73b0c for instance 76ea0c89-d7c8-414d-b796-4c45aca5729f on n-h2-862416-2 Oct 22 03:20:10.499173 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c772f285-6888-4ebf-aec0-d32924e8fc88 req-510cafd0-99a0-4ae8-9d1f-ee7c62999b52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065370 Oct 22 03:20:10.500078 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1833/3635] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:10.505786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:10.506762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:10.515196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.515699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.516141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.517776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.518449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.518939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.547408 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b7d3b978-d1c5-4f41-b807-8b6fbe010c8c tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1464 microversion: 2.1 time: 0.121447 Oct 22 03:20:10.549143 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1803/3636] 10.222.0.25 () {58 vars in 1338 bytes} [Sat Oct 22 03:20:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F74de4a13-4c74-449e-97da-d93bc3215451 => generated 1464 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:10.554061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f7b8452f-9dff-406f-8e83-f55c7ba934e7 req-48c40783-138a-415d-9a2e-8d834828f1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667e973-b796-44b6-9ab4-9fde79a741ac", "name": "network-vif-unplugged", "status": "completed", "tag": "ad74246e-0c7b-4ede-9595-9b35122dc41a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:10.570153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f7b8452f-9dff-406f-8e83-f55c7ba934e7 req-48c40783-138a-415d-9a2e-8d834828f1f8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.570998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f7b8452f-9dff-406f-8e83-f55c7ba934e7 req-48c40783-138a-415d-9a2e-8d834828f1f8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.572344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f7b8452f-9dff-406f-8e83-f55c7ba934e7 req-48c40783-138a-415d-9a2e-8d834828f1f8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.584247 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f7b8452f-9dff-406f-8e83-f55c7ba934e7 req-48c40783-138a-415d-9a2e-8d834828f1f8 service nova] Creating event network-vif-unplugged:ad74246e-0c7b-4ede-9595-9b35122dc41a for instance f667e973-b796-44b6-9ab4-9fde79a741ac on n-h1-862416-2 Oct 22 03:20:10.590111 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f7b8452f-9dff-406f-8e83-f55c7ba934e7 req-48c40783-138a-415d-9a2e-8d834828f1f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039299 Oct 22 03:20:10.591706 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1804/3637] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:10.597275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-88584eb4-4ce9-4b32-ae30-919c7f6c6126 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a6a23a0>, body: {"quota_set": {"cores": 20}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:10.670864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88584eb4-4ce9-4b32-ae30-919c7f6c6126 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.671468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88584eb4-4ce9-4b32-ae30-919c7f6c6126 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.671998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88584eb4-4ce9-4b32-ae30-919c7f6c6126 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.672834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88584eb4-4ce9-4b32-ae30-919c7f6c6126 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.673362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88584eb4-4ce9-4b32-ae30-919c7f6c6126 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.673867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88584eb4-4ce9-4b32-ae30-919c7f6c6126 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.729975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:10.738556 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c0d5b9a-85b6-43b6-bbba-549d722cc964 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1316 microversion: 2.1 time: 0.237247 Oct 22 03:20:10.739153 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1834/3638] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:10 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:10.741577 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-88584eb4-4ce9-4b32-ae30-919c7f6c6126 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 329 microversion: 2.1 time: 0.148459 Oct 22 03:20:10.742825 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1805/3639] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:20:10 2022] PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 329 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:10.743753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c27c2c42-e24f-4c6d-8980-c89bdaac3858 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d19547820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-747966341", "description": "tempest-description-1401900980"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:10.754188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3d45bff1-b939-462c-8d30-ac8d1fbe5505 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e40d1f0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:10.828020 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3d45bff1-b939-462c-8d30-ac8d1fbe5505 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1464 microversion: 2.1 time: 0.083675 Oct 22 03:20:10.828696 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1806/3640] 10.222.0.25 () {58 vars in 1324 bytes} [Sat Oct 22 03:20:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F74de4a13-4c74-449e-97da-d93bc3215451 => generated 1464 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:10.833972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:10.834924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:10.843128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.843934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.844485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.845279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:10.845740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:10.846311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:10.942469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c27c2c42-e24f-4c6d-8980-c89bdaac3858 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.201527 Oct 22 03:20:10.943477 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1835/3641] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:10.949249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27e7c1eb-2137-4b13-88e6-615c1239aeaf tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Calling method '.version_select at 0x7f0d19547d30>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:11.044462 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27e7c1eb-2137-4b13-88e6-615c1239aeaf tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 371 microversion: 2.1 time: 0.098488 Oct 22 03:20:11.045830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:11.046131 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1836/3642] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:20:10 2022] GET /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:11.051255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ea8830b-8666-42d7-960f-887fd9e747d2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1958d8b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:11.054860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1d0290d-7254-4318-87e3-31304c1eb2b6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1505 microversion: 2.1 time: 0.224763 Oct 22 03:20:11.055383 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1807/3643] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:10 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:11.076944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b267d345-5088-41d9-9080-e1f2791cedd2 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1aa1e160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1204918846", "description": "tempest-description-2073130096"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:11.237316 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ea8830b-8666-42d7-960f-887fd9e747d2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.188781 Oct 22 03:20:11.240551 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1837/3644] 10.222.0.25 () {58 vars in 1170 bytes} [Sat Oct 22 03:20:11 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:11.251658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:11.252588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:11.258326 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b267d345-5088-41d9-9080-e1f2791cedd2 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.200790 Oct 22 03:20:11.259643 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1808/3645] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:11 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:11.265518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f1ee648-fe05-41ed-82d7-e8135dc0a5db tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1a413f70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:11.272887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:11.273390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:11.273961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:11.274905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:11.275365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:11.275915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:11.363518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1ee648-fe05-41ed-82d7-e8135dc0a5db tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:11.365799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1ee648-fe05-41ed-82d7-e8135dc0a5db tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:11.366664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1ee648-fe05-41ed-82d7-e8135dc0a5db tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:11.367417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1ee648-fe05-41ed-82d7-e8135dc0a5db tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:11.369438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1ee648-fe05-41ed-82d7-e8135dc0a5db tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:11.371556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f1ee648-fe05-41ed-82d7-e8135dc0a5db tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:11.408572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:11.436497 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f1ee648-fe05-41ed-82d7-e8135dc0a5db tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 328 microversion: 2.1 time: 0.175202 Oct 22 03:20:11.438005 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1809/3646] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:20:11 2022] PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 328 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:11.444251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:11.444902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:11.463486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:11.464323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:11.465024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:11.465505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:11.466765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:11.467441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:11.468251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:11.483398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:11.485558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:11.486811 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7bb00c78-295e-413c-8f89-4f40bafa388a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1752 microversion: 2.20 time: 0.244796 Oct 22 03:20:11.487268 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1838/3647] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:11 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:11.491684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-984eb7ba-7fed-4acb-beaf-cf62120e25d9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d19517700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:11.549206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:11.560336 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dc9c7719-65da-4db5-b183-b3dc29729499 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1288 microversion: 2.1 time: 0.121156 Oct 22 03:20:11.561156 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1810/3648] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:11 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1288 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:11.568683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e3edf9d-40e3-485b-85cb-651f289b5531 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1a0e0790>, body: {"security_group_rule": {"parent_group_id": "f147f9f3-7c9e-4163-b9fa-995142b482d4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "54de9a4f-ea47-454a-979f-39b26e9485e6"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:11.575170 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-984eb7ba-7fed-4acb-beaf-cf62120e25d9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.086874 Oct 22 03:20:11.586968 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1839/3649] 10.222.0.25 () {58 vars in 1170 bytes} [Sat Oct 22 03:20:11 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:11.586968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1826544498", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:11.641690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:20:11.889186 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e3edf9d-40e3-485b-85cb-651f289b5531 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.326711 Oct 22 03:20:11.890112 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1811/3650] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:20:11 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:11.896331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-efe1a3c2-e184-4849-8d34-1dd7eda02652 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a473ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:11.926674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:11.927193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:11.927744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:11.928289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:11.928753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:11.942281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:11.942998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:11.943748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:11.944729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:11.945394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:11.946046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:11.958359 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-efe1a3c2-e184-4849-8d34-1dd7eda02652 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/78462069-c4b0-4a1c-b064-2d19ad600046" status: 200 len: 784 microversion: 2.1 time: 0.067043 Oct 22 03:20:11.964627 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1812/3651] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:20:11 2022] GET /compute/v2.1/images/78462069-c4b0-4a1c-b064-2d19ad600046 => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:11.979219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Getting quotas for project 1cfdce851f3b41618650813a2ab41462. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:11.984882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:11.985515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:11.985984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Getting quotas for user 42e82cd341d54571a72a96c80a3450f2 and project 1cfdce851f3b41618650813a2ab41462. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:12.000832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:12.001330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.utils [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] instances quota exceeded for 1cfdce851f3b41618650813a2ab41462, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120581) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 22 03:20:12.001960 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Request method failure captured: Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 145 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2FkGRhS2V8kr0inn0zjHeqTIOXUEiXIpdOpEamq7wFxxkRnxtVG7JSbUiAIzSb1XCzhfRewl7sE01EWVfNW85SJNgvnhCUrMQjSPlQOgKdKMT5l0VY31XNSdAATLAN_Spqd365Fi9nVGtG3RXoLhDFZQGgs4TgbFvMpwWjaAewyiAM Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1cfdce851f3b41618650813a2ab41462 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cfdce851f3b41618650813a2ab41462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cfdce851f3b41618650813a2ab41462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cfdce851f3b41618650813a2ab41462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cfdce851f3b41618650813a2ab41462"}]}] Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1cfdce851f3b41618650813a2ab41462 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-QuotasAdminNegativeTest-2107633456-project Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 42e82cd341d54571a72a96c80a3450f2 Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-QuotasAdminNegativeTest-2107633456-project Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1826544498", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1826544498', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452'}}} Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 03:20:12.004187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:12.009242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:12.015317 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-82aa15f4-27bd-4b24-b5d5-ead769587200 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.428877 Oct 22 03:20:12.015470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:12.015470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:12.015470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:12.015883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1840/3652] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:20:11 2022] POST /compute/v2.1/servers => generated 119 bytes in 435 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:12.016544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:12.020573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a487f8ab-784c-4755-a51c-d6e1de1d0ca9 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d1958da60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:12.021438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:12.173075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:12.181732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d50fd527-f95b-4266-aa12-cae9ba8a0ec4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1316 microversion: 2.1 time: 0.215371 Oct 22 03:20:12.182292 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1813/3653] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:11 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:12.187064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30b4d4a5-dbed-4c84-ae9b-6394d20113b6 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a0fe160>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:12.273880 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a487f8ab-784c-4755-a51c-d6e1de1d0ca9 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/54de9a4f-ea47-454a-979f-39b26e9485e6" status: 202 len: 0 microversion: 2.1 time: 0.257122 Oct 22 03:20:12.275593 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1841/3654] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:12 2022] DELETE /compute/v2.1/os-security-groups/54de9a4f-ea47-454a-979f-39b26e9485e6 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:12.282069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65092609-b88d-4f25-bbe0-5e4e9fe687f0 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Action: 'update', calling method: .version_select at 0x7f0d19547e50>, body: {"quota_set": {"instances": 10}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:12.326141 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30b4d4a5-dbed-4c84-ae9b-6394d20113b6 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.142754 Oct 22 03:20:12.326743 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1814/3655] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:20:12 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:12.340608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:12.343438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:12.361347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:12.361820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:12.362275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:12.373513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:12.374460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:12.375256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:12.381611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65092609-b88d-4f25-bbe0-5e4e9fe687f0 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:12.382097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65092609-b88d-4f25-bbe0-5e4e9fe687f0 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:12.382536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65092609-b88d-4f25-bbe0-5e4e9fe687f0 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:12.383264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65092609-b88d-4f25-bbe0-5e4e9fe687f0 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:12.383715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65092609-b88d-4f25-bbe0-5e4e9fe687f0 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:12.388471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65092609-b88d-4f25-bbe0-5e4e9fe687f0 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:12.521526 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65092609-b88d-4f25-bbe0-5e4e9fe687f0 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 329 microversion: 2.1 time: 0.244285 Oct 22 03:20:12.522173 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1842/3656] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:20:12 2022] PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 329 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:12.529260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a7de19a-79f4-418b-ae65-daf5ca6a344c tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d19514160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:12.573494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:12.583420 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dcbad225-7f1f-458c-abae-3eb93b22b6f8 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 200 len: 1508 microversion: 2.1 time: 0.252044 Oct 22 03:20:12.584961 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1815/3657] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:12 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:12.590799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d313e8e-c82e-4f1e-a759-0daab6d387f2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1a0e0ee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:12.651305 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a7de19a-79f4-418b-ae65-daf5ca6a344c tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/f147f9f3-7c9e-4163-b9fa-995142b482d4" status: 200 len: 247 microversion: 2.1 time: 0.127815 Oct 22 03:20:12.652576 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1843/3658] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:20:12 2022] GET /compute/v2.1/os-security-groups/f147f9f3-7c9e-4163-b9fa-995142b482d4 => generated 247 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:12.658384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:12.658998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:12.667672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:12.668025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:12.668492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:12.669198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:12.669649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:12.670078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:12.996659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:13.000993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:13.011366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:13.012881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:13.014165 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2873446b-739e-4764-941f-cdc8e7d06223 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1752 microversion: 2.20 time: 0.360661 Oct 22 03:20:13.014754 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1844/3659] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:12 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1752 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:13.019417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96dd3e08-eaca-4e08-a5e0-1d82db32c470 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Calling method '.version_select at 0x7f0d19517f70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:13.110880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:13.126416 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96dd3e08-eaca-4e08-a5e0-1d82db32c470 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 371 microversion: 2.1 time: 0.110354 Oct 22 03:20:13.133550 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1845/3660] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:20:13 2022] GET /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:13.139712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:13.140388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:13.146885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:13.147377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:13.148112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:13.148866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:13.149324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:13.149872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:13.268286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:13.288664 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d313e8e-c82e-4f1e-a759-0daab6d387f2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "DELETE /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44" status: 204 len: 0 microversion: 2.1 time: 0.701989 Oct 22 03:20:13.289313 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1816/3661] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:12 2022] DELETE /compute/v2.1/images/0b8ce974-9668-40f3-b22c-1a31dc9afc44 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:13.297977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:13.300737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:13.304446 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a567cde0-b8b8-49bc-bfe8-fb008f71efce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1294 microversion: 2.1 time: 0.169414 Oct 22 03:20:13.306112 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1846/3662] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:13 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:13.312283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b2c0fa1-8471-44f5-88d0-3cadbc34f4e2 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1958ddc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1438306986", "description": "tempest-description-1294638094"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:13.320983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:13.321545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:13.322627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:13.325012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:13.325608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:13.326390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:13.348988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:13.357613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:20:13.367896 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.compute.api [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Working on deleting snapshot 089db427-cd21-4c40-957b-0d5f18c80851 from shelved instance... Oct 22 03:20:13.911083 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b2c0fa1-8471-44f5-88d0-3cadbc34f4e2 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.603469 Oct 22 03:20:13.911702 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1847/3663] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:13.921162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a9dbfaa4-f862-4705-896f-1c7fd587880b tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Action: 'update', calling method: .version_select at 0x7f0d19547a60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:14.033886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9dbfaa4-f862-4705-896f-1c7fd587880b tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:14.034403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9dbfaa4-f862-4705-896f-1c7fd587880b tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:14.035209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9dbfaa4-f862-4705-896f-1c7fd587880b tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:14.036334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9dbfaa4-f862-4705-896f-1c7fd587880b tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:14.036801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9dbfaa4-f862-4705-896f-1c7fd587880b tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:14.037288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9dbfaa4-f862-4705-896f-1c7fd587880b tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:14.046902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Doing local delete in cell 8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) {{(pid=120582) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 22 03:20:14.047695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:14.048810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:14.049338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:14.049750 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.compute.api [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 22 03:20:14.061049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] deallocate_for_instance() {{(pid=120582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 22 03:20:14.108692 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a9dbfaa4-f862-4705-896f-1c7fd587880b tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 325 microversion: 2.1 time: 0.195845 Oct 22 03:20:14.109688 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1848/3664] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:20:13 2022] PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 325 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:14.114776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:14.115388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:14.127344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:14.128867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:14.129316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:14.131305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:14.131836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:14.132302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:14.397552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:14.408256 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20f2c90e-ed07-4e08-81e3-9cf9728c188a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1316 microversion: 2.1 time: 0.296671 Oct 22 03:20:14.409075 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1849/3665] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:14 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:14.429676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ffc1a4c-fc93-4b7f-9f67-09b62f6b1962 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d199f3550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:14.704187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Updating instance_info_cache with network_info: [] {{(pid=120582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:20:15.114630 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ffc1a4c-fc93-4b7f-9f67-09b62f6b1962 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "DELETE /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc" status: 204 len: 0 microversion: 2.1 time: 0.688750 Oct 22 03:20:15.115808 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1850/3666] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:14 2022] DELETE /compute/v2.1/images/c2df7dd4-677e-407d-a54c-df58e684b8fc => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:15.122788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b51bfd6-2f52-45e1-9c43-a9c7cf9190dd tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d19784a60>, body: {"security_group_rule": {"parent_group_id": "f942d5d4-0643-4048-a9a6-a4dd03aeaef3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:15.199444 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a2da5b18-1aeb-469b-8518-826ac6e5c6b0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 204 len: 0 microversion: 2.1 time: 1.907421 Oct 22 03:20:15.203094 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1817/3667] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:20:13 2022] DELETE /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 0 bytes in 1910 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:15.205807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:15.206424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:15.213964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:15.214468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:15.214904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:15.215619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:15.216072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:15.217048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:15.388445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:15.402974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:15.404905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:15.406264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fc13fe2d-db92-4120-9683-9bb3b3725905 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1752 microversion: 2.20 time: 0.204592 Oct 22 03:20:15.407026 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1818/3668] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:15 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1752 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:15.412331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1151825809", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:15.511975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:20:15.588775 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b51bfd6-2f52-45e1-9c43-a9c7cf9190dd tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.471575 Oct 22 03:20:15.595846 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1851/3669] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:20:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:15.600683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:15.601308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:15.611465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:15.611962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:15.612442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:15.615981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:15.620086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:15.621036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:15.782017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:15.791474 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd8a8f70-54b7-41f5-af34-54d797001159 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1362 microversion: 2.1 time: 0.200709 Oct 22 03:20:15.809089 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1852/3670] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:15 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:15.889553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c7e0e5b4-0692-4d3c-8a1e-d8de14c9b58d req-7c784bd8-ec8f-443a-a66f-eba1add8d932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667e973-b796-44b6-9ab4-9fde79a741ac", "name": "network-vif-deleted", "tag": "ad74246e-0c7b-4ede-9595-9b35122dc41a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:15.900122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c7e0e5b4-0692-4d3c-8a1e-d8de14c9b58d req-7c784bd8-ec8f-443a-a66f-eba1add8d932 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:15.901011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c7e0e5b4-0692-4d3c-8a1e-d8de14c9b58d req-7c784bd8-ec8f-443a-a66f-eba1add8d932 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:15.901688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c7e0e5b4-0692-4d3c-8a1e-d8de14c9b58d req-7c784bd8-ec8f-443a-a66f-eba1add8d932 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:15.915539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.compute.server_external_events [req-c7e0e5b4-0692-4d3c-8a1e-d8de14c9b58d req-7c784bd8-ec8f-443a-a66f-eba1add8d932 service nova] Unable to find a host for instance f667e973-b796-44b6-9ab4-9fde79a741ac. Dropping event network-vif-deleted {{(pid=120581) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 03:20:15.917041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c7e0e5b4-0692-4d3c-8a1e-d8de14c9b58d req-7c784bd8-ec8f-443a-a66f-eba1add8d932 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.106191 Oct 22 03:20:15.917890 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1853/3671] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 22 03:20:15.926309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ced7d5ad-e6e8-4331-bd4a-507211af2978 req-cf3c0c55-84e4-4e96-a35b-768d5a2bffb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:15.939506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ced7d5ad-e6e8-4331-bd4a-507211af2978 req-cf3c0c55-84e4-4e96-a35b-768d5a2bffb1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:15.940914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ced7d5ad-e6e8-4331-bd4a-507211af2978 req-cf3c0c55-84e4-4e96-a35b-768d5a2bffb1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:15.941596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ced7d5ad-e6e8-4331-bd4a-507211af2978 req-cf3c0c55-84e4-4e96-a35b-768d5a2bffb1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:15.949311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:15.949771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:15.950266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:15.950736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:15.951154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:15.959642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ced7d5ad-e6e8-4331-bd4a-507211af2978 req-cf3c0c55-84e4-4e96-a35b-768d5a2bffb1 service nova] Creating event network-changed:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:20:15.962604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:15.963157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:15.963600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:15.964555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:15.965544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:15.965986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:15.967263 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ced7d5ad-e6e8-4331-bd4a-507211af2978 req-cf3c0c55-84e4-4e96-a35b-768d5a2bffb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047694 Oct 22 03:20:15.968438 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1854/3672] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:15.975328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a392432-fdd3-43a3-afb5-e870f62cc4fc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d195478b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:15.992995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Getting quotas for project 1cfdce851f3b41618650813a2ab41462. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:15.998938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Getting quotas for user 42e82cd341d54571a72a96c80a3450f2 and project 1cfdce851f3b41618650813a2ab41462. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:16.021249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.utils [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] ram quota exceeded for 1cfdce851f3b41618650813a2ab41462, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120582) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 22 03:20:16.021803 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Request method failure captured: Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 145 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2FkGRhS2V8kr0inn0zjHeqTIOXUEiXIpdOpEamq7wFxxkRnxtVG7JSbUiAIzSb1XCzhfRewl7sE01EWVfNW85SJNgvnhCUrMQjSPlQOgKdKMT5l0VY31XNSdAATLAN_Spqd365Fi9nVGtG3RXoLhDFZQGgs4TgbFvMpwWjaAewyiAM Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 1cfdce851f3b41618650813a2ab41462 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cfdce851f3b41618650813a2ab41462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cfdce851f3b41618650813a2ab41462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cfdce851f3b41618650813a2ab41462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cfdce851f3b41618650813a2ab41462"}]}] Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 1cfdce851f3b41618650813a2ab41462 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-QuotasAdminNegativeTest-2107633456-project Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 42e82cd341d54571a72a96c80a3450f2 Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-QuotasAdminNegativeTest-2107633456-project Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1151825809", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1151825809', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452'}}} Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 22 03:20:16.024627 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5be94e3e-8a95-49c9-9219-7a30f70997a4 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.618106 Oct 22 03:20:16.029363 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1819/3673] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:20:15 2022] POST /compute/v2.1/servers => generated 110 bytes in 619 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:16.034599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:16.034599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:16.039294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.039807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.040795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.041503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.041954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.042380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.056054 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac HTTP/1.1 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f667e973-b796-44b6-9ab4-9fde79a741ac'} Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:16.057948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d75eeb0-bab3-49e3-bd27-a84863a339fb tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 404 len: 111 microversion: 2.1 time: 0.031497 Oct 22 03:20:16.062432 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1820/3674] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:16 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:16.074373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:16.074993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:16.083200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.083695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.084135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.084964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.085423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.085846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.251752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:16.260630 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4befe0ac-07b4-4082-838a-199a07ffd0ac tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1316 microversion: 2.1 time: 0.200036 Oct 22 03:20:16.272232 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1821/3675] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:16 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:16.272232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61aa2117-e1cd-4e87-9435-a49c9a18e2e1 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Action: 'create', calling method: .version_select at 0x7f0d1a473700>, body: {"security_group_rule": {"parent_group_id": "f942d5d4-0643-4048-a9a6-a4dd03aeaef3", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:16.487252 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61aa2117-e1cd-4e87-9435-a49c9a18e2e1 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.224109 Oct 22 03:20:16.488526 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1822/3676] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:20:16 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:16.497093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27ab621e-9f72-441a-a2c7-1471272ebed9 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Action: 'update', calling method: .version_select at 0x7f0d1e51ed30>, body: {"quota_set": {"ram": 51200}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:16.564585 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a392432-fdd3-43a3-afb5-e870f62cc4fc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "DELETE /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585" status: 204 len: 0 microversion: 2.1 time: 0.594433 Oct 22 03:20:16.565185 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1855/3677] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:15 2022] DELETE /compute/v2.1/images/0ea2852b-114c-4b25-9797-7dc2908a7585 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:16.569408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27ab621e-9f72-441a-a2c7-1471272ebed9 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.569911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27ab621e-9f72-441a-a2c7-1471272ebed9 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.570336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27ab621e-9f72-441a-a2c7-1471272ebed9 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.570581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2081882051", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "636a4e0f-2dc3-4c83-88d5-b5568cafac2d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:16.571064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27ab621e-9f72-441a-a2c7-1471272ebed9 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.572127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27ab621e-9f72-441a-a2c7-1471272ebed9 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.572757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27ab621e-9f72-441a-a2c7-1471272ebed9 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.628228 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27ab621e-9f72-441a-a2c7-1471272ebed9 tempest-QuotasAdminNegativeTest-1115311799 tempest-QuotasAdminNegativeTest-1115311799-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 200 len: 329 microversion: 2.1 time: 0.138394 Oct 22 03:20:16.628801 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1823/3678] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:20:16 2022] PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 329 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:16.629560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] validate_networks() for [('636a4e0f-2dc3-4c83-88d5-b5568cafac2d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:20:16.633240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:16.633914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:16.642595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.643140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.643588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.644352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.644812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.645245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.786767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:16.796083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:16.797552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:16.798706 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-31a81d69-c70f-4c4f-99c8-45fc13204d86 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.168991 Oct 22 03:20:16.799264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1824/3679] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:16 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:16.813603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6998c7db-84c1-4c62-8c23-77381d032722 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d1e535af0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:16.878298 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6998c7db-84c1-4c62-8c23-77381d032722 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/f942d5d4-0643-4048-a9a6-a4dd03aeaef3" status: 200 len: 665 microversion: 2.1 time: 0.068382 Oct 22 03:20:16.878896 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1825/3680] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:20:16 2022] GET /compute/v2.1/os-security-groups/f942d5d4-0643-4048-a9a6-a4dd03aeaef3 => generated 665 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:16.884091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:16.884634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:16.890977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.891463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.891905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.892640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:16.893280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:16.893904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:16.921643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:20:16.998845 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1af9ba2d-49da-43e6-94ba-d4ca176e14a8 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 204 len: 0 microversion: 2.1 time: 0.118475 Oct 22 03:20:17.002366 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1826/3681] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:20:16 2022] DELETE /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:17.004439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef8fa51f-1f45-433c-9879-e567a5da6e45 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Action: 'update', calling method: .version_select at 0x7f0d1a408310>, body: {"quota_set": {"ram": 0}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:17.009944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ef8fa51f-1f45-433c-9879-e567a5da6e45 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '42e82cd341d54571a72a96c80a3450f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfdce851f3b41618650813a2ab41462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef8fa51f-1f45-433c-9879-e567a5da6e45 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Request method failure captured: Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 HTTP/1.1 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 25 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2FkGRhS2V8kr0inn0zjHeqTIOXUEiXIpdOpEamq7wFxxkRnxtVG7JSbUiAIzSb1XCzhfRewl7sE01EWVfNW85SJNgvnhCUrMQjSPlQOgKdKMT5l0VY31XNSdAATLAN_Spqd365Fi9nVGtG3RXoLhDFZQGgs4TgbFvMpwWjaAewyiAM Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 1cfdce851f3b41618650813a2ab41462 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cfdce851f3b41618650813a2ab41462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cfdce851f3b41618650813a2ab41462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cfdce851f3b41618650813a2ab41462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cfdce851f3b41618650813a2ab41462"}]}] Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 1cfdce851f3b41618650813a2ab41462 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2107633456 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-QuotasAdminNegativeTest-2107633456-project Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 42e82cd341d54571a72a96c80a3450f2 Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-QuotasAdminNegativeTest-2107633456-project Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: {"quota_set": {"ram": 0}} Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1cfdce851f3b41618650813a2ab41462', 'body': {'quota_set': {'ram': 0}}} Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:20:17.015271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef8fa51f-1f45-433c-9879-e567a5da6e45 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef8fa51f-1f45-433c-9879-e567a5da6e45 tempest-QuotasAdminNegativeTest-2107633456 tempest-QuotasAdminNegativeTest-2107633456-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462" status: 403 len: 116 microversion: 2.1 time: 0.016261 Oct 22 03:20:17.020140 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1827/3682] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:20:16 2022] PUT /compute/v2.1/os-quota-sets/1cfdce851f3b41618650813a2ab41462 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:17.026133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:17.026860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:17.035035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.035551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.035997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.037246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.037713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.038154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.157272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:17.157705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:17.158439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:17.158867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:17.167371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:17.185813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.188964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.190110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.191800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.192648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.193365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.219049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:17.225806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for user 7bd4c44f32a04da48b34c9c888f36fa6 and project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:17.250493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:20:17.252969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:20:17.287958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:17.296853 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e6cb006-b080-4c84-877a-038f84b5a339 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1362 microversion: 2.1 time: 0.278112 Oct 22 03:20:17.297416 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1828/3683] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:17 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:17.316515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-33f4daa2-15c7-41b0-8115-3071eb47b64a tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d1a0e08b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:17.317873 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3cc1425a-b991-4737-bb83-8f1905789bd1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750965 Oct 22 03:20:17.319473 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1856/3684] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:20:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:20:17.329435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:17.331266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:17.339510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.340001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.340502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.341383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.342082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.342545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.530343 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-33f4daa2-15c7-41b0-8115-3071eb47b64a tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/636993c3-aa21-4151-a419-722b5fd29a4a" status: 202 len: 0 microversion: 2.1 time: 0.231313 Oct 22 03:20:17.532435 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1829/3685] 10.222.0.25 () {58 vars in 1287 bytes} [Sat Oct 22 03:20:17 2022] DELETE /compute/v2.1/os-security-group-rules/636993c3-aa21-4151-a419-722b5fd29a4a => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:17.543906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:17.547951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:17.559600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.560357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.560970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.562040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.562445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.562874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.577566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:17.589387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6eac1535-2975-4039-936f-3c30073c57f9 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1473 microversion: 2.1 time: 0.268405 Oct 22 03:20:17.600241 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1857/3686] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:17 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1473 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:17.601312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c67a4b43-2a02-47cf-8bb1-05777459f060 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:17.608515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c67a4b43-2a02-47cf-8bb1-05777459f060 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:17.705304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c67a4b43-2a02-47cf-8bb1-05777459f060 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:17.729114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:17.732512 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c67a4b43-2a02-47cf-8bb1-05777459f060 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1215 microversion: 2.1 time: 0.137843 Oct 22 03:20:17.734638 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1858/3687] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:17 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:17.740617 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37a5320c-f564-4108-a6a5-e5566832c20c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1316 microversion: 2.1 time: 0.204456 Oct 22 03:20:17.741205 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1830/3688] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:17 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:17.771676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72c76748-0ce7-49dc-82c6-1deef94ebcea tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d19569820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:17.826366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:17.827954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:17.836624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.838074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.838988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:17.840034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:17.840794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:17.841290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:18.042097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:18.054688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:18.058785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:18.060310 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39a72043-4e6e-4428-aeb1-7acf3c669480 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.239426 Oct 22 03:20:18.061348 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1831/3689] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:17 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:20:18.201671 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72c76748-0ce7-49dc-82c6-1deef94ebcea tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f942d5d4-0643-4048-a9a6-a4dd03aeaef3" status: 202 len: 0 microversion: 2.1 time: 0.465409 Oct 22 03:20:18.202277 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1859/3690] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:17 2022] DELETE /compute/v2.1/os-security-groups/f942d5d4-0643-4048-a9a6-a4dd03aeaef3 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:18.214558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f88867bb-ce10-4d12-b9ec-a6152e6acad5 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d1e4ea790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:18.257681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-f88867bb-ce10-4d12-b9ec-a6152e6acad5 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54de9a4f-ea47-454a-979f-39b26e9485e6 does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:20:18.263047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-f88867bb-ce10-4d12-b9ec-a6152e6acad5 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Neutron security group 54de9a4f-ea47-454a-979f-39b26e9485e6 not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:20:18.263582 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-f88867bb-ce10-4d12-b9ec-a6152e6acad5 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] HTTP exception thrown: Security group 54de9a4f-ea47-454a-979f-39b26e9485e6 does not exist Oct 22 03:20:18.263582 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-294dbd2f-f874-4ec4-9515-92b611f732bd'] Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f88867bb-ce10-4d12-b9ec-a6152e6acad5 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Request method failure captured: Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-security-groups/54de9a4f-ea47-454a-979f-39b26e9485e6 HTTP/1.1 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2FbRRbv_ygCgDfy1LiaPyvsxIGlzoqvVdYVpDavVcu08S-ckzMbgwqCEZ3ipV8we08vxqTDhO3mixCqsZaUkVS7pJRWavvxYWgfsscCzi27a7LZogQAZ9ZaNJW-cU8_l3WdmkTaS_oHcW25NWEmAWwyvb6ZsZt1YtCZqVT-1TFZ3Tk Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a58357cdc814440d9cbffc93e578a89b Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-242611631 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a58357cdc814440d9cbffc93e578a89b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a58357cdc814440d9cbffc93e578a89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a58357cdc814440d9cbffc93e578a89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a58357cdc814440d9cbffc93e578a89b"}]}] Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupRulesTestJSON-242611631 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a58357cdc814440d9cbffc93e578a89b Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-242611631 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupRulesTestJSON-242611631-project Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: cd1ce453e9c241a9b2ac227d19b6e236 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupRulesTestJSON-242611631-project Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group 54de9a4f-ea47-454a-979f-39b26e9485e6 does not exist Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-294dbd2f-f874-4ec4-9515-92b611f732bd'] Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '54de9a4f-ea47-454a-979f-39b26e9485e6'} Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:20:18.265530 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54de9a4f-ea47-454a-979f-39b26e9485e6 does not exist Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-294dbd2f-f874-4ec4-9515-92b611f732bd'] Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54de9a4f-ea47-454a-979f-39b26e9485e6 does not exist Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-294dbd2f-f874-4ec4-9515-92b611f732bd'] Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54de9a4f-ea47-454a-979f-39b26e9485e6 does not exist Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-294dbd2f-f874-4ec4-9515-92b611f732bd'] Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54de9a4f-ea47-454a-979f-39b26e9485e6 does not exist Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-294dbd2f-f874-4ec4-9515-92b611f732bd'] Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f88867bb-ce10-4d12-b9ec-a6152e6acad5 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Returning 404 to user: Security group 54de9a4f-ea47-454a-979f-39b26e9485e6 does not exist Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-294dbd2f-f874-4ec4-9515-92b611f732bd'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f88867bb-ce10-4d12-b9ec-a6152e6acad5 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/54de9a4f-ea47-454a-979f-39b26e9485e6" status: 404 len: 194 microversion: 2.1 time: 0.059806 Oct 22 03:20:18.269765 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1832/3691] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:18 2022] DELETE /compute/v2.1/os-security-groups/54de9a4f-ea47-454a-979f-39b26e9485e6 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:18.278572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fab55b6b-71c4-4c27-b464-bcc62c86898c tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d19675ee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:18.507001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-afbef3cf-9e08-4b5b-b3d2-bb99855fa438 req-0abe3744-5e78-42db-add9-f5903370af4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ea0c89-d7c8-414d-b796-4c45aca5729f", "name": "network-vif-plugged", "status": "completed", "tag": "9442663e-1ac1-492c-9f56-4eb699b73b0c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:18.520282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afbef3cf-9e08-4b5b-b3d2-bb99855fa438 req-0abe3744-5e78-42db-add9-f5903370af4b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:18.522155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afbef3cf-9e08-4b5b-b3d2-bb99855fa438 req-0abe3744-5e78-42db-add9-f5903370af4b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:18.522802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afbef3cf-9e08-4b5b-b3d2-bb99855fa438 req-0abe3744-5e78-42db-add9-f5903370af4b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:18.529941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:18.538458 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-afbef3cf-9e08-4b5b-b3d2-bb99855fa438 req-0abe3744-5e78-42db-add9-f5903370af4b service nova] Creating event network-vif-plugged:9442663e-1ac1-492c-9f56-4eb699b73b0c for instance 76ea0c89-d7c8-414d-b796-4c45aca5729f on n-h2-862416-2 Oct 22 03:20:18.544595 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-afbef3cf-9e08-4b5b-b3d2-bb99855fa438 req-0abe3744-5e78-42db-add9-f5903370af4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271114 Oct 22 03:20:18.545199 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1833/3692] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:18.552324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:18.553170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:18.561803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:18.562291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:18.562755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:18.563445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:18.563893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:18.564519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:18.610373 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fab55b6b-71c4-4c27-b464-bcc62c86898c tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f147f9f3-7c9e-4163-b9fa-995142b482d4" status: 202 len: 0 microversion: 2.1 time: 0.338021 Oct 22 03:20:18.618720 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1860/3693] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:18 2022] DELETE /compute/v2.1/os-security-groups/f147f9f3-7c9e-4163-b9fa-995142b482d4 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:18.624766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:18.625424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:18.637393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:18.637911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:18.638331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:18.639043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:18.639662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:18.640216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:18.956751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:18.989884 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be19f9df-2307-42d7-8d70-c8405b3888c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1362 microversion: 2.1 time: 0.443254 Oct 22 03:20:18.991774 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1834/3694] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:18 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:18.999195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92247ace-aa52-4ddc-adb5-aff2a31b5233 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d1e4eadc0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:19.086497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:19.100901 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a5177bf2-0aeb-4b27-b301-f30d2b52a0dc tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1473 microversion: 2.1 time: 0.480127 Oct 22 03:20:19.101840 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1861/3695] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:18 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1473 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:19.111563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:19.112578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:19.121527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:19.122962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:19.123559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:19.124435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:19.125005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:19.125566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:19.262710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:19.271266 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0cbb07f-8c9f-4f8d-9ba5-4935dea50b9e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1273 microversion: 2.1 time: 0.167153 Oct 22 03:20:19.272067 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1862/3696] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:19 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:19.280754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:19.281772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:19.291094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:19.291747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:19.292409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:19.293239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:19.293799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:19.294351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:19.724712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:19.736555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-02bf85e7-cb0f-4cff-ba09-7ac73ad3100f tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1316 microversion: 2.1 time: 0.461885 Oct 22 03:20:19.749155 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1863/3697] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:19 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:19.761420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:19.761991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:19.770480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:19.771125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:19.771656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:19.773209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:19.773818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:19.775373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:19.921830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:19.932429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:19.933864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:19.935200 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98d3acb9-a694-4eb8-8bcb-a90dce392346 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.184519 Oct 22 03:20:19.936145 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1864/3698] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:19 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:20.021446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:20.023095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:20.036907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.037636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.038322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.039247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.039940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.040714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.217510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:20.228177 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3e2eeac-7794-4e61-894e-f07188098b4c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1362 microversion: 2.1 time: 0.210558 Oct 22 03:20:20.239690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1865/3699] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:20 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:20.250415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:20.256415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:20.262627 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92247ace-aa52-4ddc-adb5-aff2a31b5233 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/116868e3-9651-4580-ac2e-ab1d61a00d07" status: 202 len: 0 microversion: 2.1 time: 1.269546 Oct 22 03:20:20.263218 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1835/3700] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:18 2022] DELETE /compute/v2.1/os-security-groups/116868e3-9651-4580-ac2e-ab1d61a00d07 => generated 0 bytes in 1271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:20.271547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f47c9c0-4693-4d58-b62c-a91ef512509d tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d1a0e08b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:20.274177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.275819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.276585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.277931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.278547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.279294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.476307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:20.494077 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-43f44226-5c69-45e6-869c-d927052ee029 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1473 microversion: 2.1 time: 0.250443 Oct 22 03:20:20.495168 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1866/3701] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:20 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1473 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:20.502448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:20.503239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:20.511943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.512712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.513310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.514192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.514644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.515071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.591267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:20.600339 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5882072-57be-479c-ab6e-5598e2fae541 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1273 microversion: 2.1 time: 0.103221 Oct 22 03:20:20.600937 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1867/3702] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:20 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:20.610061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-575eb15b-ecbf-4826-b130-218331857338 req-9cb78016-1a74-4729-8cfd-5bcee9416216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "name": "network-vif-plugged", "status": "completed", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:20.627568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-575eb15b-ecbf-4826-b130-218331857338 req-9cb78016-1a74-4729-8cfd-5bcee9416216 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.628094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-575eb15b-ecbf-4826-b130-218331857338 req-9cb78016-1a74-4729-8cfd-5bcee9416216 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.628553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-575eb15b-ecbf-4826-b130-218331857338 req-9cb78016-1a74-4729-8cfd-5bcee9416216 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.650037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-575eb15b-ecbf-4826-b130-218331857338 req-9cb78016-1a74-4729-8cfd-5bcee9416216 service nova] Creating event network-vif-plugged:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:20:20.652581 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-575eb15b-ecbf-4826-b130-218331857338 req-9cb78016-1a74-4729-8cfd-5bcee9416216 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050163 Oct 22 03:20:20.654676 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1868/3703] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:20.765363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:20.766750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:20.775797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.776005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.776841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.777726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.786540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.787313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.951694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:20.963627 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6396b114-0e7c-44a3-afbf-347c3094f17a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1507 microversion: 2.1 time: 0.204702 Oct 22 03:20:20.964420 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1869/3704] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:20 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:20:20.969200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:20.969805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:20.975747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.976662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.977272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:20.978267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:20.978926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:20.979538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.157083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:21.172712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:21.174829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:21.188426 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c957eebf-1be9-489c-9f00-4ce11eef4877 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.210804 Oct 22 03:20:21.192903 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1870/3705] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:20 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:21.205511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3fd756e9-bbbb-4288-b387-4db4ebf28eae req-6483f256-88b8-4a69-966a-9d73e0171caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74de4a13-4c74-449e-97da-d93bc3215451", "name": "network-vif-deleted", "tag": "12c5b67b-a6f5-4bf2-a486-6a04eed55ee9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:21.232274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3fd756e9-bbbb-4288-b387-4db4ebf28eae req-6483f256-88b8-4a69-966a-9d73e0171caa service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.232879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3fd756e9-bbbb-4288-b387-4db4ebf28eae req-6483f256-88b8-4a69-966a-9d73e0171caa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.233589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3fd756e9-bbbb-4288-b387-4db4ebf28eae req-6483f256-88b8-4a69-966a-9d73e0171caa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.253261 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f47c9c0-4693-4d58-b62c-a91ef512509d tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/da3975f4-5e20-444b-854f-a72f23d317fd" status: 202 len: 0 microversion: 2.1 time: 0.985377 Oct 22 03:20:21.254242 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1836/3706] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:20 2022] DELETE /compute/v2.1/os-security-groups/da3975f4-5e20-444b-854f-a72f23d317fd => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:20:21.259393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:21.260514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:21.266619 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3fd756e9-bbbb-4288-b387-4db4ebf28eae req-6483f256-88b8-4a69-966a-9d73e0171caa service nova] Creating event network-vif-deleted:12c5b67b-a6f5-4bf2-a486-6a04eed55ee9 for instance 74de4a13-4c74-449e-97da-d93bc3215451 on n-h1-862416-2 Oct 22 03:20:21.273212 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3fd756e9-bbbb-4288-b387-4db4ebf28eae req-6483f256-88b8-4a69-966a-9d73e0171caa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078196 Oct 22 03:20:21.274523 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1871/3707] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:21.282176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:21.282942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.283402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:21.283517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.283862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.284611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.285065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.285496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.292704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.293641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.294182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.295730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.296463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.296996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.475711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:21.486329 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92a2d252-e036-44ff-947c-a1b4dfbc3d8a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1362 microversion: 2.1 time: 0.209424 Oct 22 03:20:21.487559 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1872/3708] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:21 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:21.492710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fc0cdb3-d34c-4206-8698-81d671fdca25 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d195901f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:21.690164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:21.710088 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9189a8fd-967d-4ecf-a0ba-21c93fcabba4 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1507 microversion: 2.1 time: 0.447574 Oct 22 03:20:21.711642 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1837/3709] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:21 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:21.726054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:21.727059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:21.746789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.747709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.748766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.749321 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2fc0cdb3-d34c-4206-8698-81d671fdca25 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d994a085-294f-4b25-a5fc-ce04248b6add" status: 202 len: 0 microversion: 2.1 time: 0.260528 Oct 22 03:20:21.749990 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1873/3710] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:21 2022] DELETE /compute/v2.1/os-security-groups/d994a085-294f-4b25-a5fc-ce04248b6add => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:21.753048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.753048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.753048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.859315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.860177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.861097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.862103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lazy-loading 'fault' on Instance uuid 74de4a13-4c74-449e-97da-d93bc3215451 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:20:21.933539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:21.944062 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3f72bb4f-591a-4d1c-9796-9623b2586bd4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 200 len: 1308 microversion: 2.1 time: 0.225979 Oct 22 03:20:21.945462 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1838/3711] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:21 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:21.951367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:21.952190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:21.967553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.968322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.969343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:21.970230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:21.970846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:21.971547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:22.012653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-02f0af5f-56b2-4681-8285-86f98a04da68 tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] Action: 'create', calling method: .version_select at 0x7f0d1956f280>, body: {"security_group": {"name": "tempest-securitygroup-1321067306", "description": "tempest-description-1931986170"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:22.242841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:22.253159 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-578a730b-cbf1-4109-a90f-448c069574c6 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1315 microversion: 2.1 time: 0.305668 Oct 22 03:20:22.253984 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1839/3712] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:21 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:22.272695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:22.284636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:22.300286 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-02f0af5f-56b2-4681-8285-86f98a04da68 tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.544993 Oct 22 03:20:22.300829 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1874/3713] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:21 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:22.305961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9ff6fb3f-e86e-4177-b41b-0096a8094114 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] Calling method '.version_select at 0x7f0d194b3c10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:22.310245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:22.311049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:22.315474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:22.316787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:22.317468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:22.318135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:22.410460 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-214be1fe-b54f-4251-ace3-5ba30d397f0e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "PUT /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1079 microversion: 2.1 time: 0.155080 Oct 22 03:20:22.411802 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1840/3714] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:20:22 2022] PUT /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1079 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:22.418815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:22.420008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:22.428084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:22.429133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:22.429842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:22.431416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:22.432148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:22.432955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:22.556858 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9ff6fb3f-e86e-4177-b41b-0096a8094114 tempest-SecurityGroupRulesTestJSON-242611631 tempest-SecurityGroupRulesTestJSON-242611631-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f5662bc8-5614-461d-98dc-dde5ae36aee4" status: 202 len: 0 microversion: 2.1 time: 0.254851 Oct 22 03:20:22.557799 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1875/3715] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:22 2022] DELETE /compute/v2.1/os-security-groups/f5662bc8-5614-461d-98dc-dde5ae36aee4 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:22.566417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-947785bd-29f3-476d-8bb2-3be6d701ecd6 tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] Action: 'create', calling method: .version_select at 0x7f0d194b3d30>, body: {"security_group": {"name": "tempest-securitygroup-2002861651", "description": "tempest-description-1095116587"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:22.933629 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-947785bd-29f3-476d-8bb2-3be6d701ecd6 tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.374539 Oct 22 03:20:22.944322 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1876/3716] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:22.950231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:22.950984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:22.957769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:22.958381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:22.959067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:22.959892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:22.960472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:22.961103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:22.984922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:22.999727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:23.011139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:23.012629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:23.013812 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-965d2edc-5686-46c8-848d-f9fb20cc065a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.600410 Oct 22 03:20:23.028900 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1841/3717] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:22 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:23.039730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:23.040521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:23.046673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.047382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.047856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.048587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.049377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.049810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.205956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:23.214896 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d059863f-1599-4c0d-97d6-8fdf871cc1be tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1505 microversion: 2.1 time: 0.269166 Oct 22 03:20:23.225845 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1877/3718] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:22 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:23.304873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-641945df-e5b4-494d-98e6-a90ba25c4d7a tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] Action: 'create', calling method: .version_select at 0x7f0d19675b80>, body: {"security_group": {"name": "tempest-securitygroup-1260007723", "description": "tempest-description-226264150"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:23.385935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:23.395243 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fa290a18-d088-4957-b076-906a9b572479 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1549 microversion: 2.1 time: 0.364824 Oct 22 03:20:23.408232 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1842/3719] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:23 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1549 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:23.408232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:23.408232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 74de4a13-4c74-449e-97da-d93bc3215451] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:23.412231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.412975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.413788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.415612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.416604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.417283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.434523 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] HTTP exception thrown: Instance 74de4a13-4c74-449e-97da-d93bc3215451 could not be found. Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Request method failure captured: Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 HTTP/1.1 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2DIZQSVYTmXfv3P1HHyCybyqHqtdKD9JV_mfMHf3vTwv7xJzN4_3Tb36V0CN5v3ymYu-0IyDsVtsitbUDzpdQWnL8h-ShXqvQPAy1qou-5arDzrQ8dmXUO4ncToplHg6oR4yzsrw1yyegYTHA6F6la5zO8jahtkOdiAvcNmkOlK0wE Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: cdacaef127174c85b0bd5f08efe26952 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ListImageFiltersTestJSON-306161919 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cdacaef127174c85b0bd5f08efe26952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdacaef127174c85b0bd5f08efe26952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cdacaef127174c85b0bd5f08efe26952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdacaef127174c85b0bd5f08efe26952"}]}] Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ListImageFiltersTestJSON-306161919 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: cdacaef127174c85b0bd5f08efe26952 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-306161919 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ListImageFiltersTestJSON-306161919-project Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ae5ded1762834d11ab671efdb1d373b7 Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ListImageFiltersTestJSON-306161919-project Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 74de4a13-4c74-449e-97da-d93bc3215451 could not be found. Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '74de4a13-4c74-449e-97da-d93bc3215451'} Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74de4a13-4c74-449e-97da-d93bc3215451 could not be found. Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74de4a13-4c74-449e-97da-d93bc3215451 could not be found. Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:23.437506 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:23.443316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:23.443316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:23.443316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:23.443316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:23.443316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:23.443316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74de4a13-4c74-449e-97da-d93bc3215451 could not be found. Oct 22 03:20:23.443316 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:23.443316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Returning 404 to user: Instance 74de4a13-4c74-449e-97da-d93bc3215451 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:23.454782 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3696f3c0-a695-4772-9f72-0d08ff5f8d6b tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451" status: 404 len: 111 microversion: 2.1 time: 0.046522 Oct 22 03:20:23.454782 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1843/3720] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:23 2022] GET /compute/v2.1/servers/74de4a13-4c74-449e-97da-d93bc3215451 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:23.454782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:23.454782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:23.460770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.461373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.461913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.462998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.463574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.464098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.734109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:23.754547 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-173d6e48-bf75-48fa-a775-6982b7479ef5 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1505 microversion: 2.1 time: 0.307553 Oct 22 03:20:23.756770 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1844/3721] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:23 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:23.776785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:23.777559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:23.784340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.785011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.785628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.786508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.787035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.787642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.861496 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-641945df-e5b4-494d-98e6-a90ba25c4d7a tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.634213 Oct 22 03:20:23.862342 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1878/3722] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:23 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:23.880284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cf247be5-7de8-4d58-92d5-4fb9996610a3 req-194ae3b5-c3ab-4d2e-9010-f4d0a1214ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb680fc8-0d54-4742-b649-b82abbf4884e", "tag": "d85d1270-815c-43e2-aa88-748b7e3a2c72"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:23.904504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cf247be5-7de8-4d58-92d5-4fb9996610a3 req-194ae3b5-c3ab-4d2e-9010-f4d0a1214ac3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.905026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cf247be5-7de8-4d58-92d5-4fb9996610a3 req-194ae3b5-c3ab-4d2e-9010-f4d0a1214ac3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.905479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cf247be5-7de8-4d58-92d5-4fb9996610a3 req-194ae3b5-c3ab-4d2e-9010-f4d0a1214ac3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.919719 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cf247be5-7de8-4d58-92d5-4fb9996610a3 req-194ae3b5-c3ab-4d2e-9010-f4d0a1214ac3 service nova] Creating event network-changed:d85d1270-815c-43e2-aa88-748b7e3a2c72 for instance eb680fc8-0d54-4742-b649-b82abbf4884e on n-h1-862416-2 Oct 22 03:20:23.925231 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cf247be5-7de8-4d58-92d5-4fb9996610a3 req-194ae3b5-c3ab-4d2e-9010-f4d0a1214ac3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050719 Oct 22 03:20:23.925847 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1879/3723] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:23.932625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:23.933533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:23.940111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.940973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.941639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:23.942918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:23.944051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:23.944674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.090615 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e692d1ce-e186-47a8-9599-43bf408bc4f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163357 Oct 22 03:20:24.092123 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1880/3724] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:20:23 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:24.105298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:24.105826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:24.112410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:24.112911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:24.113352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.115370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:24.115853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:24.117735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.155341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:24.162307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:20:24.168401 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-88a0d258-9fdf-4e81-a059-1a64ae95c2a0 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1315 microversion: 2.1 time: 0.410391 Oct 22 03:20:24.171413 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1845/3725] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:23 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:24.185867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:24.198704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:24.219266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:24.219763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:24.220265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.220954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:24.221416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:24.226810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.391972 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f7937a62-ae15-42bf-a798-4e203bc94333 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "PUT /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1081 microversion: 2.1 time: 0.217212 Oct 22 03:20:24.395826 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1846/3726] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:20:24 2022] PUT /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1081 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:24.397934 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce16c79c-76c0-4567-86d8-762db46747ae tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 204 len: 0 microversion: 2.1 time: 0.303899 Oct 22 03:20:24.402564 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1881/3727] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:20:24 2022] DELETE /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:24.404529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ce936c6-63c2-4a66-a45b-5fa7feea778a tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] Action: 'create', calling method: .version_select at 0x7f0d1a408310>, body: {"security_group": {"name": "tempest-securitygroup-1742067999", "description": "tempest-description-860860078"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:24.414302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:24.416406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:24.422956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:24.423721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:24.424367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.425280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:24.425922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:24.426355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.786638 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ce936c6-63c2-4a66-a45b-5fa7feea778a tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.387804 Oct 22 03:20:24.787360 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1847/3728] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:20:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:24.797702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:24.799233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:24.827091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:24.827639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:24.828190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.831576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:24.832113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:24.835233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:24.994161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:25.011463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:25.013014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:25.014301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ffd27726-ce80-4d1b-b419-ff90f0ca68e1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.610409 Oct 22 03:20:25.022833 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1882/3729] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:24 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:25.028577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:25.029438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:25.055124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:25.057509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:25.058374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:25.059227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:25.060725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:25.061612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:25.289138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:25.309736 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6187e5ce-5b8d-4c58-b1f7-1659ce4f3bb4 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 200 len: 1473 microversion: 2.1 time: 0.521203 Oct 22 03:20:25.313343 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1848/3730] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:24 2022] GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 1473 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:25.323441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-44fbfd31-de12-4e92-830a-6489020aa687 tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] Calling method '.version_select at 0x7f0d1a129670>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:26.166843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:26.183587 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ce84d19-6f13-41f1-a00f-acbb2fae3b57 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1507 microversion: 2.1 time: 1.159219 Oct 22 03:20:26.192786 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1883/3731] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:25 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1507 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:26.206649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:26.207802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:26.234815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:26.235611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:26.236339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:26.237310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:26.237987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:26.238637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:26.580305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=14 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:26.621962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=54 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:27.180017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:27.206273 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08ba5599-f2f8-40ba-b9f6-5484f0569674 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1315 microversion: 2.1 time: 1.011326 Oct 22 03:20:27.209790 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1884/3732] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:26 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1315 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:27.227159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ffaa6fd8-7600-41a1-9ac9-74aeec98767c req-b593ebf2-bb7e-4dc8-9a67-09623238480f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4dc0ad-7879-4fd2-8464-46da72e85755", "tag": "a55eee90-06c2-45fc-98cd-3cc3996f91b1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:27.267518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:27.270339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ffaa6fd8-7600-41a1-9ac9-74aeec98767c req-b593ebf2-bb7e-4dc8-9a67-09623238480f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:27.271092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ffaa6fd8-7600-41a1-9ac9-74aeec98767c req-b593ebf2-bb7e-4dc8-9a67-09623238480f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:27.271784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ffaa6fd8-7600-41a1-9ac9-74aeec98767c req-b593ebf2-bb7e-4dc8-9a67-09623238480f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:27.319240 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ffaa6fd8-7600-41a1-9ac9-74aeec98767c req-b593ebf2-bb7e-4dc8-9a67-09623238480f service nova] Creating event network-changed:a55eee90-06c2-45fc-98cd-3cc3996f91b1 for instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 on n-h2-862416-2 Oct 22 03:20:27.331852 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ffaa6fd8-7600-41a1-9ac9-74aeec98767c req-b593ebf2-bb7e-4dc8-9a67-09623238480f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116198 Oct 22 03:20:27.336541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1885/3733] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:27.359747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:27.361441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:27.380740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:27.381840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:27.382622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:27.383598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:27.384326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:27.384979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:27.664842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:27.676466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:27.678270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:27.679650 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c15f9ae-b713-4ade-847a-72dd806a9895 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.341389 Oct 22 03:20:27.681399 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1886/3734] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:27 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:27.686130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:27.686911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:27.693614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:27.694306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:27.694931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:27.695826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:27.697036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:27.697628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:27.730494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=46 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:27.967727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:27.981477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dfceeabc-8f6f-4ca1-b2fb-2824ceab43d8 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1507 microversion: 2.1 time: 0.298790 Oct 22 03:20:27.989050 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1887/3735] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:27 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:28.010013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:28.011108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:28.026732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:28.030298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:28.033034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:28.033822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:28.042355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:28.048680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:28.049572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:28.331336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:28.343223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-438df7ca-bff7-448c-be9b-98b72ddd9790 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 200 len: 1473 microversion: 2.1 time: 0.349384 Oct 22 03:20:28.366689 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1888/3736] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:27 2022] GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 1473 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:28.372601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d4336209-e514-4f55-bcb7-aae653091cbd req-eb11a571-9f62-4f51-9d2e-c5584076d8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:28.387962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d4336209-e514-4f55-bcb7-aae653091cbd req-eb11a571-9f62-4f51-9d2e-c5584076d8f7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:28.388896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d4336209-e514-4f55-bcb7-aae653091cbd req-eb11a571-9f62-4f51-9d2e-c5584076d8f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:28.389576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d4336209-e514-4f55-bcb7-aae653091cbd req-eb11a571-9f62-4f51-9d2e-c5584076d8f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:28.421544 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d4336209-e514-4f55-bcb7-aae653091cbd req-eb11a571-9f62-4f51-9d2e-c5584076d8f7 service nova] Creating event network-changed:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:20:28.436594 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d4336209-e514-4f55-bcb7-aae653091cbd req-eb11a571-9f62-4f51-9d2e-c5584076d8f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068090 Oct 22 03:20:28.437551 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1889/3737] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:28.450938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:28.451562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:28.465588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:28.466087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:28.466536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:28.467263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:28.467726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:28.468168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:28.551797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:20:28.731117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9daefb07-55ea-4772-984a-c2d01a1f823d tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 204 len: 0 microversion: 2.1 time: 0.291997 Oct 22 03:20:28.739980 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1890/3738] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:20:28 2022] DELETE /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:28.754883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:28.755788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:28.771048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:28.772091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:28.772815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:28.773740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:28.775207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:28.775788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:29.043377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:29.067346 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f061d75-21ce-4b63-af1a-a1d4a3930198 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1315 microversion: 2.1 time: 0.324298 Oct 22 03:20:29.073159 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1891/3739] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:28 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:29.078748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:29.079333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:29.097628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:29.098926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:29.100711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:29.101455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:29.103868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:29.104531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:29.428746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:29.449388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:29.471666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:29.471666 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23fa37a6-74d9-4d0d-a4c3-2c493b472457 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.395972 Oct 22 03:20:29.471666 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1892/3740] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:29 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:29.475528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:29.476021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:29.498399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:29.498795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:29.499247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:29.499990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:29.500552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:29.500989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:29.558207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:20:29.607304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:29.710298 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.compute.api [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Instance is already in deleting state, ignoring this request Oct 22 03:20:29.711234 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65fe8718-a16c-46d7-b7a1-65af0098426a tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 204 len: 0 microversion: 2.1 time: 0.239322 Oct 22 03:20:29.719134 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1893/3741] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:20:29 2022] DELETE /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:29.737361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:29.737994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:29.757907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:29.758415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:29.758931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:29.762735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:29.763252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:29.763704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:30.919504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae5ded1762834d11ab671efdb1d373b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdacaef127174c85b0bd5f08efe26952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:30.934800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-422b8416-f8b5-4125-9c26-fac56be1f6f3 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 200 len: 1473 microversion: 2.1 time: 1.214491 Oct 22 03:20:30.954528 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1894/3742] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:29 2022] GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 1473 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:30.965946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:30.967400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:30.978135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:30.979008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:30.979631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:30.980555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:30.981164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:30.982003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:31.714645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:31.723070 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db387996-5a5f-4903-a91d-29c9a1ac2a00 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1513 microversion: 2.1 time: 0.766618 Oct 22 03:20:31.744613 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1895/3743] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:30 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1513 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:31.757927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:31.759503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:31.771543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:31.772299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:31.774086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:31.775760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:31.789024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:31.789942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:32.052821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:32.063876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3df313e3-f228-42f2-8a3e-c300072d4f82 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1315 microversion: 2.1 time: 0.318006 Oct 22 03:20:32.068189 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1896/3744] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:31 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:32.080283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:32.085328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:32.097133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:32.097628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:32.100107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:32.101386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:32.103365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:32.104217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:32.118357 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-44fbfd31-de12-4e92-830a-6489020aa687 tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11614 microversion: 2.1 time: 6.803740 Oct 22 03:20:32.119006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1849/3745] 10.222.0.25 () {58 vars in 1191 bytes} [Sat Oct 22 03:20:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11614 bytes in 6805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:20:32.134900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-111bf915-27b4-4889-a462-b7d9019c16c2 req-9d9f69e9-d636-4311-ad17-c9374eeea632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413d7cde-ec29-4239-968e-6524df522977", "name": "network-vif-deleted", "tag": "790776fd-bbd7-4ed1-b035-1ab433bbea5c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:32.170314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:32.176950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-111bf915-27b4-4889-a462-b7d9019c16c2 req-9d9f69e9-d636-4311-ad17-c9374eeea632 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:32.177591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-111bf915-27b4-4889-a462-b7d9019c16c2 req-9d9f69e9-d636-4311-ad17-c9374eeea632 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:32.178050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-111bf915-27b4-4889-a462-b7d9019c16c2 req-9d9f69e9-d636-4311-ad17-c9374eeea632 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:32.229621 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-111bf915-27b4-4889-a462-b7d9019c16c2 req-9d9f69e9-d636-4311-ad17-c9374eeea632 service nova] Creating event network-vif-deleted:790776fd-bbd7-4ed1-b035-1ab433bbea5c for instance 413d7cde-ec29-4239-968e-6524df522977 on n-h2-862416-2 Oct 22 03:20:32.243503 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-111bf915-27b4-4889-a462-b7d9019c16c2 req-9d9f69e9-d636-4311-ad17-c9374eeea632 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121286 Oct 22 03:20:32.245797 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1850/3746] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:32.253146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:32.254072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] [instance: 413d7cde-ec29-4239-968e-6524df522977] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:32.261021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:32.261784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:32.262419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:32.263315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:32.263947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:32.264592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:32.282008 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] HTTP exception thrown: Instance 413d7cde-ec29-4239-968e-6524df522977 could not be found. Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Request method failure captured: Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 HTTP/1.1 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2DIZQSVYTmXfv3P1HHyCybyqHqtdKD9JV_mfMHf3vTwv7xJzN4_3Tb36V0CN5v3ymYu-0IyDsVtsitbUDzpdQWnL8h-ShXqvQPAy1qou-5arDzrQ8dmXUO4ncToplHg6oR4yzsrw1yyegYTHA6F6la5zO8jahtkOdiAvcNmkOlK0wE Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: cdacaef127174c85b0bd5f08efe26952 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ListImageFiltersTestJSON-306161919 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cdacaef127174c85b0bd5f08efe26952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdacaef127174c85b0bd5f08efe26952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cdacaef127174c85b0bd5f08efe26952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdacaef127174c85b0bd5f08efe26952"}]}] Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ListImageFiltersTestJSON-306161919 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: cdacaef127174c85b0bd5f08efe26952 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-306161919 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ListImageFiltersTestJSON-306161919-project Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ae5ded1762834d11ab671efdb1d373b7 Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ListImageFiltersTestJSON-306161919-project Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 413d7cde-ec29-4239-968e-6524df522977 could not be found. Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '413d7cde-ec29-4239-968e-6524df522977'} Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413d7cde-ec29-4239-968e-6524df522977 could not be found. Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413d7cde-ec29-4239-968e-6524df522977 could not be found. Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:32.284484 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:32.291798 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:32.291798 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:32.291798 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:32.291798 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:32.291798 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:32.291798 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413d7cde-ec29-4239-968e-6524df522977 could not be found. Oct 22 03:20:32.291798 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:32.293569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Returning 404 to user: Instance 413d7cde-ec29-4239-968e-6524df522977 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:32.294674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-52b7feb3-15a1-460f-b83d-055d0acd6af2 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977" status: 404 len: 111 microversion: 2.1 time: 0.047554 Oct 22 03:20:32.295755 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1851/3747] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:32 2022] GET /compute/v2.1/servers/413d7cde-ec29-4239-968e-6524df522977 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:32.301300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b0461695-46a4-4d6a-add9-c5f7bcc14d71 tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] Calling method '.version_select at 0x7f0d1993d280>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:32.400808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:32.411103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:32.412736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:32.413946 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91c77c8b-70ed-4bf4-8fb7-140c534b43ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.343888 Oct 22 03:20:32.424693 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1897/3748] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:32 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:32.432531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ffa42ea8-b347-4d4e-90db-e8e1e9dd5c5e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d194b31f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:33.029967 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ffa42ea8-b347-4d4e-90db-e8e1e9dd5c5e tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "DELETE /compute/v2.1/images/f2a9c875-be55-42fd-9c0b-f5b4c94fe080" status: 204 len: 0 microversion: 2.1 time: 0.604031 Oct 22 03:20:33.036441 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1898/3749] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:32 2022] DELETE /compute/v2.1/images/f2a9c875-be55-42fd-9c0b-f5b4c94fe080 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:33.053292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-86e8a5cb-5f4f-4701-bc3e-6947bbdb4986 req-54f82976-1767-46dc-85f1-67934b15fb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ea0c89-d7c8-414d-b796-4c45aca5729f", "name": "network-vif-deleted", "tag": "9442663e-1ac1-492c-9f56-4eb699b73b0c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:33.078211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86e8a5cb-5f4f-4701-bc3e-6947bbdb4986 req-54f82976-1767-46dc-85f1-67934b15fb9f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:33.078887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86e8a5cb-5f4f-4701-bc3e-6947bbdb4986 req-54f82976-1767-46dc-85f1-67934b15fb9f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:33.079546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86e8a5cb-5f4f-4701-bc3e-6947bbdb4986 req-54f82976-1767-46dc-85f1-67934b15fb9f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:33.130658 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-86e8a5cb-5f4f-4701-bc3e-6947bbdb4986 req-54f82976-1767-46dc-85f1-67934b15fb9f service nova] Creating event network-vif-deleted:9442663e-1ac1-492c-9f56-4eb699b73b0c for instance 76ea0c89-d7c8-414d-b796-4c45aca5729f on n-h2-862416-2 Oct 22 03:20:33.138865 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b0461695-46a4-4d6a-add9-c5f7bcc14d71 tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.841797 Oct 22 03:20:33.148832 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1852/3750] 10.222.0.25 () {58 vars in 1191 bytes} [Sat Oct 22 03:20:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:33.154803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8bc5bf82-d631-4edf-9b9c-d6ecbf5f0709 req-0719794b-dd86-4cf9-a828-dad60c425e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4dc0ad-7879-4fd2-8464-46da72e85755", "name": "network-vif-plugged", "status": "completed", "tag": "a55eee90-06c2-45fc-98cd-3cc3996f91b1"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:33.170213 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-86e8a5cb-5f4f-4701-bc3e-6947bbdb4986 req-54f82976-1767-46dc-85f1-67934b15fb9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123019 Oct 22 03:20:33.171087 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1899/3751] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:33.171626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8bc5bf82-d631-4edf-9b9c-d6ecbf5f0709 req-0719794b-dd86-4cf9-a828-dad60c425e99 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:33.172146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8bc5bf82-d631-4edf-9b9c-d6ecbf5f0709 req-0719794b-dd86-4cf9-a828-dad60c425e99 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:33.172657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8bc5bf82-d631-4edf-9b9c-d6ecbf5f0709 req-0719794b-dd86-4cf9-a828-dad60c425e99 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:33.185060 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8bc5bf82-d631-4edf-9b9c-d6ecbf5f0709 req-0719794b-dd86-4cf9-a828-dad60c425e99 service nova] Creating event network-vif-plugged:a55eee90-06c2-45fc-98cd-3cc3996f91b1 for instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 on n-h2-862416-2 Oct 22 03:20:33.187950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:33.188699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:33.190379 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8bc5bf82-d631-4edf-9b9c-d6ecbf5f0709 req-0719794b-dd86-4cf9-a828-dad60c425e99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039347 Oct 22 03:20:33.191457 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1853/3752] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:33.201115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d293a8eb-4403-415b-85ed-781a812ea999 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d1e55f310>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:33.202525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:33.203021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:33.203465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:33.204166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:33.225695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:33.228051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:33.387323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:33.388090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:33.388744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:33.391105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lazy-loading 'fault' on Instance uuid 76ea0c89-d7c8-414d-b796-4c45aca5729f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:20:33.615651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0acb8d942d09476994afa9a647132e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e11664c867b4d08b961a0613160c3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:33.624794 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d43719a7-ac77-4566-a284-01da56a7f27c tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 200 len: 1306 microversion: 2.1 time: 0.452384 Oct 22 03:20:33.627781 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1900/3753] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:33 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 1306 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:33.641249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:33.643336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:33.657158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:33.661502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:33.662489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:33.663473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:33.664304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:33.682117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:33.814742 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d293a8eb-4403-415b-85ed-781a812ea999 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "DELETE /compute/v2.1/images/aa676023-2bb9-4a10-a38e-ebea284e5c12" status: 204 len: 0 microversion: 2.1 time: 0.621841 Oct 22 03:20:33.818570 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1854/3754] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:33 2022] DELETE /compute/v2.1/images/aa676023-2bb9-4a10-a38e-ebea284e5c12 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:33.824737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1dccb149-342d-45eb-b653-ce19f2d51ccd tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] Calling method '.version_select at 0x7f0d1e55faf0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:33.951755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:33.969702 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35fcf7e4-ab78-4a80-b6f7-766fae78f9de tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1315 microversion: 2.1 time: 0.338039 Oct 22 03:20:34.000020 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1901/3755] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:33 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:34.005611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:34.006494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:34.014647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:34.015440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:34.016082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:34.017026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:34.017701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:34.018300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:34.229765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:34.246378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:34.249440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:34.252286 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ffe959c-6513-4588-a800-5d6795f863f8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.250410 Oct 22 03:20:34.253335 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1902/3756] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:34 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:34.259466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca8d7a94-abf6-4c84-b1d6-6102edce8474 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] Calling method '.version_select at 0x7f0d194b73a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:34.434469 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1dccb149-342d-45eb-b653-ce19f2d51ccd tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/17e35875-a38b-4bcc-891a-2cbcc4e9d65c" status: 202 len: 0 microversion: 2.1 time: 0.617045 Oct 22 03:20:34.437447 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1855/3757] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:33 2022] DELETE /compute/v2.1/os-security-groups/17e35875-a38b-4bcc-891a-2cbcc4e9d65c => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:34.460240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7c336e6-12b7-46c5-a7dc-35e0db651066 tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] Calling method '.version_select at 0x7f0d1a77dca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:34.697660 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7c336e6-12b7-46c5-a7dc-35e0db651066 tempest-SecurityGroupsTestAdminJSON-1591981243 tempest-SecurityGroupsTestAdminJSON-1591981243-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e6346838-eb30-4d34-a0d6-2e9a7f383716" status: 202 len: 0 microversion: 2.1 time: 0.255773 Oct 22 03:20:34.698777 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1856/3758] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:34 2022] DELETE /compute/v2.1/os-security-groups/e6346838-eb30-4d34-a0d6-2e9a7f383716 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:20:34.704639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:34.705475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 76ea0c89-d7c8-414d-b796-4c45aca5729f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:34.726068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:34.727068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:34.727778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:34.728616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:34.728989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:34.729827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:34.745916 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] HTTP exception thrown: Instance 76ea0c89-d7c8-414d-b796-4c45aca5729f could not be found. Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Request method failure captured: Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f HTTP/1.1 Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2C0V8vD1-aayKHeeOC952ZWoHQKkETOKzIWbprXGargXUy47LPZbwR2aGIhvtp_TgwWamd-8gLsSf-cMHxpJsG1DjoJVZQv_EoB4YaD3xno_6TC3IddLvCz6deQJJdqO_37AuEYL9prgDmKwSFqId4TrmgfXnVonqzkPhPr9-494eA Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}] Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0acb8d942d09476994afa9a647132e5c Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 76ea0c89-d7c8-414d-b796-4c45aca5729f could not be found. Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '76ea0c89-d7c8-414d-b796-4c45aca5729f'} Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ea0c89-d7c8-414d-b796-4c45aca5729f could not be found. Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ea0c89-d7c8-414d-b796-4c45aca5729f could not be found. Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:34.747590 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:34.752231 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:34.752231 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:34.752231 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:34.752231 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:34.752231 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:34.752231 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ea0c89-d7c8-414d-b796-4c45aca5729f could not be found. Oct 22 03:20:34.752231 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:34.753959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Returning 404 to user: Instance 76ea0c89-d7c8-414d-b796-4c45aca5729f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:34.754778 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39058530-2314-4304-8c98-a5e008e6f66e tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f" status: 404 len: 111 microversion: 2.1 time: 0.055038 Oct 22 03:20:34.755447 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1857/3759] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:34 2022] GET /compute/v2.1/servers/76ea0c89-d7c8-414d-b796-4c45aca5729f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:34.770360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04ffbc74-ebe3-478e-9ca0-3275a4764c6f tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] Calling method '.version_select at 0x7f0d1a4250d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:34.996458 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca8d7a94-abf6-4c84-b1d6-6102edce8474 tempest-ListImageFiltersTestJSON-306161919 tempest-ListImageFiltersTestJSON-306161919-project] 10.222.0.25 "DELETE /compute/v2.1/images/d8c754b5-a5ab-44d0-9971-b0d2a023aa4c" status: 204 len: 0 microversion: 2.1 time: 0.741572 Oct 22 03:20:34.997035 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1903/3760] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:34 2022] DELETE /compute/v2.1/images/d8c754b5-a5ab-44d0-9971-b0d2a023aa4c => generated 0 bytes in 743 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:35.005729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:35.006229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:35.012871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.013361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.013999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.015533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.016430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.017103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.043291 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] HTTP exception thrown: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Request method failure captured: Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 HTTP/1.1 Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2C0V8vD1-aayKHeeOC952ZWoHQKkETOKzIWbprXGargXUy47LPZbwR2aGIhvtp_TgwWamd-8gLsSf-cMHxpJsG1DjoJVZQv_EoB4YaD3xno_6TC3IddLvCz6deQJJdqO_37AuEYL9prgDmKwSFqId4TrmgfXnVonqzkPhPr9-494eA Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}] Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0acb8d942d09476994afa9a647132e5c Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '158a3acf-7c48-47fc-868c-3e89b334ccb6'} Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:20:35.051290 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Returning 404 to user: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:35.055525 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a98c6d80-1992-4142-ba12-406b33839336 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 404 len: 111 microversion: 2.1 time: 0.054832 Oct 22 03:20:35.060342 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1904/3761] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:20:34 2022] DELETE /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:35.070025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:35.070748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:35.089108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.089610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.090059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.090814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.091277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.091752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.352953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:35.366489 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f61b760e-8932-4410-8f0e-b6d93eeb7073 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1315 microversion: 2.1 time: 0.304099 Oct 22 03:20:35.380340 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1905/3762] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:35 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:35.385371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:35.386287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 158a3acf-7c48-47fc-868c-3e89b334ccb6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:35.394854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.395664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.396327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.397398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.398056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.398655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.424738 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] HTTP exception thrown: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.426710 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04ffbc74-ebe3-478e-9ca0-3275a4764c6f tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0fb8e348-9a4b-49a6-a535-7b319e2acc46" status: 202 len: 0 microversion: 2.1 time: 0.666290 Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Request method failure captured: Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 HTTP/1.1 Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2C0V8vD1-aayKHeeOC952ZWoHQKkETOKzIWbprXGargXUy47LPZbwR2aGIhvtp_TgwWamd-8gLsSf-cMHxpJsG1DjoJVZQv_EoB4YaD3xno_6TC3IddLvCz6deQJJdqO_37AuEYL9prgDmKwSFqId4TrmgfXnVonqzkPhPr9-494eA Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}] Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0acb8d942d09476994afa9a647132e5c Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '158a3acf-7c48-47fc-868c-3e89b334ccb6'} Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:35.427313 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.431722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.431722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:35.431722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:35.431722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:35.431722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:35.431722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. Oct 22 03:20:35.431722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.434037 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1858/3763] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:34 2022] DELETE /compute/v2.1/os-security-groups/0fb8e348-9a4b-49a6-a535-7b319e2acc46 => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:35.435273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Returning 404 to user: Instance 158a3acf-7c48-47fc-868c-3e89b334ccb6 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:35.437001 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfd57843-9135-4559-a235-e0e6ec47a7bf tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6" status: 404 len: 111 microversion: 2.1 time: 0.062814 Oct 22 03:20:35.438020 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1906/3764] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:35 2022] GET /compute/v2.1/servers/158a3acf-7c48-47fc-868c-3e89b334ccb6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:35.447581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc54e64b-5a51-4be9-b641-95ba2c37f51f tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] Calling method '.version_select at 0x7f0d195145e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:35.459512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:35.460133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:35.484865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.485776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.486809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.487706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.488174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.488662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.656003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:35.667240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:35.668919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:35.670246 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6865e39-9fd9-4aac-9e78-d2f43aa7045e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.241655 Oct 22 03:20:35.670836 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1859/3765] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:35 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:35.694097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:35.694680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:35.701513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.701988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.702549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.704249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.704249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.704249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.719688 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] HTTP exception thrown: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Request method failure captured: Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 HTTP/1.1 Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2C0V8vD1-aayKHeeOC952ZWoHQKkETOKzIWbprXGargXUy47LPZbwR2aGIhvtp_TgwWamd-8gLsSf-cMHxpJsG1DjoJVZQv_EoB4YaD3xno_6TC3IddLvCz6deQJJdqO_37AuEYL9prgDmKwSFqId4TrmgfXnVonqzkPhPr9-494eA Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}] Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0acb8d942d09476994afa9a647132e5c Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '54e062bf-a697-4a20-aeda-260c6517a642'} Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:20:35.721399 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Returning 404 to user: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e031c912-717e-4553-a667-aca4891dd939 tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 404 len: 111 microversion: 2.1 time: 0.034486 Oct 22 03:20:35.725571 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1860/3766] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:20:35 2022] DELETE /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:35.733482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:35.734648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] [instance: 54e062bf-a697-4a20-aeda-260c6517a642] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:35.741331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.741903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.742401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.744339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:35.745016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:35.745455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:35.769562 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] HTTP exception thrown: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Request method failure captured: Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 HTTP/1.1 Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2C0V8vD1-aayKHeeOC952ZWoHQKkETOKzIWbprXGargXUy47LPZbwR2aGIhvtp_TgwWamd-8gLsSf-cMHxpJsG1DjoJVZQv_EoB4YaD3xno_6TC3IddLvCz6deQJJdqO_37AuEYL9prgDmKwSFqId4TrmgfXnVonqzkPhPr9-494eA Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e11664c867b4d08b961a0613160c3cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e11664c867b4d08b961a0613160c3cb"}]}] Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 6e11664c867b4d08b961a0613160c3cb Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-300468625 Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0acb8d942d09476994afa9a647132e5c Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerDiskConfigTestJSON-300468625-project Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '54e062bf-a697-4a20-aeda-260c6517a642'} Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:35.772360 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] Returning 404 to user: Instance 54e062bf-a697-4a20-aeda-260c6517a642 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:35.777392 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c24f7e34-8d43-4869-8252-d33012d3dc4b tempest-ServerDiskConfigTestJSON-300468625 tempest-ServerDiskConfigTestJSON-300468625-project] 10.222.0.25 "GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642" status: 404 len: 111 microversion: 2.1 time: 0.047238 Oct 22 03:20:35.778870 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1861/3767] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:35 2022] GET /compute/v2.1/servers/54e062bf-a697-4a20-aeda-260c6517a642 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:20:35.796998 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc54e64b-5a51-4be9-b641-95ba2c37f51f tempest-SecurityGroupsTestAdminJSON-2024094056 tempest-SecurityGroupsTestAdminJSON-2024094056-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5a1bc47f-751c-47f0-a5a3-adef908090fb" status: 202 len: 0 microversion: 2.1 time: 0.357326 Oct 22 03:20:35.797791 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1907/3768] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:20:35 2022] DELETE /compute/v2.1/os-security-groups/5a1bc47f-751c-47f0-a5a3-adef908090fb => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:36.395018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:36.395642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:36.409973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:36.410556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:36.410993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:36.411896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:36.413287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:36.413871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:36.440668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:36.701583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:36.703810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:36.715889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:36.716871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:36.718047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:36.719019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:36.719965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:36.720749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:36.740641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:36.771433 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84addfb7-efa7-45c5-9352-efc122186539 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1501 microversion: 2.1 time: 0.383729 Oct 22 03:20:36.771931 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1862/3769] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:36 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1501 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:36.796436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dce30d8b-52b7-483d-bb3e-d12a7398996d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:36.807524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce30d8b-52b7-483d-bb3e-d12a7398996d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:36.809061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce30d8b-52b7-483d-bb3e-d12a7398996d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:36.809625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce30d8b-52b7-483d-bb3e-d12a7398996d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:36.891063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dce30d8b-52b7-483d-bb3e-d12a7398996d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Going to try to stop instance {{(pid=120582) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:20:37.009238 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dce30d8b-52b7-483d-bb3e-d12a7398996d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755/action" status: 202 len: 0 microversion: 2.1 time: 0.215400 Oct 22 03:20:37.012752 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1863/3770] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:20:36 2022] POST /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:20:37.033101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:37.034047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:37.050521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:37.051026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:37.051474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:37.054266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:37.059171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:37.059816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:37.232710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:37.246769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:37.248200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:37.249453 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9bee7a44-27c2-47ce-ad7c-bb69c8e07918 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.553707 Oct 22 03:20:37.260516 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1908/3771] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:36 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:37.422556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:37.435543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-462a79ba-621a-4e32-9969-63ca3d2d22ff tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.417693 Oct 22 03:20:37.436142 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1864/3772] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:37 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:37.729174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8715e60c-5a6c-4059-8782-792f64208b17 tempest-ListImageFiltersNegativeTestJSON-1578144682 tempest-ListImageFiltersNegativeTestJSON-1578144682-project] Calling method '.version_select at 0x7f0d199df160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:37.758025 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-8715e60c-5a6c-4059-8782-792f64208b17 tempest-ListImageFiltersNegativeTestJSON-1578144682 tempest-ListImageFiltersNegativeTestJSON-1578144682-project] HTTP exception thrown: Image not found. Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8715e60c-5a6c-4059-8782-792f64208b17 tempest-ListImageFiltersNegativeTestJSON-1578144682 tempest-ListImageFiltersNegativeTestJSON-1578144682-project] Request method failure captured: Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/images/df0f8421-22ed-4369-906c-d20ca9872f77 HTTP/1.1 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2GEtgoAwDBJZK7_iDJCxcaf0OWXg0FII721txjpdNxI7CwvLelV8GoBWwXZgA_Y-KvRtuRl-Iucx0Goys_DhY8xeqHSIpwpc4tFCwm1MGBtQN7BKyrJl2jIzU3ffoEHLyt4BtZBO03-03STmec5V8hj67fCaFkPd93ycGySRDDdYY8 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1ed5a71548d64c448e9b8001167ad137 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1578144682 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ed5a71548d64c448e9b8001167ad137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed5a71548d64c448e9b8001167ad137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ed5a71548d64c448e9b8001167ad137"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed5a71548d64c448e9b8001167ad137"}]}] Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1578144682 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1ed5a71548d64c448e9b8001167ad137 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1578144682 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListImageFiltersNegativeTestJSON-1578144682-project Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0fe700da762c44c3aee00a41278cf3a3 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1578144682-project Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'df0f8421-22ed-4369-906c-d20ca9872f77'} Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID df0f8421-22ed-4369-906c-d20ca9872f77 Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:20:37.763062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df0f8421-22ed-4369-906c-d20ca9872f77 could not be found. Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:20:37.767380 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:20:37.779279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8715e60c-5a6c-4059-8782-792f64208b17 tempest-ListImageFiltersNegativeTestJSON-1578144682 tempest-ListImageFiltersNegativeTestJSON-1578144682-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:37.780505 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8715e60c-5a6c-4059-8782-792f64208b17 tempest-ListImageFiltersNegativeTestJSON-1578144682 tempest-ListImageFiltersNegativeTestJSON-1578144682-project] 10.222.0.25 "GET /compute/v2.1/images/df0f8421-22ed-4369-906c-d20ca9872f77" status: 404 len: 62 microversion: 2.1 time: 0.515031 Oct 22 03:20:37.781957 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1909/3773] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:20:37 2022] GET /compute/v2.1/images/df0f8421-22ed-4369-906c-d20ca9872f77 => generated 62 bytes in 521 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:20:38.297329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:38.299128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:38.317251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:38.317752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:38.318988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:38.320858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:38.321561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:38.322778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:38.463971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:38.464627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:38.668916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:38.678390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:38.682568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:38.684596 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be41b4ec-2cfe-402d-8962-06a9f441d5d3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.400575 Oct 22 03:20:38.716289 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1865/3774] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:38 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:38.903127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:38.904301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:38.904957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:38.905869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:38.906545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:38.907426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:39.723140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:39.723619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:39.739810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:39.740392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:39.740844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:39.741698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:39.742173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:39.742583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:39.931946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:39.947886 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16e56676-fbfe-44a0-8266-ef9eef176bdc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 1.490750 Oct 22 03:20:39.948700 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1910/3775] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:38 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:40.493716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9747dba2-18a5-4d82-87f2-1374da766b79 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:40.497394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9747dba2-18a5-4d82-87f2-1374da766b79 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.497882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9747dba2-18a5-4d82-87f2-1374da766b79 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.498321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9747dba2-18a5-4d82-87f2-1374da766b79 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.499055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9747dba2-18a5-4d82-87f2-1374da766b79 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.499508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9747dba2-18a5-4d82-87f2-1374da766b79 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.500383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9747dba2-18a5-4d82-87f2-1374da766b79 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.565060 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9747dba2-18a5-4d82-87f2-1374da766b79 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.315440 Oct 22 03:20:40.572620 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1911/3776] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:20:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:40.579109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b259617c-fece-4775-8424-174e0b0ad5a2 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:40.597953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b259617c-fece-4775-8424-174e0b0ad5a2 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.598701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b259617c-fece-4775-8424-174e0b0ad5a2 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.599340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b259617c-fece-4775-8424-174e0b0ad5a2 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.600328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b259617c-fece-4775-8424-174e0b0ad5a2 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.606276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b259617c-fece-4775-8424-174e0b0ad5a2 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.607376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b259617c-fece-4775-8424-174e0b0ad5a2 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.651261 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b259617c-fece-4775-8424-174e0b0ad5a2 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.076322 Oct 22 03:20:40.653482 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1912/3777] 10.222.0.25 () {58 vars in 1170 bytes} [Sat Oct 22 03:20:40 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:20:40.668479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bf12cfaf-4a5e-4e9c-9a3b-bf596baaa92f tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:40.677890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:40.679785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf12cfaf-4a5e-4e9c-9a3b-bf596baaa92f tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.680825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf12cfaf-4a5e-4e9c-9a3b-bf596baaa92f tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.683074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf12cfaf-4a5e-4e9c-9a3b-bf596baaa92f tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.684076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf12cfaf-4a5e-4e9c-9a3b-bf596baaa92f tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.685910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf12cfaf-4a5e-4e9c-9a3b-bf596baaa92f tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.686520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf12cfaf-4a5e-4e9c-9a3b-bf596baaa92f tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.692979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:40.699621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:40.701466 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3e4ab7a-7f44-4bb0-b649-47fdfc6ccf0d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.982787 Oct 22 03:20:40.705277 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1866/3778] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:39 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:40.736571 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bf12cfaf-4a5e-4e9c-9a3b-bf596baaa92f tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.074863 Oct 22 03:20:40.737886 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1913/3779] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:20:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:40.750483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5507d68d-6521-4de1-9553-9efc6e74e428 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:40.754945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5507d68d-6521-4de1-9553-9efc6e74e428 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.756077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5507d68d-6521-4de1-9553-9efc6e74e428 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.757151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5507d68d-6521-4de1-9553-9efc6e74e428 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.758212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5507d68d-6521-4de1-9553-9efc6e74e428 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.759537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5507d68d-6521-4de1-9553-9efc6e74e428 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.761966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5507d68d-6521-4de1-9553-9efc6e74e428 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.793943 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5507d68d-6521-4de1-9553-9efc6e74e428 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-862416-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.047281 Oct 22 03:20:40.804064 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1867/3780] 10.222.0.25 () {58 vars in 1194 bytes} [Sat Oct 22 03:20:40 2022] GET /compute/v2.1/os-services?host=n-d-862416-2&binary=xxx => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:20:40.808403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b63c986a-07bb-4bb4-b22b-0eb218f07631 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:40.812310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b63c986a-07bb-4bb4-b22b-0eb218f07631 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.813029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b63c986a-07bb-4bb4-b22b-0eb218f07631 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.813728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b63c986a-07bb-4bb4-b22b-0eb218f07631 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.814804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b63c986a-07bb-4bb4-b22b-0eb218f07631 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.815752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b63c986a-07bb-4bb4-b22b-0eb218f07631 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.816443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b63c986a-07bb-4bb4-b22b-0eb218f07631 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.886054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b63c986a-07bb-4bb4-b22b-0eb218f07631 tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.082435 Oct 22 03:20:40.889689 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1914/3781] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:20:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:20:40.906374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9eb2ef43-e890-41a8-bfc1-55997fd08f6d tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:40.912396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9eb2ef43-e890-41a8-bfc1-55997fd08f6d tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.913088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9eb2ef43-e890-41a8-bfc1-55997fd08f6d tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.913749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9eb2ef43-e890-41a8-bfc1-55997fd08f6d tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.919798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9eb2ef43-e890-41a8-bfc1-55997fd08f6d tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:40.922278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9eb2ef43-e890-41a8-bfc1-55997fd08f6d tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:40.924833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9eb2ef43-e890-41a8-bfc1-55997fd08f6d tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:40.974209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:40.976961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:41.014537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:41.019481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:41.020856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:41.024718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:41.033598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:41.034654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:41.046717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9eb2ef43-e890-41a8-bfc1-55997fd08f6d tempest-ServicesAdminNegativeTestJSON-1100373665 tempest-ServicesAdminNegativeTestJSON-1100373665-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.146016 Oct 22 03:20:41.062989 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1868/3782] 10.222.0.25 () {58 vars in 1198 bytes} [Sat Oct 22 03:20:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:20:41.467764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f291cf8-fcf5-4c75-a587-a1936109de00 tempest-ServicesAdminNegativeTestJSON-173390660 tempest-ServicesAdminNegativeTestJSON-173390660-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:41.472083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f291cf8-fcf5-4c75-a587-a1936109de00 tempest-ServicesAdminNegativeTestJSON-173390660 tempest-ServicesAdminNegativeTestJSON-173390660-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1a587b597a03424b9049c6a6329fef95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df70536a7a244f889b480d22bd73362e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f291cf8-fcf5-4c75-a587-a1936109de00 tempest-ServicesAdminNegativeTestJSON-173390660 tempest-ServicesAdminNegativeTestJSON-173390660-project] Request method failure captured: Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2GHGCtnwqQjiJSvN3-pUVKQ6K4y3tmPEulO8gHwDPhvCFxKgt0PzEdEq4yeTCmfcgBXhwlL-dfywkUvgQlxNLUEZ33pFryzqSyi4UxZGaV3Soj9ajc9PQaRtcwPe6lUNlG3yvcvigkJ04vldEvRcuCHzDi0RAoMC2FS7_RYfM7xUwo Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: df70536a7a244f889b480d22bd73362e Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-173390660 Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df70536a7a244f889b480d22bd73362e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df70536a7a244f889b480d22bd73362e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df70536a7a244f889b480d22bd73362e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df70536a7a244f889b480d22bd73362e"}]}] Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-173390660 Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: df70536a7a244f889b480d22bd73362e Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-173390660 Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServicesAdminNegativeTestJSON-173390660-project Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 1a587b597a03424b9049c6a6329fef95 Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-173390660-project Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: action_args: {} Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise self.value Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 03:20:41.474742 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 22 03:20:41.480509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:20:41.483749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f291cf8-fcf5-4c75-a587-a1936109de00 tempest-ServicesAdminNegativeTestJSON-173390660 tempest-ServicesAdminNegativeTestJSON-173390660-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:20:41.484013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f291cf8-fcf5-4c75-a587-a1936109de00 tempest-ServicesAdminNegativeTestJSON-173390660 tempest-ServicesAdminNegativeTestJSON-173390660-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.419641 Oct 22 03:20:41.493682 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1869/3783] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:20:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 430 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:20:41.581951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:41.591639 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea90c6d3-4b42-4208-88a4-2a111db8810f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.622415 Oct 22 03:20:41.596506 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1915/3784] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:40 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:20:41.732198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:41.732983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:41.747578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:41.748090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:41.748558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:41.755559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:41.758295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:41.761728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:42.073193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:42.084968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:42.086492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:42.089171 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19f7a94e-1124-4539-b5ac-7014d32e6ad1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.362095 Oct 22 03:20:42.089737 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1870/3785] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:41 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:42.393877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c1dad529-66b7-4c50-96ea-4b1d19f3fb8e tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Action: 'create', calling method: .version_select at 0x7f0d19591e50>, body: {"keypair": {"name": "tempest-keypair-2006468397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJydu2qo/g18H+J/CyGuNXcG0R08L/hg1zouvUkbfg3sumlJGhKGFdNBjP110J3kqZI2gcXe+c0pa+SlY/GOgDY6cKCGlSaTGHbq0rW1fIptjGxlgt1RlDirZ/pRsrp59A=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:42.425487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-c1dad529-66b7-4c50-96ea-4b1d19f3fb8e tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:42.440925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-c1dad529-66b7-4c50-96ea-4b1d19f3fb8e tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:42.488297 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c1dad529-66b7-4c50-96ea-4b1d19f3fb8e tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.617621 Oct 22 03:20:42.501823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9709e2ea-f7f9-4ac4-9a4b-9afe21bd615a tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d1e509820>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:42.507716 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1916/3786] 10.222.0.25 () {62 vars in 1199 bytes} [Sat Oct 22 03:20:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 640 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 22 03:20:42.516972 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9709e2ea-f7f9-4ac4-9a4b-9afe21bd615a tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-2006468397" status: 200 len: 513 microversion: 2.2 time: 0.019697 Oct 22 03:20:42.520414 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1871/3787] 10.222.0.25 () {60 vars in 1258 bytes} [Sat Oct 22 03:20:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2006468397 => generated 513 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:20:42.533350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b22f6985-9d86-4594-a888-624dcb50ba5f tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d19569ee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:42.575280 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b22f6985-9d86-4594-a888-624dcb50ba5f tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006468397" status: 204 len: 0 microversion: 2.2 time: 0.045995 Oct 22 03:20:42.575879 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1917/3788] 10.222.0.25 () {60 vars in 1261 bytes} [Sat Oct 22 03:20:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006468397 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:42.590071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b3528a11-e5c2-49cf-b8e8-68186d75c975 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Action: 'create', calling method: .version_select at 0x7f0d1e51e5e0>, body: {"keypair": {"name": "tempest-keypair-1488649939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyK/o+02XRPpLkX9E9/U2WOcEPK/UTsUQSnUgmASYPZa6qmSzTalTX+Fu0/cxkXvbo3WmbSg+JXSQF9Xb3TnZ8d9zQJhMymjZH5fb2TMXtZ5c2dy7QoV5F7LWf9VBmctA=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:42.622788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:42.624110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:42.634565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b3528a11-e5c2-49cf-b8e8-68186d75c975 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:42.640042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:42.641208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:42.643479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:42.644854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:42.646709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:42.647234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:42.653536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b3528a11-e5c2-49cf-b8e8-68186d75c975 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:42.719083 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b3528a11-e5c2-49cf-b8e8-68186d75c975 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.131736 Oct 22 03:20:42.721327 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1872/3789] 10.222.0.25 () {62 vars in 1199 bytes} [Sat Oct 22 03:20:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 22 03:20:42.744782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba9338b9-1b13-4513-85fd-69cc009304f9 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d197560d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:42.789395 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba9338b9-1b13-4513-85fd-69cc009304f9 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488649939" status: 204 len: 0 microversion: 2.2 time: 0.058343 Oct 22 03:20:42.791291 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1873/3790] 10.222.0.25 () {60 vars in 1261 bytes} [Sat Oct 22 03:20:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488649939 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:42.804170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7f610efa-ef20-43e7-aad5-120b7cc21f19 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Action: 'create', calling method: .version_select at 0x7f0d1e509a60>, body: {"keypair": {"name": "tempest-keypair-1523288506", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:42.860043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7f610efa-ef20-43e7-aad5-120b7cc21f19 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:42.873760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7f610efa-ef20-43e7-aad5-120b7cc21f19 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:42.938479 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7f610efa-ef20-43e7-aad5-120b7cc21f19 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.142140 Oct 22 03:20:42.939778 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1874/3791] 10.222.0.25 () {62 vars in 1199 bytes} [Sat Oct 22 03:20:42 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 22 03:20:42.951148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e42ecbcd-8720-4c58-aca7-b30f13c1a8fe tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d19756790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:42.994092 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e42ecbcd-8720-4c58-aca7-b30f13c1a8fe tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523288506" status: 204 len: 0 microversion: 2.2 time: 0.047053 Oct 22 03:20:42.995792 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1875/3792] 10.222.0.25 () {60 vars in 1261 bytes} [Sat Oct 22 03:20:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523288506 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:43.007998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a079f13b-186c-46ff-bf9c-f3516a284ffe tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Action: 'create', calling method: .version_select at 0x7f0d1e51e310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1554134027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchSb8zMkd4mXEVGRU47522NpEDWRb2Tm6cNpX6TQqzhnvTY0Zmb8yL6PnYeRKBnqGhGZ8cmeXEaU3BIDrGOKRNoBgRug6zUC9Q5m47sLC4HpCNwKi6j2qoQZ5tbFBRMg=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:43.043614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a079f13b-186c-46ff-bf9c-f3516a284ffe tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:43.058653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a079f13b-186c-46ff-bf9c-f3516a284ffe tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:43.067391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:43.082658 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05dd47f8-6ed4-4fc5-a37c-d99b3b464b6b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.466215 Oct 22 03:20:43.083829 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1918/3793] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:42 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:43.116794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:43.118452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:43.132659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:43.133175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:43.136160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:43.137031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:43.137544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:43.138011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:43.141551 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a079f13b-186c-46ff-bf9c-f3516a284ffe tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.137655 Oct 22 03:20:43.144814 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1876/3794] 10.222.0.25 () {62 vars in 1199 bytes} [Sat Oct 22 03:20:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 22 03:20:43.157771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5c194b5-0bb1-4923-a3ed-b64eef9d5ae4 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Action: 'create', calling method: .version_select at 0x7f0d19abb4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-289026174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9BJQhTD9jnFr6Us7rXVBxVJh8uAcoLCL1VFiVJFOzlYrrnp5HH8InxEeVVnxtjU1PJyx76RrR2Il9FBD4u5gMWDcY3U14o+xx7mHqOJVSZp9gxRnKdpLEStwDUHM10hw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:43.199220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e5c194b5-0bb1-4923-a3ed-b64eef9d5ae4 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:43.209298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e5c194b5-0bb1-4923-a3ed-b64eef9d5ae4 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:43.265182 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5c194b5-0bb1-4923-a3ed-b64eef9d5ae4 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.112117 Oct 22 03:20:43.265908 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1877/3795] 10.222.0.25 () {62 vars in 1199 bytes} [Sat Oct 22 03:20:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 22 03:20:43.287961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-330410c5-d61a-4710-ac48-bc550fcc1aea tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Action: 'create', calling method: .version_select at 0x7f0d19756b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-420007069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1E9wDfUyvl8vzgv96XWWb7rKG5T7jsct5QVHBgdFHyusz/BTxkO+frJS66Oiq0IImMXqAWMTIoPDIs+8H7PODx7vbtniSj7qAyT1+M6/sarizJgoBYYNd/1u9uiy0+8A=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:43.315058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-330410c5-d61a-4710-ac48-bc550fcc1aea tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:43.325064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-330410c5-d61a-4710-ac48-bc550fcc1aea tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:43.359856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:43.393726 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-330410c5-d61a-4710-ac48-bc550fcc1aea tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.115236 Oct 22 03:20:43.394870 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1878/3796] 10.222.0.25 () {62 vars in 1199 bytes} [Sat Oct 22 03:20:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 22 03:20:43.421342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-478a3cfa-9ee1-4154-94f1-3a1c0096e1ba tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d19756ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:43.427783 n-d-862416-2 devstack@n-api.service[120582]: WARNING oslo_db.sqlalchemy.utils [None req-478a3cfa-9ee1-4154-94f1-3a1c0096e1ba tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 03:20:43.441724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-478a3cfa-9ee1-4154-94f1-3a1c0096e1ba tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.036233 Oct 22 03:20:43.451611 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1879/3797] 10.222.0.25 () {60 vars in 1177 bytes} [Sat Oct 22 03:20:43 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:43.459795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c1b4d77-3425-436e-b1cf-47300c2a6125 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d1987b4c0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:43.505488 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c1b4d77-3425-436e-b1cf-47300c2a6125 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-420007069" status: 204 len: 0 microversion: 2.2 time: 0.050825 Oct 22 03:20:43.511167 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1880/3798] 10.222.0.25 () {60 vars in 1318 bytes} [Sat Oct 22 03:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-420007069 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:43.525872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b82c996-2f08-42ee-a17b-174d113de65a tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d1e509af0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:43.569933 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b82c996-2f08-42ee-a17b-174d113de65a tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-289026174" status: 204 len: 0 microversion: 2.2 time: 0.054540 Oct 22 03:20:43.570739 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1881/3799] 10.222.0.25 () {60 vars in 1318 bytes} [Sat Oct 22 03:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-289026174 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:43.580684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:43.588176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c7a53e82-97a5-4930-b322-11dacbfa4c8f tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d1a3c83a0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:43.589112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:43.619162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:43.621215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:43.625587 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19bfd3d6-05dd-483f-a495-7d783b1e4600 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.512989 Oct 22 03:20:43.627906 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1919/3800] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:43 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:43.648758 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c7a53e82-97a5-4930-b322-11dacbfa4c8f tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1554134027" status: 204 len: 0 microversion: 2.2 time: 0.071365 Oct 22 03:20:43.649720 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1882/3801] 10.222.0.25 () {60 vars in 1321 bytes} [Sat Oct 22 03:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1554134027 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:43.661261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb83127c-7896-46b2-9913-41c459a4be07 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Action: 'create', calling method: .version_select at 0x7f0d195174c0>, body: {"keypair": {"name": "tempest-keypair-705807778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKsv5AB1xmC+smX52iE/uOPnLWwsItm3nn3xMRlC2Hb85C/ZnoqDtstrMiDvcGRRYTp3TQZPjy3rBOwzW82crUrLhKInoeyc7SPcoSA7yRGUdLQjkrTU6zWQ6EIwkUbbA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:43.708659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-eb83127c-7896-46b2-9913-41c459a4be07 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:43.718906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-eb83127c-7896-46b2-9913-41c459a4be07 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:43.777450 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb83127c-7896-46b2-9913-41c459a4be07 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.119968 Oct 22 03:20:43.778365 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1920/3802] 10.222.0.25 () {62 vars in 1199 bytes} [Sat Oct 22 03:20:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 22 03:20:43.793232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dde97934-48d9-40e0-9335-9321f2762725 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d19756e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:43.814928 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dde97934-48d9-40e0-9335-9321f2762725 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-705807778" status: 200 len: 512 microversion: 2.2 time: 0.029301 Oct 22 03:20:43.815830 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1883/3803] 10.222.0.25 () {60 vars in 1255 bytes} [Sat Oct 22 03:20:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-705807778 => generated 512 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:43.827657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39c6831f-d8d7-4dc8-912f-bb0f5253c922 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d194bc310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:43.831528 n-d-862416-2 devstack@n-api.service[120581]: WARNING oslo_db.sqlalchemy.utils [None req-39c6831f-d8d7-4dc8-912f-bb0f5253c922 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 03:20:43.838969 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39c6831f-d8d7-4dc8-912f-bb0f5253c922 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.015029 Oct 22 03:20:43.845204 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1921/3804] 10.222.0.25 () {60 vars in 1177 bytes} [Sat Oct 22 03:20:43 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:43.854779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5050f2c2-2950-412c-a90e-ea8cde0d8a70 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d1e51e700>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:43.897660 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5050f2c2-2950-412c-a90e-ea8cde0d8a70 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705807778" status: 204 len: 0 microversion: 2.2 time: 0.050105 Oct 22 03:20:43.900520 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1884/3805] 10.222.0.25 () {60 vars in 1258 bytes} [Sat Oct 22 03:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705807778 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:43.916535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Action: 'create', calling method: .version_select at 0x7f0d19569ca0>, body: {"keypair": {"name": "tempest-keypair-1724365832", "type": "x509"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:43.928629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:43.939650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:43.948260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:43.969899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.processutils [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpspj2g64c/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpspj2g64c/temp.key -subj /CN=41c87cf85f0b4028930c3bf1c62d65ee -extensions v3_req_client {{(pid=120581) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 03:20:44.470297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.processutils [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpspj2g64c/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpspj2g64c/temp.key -subj /CN=41c87cf85f0b4028930c3bf1c62d65ee -extensions v3_req_client" returned: 0 in 0.500s {{(pid=120581) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 03:20:44.472372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.processutils [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpspj2g64c/temp.key -password pass: {{(pid=120581) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 22 03:20:44.557178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.processutils [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpspj2g64c/temp.key -password pass:" returned: 0 in 0.085s {{(pid=120581) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 22 03:20:44.577369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:44.578466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:44.610193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:44.614796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:44.616758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:44.620469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:44.621576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:44.623394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:44.654093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:44.676149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Getting quotas for user 41c87cf85f0b4028930c3bf1c62d65ee and project 14f98ec273c1473b90f14c632bc62592. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:44.749973 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-347cff8c-89f7-4306-8f26-c8ab9d0d4419 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.829353 Oct 22 03:20:44.751080 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1922/3806] 10.222.0.25 () {62 vars in 1198 bytes} [Sat Oct 22 03:20:43 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 839 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:44.765080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:44.769541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:44.809992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:44.812668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:44.813527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:44.815859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:44.816439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:44.816915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:44.887709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:44.898479 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9119d6c-ed4e-4977-ba84-c41752e86e9c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.791226 Oct 22 03:20:44.917938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1885/3807] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:44 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:20:44.923733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1541a7b7-7e34-45a3-a234-8b69331dcaab tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d1e5090d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:44.935190 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1541a7b7-7e34-45a3-a234-8b69331dcaab tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1724365832" status: 200 len: 1534 microversion: 2.2 time: 0.015726 Oct 22 03:20:44.936250 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1886/3808] 10.222.0.25 () {60 vars in 1258 bytes} [Sat Oct 22 03:20:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1724365832 => generated 1534 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:44.955061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e57e33b-305e-4d83-a1b3-21dea73232e2 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d1a3c8e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:44.963734 n-d-862416-2 devstack@n-api.service[120582]: WARNING oslo_db.sqlalchemy.utils [None req-7e57e33b-305e-4d83-a1b3-21dea73232e2 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 03:20:44.969459 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e57e33b-305e-4d83-a1b3-21dea73232e2 tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.024197 Oct 22 03:20:44.970625 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1887/3809] 10.222.0.25 () {60 vars in 1177 bytes} [Sat Oct 22 03:20:44 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:44.990339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-756935ee-325f-4532-aa51-6aa6f21eb8aa tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] Calling method '.version_select at 0x7f0d1a4739d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:45.021925 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-756935ee-325f-4532-aa51-6aa6f21eb8aa tempest-KeyPairsV22TestJSON-1468772762 tempest-KeyPairsV22TestJSON-1468772762-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724365832" status: 204 len: 0 microversion: 2.2 time: 0.040476 Oct 22 03:20:45.022936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1888/3810] 10.222.0.25 () {60 vars in 1261 bytes} [Sat Oct 22 03:20:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724365832 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:20:45.153241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:45.166976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:45.168780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:45.170118 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fce98333-41b5-4410-ab3d-3c9881d752d9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.416909 Oct 22 03:20:45.171000 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1923/3811] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:44 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:45.925825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:45.927032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:45.942791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:45.943926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:45.944701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:45.948945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:45.953018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:45.953731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:46.199318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:46.202220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:46.219554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:46.222435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:46.223074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:46.225147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:46.226726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:46.227202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:46.284778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:46.294299 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b968feb-c8db-44cc-8e2e-923f9bacb462 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.374762 Oct 22 03:20:46.296568 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1889/3812] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:45 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:46.753750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:46.779101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:46.786852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:46.791511 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-294ca6a6-3455-4299-b634-61d3a8d97fab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.595376 Oct 22 03:20:46.794407 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1924/3813] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:46 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:47.324520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:47.325119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:47.337854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:47.338370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:47.338828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:47.341976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:47.342721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:47.343664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:47.556765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-101041114", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "d898e8f8-ed8a-40b2-b5c8-a3f2a411231d"}, {"uuid": "d772c444-1baa-45f6-91ba-706407ef9f41"}, {"uuid": "d898e8f8-ed8a-40b2-b5c8-a3f2a411231d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:47.659105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] validate_networks() for [('d898e8f8-ed8a-40b2-b5c8-a3f2a411231d', None, None, None, None, None), ('d772c444-1baa-45f6-91ba-706407ef9f41', None, None, None, None, None), ('d898e8f8-ed8a-40b2-b5c8-a3f2a411231d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:20:47.670987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:47.682132 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0931f590-fcf4-4838-90f2-6c480550de50 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.361254 Oct 22 03:20:47.696234 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1890/3814] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:47 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:47.829984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:47.830594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:47.839640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:47.840132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:47.840764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:47.841626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:47.842338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:47.843015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:48.062707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:48.080105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:48.081968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:48.083584 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-70e9bc89-4ba4-448e-9b05-cbcb3410b3b6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.262858 Oct 22 03:20:48.096119 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1891/3815] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:47 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:48.106384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fe6e52ab-88c9-47e2-8321-5de4c3b2dacd req-47a3863b-5507-4f63-b352-988276a04573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb680fc8-0d54-4742-b649-b82abbf4884e", "name": "network-vif-plugged", "status": "completed", "tag": "d85d1270-815c-43e2-aa88-748b7e3a2c72"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:48.125400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fe6e52ab-88c9-47e2-8321-5de4c3b2dacd req-47a3863b-5507-4f63-b352-988276a04573 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:48.126119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fe6e52ab-88c9-47e2-8321-5de4c3b2dacd req-47a3863b-5507-4f63-b352-988276a04573 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:48.127131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fe6e52ab-88c9-47e2-8321-5de4c3b2dacd req-47a3863b-5507-4f63-b352-988276a04573 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:48.141405 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fe6e52ab-88c9-47e2-8321-5de4c3b2dacd req-47a3863b-5507-4f63-b352-988276a04573 service nova] Creating event network-vif-plugged:d85d1270-815c-43e2-aa88-748b7e3a2c72 for instance eb680fc8-0d54-4742-b649-b82abbf4884e on n-h1-862416-2 Oct 22 03:20:48.148438 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fe6e52ab-88c9-47e2-8321-5de4c3b2dacd req-47a3863b-5507-4f63-b352-988276a04573 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050599 Oct 22 03:20:48.150597 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1892/3816] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:20:48.377579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-346954879", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:48.443111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:20:48.713884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:48.714316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:48.714797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:48.715212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:48.715643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:48.725793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:48.727389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:48.728286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:48.729287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:48.729760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:48.730473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:48.751685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Getting quotas for project 68722b7d4c83464ab08c61616a71b3e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:48.758111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Getting quotas for user 6aa8f9e5f2514418a73734a048809900 and project 68722b7d4c83464ab08c61616a71b3e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:48.773468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:20:48.776100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:20:48.841471 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-85d167a1-bb6f-4fcb-a4f5-42f8353acc80 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687886 Oct 22 03:20:48.842136 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1893/3817] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:20:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:20:48.855335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:48.857559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:48.873515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:48.874545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:48.875016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:48.875747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:48.876441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:48.877050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:49.160803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:49.173889 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-29c1ff89-34b7-4b6b-84d7-be1acc690dfe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.326604 Oct 22 03:20:49.175521 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1894/3818] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:48 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:49.185295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-24f1bbd0-c549-40de-9fd5-131252694c30 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:49.187461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-24f1bbd0-c549-40de-9fd5-131252694c30 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:49.308617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-24f1bbd0-c549-40de-9fd5-131252694c30 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:49.320268 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-24f1bbd0-c549-40de-9fd5-131252694c30 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1213 microversion: 2.1 time: 0.143614 Oct 22 03:20:49.322241 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1895/3819] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:49 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:49.332099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:49.332977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:49.344320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:49.345019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:49.345653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:49.347503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:49.348133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:49.349606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:49.611942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:49.624028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:49.625630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:49.627037 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-51b0ad10-c0cf-43ba-8dd5-e0d7771e01a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.303485 Oct 22 03:20:49.628159 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1896/3820] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:49 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:50.203365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:50.204276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:50.216778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:50.221668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:50.222268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:50.224890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:50.225645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:50.227647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:50.493117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:50.493624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:50.494341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:50.494610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:50.495800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:50.517475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:50.517974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:50.518421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:50.519233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:50.519760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:50.520261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:50.606789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Getting quotas for project f1f91285c5cf439194c1da640b4e1f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:50.626622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Getting quotas for user 50827aa842ce4e0bb8b21e57a3d5b318 and project f1f91285c5cf439194c1da640b4e1f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:50.666762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:20:50.672702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:20:50.901754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:50.910857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1729a27e-be78-4050-9649-76aa3c7e0215 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.713581 Oct 22 03:20:50.917296 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1897/3821] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:50 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:50.954984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:50.955637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:50.969318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:50.970122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:50.970748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:50.972307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:50.972973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:50.973671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:50.983443 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-889225e4-3811-456c-9009-49a3b076a80a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.430593 Oct 22 03:20:50.990413 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1925/3822] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:20:51.014981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:51.016728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:51.027292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:51.031440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:51.032312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:51.033799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:51.034749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:51.037827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:51.758422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:51.773589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:51.783422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:51.786231 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-deee9d0f-8a8a-4b7d-8d15-cb2e4fde1f2e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1808 microversion: 2.20 time: 0.787858 Oct 22 03:20:51.789071 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1926/3823] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:50 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1808 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:51.808042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a857d1f-eac2-4fc2-a07a-ae4b3acb753b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:51.810572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a857d1f-eac2-4fc2-a07a-ae4b3acb753b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:51.931416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:51.942498 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c665cd8a-0354-4804-92ec-b65d56a3a36c tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1273 microversion: 2.1 time: 1.023845 Oct 22 03:20:51.946472 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1898/3824] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:50 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1273 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:51.956979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:51.957965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:51.972592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:51.973494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:51.976480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:51.979229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:51.980023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:51.982117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:52.065951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9a857d1f-eac2-4fc2-a07a-ae4b3acb753b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:52.083423 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a857d1f-eac2-4fc2-a07a-ae4b3acb753b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1212 microversion: 2.1 time: 0.289427 Oct 22 03:20:52.084508 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1927/3825] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:51 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1212 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:52.641264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:52.655057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:52.669704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d8803bbb-dfa8-439a-94ad-faabe071e5c5 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.721747 Oct 22 03:20:52.676535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1899/3826] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:51 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:52.819549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:52.821776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:52.867027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:52.869023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:52.870447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:52.871300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:52.874053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:52.874766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:52.976338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:52.978701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:53.012556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:53.013079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:53.013679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:53.019552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:53.020588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:53.021327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:53.237447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:53.249797 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea2d309c-0fe0-4025-94b5-8a769c2218a6 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1271 microversion: 2.1 time: 0.279108 Oct 22 03:20:53.250876 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1900/3827] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:52 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:20:53.264118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:53.265116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:53.280624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:53.284588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:53.291091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:53.292488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:53.293344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:53.294047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:53.355900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:53.366118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:53.374596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:53.378363 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fbbc6cc4-69e8-4791-ae8e-00c808190c1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1795 microversion: 2.20 time: 0.561571 Oct 22 03:20:53.378505 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1928/3828] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:20:52 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1795 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:20:53.431448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:53.456404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-26001a23-a043-4f28-87df-8505d06ebcbe tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1270 microversion: 2.1 time: 0.200890 Oct 22 03:20:53.457696 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1901/3829] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:53 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:53.699009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:53.699751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:53.710943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:53.711807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:53.725092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:53.726276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:53.727282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:53.728854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:53.983191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:54.038066 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd1b4a9d-159b-4e1c-aba9-a04a4d58088a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.343512 Oct 22 03:20:54.047964 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1929/3830] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:53 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:54.277293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:54.278117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:54.293820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:54.294545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:54.295147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:54.297492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:54.320376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:54.324321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:54.485071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:54.486640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:54.495042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:54.496370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:54.496931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:54.497951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:54.500574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:54.502812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:54.505740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:54.518519 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b9f189ee-052d-4c63-96cf-ca3253f61743 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1271 microversion: 2.1 time: 0.248060 Oct 22 03:20:54.522447 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1902/3831] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:54 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:54.639903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:54.658410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b973538d-76b0-46c3-8d08-784c7be07db3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1270 microversion: 2.1 time: 0.177294 Oct 22 03:20:54.660580 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1930/3832] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:54 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:20:55.083528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:55.084855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:55.095704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:55.096225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:55.096675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:55.097398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:55.104954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:55.105419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:55.553071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:55.554349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:55.585004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:55.586190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:55.587041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:55.588827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:55.589791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:55.593392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:55.787060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:55.796690 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bf8d1854-f71c-4369-bc70-00b06b82594e tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.728344 Oct 22 03:20:55.802721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1903/3833] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:55 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:55.818941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:55.820075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:55.828908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:55.831363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:55.832009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:55.834873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:55.835568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:55.836329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:56.028072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:56.040498 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6460b336-3572-4afc-981a-02e95a590c7e tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1313 microversion: 2.1 time: 0.497507 Oct 22 03:20:56.041659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1931/3834] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:55 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:56.213293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:56.227555 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f0cd75f6-c34b-4b3c-abbe-f286856e5bb4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1312 microversion: 2.1 time: 0.420556 Oct 22 03:20:56.251052 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1904/3835] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:55 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1312 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:56.827622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:56.828923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:56.841320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:56.841816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:56.842260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:56.842982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:56.843471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:56.844537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:57.067934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:57.069190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:57.088437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:57.088940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:57.089383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:57.090097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:57.090741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:57.091325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:57.161772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:57.174808 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b1f412ef-bdb6-4031-9762-e2296cfaa118 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.350967 Oct 22 03:20:57.177091 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1932/3836] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:56 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:57.235885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2353b56d-546b-4da8-9e6b-c292f4fed30b req-2db9d702-6454-49a0-b9ee-21b8f536924d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8218b5-e3af-4112-b85f-c254ac41824b", "tag": "b0c311d0-f384-4188-96df-c9d88b00a97d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:57.250815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2353b56d-546b-4da8-9e6b-c292f4fed30b req-2db9d702-6454-49a0-b9ee-21b8f536924d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:57.251585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2353b56d-546b-4da8-9e6b-c292f4fed30b req-2db9d702-6454-49a0-b9ee-21b8f536924d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:57.252114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2353b56d-546b-4da8-9e6b-c292f4fed30b req-2db9d702-6454-49a0-b9ee-21b8f536924d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:57.271843 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2353b56d-546b-4da8-9e6b-c292f4fed30b req-2db9d702-6454-49a0-b9ee-21b8f536924d service nova] Creating event network-changed:b0c311d0-f384-4188-96df-c9d88b00a97d for instance ae8218b5-e3af-4112-b85f-c254ac41824b on n-h1-862416-2 Oct 22 03:20:57.283141 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2353b56d-546b-4da8-9e6b-c292f4fed30b req-2db9d702-6454-49a0-b9ee-21b8f536924d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052215 Oct 22 03:20:57.283940 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1933/3837] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:20:57.295270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:57.296908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:57.306983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:57.307881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:57.308623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:57.309586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:57.310267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:57.310934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:57.532425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:57.560586 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-45ac2142-2d3a-4e14-9b00-d95861612d59 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1313 microversion: 2.1 time: 0.494982 Oct 22 03:20:57.568377 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1905/3838] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:57 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:57.734306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:57.743790 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a73c48e-c7eb-49fb-8c26-ed0db1b6bb62 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1333 microversion: 2.1 time: 0.458349 Oct 22 03:20:57.744537 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1934/3839] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:57 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1333 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:58.204226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:58.204919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:58.211663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:58.212287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:58.212618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:58.213330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:58.213785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:58.214211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:58.364244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1440945715", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:20:58.461555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] validate_networks() for [('15708bca-6225-42cd-bc0d-033c10bb7198', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:20:58.577558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:58.590400 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-690b6d80-ca4b-40b2-a8c3-df1c483a68ce tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.389856 Oct 22 03:20:58.591342 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1906/3840] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:58 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:58.597810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:58.604690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:58.623920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:58.624544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:58.625213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:58.626108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:58.626734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:58.627341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:58.739151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:59.182551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:20:59.197763 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-78bde4f8-df3b-46b1-babd-4a331a628292 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1313 microversion: 2.1 time: 0.603695 Oct 22 03:20:59.201968 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1907/3841] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:58 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:20:59.217449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:59.218142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:59.237866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:59.241633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:59.242211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:59.246887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:59.247487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:59.248191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:59.313395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=28 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:20:59.598938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:20:59.600241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:20:59.600926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:20:59.603381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:20:59.606548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:20:59.621850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:59.625818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:59.626569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:59.627902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:59.628893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:59.629697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:59.663221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Getting quotas for project d98cea0b45fe423ea345888fe03ad61f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:20:59.671774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Getting quotas for user 2bfdbcbd066b4e6589f216a9c8bb685c and project d98cea0b45fe423ea345888fe03ad61f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:20:59.717332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:20:59.724280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:20:59.830066 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e41ddabf-543a-46d5-918f-612f2360feac tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.545586 Oct 22 03:20:59.839954 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1935/3842] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:20:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:20:59.846662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:20:59.847678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:20:59.880267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:59.882786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:59.883491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:20:59.885929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:20:59.886799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:20:59.887649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:00.062912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:00.074237 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-528f226e-0bad-4fca-baf0-315f2fc4f713 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.869255 Oct 22 03:21:00.081362 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1908/3843] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:59 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:00.087313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2fac64a-65c5-4813-b671-61769a5aa150 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:00.095009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2fac64a-65c5-4813-b671-61769a5aa150 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:00.282845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:00.306940 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f803cb17-aec2-4296-913a-ac749f33d387 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.464609 Oct 22 03:21:00.308148 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1936/3844] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:20:59 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:00.329238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:00.332351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:00.338001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d2fac64a-65c5-4813-b671-61769a5aa150 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:00.346140 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2fac64a-65c5-4813-b671-61769a5aa150 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1214 microversion: 2.1 time: 0.263381 Oct 22 03:21:00.346730 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1909/3845] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:00 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:00.355915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:00.356489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:00.362054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:00.368879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:00.374667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:00.375151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:00.926025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:00.946488 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9ddc3265-95af-4be6-9242-5c28a35116c4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1313 microversion: 2.1 time: 0.635854 Oct 22 03:21:00.949286 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1937/3846] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:00 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:01.102960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:01.103902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:01.111287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:01.111782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:01.112240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:01.114734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:01.116381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:01.122490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:01.281293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5e124c8d-e03e-4916-94e1-addacce885ed req-2739ac5c-e1b0-4b89-99f1-be500dc7ca59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "tag": "4abd0e7d-03e3-43f2-9a31-4b95708ad88a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:01.296180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5e124c8d-e03e-4916-94e1-addacce885ed req-2739ac5c-e1b0-4b89-99f1-be500dc7ca59 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:01.297048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5e124c8d-e03e-4916-94e1-addacce885ed req-2739ac5c-e1b0-4b89-99f1-be500dc7ca59 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:01.297698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5e124c8d-e03e-4916-94e1-addacce885ed req-2739ac5c-e1b0-4b89-99f1-be500dc7ca59 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:01.342513 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5e124c8d-e03e-4916-94e1-addacce885ed req-2739ac5c-e1b0-4b89-99f1-be500dc7ca59 service nova] Creating event network-changed:4abd0e7d-03e3-43f2-9a31-4b95708ad88a for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:01.380728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5e124c8d-e03e-4916-94e1-addacce885ed req-2739ac5c-e1b0-4b89-99f1-be500dc7ca59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081698 Oct 22 03:21:01.388658 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1938/3847] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 22 03:21:01.396577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:01.403636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:01.421731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:01.422811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:01.423662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:01.425127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:01.425874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:01.426564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:01.715950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:01.728574 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d64eb54-ac83-41d8-99ec-357d1080b662 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.627756 Oct 22 03:21:01.731707 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1910/3848] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:01 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:01.741578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:01.742244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:01.760200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:01.760865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:01.761322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:01.762060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:01.762525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:01.762961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:01.882277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:01.892591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a95d26f-0c31-456c-b201-742e2be1555f tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1266 microversion: 2.1 time: 0.157990 Oct 22 03:21:01.898914 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1911/3849] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:01 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:01.971539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:01.972644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:01.988694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:01.989256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:01.999817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:02.000898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:02.001554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:02.002310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:02.109109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:02.122798 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d00920fc-7030-44f3-8816-1cbb3f81e5dc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1511 microversion: 2.1 time: 0.731607 Oct 22 03:21:02.124156 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1939/3850] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:01 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1511 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:02.462474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1076126268", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "178e8faa-2a03-49c1-af73-691fcdcd97b7"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:02.474917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:02.488858 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6dc99134-9781-4470-b138-3d56495fe866 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1313 microversion: 2.1 time: 0.521410 Oct 22 03:21:02.489460 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1912/3851] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:01 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:02.535429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:02.536057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:02.539879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:02.555612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:02.556110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:02.556579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:02.557305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:02.557767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:02.558208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:02.593433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] validate_networks() for [('178e8faa-2a03-49c1-af73-691fcdcd97b7', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:21:02.855445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:02.865615 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-729bbfc3-cb6c-436a-95c5-c7c386e8b328 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.355074 Oct 22 03:21:02.880514 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1913/3852] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:02 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:02.880514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:02.880514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:02.897603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:02.898669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:02.899353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:02.900353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:02.901057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:02.901737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.200585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:03.209910 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c445fee1-cf19-4c95-ad7f-775cc94b3ad5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.342641 Oct 22 03:21:03.211300 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1914/3853] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:02 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:03.217192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-18807a47-c3aa-4466-acd9-f122f5104a95 req-624e82fb-37c2-48e8-84f8-11b5e1a7dcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8218b5-e3af-4112-b85f-c254ac41824b", "name": "network-vif-plugged", "status": "completed", "tag": "b0c311d0-f384-4188-96df-c9d88b00a97d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:03.230501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-18807a47-c3aa-4466-acd9-f122f5104a95 req-624e82fb-37c2-48e8-84f8-11b5e1a7dcf1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.231377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-18807a47-c3aa-4466-acd9-f122f5104a95 req-624e82fb-37c2-48e8-84f8-11b5e1a7dcf1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.232793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-18807a47-c3aa-4466-acd9-f122f5104a95 req-624e82fb-37c2-48e8-84f8-11b5e1a7dcf1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.248113 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-18807a47-c3aa-4466-acd9-f122f5104a95 req-624e82fb-37c2-48e8-84f8-11b5e1a7dcf1 service nova] Creating event network-vif-plugged:b0c311d0-f384-4188-96df-c9d88b00a97d for instance ae8218b5-e3af-4112-b85f-c254ac41824b on n-h1-862416-2 Oct 22 03:21:03.257103 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-18807a47-c3aa-4466-acd9-f122f5104a95 req-624e82fb-37c2-48e8-84f8-11b5e1a7dcf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043955 Oct 22 03:21:03.259910 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1915/3854] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:03.275100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:03.276440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:03.284473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.285365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.297492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.300709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.301670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.303527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.603289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:03.611524 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-497a4a8a-5d5c-4f3e-970e-691f4ffa553a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.347401 Oct 22 03:21:03.612691 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1916/3855] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:03 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:03.617911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:03.618805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:03.625103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.625880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.626580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.627518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.628261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.629288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.815755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:21:03.816994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:21:03.817727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:21:03.818771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:21:03.819437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:21:03.837599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.838392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.839408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.840949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.841424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.841866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.869650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Getting quotas for project 171482f425ce4686888d634676bdf56d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:21:03.876366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Getting quotas for user dbb3149b34fa48dfa17945ba603a09da and project 171482f425ce4686888d634676bdf56d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:21:03.893952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:21:03.899416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:03.910651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:21:03.912372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d58300a3-5259-4134-b477-96448281a3b1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1314 microversion: 2.1 time: 0.298236 Oct 22 03:21:03.913006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1917/3856] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:03 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:03.929255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:03.930861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:03.943600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.946216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.948956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.951641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:03.953201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:03.953858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:03.993811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:04.049425 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f454b9b-3ed4-4754-a4e1-c09e381d14d0 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.705825 Oct 22 03:21:04.056732 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1940/3857] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 22 03:21:04.056732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:04.057503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:04.061096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:04.066657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.067316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.067854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.068739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.069450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.069974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.236065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:04.247281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6482f996-d708-405a-99f9-b25303c58d04 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1488 microversion: 2.1 time: 0.329405 Oct 22 03:21:04.261800 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1918/3858] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:03 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1488 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:04.273066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-35c5e964-9c93-4979-86d3-7d32bc8315b8 req-ca415e65-6332-46ed-baf4-e0529253c2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "tag": "fb6e20d7-2629-4c40-ba1b-49d5a11fc5fb"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:04.285828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35c5e964-9c93-4979-86d3-7d32bc8315b8 req-ca415e65-6332-46ed-baf4-e0529253c2f0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.286411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35c5e964-9c93-4979-86d3-7d32bc8315b8 req-ca415e65-6332-46ed-baf4-e0529253c2f0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.286951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35c5e964-9c93-4979-86d3-7d32bc8315b8 req-ca415e65-6332-46ed-baf4-e0529253c2f0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.302623 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-35c5e964-9c93-4979-86d3-7d32bc8315b8 req-ca415e65-6332-46ed-baf4-e0529253c2f0 service nova] Creating event network-changed:fb6e20d7-2629-4c40-ba1b-49d5a11fc5fb for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:04.309237 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-35c5e964-9c93-4979-86d3-7d32bc8315b8 req-ca415e65-6332-46ed-baf4-e0529253c2f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045866 Oct 22 03:21:04.310356 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1919/3859] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:04.326948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:04.328534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:04.336456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.341822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.343047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.344050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.344663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.345271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.571041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:04.590261 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca951808-a578-4955-9c09-5cef7075fd7a tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1313 microversion: 2.1 time: 0.538537 Oct 22 03:21:04.592541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1941/3860] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:04 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:04.598604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c1b2af45-d9d7-4eb0-8f08-2dbd3a30b272 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:04.599200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c1b2af45-d9d7-4eb0-8f08-2dbd3a30b272 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:04.656410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:04.669670 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ecb2bf2-c4e5-4538-97d9-7ad753384330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.357776 Oct 22 03:21:04.671492 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1920/3861] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:04 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:04.682364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:04.683897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:04.700612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.707361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.708223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.709313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.709900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.710585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.738112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c1b2af45-d9d7-4eb0-8f08-2dbd3a30b272 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:04.748061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c1b2af45-d9d7-4eb0-8f08-2dbd3a30b272 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:04.756465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c1b2af45-d9d7-4eb0-8f08-2dbd3a30b272 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:04.775322 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c1b2af45-d9d7-4eb0-8f08-2dbd3a30b272 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1259 microversion: 2.21 time: 0.166190 Oct 22 03:21:04.777299 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1942/3862] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:04 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:04.803444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:04.807972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:04.830399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.831258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.831776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.833646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:04.834791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:04.838924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:04.916667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:21:04.974033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:05.076892 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0a712305-d605-40b4-9e59-eeb9419decb9 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 204 len: 0 microversion: 2.1 time: 0.297323 Oct 22 03:21:05.078725 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1943/3863] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:04 2022] DELETE /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:21:05.087523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-407134709"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:05.092663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:05.102197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.102897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.104112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.105045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.105975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.106127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.160500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:05.175270 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-983109b2-275d-4978-b840-8ca01d7f09eb tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.499656 Oct 22 03:21:05.192233 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1921/3864] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:04 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:05.192233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:05.192233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:05.203925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.204457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.204907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.205616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.206070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.206944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.419372 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e7a6754-930e-4de6-b944-588d1f4b7bf2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.339056 Oct 22 03:21:05.420114 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1944/3865] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:21:05 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 22 03:21:05.433872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:05.434821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:05.467546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.475788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.476682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.481369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.482354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.483020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.510076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:05.524575 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be13fd6a-a6ce-4fbc-a749-98b940491129 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1314 microversion: 2.1 time: 0.344654 Oct 22 03:21:05.545394 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1922/3866] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:05 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:05.550754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a2707f86-3ab3-4d5b-ad41-f0ef2ae3893f req-64781e9e-f61c-418d-a151-f3af0d66db10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbf3baa-77ae-48d3-83ea-2727e3b72219", "tag": "88bf9269-36c5-4aea-8d89-252e85ba4c85"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:05.566121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a2707f86-3ab3-4d5b-ad41-f0ef2ae3893f req-64781e9e-f61c-418d-a151-f3af0d66db10 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.567405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a2707f86-3ab3-4d5b-ad41-f0ef2ae3893f req-64781e9e-f61c-418d-a151-f3af0d66db10 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.568113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a2707f86-3ab3-4d5b-ad41-f0ef2ae3893f req-64781e9e-f61c-418d-a151-f3af0d66db10 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.587290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a2707f86-3ab3-4d5b-ad41-f0ef2ae3893f req-64781e9e-f61c-418d-a151-f3af0d66db10 service nova] Creating event network-changed:88bf9269-36c5-4aea-8d89-252e85ba4c85 for instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 on n-h1-862416-2 Oct 22 03:21:05.594085 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a2707f86-3ab3-4d5b-ad41-f0ef2ae3893f req-64781e9e-f61c-418d-a151-f3af0d66db10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046794 Oct 22 03:21:05.595382 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1923/3867] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:05.620500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:05.621495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:05.630088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.630711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.631156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.631931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.632338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.633315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.694584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:05.714609 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e26c489c-b578-4934-bc1b-45faf75db130 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1494 microversion: 2.1 time: 0.293019 Oct 22 03:21:05.715615 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1945/3868] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:05 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1494 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:05.808450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:05.809098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:05.817268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.817948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.819004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.820980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:05.821788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:05.822296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:05.905499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:05.915984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:05.918220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:05.919543 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b928cfac-be64-4b09-9795-890b9f68cc52 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1311 microversion: 2.21 time: 0.116622 Oct 22 03:21:05.920588 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1946/3869] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:05 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:21:05.951622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:05.959873 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c614235e-0690-44be-b0b4-50219edcc4e1 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1462 microversion: 2.1 time: 0.344879 Oct 22 03:21:05.960507 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1924/3870] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:05 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1462 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:06.120558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-734747b9-347a-45d2-8621-1f91f8bcd9e5 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Calling method '.version_select at 0x7f0d1971a790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:06.141924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-734747b9-347a-45d2-8621-1f91f8bcd9e5 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.142648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-734747b9-347a-45d2-8621-1f91f8bcd9e5 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.143181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-734747b9-347a-45d2-8621-1f91f8bcd9e5 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.171946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-734747b9-347a-45d2-8621-1f91f8bcd9e5 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.172676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-734747b9-347a-45d2-8621-1f91f8bcd9e5 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.174173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-734747b9-347a-45d2-8621-1f91f8bcd9e5 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.205863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:06.207257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:06.212008 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-734747b9-347a-45d2-8621-1f91f8bcd9e5 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/68722b7d4c83464ab08c61616a71b3e2?start=2022-10-21T03%3A21%3A05.983220&end=2022-10-23T03%3A21%3A05.983220" status: 200 len: 694 microversion: 2.1 time: 0.224235 Oct 22 03:21:06.219237 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1947/3871] 10.222.0.25 () {58 vars in 1412 bytes} [Sat Oct 22 03:21:05 2022] GET /compute/v2.1/os-simple-tenant-usage/68722b7d4c83464ab08c61616a71b3e2?start=2022-10-21T03%3A21%3A05.983220&end=2022-10-23T03%3A21%3A05.983220 => generated 694 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:06.222572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.223073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.225764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.226581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.227058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.227495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.230560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-790cc1a2-3056-4f52-a19f-94aeb07c9288 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '.version_select at 0x7f0d194cff70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:06.250464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-790cc1a2-3056-4f52-a19f-94aeb07c9288 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.251092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-790cc1a2-3056-4f52-a19f-94aeb07c9288 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.251611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-790cc1a2-3056-4f52-a19f-94aeb07c9288 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.263571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-790cc1a2-3056-4f52-a19f-94aeb07c9288 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.264071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-790cc1a2-3056-4f52-a19f-94aeb07c9288 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.264621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-790cc1a2-3056-4f52-a19f-94aeb07c9288 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.277979 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-790cc1a2-3056-4f52-a19f-94aeb07c9288 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/68722b7d4c83464ab08c61616a71b3e2?start=2022-10-21T03%3A21%3A05.983220&end=2022-10-23T03%3A21%3A05.983220" status: 200 len: 694 microversion: 2.1 time: 0.051221 Oct 22 03:21:06.280419 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1948/3872] 10.222.0.25 () {58 vars in 1412 bytes} [Sat Oct 22 03:21:06 2022] GET /compute/v2.1/os-simple-tenant-usage/68722b7d4c83464ab08c61616a71b3e2?start=2022-10-21T03%3A21%3A05.983220&end=2022-10-23T03%3A21%3A05.983220 => generated 694 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:06.294473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6df3a614-db64-406f-8ed6-93d8eeb431a4 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Calling method '.version_select at 0x7f0d195138b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:06.315878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df3a614-db64-406f-8ed6-93d8eeb431a4 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.316410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df3a614-db64-406f-8ed6-93d8eeb431a4 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.316855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df3a614-db64-406f-8ed6-93d8eeb431a4 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.335225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df3a614-db64-406f-8ed6-93d8eeb431a4 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.335726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df3a614-db64-406f-8ed6-93d8eeb431a4 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.336742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df3a614-db64-406f-8ed6-93d8eeb431a4 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.435557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:06.443242 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27b20761-68ce-4a32-8332-933281595f3b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.243525 Oct 22 03:21:06.454742 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1925/3873] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:06 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:06.460181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-54ba39a4-6df0-42c2-a241-d0f031fbaa13 req-1092b88c-d9db-48f0-9918-2a5c7a9e9e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "tag": "8aa25744-3009-48ef-938a-4ba8aad5b5e3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:06.472851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-54ba39a4-6df0-42c2-a241-d0f031fbaa13 req-1092b88c-d9db-48f0-9918-2a5c7a9e9e5e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.473869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-54ba39a4-6df0-42c2-a241-d0f031fbaa13 req-1092b88c-d9db-48f0-9918-2a5c7a9e9e5e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.479375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-54ba39a4-6df0-42c2-a241-d0f031fbaa13 req-1092b88c-d9db-48f0-9918-2a5c7a9e9e5e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.493653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-54ba39a4-6df0-42c2-a241-d0f031fbaa13 req-1092b88c-d9db-48f0-9918-2a5c7a9e9e5e service nova] Creating event network-changed:8aa25744-3009-48ef-938a-4ba8aad5b5e3 for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:06.498854 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-54ba39a4-6df0-42c2-a241-d0f031fbaa13 req-1092b88c-d9db-48f0-9918-2a5c7a9e9e5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042287 Oct 22 03:21:06.499751 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1926/3874] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:06.522591 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6df3a614-db64-406f-8ed6-93d8eeb431a4 tempest-TenantUsagesTestJSON-1798636849 tempest-TenantUsagesTestJSON-1798636849-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T03%3A21%3A05.983220&end=2022-10-23T03%3A21%3A05.983220&detailed=1" status: 200 len: 40608 microversion: 2.1 time: 0.232199 Oct 22 03:21:06.523232 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1949/3875] 10.222.0.25 () {58 vars in 1335 bytes} [Sat Oct 22 03:21:06 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-21T03%3A21%3A05.983220&end=2022-10-23T03%3A21%3A05.983220&detailed=1 => generated 40608 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:06.553634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:06.554348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:06.560967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.561767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.562211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.563151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.563613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.564047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.573835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:06.574344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:06.581615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.582359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.582604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.583529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.584018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.584499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.619832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:21:06.744309 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9917deac-9781-4852-bb5d-28278b250edb tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 204 len: 0 microversion: 2.1 time: 0.174061 Oct 22 03:21:06.745110 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1950/3876] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:06 2022] DELETE /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:21:06.754452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:06.756077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:06.764943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.765633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.766256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.767199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.767881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.768343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.855005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:06.884976 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77843ac9-fd45-44e5-97f0-955559038fdd tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1314 microversion: 2.1 time: 0.335877 Oct 22 03:21:06.904914 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1927/3877] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:06 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:06.921012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:06.921891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:06.928852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.929605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.930093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:06.935023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:06.935173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:06.935601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:07.180544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:07.208675 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fd5c1f01-2c15-463d-a384-a3d2a954dfa7 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1494 microversion: 2.1 time: 0.456568 Oct 22 03:21:07.209686 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1951/3878] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:06 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1494 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:07.215689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:07.216149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:07.222460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:07.222953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:07.223394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:07.224103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:07.225208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:07.225208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:07.341883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:07.352813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:07.354348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:07.355506 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44576cf0-616b-4e8a-bb66-6bf83b21e67f tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1317 microversion: 2.21 time: 0.144819 Oct 22 03:21:07.356096 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1952/3879] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:07 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:07.483920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:07.489120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:07.505410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:07.509289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:07.510756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:07.510756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:07.510756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:07.511040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:07.514069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:07.519885 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9bcba387-0fa9-488d-a76b-63f497c1479f tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1468 microversion: 2.1 time: 0.609897 Oct 22 03:21:07.532919 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1928/3880] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:06 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1468 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:07.919111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:07.920195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:07.933882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:07.942212 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-146ded55-9483-401a-9a7e-2b59e77c4770 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.479652 Oct 22 03:21:07.944789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:07.946362 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1953/3881] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:07 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:07.948503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:07.949149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:07.952978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:07.954795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:07.961731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.237321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:08.237943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:08.246906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.247776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:08.248659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.249459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.250354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.250977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.260366 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fc67347e-e5b1-4dc0-bf20-06ac209ee84b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1314 microversion: 2.1 time: 0.351566 Oct 22 03:21:08.276361 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1929/3882] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:07 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:08.278491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.326953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.327513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.327960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.328667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lazy-loading 'fault' on Instance uuid 2e4dc0ad-7879-4fd2-8464-46da72e85755 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:21:08.388142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:08.389330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:08.400001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:08.400478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.401491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.402156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.403151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.404851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.405554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.415638 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f08d3ce9-dc3b-4356-afc2-0640ff8795a2 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 200 len: 1305 microversion: 2.1 time: 0.182481 Oct 22 03:21:08.425722 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1954/3883] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:08 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 1305 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:08.521653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-187e7be5-92d3-419d-ac4d-1b11b862fb04 req-fefee760-59b3-4244-96b5-034b223c861a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4dc0ad-7879-4fd2-8464-46da72e85755", "name": "network-vif-deleted", "tag": "a55eee90-06c2-45fc-98cd-3cc3996f91b1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:08.534060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-187e7be5-92d3-419d-ac4d-1b11b862fb04 req-fefee760-59b3-4244-96b5-034b223c861a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.534561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-187e7be5-92d3-419d-ac4d-1b11b862fb04 req-fefee760-59b3-4244-96b5-034b223c861a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.534999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-187e7be5-92d3-419d-ac4d-1b11b862fb04 req-fefee760-59b3-4244-96b5-034b223c861a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.552502 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-187e7be5-92d3-419d-ac4d-1b11b862fb04 req-fefee760-59b3-4244-96b5-034b223c861a service nova] Creating event network-vif-deleted:a55eee90-06c2-45fc-98cd-3cc3996f91b1 for instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 on n-h2-862416-2 Oct 22 03:21:08.559237 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-187e7be5-92d3-419d-ac4d-1b11b862fb04 req-fefee760-59b3-4244-96b5-034b223c861a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043329 Oct 22 03:21:08.562008 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1955/3884] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:08.569845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:08.571373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:08.578465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.579773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.580594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.581428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.582159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.582700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.800431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:08.814766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:08.816301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:08.820732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4a6795b5-7087-48ac-a78d-c25afc8ef8b2 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.440371 Oct 22 03:21:08.821375 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1930/3885] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:08 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:21:08.841262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:08.850670 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5dd2fe4e-a24e-4ac5-b717-f85c968a6b12 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1468 microversion: 2.1 time: 0.285137 Oct 22 03:21:08.852056 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1956/3886] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:08 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1468 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:08.970931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:08.971860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:08.979725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.980350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.980906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:08.981618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:08.982470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:08.982904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:09.284358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:09.285223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:09.291627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:09.292243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:09.292908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:09.293611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:09.294246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:09.294681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:09.383077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:09.391289 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-381a3c63-953a-4515-bc4e-18524aecccda tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.425300 Oct 22 03:21:09.391883 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1931/3887] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:08 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:09.434590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:09.443756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:09.444430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:09.453398 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc2cfb40-efb5-4e4b-b5bb-4911dcf14530 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1314 microversion: 2.1 time: 0.172971 Oct 22 03:21:09.457985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:09.458471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:09.458936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:09.459697 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1957/3888] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:09 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:09.460465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:09.461576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:09.462182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:09.481292 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 HTTP/1.1 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '2e4dc0ad-7879-4fd2-8464-46da72e85755'} Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:09.483286 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1becb08-bd45-461c-b91e-da3f8beacbbc tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 404 len: 111 microversion: 2.1 time: 0.046359 Oct 22 03:21:09.489284 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1932/3889] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:09 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:21:09.612941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-254689330", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "636a4e0f-2dc3-4c83-88d5-b5568cafac2d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:09.677517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] validate_networks() for [('636a4e0f-2dc3-4c83-88d5-b5568cafac2d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:21:09.849377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:09.850752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:09.859045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:09.859435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:09.860679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:09.861106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:09.861574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:09.862009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.225303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:10.246912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:10.248719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:10.251306 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4358fe47-04b6-4fe3-b86f-1417a052bd36 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.405969 Oct 22 03:21:10.270810 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1933/3890] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:09 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:10.276185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:10.277053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:10.283085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.283798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.284455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.285399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.286110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.286761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.343091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:10.362987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa8f9e5f2514418a73734a048809900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68722b7d4c83464ab08c61616a71b3e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:10.374283 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fc2c3aae-6d6f-4929-9b48-74c78f94d5fc tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 200 len: 1298 microversion: 2.1 time: 0.101605 Oct 22 03:21:10.375132 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1934/3891] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:10 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:10.380341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-470084c1-b514-4ac1-8a5b-2e0d81f59007 req-aaf30af2-cf29-457c-8317-c1504913c155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce28cd56-c8bb-498a-90a9-a6a63145188b", "tag": "8c157433-227e-4e41-9206-a96124de2237"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:10.389718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-470084c1-b514-4ac1-8a5b-2e0d81f59007 req-aaf30af2-cf29-457c-8317-c1504913c155 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.390421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-470084c1-b514-4ac1-8a5b-2e0d81f59007 req-aaf30af2-cf29-457c-8317-c1504913c155 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.391044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-470084c1-b514-4ac1-8a5b-2e0d81f59007 req-aaf30af2-cf29-457c-8317-c1504913c155 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.404675 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-470084c1-b514-4ac1-8a5b-2e0d81f59007 req-aaf30af2-cf29-457c-8317-c1504913c155 service nova] Creating event network-changed:8c157433-227e-4e41-9206-a96124de2237 for instance ce28cd56-c8bb-498a-90a9-a6a63145188b on n-h2-862416-2 Oct 22 03:21:10.411040 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-470084c1-b514-4ac1-8a5b-2e0d81f59007 req-aaf30af2-cf29-457c-8317-c1504913c155 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034372 Oct 22 03:21:10.411690 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1935/3892] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:10.417443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:10.418213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:10.425186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.425744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.427052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.427769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.428242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.428874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.455384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:21:10.455946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:21:10.456412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:21:10.457126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:21:10.457552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:21:10.465738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=39 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:10.478470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.478971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.479413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.480152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.480694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.481125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.490591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=21 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:10.503498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:21:10.512894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Getting quotas for user 7bd4c44f32a04da48b34c9c888f36fa6 and project 27587c6206d249979148d0bb2a832036. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:21:10.534942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:21:10.537597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:21:10.597902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:10.618918 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-728c4e9c-6921-4b30-a01f-57d03285f49f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013761 Oct 22 03:21:10.620396 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1958/3893] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:21:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:21:10.623500 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-693c1e7d-95d3-463e-91e7-72b7b75a7ecc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.208896 Oct 22 03:21:10.625961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:10.626145 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1936/3894] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:10 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:10.627063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:10.635842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-adffedf8-a0a0-4e3b-b9ef-116e83e364e4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:10.636879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-adffedf8-a0a0-4e3b-b9ef-116e83e364e4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:10.637541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.638209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.638720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.639499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:10.640030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:10.640651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:10.701322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-adffedf8-a0a0-4e3b-b9ef-116e83e364e4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:10.709981 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-adffedf8-a0a0-4e3b-b9ef-116e83e364e4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1214 microversion: 2.1 time: 0.081893 Oct 22 03:21:10.710810 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1937/3895] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:10 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:10.787931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:10.793103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:10.807305 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3409cb41-638d-4cfc-a842-23fe6732a0c9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1314 microversion: 2.1 time: 0.181073 Oct 22 03:21:10.808139 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1959/3896] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:10 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:11.001129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-cd73f653-abf0-4310-8a9c-679b727795d6 req-e0500416-5ff7-4c4d-953c-da70f2ba8e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbf3baa-77ae-48d3-83ea-2727e3b72219", "name": "network-vif-plugged", "status": "completed", "tag": "88bf9269-36c5-4aea-8d89-252e85ba4c85"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:11.012938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cd73f653-abf0-4310-8a9c-679b727795d6 req-e0500416-5ff7-4c4d-953c-da70f2ba8e49 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.013690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cd73f653-abf0-4310-8a9c-679b727795d6 req-e0500416-5ff7-4c4d-953c-da70f2ba8e49 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.014934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cd73f653-abf0-4310-8a9c-679b727795d6 req-e0500416-5ff7-4c4d-953c-da70f2ba8e49 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.030789 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-cd73f653-abf0-4310-8a9c-679b727795d6 req-e0500416-5ff7-4c4d-953c-da70f2ba8e49 service nova] Creating event network-vif-plugged:88bf9269-36c5-4aea-8d89-252e85ba4c85 for instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 on n-h1-862416-2 Oct 22 03:21:11.037516 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-cd73f653-abf0-4310-8a9c-679b727795d6 req-e0500416-5ff7-4c4d-953c-da70f2ba8e49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040656 Oct 22 03:21:11.038734 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1938/3897] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:11.281707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:11.282440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:11.296475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.297360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.306891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.308486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.309077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.309785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.398203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:11.399416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] [instance: ae8218b5-e3af-4112-b85f-c254ac41824b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:11.411638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.413313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.414921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.417333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.418433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.419127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.458669 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] HTTP exception thrown: Instance ae8218b5-e3af-4112-b85f-c254ac41824b could not be found. Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Request method failure captured: Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b HTTP/1.1 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2GOGCODsG9xeKnAk9qWHC8aZICfpc7KiJ8YvV6ctXCb_CdBxPbxD2wDUU8to10WxTdBb5QNNRV20i8ntYQVzL01xHYfVNXcfvDRz8s4O9Yd2YObLX2B9crO7gENhBpIJVkYmYezEJXJwKQy7uy1eaFagZ-Lus222B5E4enQLcmodOI Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 68722b7d4c83464ab08c61616a71b3e2 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TenantUsagesTestJSON-767924381 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_68722b7d4c83464ab08c61616a71b3e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/68722b7d4c83464ab08c61616a71b3e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/68722b7d4c83464ab08c61616a71b3e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/68722b7d4c83464ab08c61616a71b3e2"}]}] Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TenantUsagesTestJSON-767924381 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 68722b7d4c83464ab08c61616a71b3e2 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TenantUsagesTestJSON-767924381 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TenantUsagesTestJSON-767924381-project Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 6aa8f9e5f2514418a73734a048809900 Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TenantUsagesTestJSON-767924381-project Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ae8218b5-e3af-4112-b85f-c254ac41824b could not be found. Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ae8218b5-e3af-4112-b85f-c254ac41824b'} Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8218b5-e3af-4112-b85f-c254ac41824b could not be found. Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8218b5-e3af-4112-b85f-c254ac41824b could not be found. Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:11.460906 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:11.465569 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:11.465569 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:11.465569 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:11.465569 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:11.465569 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:11.465569 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8218b5-e3af-4112-b85f-c254ac41824b could not be found. Oct 22 03:21:11.465569 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:11.475782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] Returning 404 to user: Instance ae8218b5-e3af-4112-b85f-c254ac41824b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:11.478310 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eeb91ee6-cb8e-4a86-8ea1-6a28425750b4 tempest-TenantUsagesTestJSON-767924381 tempest-TenantUsagesTestJSON-767924381-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b" status: 404 len: 111 microversion: 2.1 time: 0.085113 Oct 22 03:21:11.484056 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1939/3898] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:11 2022] GET /compute/v2.1/servers/ae8218b5-e3af-4112-b85f-c254ac41824b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:11.653690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:11.654615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:11.668743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.670464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.675774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:11.676367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.677018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.677600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.678185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.687337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:11.702013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:11.707471 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d509c27c-845c-4619-a2f5-e73c97a0454c tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.431306 Oct 22 03:21:11.712707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:11.720882 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1960/3899] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:11 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:11.749229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:11.751721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:11.765456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.766596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.769269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.770595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.771236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.771751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.853312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:11.874121 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3a3eb194-5c74-497d-af98-335ff9a89414 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1266 microversion: 2.1 time: 0.135404 Oct 22 03:21:11.881226 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1961/3900] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:11 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:11.886852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:11.887901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:11.905787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.906306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.906747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:11.907518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:11.907977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:11.908435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:12.158029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:12.159513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:12.167887 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-12aa615b-4c0b-4689-bbcc-548069731aaf tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.521760 Oct 22 03:21:12.172526 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93fa3c18-e31b-4215-93b7-8b1bc24c1333 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1314 microversion: 2.1 time: 0.285806 Oct 22 03:21:12.174799 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1962/3901] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:11 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:12.184861 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1940/3902] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:11 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:12.425617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-968c8c60-6a8c-4084-ab98-c8d4d12161f7 req-8a512937-dea8-481e-9970-71d013a905ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8218b5-e3af-4112-b85f-c254ac41824b", "name": "network-vif-deleted", "tag": "b0c311d0-f384-4188-96df-c9d88b00a97d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:12.436827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-968c8c60-6a8c-4084-ab98-c8d4d12161f7 req-8a512937-dea8-481e-9970-71d013a905ee service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:12.437609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-968c8c60-6a8c-4084-ab98-c8d4d12161f7 req-8a512937-dea8-481e-9970-71d013a905ee service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:12.438214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-968c8c60-6a8c-4084-ab98-c8d4d12161f7 req-8a512937-dea8-481e-9970-71d013a905ee service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:12.451751 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-968c8c60-6a8c-4084-ab98-c8d4d12161f7 req-8a512937-dea8-481e-9970-71d013a905ee service nova] Creating event network-vif-deleted:b0c311d0-f384-4188-96df-c9d88b00a97d for instance ae8218b5-e3af-4112-b85f-c254ac41824b on n-h1-862416-2 Oct 22 03:21:12.460072 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-968c8c60-6a8c-4084-ab98-c8d4d12161f7 req-8a512937-dea8-481e-9970-71d013a905ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038203 Oct 22 03:21:12.471376 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1963/3903] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:21:12.734915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:12.736002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:12.753443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:12.755020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:12.755736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:12.756693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:12.759921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:12.760406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:12.903660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:12.905474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:12.922676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:12.923439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:12.924065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:12.924977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:12.926409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:12.929239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:13.045190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:13.061866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec84659b-6da9-4b23-981d-6d952eea87d1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1274 microversion: 2.1 time: 0.164372 Oct 22 03:21:13.074270 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1964/3904] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:12 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:13.121083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:13.137241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:13.139161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:13.140533 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9d73bbd-b2d5-4b5a-b874-91ab52e52e9d tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.411352 Oct 22 03:21:13.141961 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1941/3905] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:12 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:13.199876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:13.200970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:13.216819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:13.221324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:13.235951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:13.242921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:13.245412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:13.246319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:13.249856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:13.251596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:13.252175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:13.253252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:13.254831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:13.257154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:13.260435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:13.262645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:13.571719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:13.594743 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-642240a4-475e-4990-90a7-899c5442b152 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.398371 Oct 22 03:21:13.596592 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1965/3906] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:13 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:13.612344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2f4db94f-ee2b-48dc-aee3-8c78c48d2226 req-224c1f4b-ea43-43cb-8574-bac941691ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "name": "network-vif-plugged", "status": "completed", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:13.650894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f4db94f-ee2b-48dc-aee3-8c78c48d2226 req-224c1f4b-ea43-43cb-8574-bac941691ad9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:13.658200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f4db94f-ee2b-48dc-aee3-8c78c48d2226 req-224c1f4b-ea43-43cb-8574-bac941691ad9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:13.659840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2f4db94f-ee2b-48dc-aee3-8c78c48d2226 req-224c1f4b-ea43-43cb-8574-bac941691ad9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:13.713543 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2f4db94f-ee2b-48dc-aee3-8c78c48d2226 req-224c1f4b-ea43-43cb-8574-bac941691ad9 service nova] Creating event network-vif-plugged:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:21:13.719643 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2f4db94f-ee2b-48dc-aee3-8c78c48d2226 req-224c1f4b-ea43-43cb-8574-bac941691ad9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121133 Oct 22 03:21:13.731052 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1966/3907] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:13.755526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:13.771784 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8517dbee-33ce-4ba4-8eb8-8aeed31c692e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1500 microversion: 2.1 time: 0.565737 Oct 22 03:21:13.772888 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1942/3908] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:13 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1500 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:13.797129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:13.799914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:13.808255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:13.809242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:13.809703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:13.810825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:13.811418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:13.811852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:13.856755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lazy-loading 'flavor' on Instance uuid ddbf3baa-77ae-48d3-83ea-2727e3b72219 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:21:13.978642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-94c56479-1434-48f2-995e-738f04504385 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "POST /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219/action" status: 200 len: 32 microversion: 2.1 time: 0.186762 Oct 22 03:21:13.984569 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1967/3909] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:21:13 2022] POST /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:21:13.989265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:13.989981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:14.001553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:14.002067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:14.002533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:14.003717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:14.006462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:14.008907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:14.089334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:14.090337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:14.100531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:14.103086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:14.104175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:14.105377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:14.107595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:14.108771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:14.189830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:14.198895 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11ea3854-0e86-488d-92da-63af4e266c2a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1272 microversion: 2.1 time: 0.114534 Oct 22 03:21:14.200181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1968/3910] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:14 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:14.204976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:14.205741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:14.223814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:14.228237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:14.228811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:14.229589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:14.230053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:14.230503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:14.518166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:14.529456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:14.530958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:14.532174 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8fb06e64-c912-4bf6-ba3a-d442609d62f4 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.330995 Oct 22 03:21:14.552371 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1969/3911] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:14 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:14.621679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:14.624050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:14.643542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:14.647285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:14.647829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:14.652044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:14.654903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:14.661812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:14.669762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:14.686096 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d9392c3-b06d-4305-8df1-a2990ad6d5f6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.700601 Oct 22 03:21:14.686702 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1943/3912] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:13 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:15.021586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:15.030537 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23c3053b-b80e-4a63-9221-f6ee9ba7cfc6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.415395 Oct 22 03:21:15.031146 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1970/3913] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:14 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:15.225650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:15.226793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:15.237743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:15.242553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:15.243065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:15.244189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:15.248487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:15.249195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:15.566778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:15.567521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:15.574981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:15.575720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:15.576428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:15.577337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:15.578165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:15.579458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:15.700730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:15.716489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f944ca2c-8c48-4bdd-9e1d-c09aa3d8ff9f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1314 microversion: 2.1 time: 0.496189 Oct 22 03:21:15.719311 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1944/3914] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:15 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:15.734432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:15.735453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:15.751217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:15.752244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:15.754188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:15.756479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:15.758419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:15.759356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:16.096324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:16.111710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:16.119085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:16.120728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b362c0a-ca24-4848-bbb7-33614c7fed50 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.558892 Oct 22 03:21:16.121968 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1971/3915] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:15 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:16.130932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:16.134934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:16.152032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:16.155058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:16.156902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:16.158256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:16.158900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:16.161694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:16.489604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:16.503099 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11ee2ddd-16c5-4266-9d2c-6417bf1e46c4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.379704 Oct 22 03:21:16.505920 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1972/3916] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:16 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:16.592666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:16.601803 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f7077f55-bdcb-4cb0-a53f-c764e7d25234 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.881095 Oct 22 03:21:16.608788 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1945/3917] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:15 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:16.747577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:16.748481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:16.761535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:16.762606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:16.763227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:16.764235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:16.765956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:16.766555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:17.151577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:17.152863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:17.165533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:17.166353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:17.176060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:17.177196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:17.178313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:17.179606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:17.267984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:17.317810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b4cff61-a770-4c76-9a92-92e17fc2605d tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1314 microversion: 2.1 time: 0.569176 Oct 22 03:21:17.322836 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1973/3918] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:16 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:17.531465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:17.532338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:17.543246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:17.545346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:17.547530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:17.548475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:17.551738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:17.552428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:17.773768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:17.787021 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0896bb37-e2c4-4853-af91-4b3e7a0bf073 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.259527 Oct 22 03:21:17.787882 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1974/3919] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:17 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:17.793577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:17.794361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:17.802401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:17.803212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:17.803773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:17.805757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:17.806339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:17.806913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:17.870999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:17.901464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:17.904682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:17.911827 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7637fee2-a402-4d17-90eb-129a0b460152 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.765337 Oct 22 03:21:17.916055 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1946/3920] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:17 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:18.029406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:18.037029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:18.049210 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-314bec0c-3d3d-4d67-b8c0-42f1e21acf10 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.260048 Oct 22 03:21:18.068320 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1975/3921] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:17 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:18.074960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f9e36e3c-4020-4f28-ba95-b31e9e8022f4 req-8bfbd702-1743-4424-b0fa-30787e740625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d82aeb-0238-4701-b2d0-7d9bf68dff8f", "tag": "37e648ae-1fef-44f2-8376-4913240cc6d3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:18.092513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f9e36e3c-4020-4f28-ba95-b31e9e8022f4 req-8bfbd702-1743-4424-b0fa-30787e740625 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:18.093026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f9e36e3c-4020-4f28-ba95-b31e9e8022f4 req-8bfbd702-1743-4424-b0fa-30787e740625 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:18.093478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f9e36e3c-4020-4f28-ba95-b31e9e8022f4 req-8bfbd702-1743-4424-b0fa-30787e740625 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:18.122682 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f9e36e3c-4020-4f28-ba95-b31e9e8022f4 req-8bfbd702-1743-4424-b0fa-30787e740625 service nova] Creating event network-changed:37e648ae-1fef-44f2-8376-4913240cc6d3 for instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f on n-h1-862416-2 Oct 22 03:21:18.131947 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f9e36e3c-4020-4f28-ba95-b31e9e8022f4 req-8bfbd702-1743-4424-b0fa-30787e740625 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061800 Oct 22 03:21:18.136388 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1947/3922] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:18.358522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:18.359860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:18.365457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:18.393406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:18.394446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:18.395061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:18.396063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:18.396728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:18.397166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:18.637727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:18.653066 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1622374-5455-4b3b-9e65-bfce9f64a70c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1314 microversion: 2.1 time: 0.306386 Oct 22 03:21:18.654434 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1976/3923] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:18 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:18.816618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:18.822488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:18.839001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:18.840065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:18.840737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:18.841806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:18.842692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:18.844491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:18.939532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:18.940420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:18.949696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:18.950547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:18.952260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:18.953223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:18.953888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:18.954552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:19.200114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:19.201704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:19.218173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:19.220835 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4436037f-1a79-4cf5-9987-e51b9ba629a3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.412621 Oct 22 03:21:19.233493 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1948/3924] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:18 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:19.240350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:19.240350 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f91c8fc9-cd49-41ab-9caf-3c7a7575f3e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.303319 Oct 22 03:21:19.241706 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1977/3925] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:18 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:19.266890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:19.267823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:19.276682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:19.277092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:19.277541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:19.278252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:19.278905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:19.279504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:19.558809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:19.568747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cc533224-3ead-4cdb-83d2-05827d2546bb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.333822 Oct 22 03:21:19.570844 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1949/3926] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:19 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:19.682374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:19.682942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:19.699154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:19.699660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:19.700101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:19.703746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:19.704249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:19.706107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:19.892560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:19.902849 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aed2ea48-b2c4-4cad-96ee-7968b3b497c3 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1314 microversion: 2.1 time: 0.227286 Oct 22 03:21:19.903935 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1978/3927] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:19 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:19.953094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-05f95795-e673-478b-a795-7042f9b4579c req-74a8f6f5-d251-4c7a-a942-956e076696cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "name": "network-vif-plugged", "status": "completed", "tag": "4abd0e7d-03e3-43f2-9a31-4b95708ad88a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:19.975302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-05f95795-e673-478b-a795-7042f9b4579c req-74a8f6f5-d251-4c7a-a942-956e076696cd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:19.977865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-05f95795-e673-478b-a795-7042f9b4579c req-74a8f6f5-d251-4c7a-a942-956e076696cd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:19.979167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-05f95795-e673-478b-a795-7042f9b4579c req-74a8f6f5-d251-4c7a-a942-956e076696cd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:19.997164 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-05f95795-e673-478b-a795-7042f9b4579c req-74a8f6f5-d251-4c7a-a942-956e076696cd service nova] Creating event network-vif-plugged:4abd0e7d-03e3-43f2-9a31-4b95708ad88a for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:20.002821 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-05f95795-e673-478b-a795-7042f9b4579c req-74a8f6f5-d251-4c7a-a942-956e076696cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053215 Oct 22 03:21:20.003641 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1950/3928] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:20.250680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:20.251329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:20.273815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:20.274528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:20.279004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:20.279514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:20.279954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:20.280713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:20.281173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:20.281601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:20.290002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:20.291357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:20.292111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:20.293650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:20.296816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:20.298265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:20.496411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:20.523493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:20.577206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:20.586419 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a5fa542-7bfe-4997-a64c-f23ae3f5aa2e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.340959 Oct 22 03:21:20.587042 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1979/3929] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:20 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:20.609561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:20.609561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:20.617220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:20.617756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:20.618325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:20.619049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:20.620055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:20.620055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:20.705696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:20.871108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:20.884561 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-680bfd34-4d47-422a-895d-3f70b4917364 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.281883 Oct 22 03:21:20.885809 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1980/3930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:20 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:20.929870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:20.930885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:20.951905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:20.953474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:20.954180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:20.955179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:20.963507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:20.964304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:21.174702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:21.184562 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-373d247e-37d1-404c-959c-e8d5f5553544 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1314 microversion: 2.1 time: 0.260308 Oct 22 03:21:21.185534 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1981/3931] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:20 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:21.563450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:21.581976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:21.589469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:21.597646 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-091ec480-22e3-4ff0-8f3f-abd0d343848e tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 1.328667 Oct 22 03:21:21.598532 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1951/3932] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:20 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:21:21.620012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:21.620012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:21.631813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:21.632353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:21.632846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:21.633571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:21.634036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:21.634595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:21.912912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:21.914554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:21.925805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:21.928164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:21.929992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:21.932034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:21.933494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:21.935676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:21.977431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:21.994875 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f1b5cb0-2a25-47ba-9e1e-9b7cc299b448 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.381923 Oct 22 03:21:21.995804 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1982/3933] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:21 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:22.059547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3950c4dd-5c05-475b-93df-7569b0db6b95 req-1c2d8a4f-5ebe-4031-a7b7-cd594a20c68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "name": "network-vif-plugged", "status": "completed", "tag": "fb6e20d7-2629-4c40-ba1b-49d5a11fc5fb"}, {"server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "name": "network-vif-plugged", "status": "completed", "tag": "8aa25744-3009-48ef-938a-4ba8aad5b5e3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:22.108923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3950c4dd-5c05-475b-93df-7569b0db6b95 req-1c2d8a4f-5ebe-4031-a7b7-cd594a20c68a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:22.110057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3950c4dd-5c05-475b-93df-7569b0db6b95 req-1c2d8a4f-5ebe-4031-a7b7-cd594a20c68a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:22.111745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3950c4dd-5c05-475b-93df-7569b0db6b95 req-1c2d8a4f-5ebe-4031-a7b7-cd594a20c68a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:22.140439 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3950c4dd-5c05-475b-93df-7569b0db6b95 req-1c2d8a4f-5ebe-4031-a7b7-cd594a20c68a service nova] Creating event network-vif-plugged:fb6e20d7-2629-4c40-ba1b-49d5a11fc5fb for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:22.142048 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3950c4dd-5c05-475b-93df-7569b0db6b95 req-1c2d8a4f-5ebe-4031-a7b7-cd594a20c68a service nova] Creating event network-vif-plugged:8aa25744-3009-48ef-938a-4ba8aad5b5e3 for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:22.157633 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3950c4dd-5c05-475b-93df-7569b0db6b95 req-1c2d8a4f-5ebe-4031-a7b7-cd594a20c68a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103722 Oct 22 03:21:22.162727 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1983/3934] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:22.204840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:22.213805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:22.214513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:22.216971 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a271e0b-a6fb-4134-996c-89a12cc67b5d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.308438 Oct 22 03:21:22.217846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1952/3935] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:21 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:22.240567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:22.241703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:22.248095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:22.250156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:22.250665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:22.251110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:22.583806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:22.597605 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5827af7-d2c5-481e-8121-3b55453f02fe tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1314 microversion: 2.1 time: 0.389841 Oct 22 03:21:22.612733 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1984/3936] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:22 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:22.631234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:22.631985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:22.646665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:22.647600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:22.648786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:22.651998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:22.653646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:22.656135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:22.986894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:23.002926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:23.002926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:23.002926 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ade25205-b52d-4a04-af8e-83f6016fc322 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.373795 Oct 22 03:21:23.014764 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1953/3937] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:22 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:23.030249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:23.030874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:23.062571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:23.062802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:23.063118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:23.063818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:23.064844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:23.064844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:23.243381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:23.244021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:23.256753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:23.258571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:23.261378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:23.262353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:23.266125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:23.267953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:23.268859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:23.280940 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1ceabea-caf5-4df1-b830-b69d9d7d8193 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1354 microversion: 2.1 time: 0.261593 Oct 22 03:21:23.284256 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1985/3938] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:23 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1354 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:23.629314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:23.629950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:23.647904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:23.654698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:23.656744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:23.659378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:23.660028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:23.660667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:23.765862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:23.777186 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e975ae94-4614-4fd9-a722-fad89c7cc336 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.538046 Oct 22 03:21:23.779895 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1954/3939] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:23 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:23.940992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:23.954039 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34d5c37b-a9d8-46ef-a4fd-c1a1ded245aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1314 microversion: 2.1 time: 0.328598 Oct 22 03:21:23.955360 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1986/3940] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:23 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:24.027871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:24.028660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:24.042638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.050108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.050914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.051897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.052606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.053268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.263636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6d34dad3-2481-4a7a-8a72-36d9ca9883a2 req-d9004b01-1dc5-43d7-a592-62a3fc5b5cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce28cd56-c8bb-498a-90a9-a6a63145188b", "name": "network-vif-plugged", "status": "completed", "tag": "8c157433-227e-4e41-9206-a96124de2237"}, {"server_uuid": "f0d82aeb-0238-4701-b2d0-7d9bf68dff8f", "name": "network-vif-plugged", "status": "completed", "tag": "37e648ae-1fef-44f2-8376-4913240cc6d3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:24.278787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6d34dad3-2481-4a7a-8a72-36d9ca9883a2 req-d9004b01-1dc5-43d7-a592-62a3fc5b5cb1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.279612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6d34dad3-2481-4a7a-8a72-36d9ca9883a2 req-d9004b01-1dc5-43d7-a592-62a3fc5b5cb1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.280695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6d34dad3-2481-4a7a-8a72-36d9ca9883a2 req-d9004b01-1dc5-43d7-a592-62a3fc5b5cb1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.301964 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6d34dad3-2481-4a7a-8a72-36d9ca9883a2 req-d9004b01-1dc5-43d7-a592-62a3fc5b5cb1 service nova] Creating event network-vif-plugged:8c157433-227e-4e41-9206-a96124de2237 for instance ce28cd56-c8bb-498a-90a9-a6a63145188b on n-h2-862416-2 Oct 22 03:21:24.302829 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6d34dad3-2481-4a7a-8a72-36d9ca9883a2 req-d9004b01-1dc5-43d7-a592-62a3fc5b5cb1 service nova] Creating event network-vif-plugged:37e648ae-1fef-44f2-8376-4913240cc6d3 for instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f on n-h1-862416-2 Oct 22 03:21:24.321873 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6d34dad3-2481-4a7a-8a72-36d9ca9883a2 req-d9004b01-1dc5-43d7-a592-62a3fc5b5cb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066515 Oct 22 03:21:24.324774 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1987/3941] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:24.334775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:24.336463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:24.347866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.355159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.356104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.357416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.358276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.359080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.404172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:24.429913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:24.432136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:24.435661 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a27b9bb3-dec0-4c66-bf85-e9e251e84b21 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.412431 Oct 22 03:21:24.454609 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1955/3942] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:24 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:24.686352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:24.696904 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-612f3011-5c8e-4afd-87f6-3bbeb1d92268 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1804 microversion: 2.1 time: 0.370158 Oct 22 03:21:24.701873 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1988/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:24 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1804 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:24.728096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:24.728863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:24.739094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.740181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.741251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.743153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.744190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.744856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.798027 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9ff6ccb-f609-4b22-9b8c-c4795a249471 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7/ips" status: 200 len: 218 microversion: 2.1 time: 0.074383 Oct 22 03:21:24.799885 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1956/3944] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:21:24 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7/ips => generated 218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:24.808330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:24.812392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:24.813001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:24.813142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:24.822533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.823510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.824469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.825129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.826074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.826727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.827371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.836362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.836826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.838242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:24.838718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:24.839149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:24.881603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:21:24.940878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:25.042812 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fa035010-088b-45b9-8854-fa94746710ed tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 204 len: 0 microversion: 2.1 time: 0.234951 Oct 22 03:21:25.046858 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1957/3945] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:24 2022] DELETE /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:21:25.058361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:25.059902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:25.073900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:25.081018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:25.081883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:25.086751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:25.087479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:25.088131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:25.128140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:25.136633 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57b868e6-4f4d-4b7f-832b-e9906eb810d8 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.337870 Oct 22 03:21:25.148955 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1989/3946] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:24 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:25.160578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:25.161575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:25.173265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:25.173954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:25.174576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:25.176360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:25.177000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:25.177621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:25.322414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:25.331766 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-54485f31-8b7b-45ad-974b-1bae7401038c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1314 microversion: 2.1 time: 0.283468 Oct 22 03:21:25.332969 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1958/3947] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:25 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:25.416659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:25.425692 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a8a5e13-65ab-4f62-870d-d57d9caebb39 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1810 microversion: 2.1 time: 0.275223 Oct 22 03:21:25.426870 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1990/3948] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:25 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1810 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:25.483695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:25.485188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:25.497569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1448097583", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "c1717994-f451-40dc-8e07-a83aa4c6ac42"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:25.499027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:25.499534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:25.499977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:25.500810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:25.501454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:25.502097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:25.527493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:25.599526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] validate_networks() for [('c1717994-f451-40dc-8e07-a83aa4c6ac42', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:21:25.674497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:25.689278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:25.691827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:25.693983 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-43dcf9e3-aa82-46a3-90ad-a477a24dde94 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.236395 Oct 22 03:21:25.695665 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1991/3949] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:25 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:26.140729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:21:26.141924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:21:26.142963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:21:26.143966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:21:26.144735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:21:26.158595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.159525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.160232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.161229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.162116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.162792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.166761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:26.167387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:26.174989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.175826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.177133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.178088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.178753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.179423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.186823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Getting quotas for project e2b547f13734416291736f3c199b6a35. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:21:26.193084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Getting quotas for user 25678cce32e1475b9b56524158727f47 and project e2b547f13734416291736f3c199b6a35. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:21:26.207789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:21:26.210245 n-d-862416-2 devstack@n-api.service[120582]: WARNING nova.utils [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1448097583 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-144809758 Oct 22 03:21:26.211952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:21:26.278855 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-31102120-c4a4-4327-aa53-bcc7be7ca753 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943708 Oct 22 03:21:26.280320 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1959/3950] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:21:26.293256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9d2f7d6-840c-4a94-a2a1-7d71fe411b3f tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:26.294244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9d2f7d6-840c-4a94-a2a1-7d71fe411b3f tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:26.363335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9d2f7d6-840c-4a94-a2a1-7d71fe411b3f tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:26.375624 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9d2f7d6-840c-4a94-a2a1-7d71fe411b3f tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1232 microversion: 2.1 time: 0.087876 Oct 22 03:21:26.376815 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1960/3951] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:26 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1232 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:26.381735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:26.382354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:26.390607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.391302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.391825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.392690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.393261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.393753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.432945 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18fd69ca-8ed9-412f-a947-3d2e1803a1fe tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments/15702773-a8ea-4a2d-9a3e-fb4893a840f4" status: 200 len: 194 microversion: 2.20 time: 0.054516 Oct 22 03:21:26.434014 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1961/3952] 10.222.0.25 () {60 vars in 1454 bytes} [Sat Oct 22 03:21:26 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments/15702773-a8ea-4a2d-9a3e-fb4893a840f4 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:26.459871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:26.463062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:26.478036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.478536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.478972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.479688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.483975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.483975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.501624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:26.509491 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b4ecd5c5-3e46-4cb6-a04c-6cd2e983188b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.347365 Oct 22 03:21:26.510088 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1992/3953] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:26 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:26.527682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:26.530899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:26.567615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.568119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.571826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.572936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.573878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.574600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.740844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:26.753296 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04a7dc36-5c35-443e-b6fc-2d2d6709fedd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1501 microversion: 2.1 time: 0.318094 Oct 22 03:21:26.761124 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1962/3954] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:26 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1501 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:26.779793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:26.780342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:26.788984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.789473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.790004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.790728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:26.791422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:26.791785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:26.923915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lazy-loading 'services' on Instance uuid eb680fc8-0d54-4742-b649-b82abbf4884e {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:21:27.055673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:27.062622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:27.078344 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7cfdeab8-2dac-4861-b42a-efab46d29f80 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1810 microversion: 2.1 time: 0.564149 Oct 22 03:21:27.080082 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1993/3955] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:26 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1810 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:27.097291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:27.098160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:27.125703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.127476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.128224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.128463 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a18992b-aeb7-4d6c-811c-90688022446a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments/15702773-a8ea-4a2d-9a3e-fb4893a840f4" status: 202 len: 0 microversion: 2.20 time: 0.358374 Oct 22 03:21:27.129467 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1963/3956] 10.222.0.25 () {60 vars in 1457 bytes} [Sat Oct 22 03:21:26 2022] DELETE /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments/15702773-a8ea-4a2d-9a3e-fb4893a840f4 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:21:27.134819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.135401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.135859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.141871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:27.145516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:27.160285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.163186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.165266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.167647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.168246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.170183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.238272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lazy-loading 'flavor' on Instance uuid f0d82aeb-0238-4701-b2d0-7d9bf68dff8f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:21:27.389912 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-433add38-7e17-46ee-8ed6-eae42128bc15 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "POST /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f/action" status: 202 len: 0 microversion: 2.1 time: 0.258660 Oct 22 03:21:27.392622 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1964/3957] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:21:27 2022] POST /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:21:27.405055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:27.413236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:27.427998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.428282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.428611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.429372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.436988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.437470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.516038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1bb405ee-fa64-48e3-94af-f605ff6e8cf6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119740 Oct 22 03:21:27.519134 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1965/3958] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:21:27 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:27.526004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:27.528819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:27.542764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.543264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.543706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.544547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.545008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.545435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.612721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:27.631500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:27.643528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:27.652299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0af0b9de-916f-4a34-9d56-875df673e8e5 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1359 microversion: 2.21 time: 0.567322 Oct 22 03:21:27.653661 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1994/3959] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:27 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1359 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:27.665120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:27.666041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:27.695367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.696759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.697670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.698893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.699611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.702604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.925179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:27.946597 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a561eb2-b100-47ff-a25d-c83560ec8f8a tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1509 microversion: 2.1 time: 0.426165 Oct 22 03:21:27.953721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1966/3960] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:27 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1509 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:27.960090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:27.961564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:27.980754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.981267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.981715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:27.982692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:27.983151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:27.984236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:28.079784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:28.089506 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-56a2da58-a98f-4651-b9d7-44677815f0d2 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1228 microversion: 2.1 time: 0.434539 Oct 22 03:21:28.092864 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1995/3961] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:27 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1228 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:28.103527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:28.104167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:28.119440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:28.119955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:28.121400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:28.123905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:28.126970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:28.127675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:28.410378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:28.420023 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a8247a4d-778d-413b-bb9e-35eff5551747 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.465105 Oct 22 03:21:28.456591 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1967/3962] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:27 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:28.529962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:28.532180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:28.549284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:28.549774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:28.555896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:28.559071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:28.565357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:28.567423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:28.676257 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5b363790-8ce3-49d0-ae55-b52cf4558ea4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146457 Oct 22 03:21:28.679856 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1968/3963] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:21:28 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:21:28.683258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:28.698325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:28.698688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:28.703028 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10ef235f-cbe2-4ab7-b47a-844b67e3f588 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1810 microversion: 2.1 time: 0.599744 Oct 22 03:21:28.704737 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1996/3964] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:28 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1810 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:28.734135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:28.734643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:28.735430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:28.736501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:28.736960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:28.737390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:28.980701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:28.981983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:29.004912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:29.011509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:29.019955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:29.022398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:29.026005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:29.026507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:29.537529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:29.553183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:29.555403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:29.557346 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aedd3f43-8cbf-42f2-b0bf-28f6022e28e8 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1552 microversion: 2.21 time: 0.876431 Oct 22 03:21:29.558302 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1969/3965] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:28 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1552 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:29.563577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0d8082c3-90a2-4f04-9a10-c3196906c109 req-7e237aec-793d-45d0-89e7-873f1761e1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "name": "network-vif-deleted", "tag": "4abd0e7d-03e3-43f2-9a31-4b95708ad88a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:29.575151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0d8082c3-90a2-4f04-9a10-c3196906c109 req-7e237aec-793d-45d0-89e7-873f1761e1f3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:29.575972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0d8082c3-90a2-4f04-9a10-c3196906c109 req-7e237aec-793d-45d0-89e7-873f1761e1f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:29.576715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0d8082c3-90a2-4f04-9a10-c3196906c109 req-7e237aec-793d-45d0-89e7-873f1761e1f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:29.602528 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0d8082c3-90a2-4f04-9a10-c3196906c109 req-7e237aec-793d-45d0-89e7-873f1761e1f3 service nova] Creating event network-vif-deleted:4abd0e7d-03e3-43f2-9a31-4b95708ad88a for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:29.611521 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0d8082c3-90a2-4f04-9a10-c3196906c109 req-7e237aec-793d-45d0-89e7-873f1761e1f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051172 Oct 22 03:21:29.612587 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1970/3966] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:29.619518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:29.620598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:29.650102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:29.651041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:29.651850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:29.653288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:29.654411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:29.655131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:29.678338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:29.689176 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aeec793a-026d-4df9-b7b5-2737e7d68fdd tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1492 microversion: 2.1 time: 0.712893 Oct 22 03:21:29.693134 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1997/3967] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:28 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1492 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:29.715622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:29.716269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:29.762308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:29.764414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:29.766552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:29.775581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:29.776240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:29.776706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.233621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:30.262184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73d8deae-7d3f-4d7d-bf79-56585711fb44 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.553347 Oct 22 03:21:30.276239 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1998/3968] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:29 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:30.296843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:30.299678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:30.312902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.313403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.313844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.314568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.315025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.323594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.427852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:21:30.442570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:30.473701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4b36d95-2ba3-4da7-aa75-0b2d715c97c7 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1290 microversion: 2.1 time: 0.849892 Oct 22 03:21:30.474545 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1971/3969] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:29 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1290 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:30.487337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:30.489556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:30.526351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.526865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.527330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.530704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.531228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.535413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.621224 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-def46abd-a11b-4374-8982-6a709aa23247 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145477 Oct 22 03:21:30.623641 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1972/3970] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:21:30 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:30.642046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:30.646139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:30.657539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0389dd8-fe2f-474c-9fdd-73ea55e78294 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 204 len: 0 microversion: 2.21 time: 0.385231 Oct 22 03:21:30.658986 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 1999/3971] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:21:30 2022] DELETE /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:21:30.663791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.664197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.665425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.666323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.667051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.667675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.674589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:30.675330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:30.690763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.691421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.691704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.697835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.698717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.699587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.734092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:21:30.743146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:30.924295 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2cab5f34-4924-44a0-ac66-02bd96880460 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 204 len: 0 microversion: 2.1 time: 0.299239 Oct 22 03:21:30.930658 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1973/3972] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:30 2022] DELETE /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:21:30.939567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:30.942968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:30.962817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.963671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.976709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:30.980026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:30.980886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:30.981551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.213627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:31.227104 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-828bae4e-4477-44c3-aa63-aafa633aded4 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1654 microversion: 2.1 time: 0.564586 Oct 22 03:21:31.228594 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2000/3973] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:30 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1654 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:31.253885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:31.254511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:31.263051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.263818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.264485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.265657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.266431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.267166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.364311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:31.378457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:31.390303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:31.391610 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35f26f1b-308b-47b6-acd2-58e1b6601c01 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1558 microversion: 2.21 time: 0.459219 Oct 22 03:21:31.392446 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1974/3974] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:30 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1558 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:31.405840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:31.406747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:31.420326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.420771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.421220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.421945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.422408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.422839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.660544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:31.673468 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9e9626b-1ecd-4aab-acdf-29e12ad6d9af tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1498 microversion: 2.1 time: 0.441098 Oct 22 03:21:31.678565 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2001/3975] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:31 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1498 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:31.687192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-370e0333-a61e-49f7-b0c4-543bc79b3c8d req-ef70bd98-31f7-4f51-8393-4208a5305dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "name": "network-vif-unplugged", "status": "completed", "tag": "fb6e20d7-2629-4c40-ba1b-49d5a11fc5fb"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:31.693123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:31.698539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-370e0333-a61e-49f7-b0c4-543bc79b3c8d req-ef70bd98-31f7-4f51-8393-4208a5305dc2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.699971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-370e0333-a61e-49f7-b0c4-543bc79b3c8d req-ef70bd98-31f7-4f51-8393-4208a5305dc2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.700337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-370e0333-a61e-49f7-b0c4-543bc79b3c8d req-ef70bd98-31f7-4f51-8393-4208a5305dc2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.711920 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d759f9b-bb6b-410a-968c-41222c6c8d1a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.318689 Oct 22 03:21:31.713191 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1975/3976] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:31 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:31.714546 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-370e0333-a61e-49f7-b0c4-543bc79b3c8d req-ef70bd98-31f7-4f51-8393-4208a5305dc2 service nova] Creating event network-vif-unplugged:fb6e20d7-2629-4c40-ba1b-49d5a11fc5fb for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:31.718745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:31.720892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:31.735182 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-370e0333-a61e-49f7-b0c4-543bc79b3c8d req-ef70bd98-31f7-4f51-8393-4208a5305dc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052897 Oct 22 03:21:31.739006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.739704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.741516 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2002/3977] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:31.747817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.749041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.749716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.750322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.756044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:31.759994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:31.771087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.771765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.772342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.773291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.774051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.774709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.826668 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cba6cce4-5839-4ac0-b5bc-710beebfa2df tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082656 Oct 22 03:21:31.827830 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2003/3978] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:21:31 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:31.832899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cff83ab3-8456-4978-827a-9d979fdba817 req-7cd77a9b-ed0a-4edf-bbcc-79bc2ea47c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "name": "network-vif-deleted", "tag": "8aa25744-3009-48ef-938a-4ba8aad5b5e3"}, {"server_uuid": "58f40efd-b160-4f9c-8147-057e39a987d7", "name": "network-vif-deleted", "tag": "fb6e20d7-2629-4c40-ba1b-49d5a11fc5fb"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:31.845064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cff83ab3-8456-4978-827a-9d979fdba817 req-7cd77a9b-ed0a-4edf-bbcc-79bc2ea47c39 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.845940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cff83ab3-8456-4978-827a-9d979fdba817 req-7cd77a9b-ed0a-4edf-bbcc-79bc2ea47c39 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.847016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cff83ab3-8456-4978-827a-9d979fdba817 req-7cd77a9b-ed0a-4edf-bbcc-79bc2ea47c39 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.862953 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cff83ab3-8456-4978-827a-9d979fdba817 req-7cd77a9b-ed0a-4edf-bbcc-79bc2ea47c39 service nova] Creating event network-vif-deleted:8aa25744-3009-48ef-938a-4ba8aad5b5e3 for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:31.863609 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cff83ab3-8456-4978-827a-9d979fdba817 req-7cd77a9b-ed0a-4edf-bbcc-79bc2ea47c39 service nova] Creating event network-vif-deleted:fb6e20d7-2629-4c40-ba1b-49d5a11fc5fb for instance 58f40efd-b160-4f9c-8147-057e39a987d7 on n-h2-862416-2 Oct 22 03:21:31.870370 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cff83ab3-8456-4978-827a-9d979fdba817 req-7cd77a9b-ed0a-4edf-bbcc-79bc2ea47c39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041052 Oct 22 03:21:31.871322 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2004/3979] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:31.877621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:31.878451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:31.885331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.885826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.886267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:31.886986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:31.887446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:31.888027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.076661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:32.088910 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9d02b6ae-30dc-4216-bd55-c85d0c885bb0 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 0.374429 Oct 22 03:21:32.111364 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1976/3980] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:31 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:32.142743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:32.151804 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b81c677a-816e-4a2d-b3b4-87d02b28335f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.278936 Oct 22 03:21:32.152405 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2005/3981] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:31 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:32.252411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:32.253109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:32.261795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.262525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.263132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.264098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.264746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.265341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.420484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:32.421151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:32.423033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.423728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.424426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.425199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lazy-loading 'fault' on Instance uuid 58f40efd-b160-4f9c-8147-057e39a987d7 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:21:32.432002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.434377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.435033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.436707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.438267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.440006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.538053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:32.551524 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d20c0f9c-bc7c-497b-ae4e-6d9fb10cdfbc tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 200 len: 1302 microversion: 2.1 time: 0.301532 Oct 22 03:21:32.553553 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1977/3982] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:32 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 1302 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:32.709152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:32.711270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:32.714134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:32.724310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.726492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.726866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.727591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.728665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.729104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.730963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:32.732720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb3149b34fa48dfa17945ba603a09da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171482f425ce4686888d634676bdf56d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:32.734591 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16aef289-6f30-413f-9ef9-68f346b17065 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 200 len: 1558 microversion: 2.21 time: 0.320084 Oct 22 03:21:32.735174 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2006/3983] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:32 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 1558 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:21:32.747980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:32.748747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:32.761845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.779342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.780172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:32.781215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:32.781896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:32.782548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.103516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:33.115692 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fb7bbff8-5f1e-4cbd-9eea-c897b50dc82b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.379482 Oct 22 03:21:33.117265 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2007/3984] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:32 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:33.123187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:33.125968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:33.137758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.138641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.139087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.139791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.140295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.140731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.190125 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8db12c87-41ef-44eb-9cc5-5da068c4a3ba tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070753 Oct 22 03:21:33.191651 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2008/3985] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:21:33 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:33.197815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:33.198419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:33.204765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.205253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.205688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.206395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.206900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.207055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:33.207337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.215003 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c416ef2-6265-4bde-b20a-2fbf4ddd3ea4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1498 microversion: 2.1 time: 0.513692 Oct 22 03:21:33.215586 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1978/3986] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:32 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1498 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:33.233301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:33.234169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:33.240577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.241295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.241986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.242888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.243516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.244404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.358668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:33.369889 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a80915ad-c105-44e1-9ad1-f3eb4a8883cc tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 0.176004 Oct 22 03:21:33.384233 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2009/3987] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:33 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:33.384233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-76faec9c-2221-45cc-a8e1-ee71103a4337 req-97b83639-0adc-4c39-82d8-8f1653a83206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67d3dae-96e2-4911-a260-0e046834d498", "tag": "735b21da-4bcb-43ae-a866-b324d932cd4d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:33.392109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-76faec9c-2221-45cc-a8e1-ee71103a4337 req-97b83639-0adc-4c39-82d8-8f1653a83206 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.392109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-76faec9c-2221-45cc-a8e1-ee71103a4337 req-97b83639-0adc-4c39-82d8-8f1653a83206 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.392109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-76faec9c-2221-45cc-a8e1-ee71103a4337 req-97b83639-0adc-4c39-82d8-8f1653a83206 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.397152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:33.432169 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-76faec9c-2221-45cc-a8e1-ee71103a4337 req-97b83639-0adc-4c39-82d8-8f1653a83206 service nova] Creating event network-changed:735b21da-4bcb-43ae-a866-b324d932cd4d for instance d67d3dae-96e2-4911-a260-0e046834d498 on n-h2-862416-2 Oct 22 03:21:33.440831 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-76faec9c-2221-45cc-a8e1-ee71103a4337 req-97b83639-0adc-4c39-82d8-8f1653a83206 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065867 Oct 22 03:21:33.441619 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2010/3988] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:33.576256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:33.576965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:33.583509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.584143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.584603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.585996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.586472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.586966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.603019 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] HTTP exception thrown: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Request method failure captured: Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 HTTP/1.1 Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2GMT0ek3fu-YE3f7R1oPbuLVDKYnEKw0PAqsmaoV1E2-DqwXcxTJTmKjTwixO_AFwra-7RH8UDeUg-YB20fLtNU6R36gUcfRAZA-XnRFWdvq3abaj2zLJ0MVvb_EX5gBI4i9JSr3PCKGghPIjll1NIIzSNfqgyuG39hSqVP6iOWmbY Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}] Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestMultiNic-473468253 Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestMultiNic-473468253-project Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 50827aa842ce4e0bb8b21e57a3d5b318 Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestMultiNic-473468253-project Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '58f40efd-b160-4f9c-8147-057e39a987d7'} Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:33.604851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Returning 404 to user: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:33.610284 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f3366d2b-c4ac-4acc-94ac-e915c722065e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 404 len: 111 microversion: 2.1 time: 0.034847 Oct 22 03:21:33.612403 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2011/3989] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:33 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:33.765478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:33.766083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:33.766507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:33.778447 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd4d9177-4a82-436c-b2d2-01ffa0de494a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.548990 Oct 22 03:21:33.779882 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1979/3990] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:33 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:33.802107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.802360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1888708490"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:33.803036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.803674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.805231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:33.808342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.809024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.809475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.812105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.812828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.813449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.814327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.814952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.815554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.833645 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] HTTP exception thrown: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Request method failure captured: Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b HTTP/1.1 Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Gewq9ezGvGgTtwBOynC0Jb7IIi8s-aWjh9lFN26bpxH3AU7QAfqS7YwAO2msupVNKV9YpD9xZgBkxOFGtarrbAoTVKgF1x6MEPKcHOhd8nVWVuawSQx8hm6axAPreWgwKEckeLZarjLvYj3wekLgRTsjlIaYYXNjWSvKHsDnTBX9w Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.21 Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 171482f425ce4686888d634676bdf56d Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_171482f425ce4686888d634676bdf56d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/171482f425ce4686888d634676bdf56d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/171482f425ce4686888d634676bdf56d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/171482f425ce4686888d634676bdf56d"}]}] Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 171482f425ce4686888d634676bdf56d Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-InstanceActionsV221TestJSON-741834100-project Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: dbb3149b34fa48dfa17945ba603a09da Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-InstanceActionsV221TestJSON-741834100-project Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ce28cd56-c8bb-498a-90a9-a6a63145188b'} Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.836110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:33.842068 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.842068 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:33.842068 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:33.842068 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:33.842068 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:33.842068 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:33.842068 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:33.842068 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:33.843937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Returning 404 to user: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:33.845445 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b0f5ca8-f083-40bd-a880-7c057c2ddcf7 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 404 len: 111 microversion: 2.21 time: 0.083586 Oct 22 03:21:33.850421 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2012/3991] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:33 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:21:33.856845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '.version_select at 0x7f0d1ba65f70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:33.857904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:33.865056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.865796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.866430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.867734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.868468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.869074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.961328 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cbe679bb-93df-48d3-ae3e-609a74b32cbf tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.108306 Oct 22 03:21:33.970666 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2013/3992] 10.222.0.25 () {60 vars in 1337 bytes} [Sat Oct 22 03:21:33 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b/os-instance-actions => generated 611 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:33.982846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:33.983638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:33.990631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.991539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.991979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:33.992740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:33.993389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:33.993995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.012189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] HTTP exception thrown: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Request method failure captured: Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b HTTP/1.1 Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Gewq9ezGvGgTtwBOynC0Jb7IIi8s-aWjh9lFN26bpxH3AU7QAfqS7YwAO2msupVNKV9YpD9xZgBkxOFGtarrbAoTVKgF1x6MEPKcHOhd8nVWVuawSQx8hm6axAPreWgwKEckeLZarjLvYj3wekLgRTsjlIaYYXNjWSvKHsDnTBX9w Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.21 Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 171482f425ce4686888d634676bdf56d Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_171482f425ce4686888d634676bdf56d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/171482f425ce4686888d634676bdf56d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/171482f425ce4686888d634676bdf56d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/171482f425ce4686888d634676bdf56d"}]}] Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 171482f425ce4686888d634676bdf56d Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-InstanceActionsV221TestJSON-741834100-project Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: dbb3149b34fa48dfa17945ba603a09da Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-InstanceActionsV221TestJSON-741834100-project Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ce28cd56-c8bb-498a-90a9-a6a63145188b'} Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:34.015106 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.020637 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.025189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Returning 404 to user: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:34.028193 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-24531de1-39f6-413e-963f-1dac4cb6ab3a tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 404 len: 111 microversion: 2.21 time: 0.055270 Oct 22 03:21:34.028961 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2014/3993] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:21:33 2022] DELETE /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:21:34.046689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:34.047333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] [instance: ce28cd56-c8bb-498a-90a9-a6a63145188b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:34.071643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.072758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.074279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.075344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.076045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.077268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.098703 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] HTTP exception thrown: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Request method failure captured: Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b HTTP/1.1 Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Gewq9ezGvGgTtwBOynC0Jb7IIi8s-aWjh9lFN26bpxH3AU7QAfqS7YwAO2msupVNKV9YpD9xZgBkxOFGtarrbAoTVKgF1x6MEPKcHOhd8nVWVuawSQx8hm6axAPreWgwKEckeLZarjLvYj3wekLgRTsjlIaYYXNjWSvKHsDnTBX9w Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.21 Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 171482f425ce4686888d634676bdf56d Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_171482f425ce4686888d634676bdf56d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/171482f425ce4686888d634676bdf56d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/171482f425ce4686888d634676bdf56d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/171482f425ce4686888d634676bdf56d"}]}] Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 171482f425ce4686888d634676bdf56d Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-741834100 Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-InstanceActionsV221TestJSON-741834100-project Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: dbb3149b34fa48dfa17945ba603a09da Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-InstanceActionsV221TestJSON-741834100-project Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ce28cd56-c8bb-498a-90a9-a6a63145188b'} Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.105014 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:34.109906 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.109906 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:34.109906 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:34.109906 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:34.109906 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:34.109906 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:34.109906 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. Oct 22 03:21:34.109906 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:34.111847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] Returning 404 to user: Instance ce28cd56-c8bb-498a-90a9-a6a63145188b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:34.113665 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8f8bd4fa-5fd0-4ea1-bb28-0a8bb7736de3 tempest-InstanceActionsV221TestJSON-741834100 tempest-InstanceActionsV221TestJSON-741834100-project] 10.222.0.25 "GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b" status: 404 len: 111 microversion: 2.21 time: 0.078197 Oct 22 03:21:34.115255 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2015/3994] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:34 2022] GET /compute/v2.1/servers/ce28cd56-c8bb-498a-90a9-a6a63145188b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:21:34.140659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:34.141640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:34.157521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.159087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.159555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.160325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.160799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.161234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.209760 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62b5279b-a19b-44db-8d82-7a8a4457b5f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.411105 Oct 22 03:21:34.214991 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1980/3995] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:21:33 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 22 03:21:34.222165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:34.225354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:34.250508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.252201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.252915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.253834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.254486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.254956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.291744 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be979e29-0c17-4083-a7ca-2ed81378477f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073992 Oct 22 03:21:34.292724 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1981/3996] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:21:34 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:34.298213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:34.299063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:34.305942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.306611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.307398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.308354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.309080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.309686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.636735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:34.645952 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-205d1c84-dd96-4b09-8a10-b0f1c98be48e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.509966 Oct 22 03:21:34.649209 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2016/3997] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:34 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:34.653775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9433890c-f57d-4beb-97e4-6549e8fe789e req-a03acab2-0499-447a-8e2c-652cf7a05529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce28cd56-c8bb-498a-90a9-a6a63145188b", "name": "network-vif-deleted", "tag": "8c157433-227e-4e41-9206-a96124de2237"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:34.676391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9433890c-f57d-4beb-97e4-6549e8fe789e req-a03acab2-0499-447a-8e2c-652cf7a05529 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.676887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9433890c-f57d-4beb-97e4-6549e8fe789e req-a03acab2-0499-447a-8e2c-652cf7a05529 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.677322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9433890c-f57d-4beb-97e4-6549e8fe789e req-a03acab2-0499-447a-8e2c-652cf7a05529 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.689900 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9433890c-f57d-4beb-97e4-6549e8fe789e req-a03acab2-0499-447a-8e2c-652cf7a05529 service nova] Creating event network-vif-deleted:8c157433-227e-4e41-9206-a96124de2237 for instance ce28cd56-c8bb-498a-90a9-a6a63145188b on n-h2-862416-2 Oct 22 03:21:34.700647 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9433890c-f57d-4beb-97e4-6549e8fe789e req-a03acab2-0499-447a-8e2c-652cf7a05529 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050320 Oct 22 03:21:34.701453 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2017/3998] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:34.706643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:34.707383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:34.714715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.715491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.716129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.718083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:34.718758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:34.719451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:34.997548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:35.006366 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f23f217d-a264-4ada-b2a0-84878fc312aa tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1456 microversion: 2.1 time: 0.712379 Oct 22 03:21:35.020469 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1982/3999] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:34 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1456 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:35.078392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:35.087348 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe8ac277-781c-47aa-afc0-f0210b1afa87 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 0.384797 Oct 22 03:21:35.112358 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2018/4000] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:34 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:35.305067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:35.307086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:35.321049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:35.323302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:35.325374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:35.329125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:35.330115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:35.330944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:35.401058 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f63d9133-ef60-412a-8f9f-93f4d04950e5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101010 Oct 22 03:21:35.402009 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1983/4001] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:21:35 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:21:35.509548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-dd3ed385-3792-4c77-8303-335d75cdbea1 req-2c0b2751-9b4b-4db3-8f4b-ad5022ce4f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d82aeb-0238-4701-b2d0-7d9bf68dff8f", "name": "network-vif-deleted", "tag": "37e648ae-1fef-44f2-8376-4913240cc6d3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:35.521423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dd3ed385-3792-4c77-8303-335d75cdbea1 req-2c0b2751-9b4b-4db3-8f4b-ad5022ce4f6c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:35.522267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dd3ed385-3792-4c77-8303-335d75cdbea1 req-2c0b2751-9b4b-4db3-8f4b-ad5022ce4f6c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:35.523195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-dd3ed385-3792-4c77-8303-335d75cdbea1 req-2c0b2751-9b4b-4db3-8f4b-ad5022ce4f6c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:35.543323 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-dd3ed385-3792-4c77-8303-335d75cdbea1 req-2c0b2751-9b4b-4db3-8f4b-ad5022ce4f6c service nova] Creating event network-vif-deleted:37e648ae-1fef-44f2-8376-4913240cc6d3 for instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f on n-h1-862416-2 Oct 22 03:21:35.558078 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-dd3ed385-3792-4c77-8303-335d75cdbea1 req-2c0b2751-9b4b-4db3-8f4b-ad5022ce4f6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051876 Oct 22 03:21:35.562728 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2019/4002] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:35.680185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:35.681048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:35.693909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:35.697014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:35.697680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:35.698612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:35.701106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:35.701901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.016957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:36.035679 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fe1cdde8-e415-4cba-b41b-6bc81357f2d9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.362543 Oct 22 03:21:36.036898 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1984/4003] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:35 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:36.037779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:36.039566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:36.057722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.058240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.061098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.062096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.062743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.063544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.108892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.110615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.111231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.111858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lazy-loading 'fault' on Instance uuid f0d82aeb-0238-4701-b2d0-7d9bf68dff8f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:21:36.112719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:36.113334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:36.129588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.130816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.133414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.134359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.135956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.136588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.181146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:36.204123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd4c44f32a04da48b34c9c888f36fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27587c6206d249979148d0bb2a832036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:36.213665 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38596ca2-5710-4079-8d2f-89e20b2ef794 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 200 len: 1304 microversion: 2.1 time: 0.184541 Oct 22 03:21:36.215046 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2020/4004] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:36 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:36.373481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:36.415187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:36.417783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:36.423760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.424304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.425026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.425937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.426713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.427216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.482035 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e35ea6b-0979-44ca-8c2c-f2eb110fa0e4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071381 Oct 22 03:21:36.488362 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2021/4005] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:21:36 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:36.492946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:36.509603 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7b1da682-11dc-4c14-aa86-cc34dd946db8 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 0.401279 Oct 22 03:21:36.510201 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1985/4006] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:36 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:36.585815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:36.586328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:36.593949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:36.595618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.596310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.597135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.597873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.598403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.598844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.640415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:21:36.769170 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b7ba015-d95a-4ded-a423-cbb3ea62aee7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 204 len: 0 microversion: 2.20 time: 0.187222 Oct 22 03:21:36.770711 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2022/4007] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:21:36 2022] DELETE /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:21:36.779840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:36.781935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:36.796476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.797991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.798796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:36.799680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:36.800390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:36.801126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.060844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.061560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.074897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.079674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.080418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.081733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.082436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.082934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.127809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:37.139331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:37.143605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:37.146548 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-66cd606e-353e-43f8-a332-7e932a6944ac tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.371194 Oct 22 03:21:37.148366 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1986/4008] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:36 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:37.240456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.242034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.249924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.250772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.251569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.252802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.253513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.254233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.260929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:37.275660 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f HTTP/1.1 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f0d82aeb-0238-4701-b2d0-7d9bf68dff8f'} Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.278448 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.285061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.285061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.285061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.285061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.285061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.285061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.285061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.287649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.288788 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9086b060-259b-4cbc-98c2-ed983a4dd020 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 404 len: 111 microversion: 2.1 time: 0.055161 Oct 22 03:21:37.289817 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1987/4009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:37 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.303163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.303667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.314206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.314710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.315156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.315868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.316380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.316818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.354696 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f HTTP/1.1 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f0d82aeb-0238-4701-b2d0-7d9bf68dff8f'} Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.358483 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.364698 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.368615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.369674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cd9a82fd-bcc5-417a-ba22-07c533671293 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 404 len: 111 microversion: 2.1 time: 0.072020 Oct 22 03:21:37.371202 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1988/4010] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:37 2022] DELETE /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.384847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.386657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f0d82aeb-0238-4701-b2d0-7d9bf68dff8f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.397408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.399343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.400023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.400989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.402562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.403003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.422397 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f HTTP/1.1 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f0d82aeb-0238-4701-b2d0-7d9bf68dff8f'} Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.425009 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance f0d82aeb-0238-4701-b2d0-7d9bf68dff8f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.430179 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-52cf985e-d004-485a-9141-2ff7e01bc18f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f" status: 404 len: 111 microversion: 2.1 time: 0.049558 Oct 22 03:21:37.432318 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1989/4011] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:37 2022] GET /compute/v2.1/servers/f0d82aeb-0238-4701-b2d0-7d9bf68dff8f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.438845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:37.451231 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f75e1d3-cb1c-4eaf-9eb4-164cf5c1c143 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.392751 Oct 22 03:21:37.456391 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2023/4012] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:37 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:37.456748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.457475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.466788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.467468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.468053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.468939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.469613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.476979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.495128 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 HTTP/1.1 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '2e4dc0ad-7879-4fd2-8464-46da72e85755'} Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.496947 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.502076 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cbe7c64d-576b-4d28-be4b-cd017aa12b2c tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 404 len: 111 microversion: 2.1 time: 0.066262 Oct 22 03:21:37.508393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.509020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 2e4dc0ad-7879-4fd2-8464-46da72e85755] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.512620 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1990/4013] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:37 2022] DELETE /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.517632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.518143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.518594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.519320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.519786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.520234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.536987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.537591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.543633 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 HTTP/1.1 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '2e4dc0ad-7879-4fd2-8464-46da72e85755'} Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.545911 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 2e4dc0ad-7879-4fd2-8464-46da72e85755 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.551898 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20e9ab9f-3303-4eed-9568-b1ca29a9db84 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755" status: 404 len: 111 microversion: 2.1 time: 0.043290 Oct 22 03:21:37.552566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.552566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.552566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.552832 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2024/4014] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:37 2022] GET /compute/v2.1/servers/2e4dc0ad-7879-4fd2-8464-46da72e85755 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:21:37.555686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.556432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.556885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.557443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.557964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.564368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.564878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.565329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.566049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.566709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.567319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.586635 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac HTTP/1.1 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f667e973-b796-44b6-9ab4-9fde79a741ac'} Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.589232 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.594119 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.599600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.600743 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d8c339f-5b37-4972-b555-94fa8a5c9459 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 404 len: 111 microversion: 2.1 time: 0.047799 Oct 22 03:21:37.610303 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2025/4015] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:37 2022] DELETE /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.625699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.626539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: f667e973-b796-44b6-9ab4-9fde79a741ac] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.639619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.640452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.641170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.642134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.642781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.643386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.665977 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac HTTP/1.1 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f667e973-b796-44b6-9ab4-9fde79a741ac'} Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.667582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance f667e973-b796-44b6-9ab4-9fde79a741ac could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fb57c78e-8d62-4677-a1e0-e64faba604ed tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac" status: 404 len: 111 microversion: 2.1 time: 0.057531 Oct 22 03:21:37.676167 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2026/4016] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:37 2022] GET /compute/v2.1/servers/f667e973-b796-44b6-9ab4-9fde79a741ac => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.680017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.680557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.686959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.687536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.688019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.689417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.691098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.691594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.710723 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 HTTP/1.1 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '562b1d73-9053-4f68-95d5-faf97ca3cee9'} Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.712484 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d3a8e05-0044-45f6-8c56-b5f6cb69551f tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 404 len: 111 microversion: 2.1 time: 0.038771 Oct 22 03:21:37.717961 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2027/4017] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:37 2022] DELETE /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.723186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.723964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 562b1d73-9053-4f68-95d5-faf97ca3cee9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.732632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.734111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.735272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.736654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:37.737354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:37.738462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:37.768790 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 HTTP/1.1 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '562b1d73-9053-4f68-95d5-faf97ca3cee9'} Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.771186 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 562b1d73-9053-4f68-95d5-faf97ca3cee9 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.776927 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7401d225-9c23-4f65-bfa2-d4f383f98754 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9" status: 404 len: 111 microversion: 2.1 time: 0.053835 Oct 22 03:21:37.777704 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2028/4018] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:37 2022] GET /compute/v2.1/servers/562b1d73-9053-4f68-95d5-faf97ca3cee9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.783845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97eac0bc-e8dc-4c3a-a69e-b2704eea0957 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.784952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97eac0bc-e8dc-4c3a-a69e-b2704eea0957 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 9622909e-5004-46d0-975d-c3643aec6b67] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.792176 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-97eac0bc-e8dc-4c3a-a69e-b2704eea0957 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97eac0bc-e8dc-4c3a-a69e-b2704eea0957 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67 HTTP/1.1 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9622909e-5004-46d0-975d-c3643aec6b67'} Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.793799 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97eac0bc-e8dc-4c3a-a69e-b2704eea0957 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97eac0bc-e8dc-4c3a-a69e-b2704eea0957 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67" status: 404 len: 111 microversion: 2.1 time: 0.016992 Oct 22 03:21:37.799074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2029/4019] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:37 2022] DELETE /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:37.804804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-920e80b6-94e4-48d7-8026-4b39f14e2ee1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:37.805434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-920e80b6-94e4-48d7-8026-4b39f14e2ee1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 9622909e-5004-46d0-975d-c3643aec6b67] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:37.813244 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-920e80b6-94e4-48d7-8026-4b39f14e2ee1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-920e80b6-94e4-48d7-8026-4b39f14e2ee1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67 HTTP/1.1 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9622909e-5004-46d0-975d-c3643aec6b67'} Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:37.816748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:37.822579 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:37.822579 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:37.822579 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:37.822579 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. Oct 22 03:21:37.822579 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:37.830398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-920e80b6-94e4-48d7-8026-4b39f14e2ee1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 9622909e-5004-46d0-975d-c3643aec6b67 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:37.831370 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-920e80b6-94e4-48d7-8026-4b39f14e2ee1 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67" status: 404 len: 111 microversion: 2.1 time: 0.031159 Oct 22 03:21:37.841425 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2030/4020] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:37 2022] GET /compute/v2.1/servers/9622909e-5004-46d0-975d-c3643aec6b67 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:38.143428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b7b01777-29cc-4f97-b8e9-43bdf65ddf7c req-06d5711a-1066-4a54-8323-252dbef83312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "name": "network-vif-unplugged", "status": "completed", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:38.165845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7b01777-29cc-4f97-b8e9-43bdf65ddf7c req-06d5711a-1066-4a54-8323-252dbef83312 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:38.166418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7b01777-29cc-4f97-b8e9-43bdf65ddf7c req-06d5711a-1066-4a54-8323-252dbef83312 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:38.166869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7b01777-29cc-4f97-b8e9-43bdf65ddf7c req-06d5711a-1066-4a54-8323-252dbef83312 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:38.206065 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b7b01777-29cc-4f97-b8e9-43bdf65ddf7c req-06d5711a-1066-4a54-8323-252dbef83312 service nova] Creating event network-vif-unplugged:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:21:38.214494 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b7b01777-29cc-4f97-b8e9-43bdf65ddf7c req-06d5711a-1066-4a54-8323-252dbef83312 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075217 Oct 22 03:21:38.215125 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2031/4021] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:21:38.226712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:38.232658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:38.252120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:38.252674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:38.253102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:38.253912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:38.254571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:38.255762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:38.395701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:38.411896 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-60b43e91-a186-4ac4-8008-0dc9c35740cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 0.875811 Oct 22 03:21:38.413338 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1991/4022] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:37 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:38.479546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:38.480165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:38.495199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:38.495802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:38.496201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:38.496972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:38.497655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:38.497850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:38.958966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:38.973790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:38.988890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:38.991107 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4cb33c2-7e48-43a8-b02d-2d8855b63fa2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.768796 Oct 22 03:21:39.001376 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2032/4023] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:38 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:39.436814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:39.437706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:39.458138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:39.459872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:39.461692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:39.462747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:39.464747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:39.465738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:39.521469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:39.537614 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9565ef2c-fdce-4777-aa7c-372205f242e0 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 1.062346 Oct 22 03:21:39.538250 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1992/4024] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:38 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:39.922420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:39.934403 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f97a520e-450c-49cf-942b-01c46657d0cf tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 0.501676 Oct 22 03:21:39.935831 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2033/4025] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:39 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:40.029966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:40.030833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:40.037986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:40.039294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:40.039905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:40.040828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:40.048107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:40.048884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:40.563342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:40.564036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:40.589540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:40.590065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:40.590523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:40.591268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:40.591736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:40.592174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:40.802950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:40.813907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:40.815383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:40.828440 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ec25320-4190-4c76-8b19-e9dc2e3b8d2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1723 microversion: 2.20 time: 0.790538 Oct 22 03:21:40.853043 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1993/4026] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:40 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1723 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:40.872989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1775994608", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "af06b0a6-e486-4737-866a-de5fdae0b029"}, {"uuid": "95ff6cf6-b496-4bab-9221-a3d00aebf0b8"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:41.039564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] validate_networks() for [('af06b0a6-e486-4737-866a-de5fdae0b029', None, None, None, None, None), ('95ff6cf6-b496-4bab-9221-a3d00aebf0b8', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:21:41.182135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:41.196069 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-00035f0c-d061-4bd4-9e55-b8927acca426 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.636841 Oct 22 03:21:41.209299 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2034/4027] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:40 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:41.233160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:41.234798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:41.254344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:41.255112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:41.256385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:41.258023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:41.258681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:41.259492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:41.295218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:41.658326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:41.675606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-84d1539d-5288-47ae-84dc-2e078467ca37 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 0.464239 Oct 22 03:21:41.682810 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2035/4028] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:41 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:41.869824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:41.870448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:41.891669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:41.896710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:41.899318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:41.903065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:41.904618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:41.906638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:42.134910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:42.154304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:42.161411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:42.170667 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1939b590-7d50-48a8-860f-14c7d54e2386 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1655 microversion: 2.20 time: 0.316958 Oct 22 03:21:42.184243 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2036/4029] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:41 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1655 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:21:42.224503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:42.225277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:42.240328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:42.244183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:42.245835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:42.249090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:42.253818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:42.257714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:43.154893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:43.167873 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55d7ec9e-95b9-477d-9317-f274cfa66855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.947337 Oct 22 03:21:43.168758 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2037/4030] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:42 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:43.173950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1aef8ad1-b5ea-4a81-8ee1-df1eef8353b3 req-e5342650-f509-44d1-9e97-241ec39a5bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "name": "network-vif-plugged", "status": "completed", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:43.226947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1aef8ad1-b5ea-4a81-8ee1-df1eef8353b3 req-e5342650-f509-44d1-9e97-241ec39a5bed service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:43.233615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1aef8ad1-b5ea-4a81-8ee1-df1eef8353b3 req-e5342650-f509-44d1-9e97-241ec39a5bed service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:43.234328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1aef8ad1-b5ea-4a81-8ee1-df1eef8353b3 req-e5342650-f509-44d1-9e97-241ec39a5bed service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:43.272385 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1aef8ad1-b5ea-4a81-8ee1-df1eef8353b3 req-e5342650-f509-44d1-9e97-241ec39a5bed service nova] Creating event network-vif-plugged:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:21:43.291189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1aef8ad1-b5ea-4a81-8ee1-df1eef8353b3 req-e5342650-f509-44d1-9e97-241ec39a5bed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120579 Oct 22 03:21:43.291976 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2038/4031] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:43.298610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:43.301993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:43.311176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:43.311933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:43.316518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:43.317716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:43.318539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:43.319350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.466247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:21:44.467415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:21:44.468112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:21:44.468959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:21:44.469586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:21:44.512917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:44.513408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:44.518166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.519208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:44.519853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:44.520643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.568454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Getting quotas for project f1f91285c5cf439194c1da640b4e1f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:21:44.577743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:44.578735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:44.580198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Getting quotas for user 50827aa842ce4e0bb8b21e57a3d5b318 and project f1f91285c5cf439194c1da640b4e1f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:21:44.587441 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a552c3c-11d5-4cf3-a3cd-a556988a4315 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 1.293881 Oct 22 03:21:44.603104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:21:44.610477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:21:44.614263 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2039/4032] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:43 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:44.646454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:44.649835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:44.679028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:44.679565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:44.689127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2013f0a5-76a4-44fa-8fa2-b24e0ec227c6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.834791 Oct 22 03:21:44.690102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1994/4033] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:21:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:21:44.697002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.697426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:44.697993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:44.698488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.721317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5b242996-0fe1-4a1f-ae2e-44deabeb1957 req-69487f69-edc9-4936-92bd-9b2d426be516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb680fc8-0d54-4742-b649-b82abbf4884e", "name": "network-vif-deleted", "tag": "d85d1270-815c-43e2-aa88-748b7e3a2c72"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:44.769795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5b242996-0fe1-4a1f-ae2e-44deabeb1957 req-69487f69-edc9-4936-92bd-9b2d426be516 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:44.774211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5b242996-0fe1-4a1f-ae2e-44deabeb1957 req-69487f69-edc9-4936-92bd-9b2d426be516 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:44.775312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5b242996-0fe1-4a1f-ae2e-44deabeb1957 req-69487f69-edc9-4936-92bd-9b2d426be516 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.816368 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5b242996-0fe1-4a1f-ae2e-44deabeb1957 req-69487f69-edc9-4936-92bd-9b2d426be516 service nova] Creating event network-vif-deleted:d85d1270-815c-43e2-aa88-748b7e3a2c72 for instance eb680fc8-0d54-4742-b649-b82abbf4884e on n-h1-862416-2 Oct 22 03:21:44.839319 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5b242996-0fe1-4a1f-ae2e-44deabeb1957 req-69487f69-edc9-4936-92bd-9b2d426be516 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138918 Oct 22 03:21:44.840059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:44.846998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:44.847525 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1995/4034] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:44.850716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.851411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lazy-loading 'fault' on Instance uuid eb680fc8-0d54-4742-b649-b82abbf4884e {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:21:44.863656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:44.871273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:44.888424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:44.889200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:44.889876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.891021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:44.892967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:44.893699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:44.974723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:44.993435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:44.997815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:45.001374 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2dadb86d-2e6b-4fca-88a6-81e957697290 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 200 len: 1371 microversion: 2.20 time: 0.385462 Oct 22 03:21:45.017402 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2040/4035] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:44 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:21:45.043850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd3569b3-e436-419e-a184-8d215d9b5b27 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:45.047339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd3569b3-e436-419e-a184-8d215d9b5b27 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:45.283545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:45.297036 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9cef30b2-5047-42c2-9650-3fc90e0abada tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.447883 Oct 22 03:21:45.300656 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1996/4036] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:44 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:45.349397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd3569b3-e436-419e-a184-8d215d9b5b27 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:45.370049 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd3569b3-e436-419e-a184-8d215d9b5b27 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1213 microversion: 2.1 time: 0.343846 Oct 22 03:21:45.371720 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2041/4037] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:45 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1213 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:45.614115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:45.615536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:45.631024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-57a48820-ae87-4467-ad99-533d2b846715 req-dc7167f3-b5b2-4955-95e7-16ec5f2bede9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67d3dae-96e2-4911-a260-0e046834d498", "name": "network-vif-plugged", "status": "completed", "tag": "735b21da-4bcb-43ae-a866-b324d932cd4d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:45.645962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:45.649644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:45.651476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:45.654574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:45.655184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:45.657493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:45.679638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57a48820-ae87-4467-ad99-533d2b846715 req-dc7167f3-b5b2-4955-95e7-16ec5f2bede9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:45.682712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57a48820-ae87-4467-ad99-533d2b846715 req-dc7167f3-b5b2-4955-95e7-16ec5f2bede9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:45.684066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57a48820-ae87-4467-ad99-533d2b846715 req-dc7167f3-b5b2-4955-95e7-16ec5f2bede9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:45.726453 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-57a48820-ae87-4467-ad99-533d2b846715 req-dc7167f3-b5b2-4955-95e7-16ec5f2bede9 service nova] Creating event network-vif-plugged:735b21da-4bcb-43ae-a866-b324d932cd4d for instance d67d3dae-96e2-4911-a260-0e046834d498 on n-h2-862416-2 Oct 22 03:21:45.745803 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-57a48820-ae87-4467-ad99-533d2b846715 req-dc7167f3-b5b2-4955-95e7-16ec5f2bede9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119010 Oct 22 03:21:45.753757 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2042/4038] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:45.953812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:45.955251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:45.973001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:45.979635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:45.981210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:45.986250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.003534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.006637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.017740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:46.039951 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1b89f1e7-a7ac-4abf-b161-98ddaf4e3f06 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 0.430480 Oct 22 03:21:46.040841 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1997/4039] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:45 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:46.059074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:46.063738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:46.089457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef HTTP/1.1 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'c9f44efb-8009-4ced-ac1e-ff47e2ab67ef'} Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:46.104548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.110151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.111550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.112468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:46.112875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.113888 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-008140c9-73fc-41ba-ac1b-bf9050a14643 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 404 len: 111 microversion: 2.1 time: 0.165431 Oct 22 03:21:46.114531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.115377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.117638 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2043/4040] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:45 2022] DELETE /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:46.118467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.119008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.130726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:46.131413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: c9f44efb-8009-4ced-ac1e-ff47e2ab67ef] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:46.145535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.146242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.146714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.148643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.150819 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] HTTP exception thrown: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:21:46.151076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.151638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Request method failure captured: Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e HTTP/1.1 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Cpx_sDdPCAh6PeAQtXSy8eGyMbbevw5OzVqWm_rxfHyK_1Z2XeW7erChZ3omCqTOng5mfBnAcsuSZPgp0oSF1a6s_zI0oimF0FfNrXocc71yxDoHCHm8XMd4PVnJ-LFl_2M2yMTAm-HWAePu438dQWgA3WyVhvYGa2vMtxZRxmzeg Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}] Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 538f74faf48e4343b1794378636552d2 Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'eb680fc8-0d54-4742-b649-b82abbf4884e'} Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.156038 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.161173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.161173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.161173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.161173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.161173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:46.161173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:46.161173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:21:46.161173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.164192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Returning 404 to user: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:46.167031 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-166cfdf7-5179-42a9-8b80-a4b581ebb5a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 404 len: 111 microversion: 2.20 time: 0.121201 Oct 22 03:21:46.170099 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1998/4041] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:21:46 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:21:46.179704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec1f7311-b0e8-49b7-8bf1-7dad470d66a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '.version_select at 0x7f0d196855e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:46.195140 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef HTTP/1.1 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'c9f44efb-8009-4ced-ac1e-ff47e2ab67ef'} Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.212246 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance c9f44efb-8009-4ced-ac1e-ff47e2ab67ef could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bbe480b1-c692-4668-873f-163772e513db tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef" status: 404 len: 111 microversion: 2.1 time: 0.085159 Oct 22 03:21:46.217439 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2044/4042] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:46 2022] GET /compute/v2.1/servers/c9f44efb-8009-4ced-ac1e-ff47e2ab67ef => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:46.238752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:46.239507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:46.255328 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ec1f7311-b0e8-49b7-8bf1-7dad470d66a6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-761533599" status: 204 len: 0 microversion: 2.20 time: 0.080513 Oct 22 03:21:46.256069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.257901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.259303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.260368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.261203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.261923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.281101 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.282158 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 1999/4043] 10.222.0.25 () {60 vars in 1259 bytes} [Sat Oct 22 03:21:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-761533599 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c HTTP/1.1 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '938f6f66-f2cf-4acd-8470-fa0df1b62f1c'} Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:46.283332 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.289606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.292762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:46.293141 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ff29d4c7-608d-45c3-8e50-661d9cab646b tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 404 len: 111 microversion: 2.1 time: 0.078193 Oct 22 03:21:46.294262 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2045/4044] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:21:46 2022] DELETE /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:46.306878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:46.308175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] [instance: 938f6f66-f2cf-4acd-8470-fa0df1b62f1c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:46.326806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:46.328564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:46.339855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.340734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.342469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.344320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.345072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.346047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.358514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.364226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.367795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.368804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.369467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.374040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.420417 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] HTTP exception thrown: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Request method failure captured: Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c HTTP/1.1 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BfKHbbd90RR6LZP4cLlkFFHWe7HejkBoIV4VPIg8TNTCnYcLhPDJQH1sw2Qmi-hEfVKxhGYyDkHh65wLXB7EID4y0FWri28fqCenYdrriH9eytgmlTFHkhIRLNlWG8-EgMhrQfZXLQhI7S-RoTYgsOEHdsNK3UbWzegGmoXWyk9ds Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27587c6206d249979148d0bb2a832036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27587c6206d249979148d0bb2a832036"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27587c6206d249979148d0bb2a832036"}]}] Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 27587c6206d249979148d0bb2a832036 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1397745438 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 7bd4c44f32a04da48b34c9c888f36fa6 Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1397745438-project Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '938f6f66-f2cf-4acd-8470-fa0df1b62f1c'} Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:21:46.429218 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.434605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:21:46.434605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:21:46.434605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:21:46.434605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:21:46.434605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:21:46.434605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. Oct 22 03:21:46.434605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:21:46.436796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] Returning 404 to user: Instance 938f6f66-f2cf-4acd-8470-fa0df1b62f1c could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:21:46.441596 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2e854d71-8ddf-4f50-8c89-6118ac47ffe4 tempest-DeleteServersTestJSON-1397745438 tempest-DeleteServersTestJSON-1397745438-project] 10.222.0.25 "GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c" status: 404 len: 111 microversion: 2.1 time: 0.143564 Oct 22 03:21:46.465008 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2000/4045] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:46 2022] GET /compute/v2.1/servers/938f6f66-f2cf-4acd-8470-fa0df1b62f1c => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:21:46.483975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:46.507352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:46.534557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.537834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.538497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.540907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:46.542087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:46.545928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:46.853853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:46.868308 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d33075bc-dab9-4584-9835-cece5caf78ae tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1265 microversion: 2.1 time: 0.388236 Oct 22 03:21:46.872585 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2001/4046] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:46 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1265 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:46.985975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:47.003874 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a55981f4-77bf-4af5-8866-05ad94a7e6d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.683116 Oct 22 03:21:47.007768 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2046/4047] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:46 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:47.064538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:47.065309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:47.077069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:47.080351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:47.080848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:47.081585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:47.087073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:47.087525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:47.897807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:47.899128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:47.925872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:47.930322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:47.937413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:47.938706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:47.944151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:47.948376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:48.326733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:48.349514 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c7f251cc-9524-40d8-83e0-5acea766541a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1283 microversion: 2.1 time: 0.457371 Oct 22 03:21:48.354051 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2047/4048] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:47 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1283 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:48.381021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:48.384059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:48.401521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:48.402384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:48.402995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:48.409078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:48.409793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:48.410421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:48.902427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:48.919141 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2528496c-ea88-4b59-ae7d-a38c17a2ca55 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1506 microversion: 2.1 time: 0.554245 Oct 22 03:21:48.930459 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2048/4049] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:48 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:49.151193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:49.180977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9334832a-bca8-40e2-acee-72561454cc5e tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1332 microversion: 2.1 time: 2.119812 Oct 22 03:21:49.181945 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2002/4050] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:47 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1332 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:49.377431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:49.378142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:49.398751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:49.399540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:49.400365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:49.401237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:49.401842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:49.402431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:49.544421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:49.554586 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a85c89ba-27a5-402f-be0f-d66b97e023a8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1271 microversion: 2.1 time: 0.181315 Oct 22 03:21:49.574361 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2049/4051] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:49 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:49.962826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:49.963690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:49.983770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:49.987352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:49.988128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:49.989195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:49.991989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:49.996098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:50.207700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:50.208289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:50.224029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:50.224564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:50.225263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:50.225803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:50.226275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:50.226709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:50.401131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:50.465247 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-55735772-b99a-4d32-8ffc-0385da09dd05 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1486 microversion: 2.1 time: 0.509572 Oct 22 03:21:50.467405 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2003/4052] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:49 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1486 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:50.486749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bfddf7fc-a46f-45e8-b6f9-0c5a7b499856 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'create', calling method: .version_select at 0x7f0d1e5098b0>, body: {"keypair": {"name": "tempest-keypair-25466774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6wRlHFL2wJehblH82eLr84KqyVu5+vGbr0cMkRmYhAH4ofyfhfpr0BSZW3oI9caFeV87QfzY/HoFrTY2Jr5Vy6T4kLgpZcKk5NTQyrOip897UJR552gWO60Hl0gJGMnQ=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:50.525510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-bfddf7fc-a46f-45e8-b6f9-0c5a7b499856 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Getting quotas for project 0acbea2993cb4d1d81f171c1b7f07443. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:21:50.539038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-bfddf7fc-a46f-45e8-b6f9-0c5a7b499856 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Getting quotas for user 538f74faf48e4343b1794378636552d2 and project 0acbea2993cb4d1d81f171c1b7f07443. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:21:50.571428 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bfddf7fc-a46f-45e8-b6f9-0c5a7b499856 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.100802 Oct 22 03:21:50.572766 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2004/4053] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Oct 22 03:21:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 22 03:21:50.598078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:50.600440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:50.624172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:50.627274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:50.628456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:50.631149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:50.633423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:50.635246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:50.781087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:50.795207 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e0453511-9b0d-468e-897d-50d0e9769e96 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1535 microversion: 2.1 time: 0.591742 Oct 22 03:21:50.796424 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2050/4054] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:50 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1535 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:50.801671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1044945859", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:50.923257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] validate_networks() for [('15708bca-6225-42cd-bc0d-033c10bb7198', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:21:50.997452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:51.011668 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f17a1caf-81fc-4995-8985-06195a218bb1 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1313 microversion: 2.1 time: 0.426718 Oct 22 03:21:51.024239 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2005/4055] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:50 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:51.032711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2869b6f1-b532-49d9-9edb-962fe9cda9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'create', calling method: .version_select at 0x7f0d19686310>, body: {"pool": "55370f84-6f6d-40f1-8b4b-a7511a9ada23"} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:52.186699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:21:52.187611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:21:52.187818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:21:52.188489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:21:52.188913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:21:52.205948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:52.206823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:52.207905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:52.208954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:52.209602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:52.211069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:52.271485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Getting quotas for project d98cea0b45fe423ea345888fe03ad61f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:21:52.279190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Getting quotas for user 2bfdbcbd066b4e6589f216a9c8bb685c and project d98cea0b45fe423ea345888fe03ad61f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:21:52.320711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:21:52.323112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:21:52.471933 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9acc223e-64fd-4927-bc7e-30f23ea9aacb tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.674131 Oct 22 03:21:52.481217 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2051/4056] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:21:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:21:52.506288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:52.526016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:52.580527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:52.580950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:52.583930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:52.586623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:52.587686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:52.590013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:54.255814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:54.273669 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c817fe0e-6ed6-4b1b-9eb6-dd7f515dcc0f tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 1.777280 Oct 22 03:21:54.274638 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2052/4057] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:52 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:54.291995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:54.292626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:54.309958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:54.311369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:54.312047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:54.313460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:54.314091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:54.314684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:54.552131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:54.568889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:54.583664 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-074991ce-fc83-43c8-b609-945905ed8e6a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1266 microversion: 2.1 time: 0.306194 Oct 22 03:21:54.586658 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2053/4058] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:54 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:54.596810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a12ffd0d-f2b3-42ed-9137-6b4a796147e0 req-b0174bf3-f1da-438b-9d5f-d00beaed3168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728b11ec-aba0-40d7-a1bf-053a236b4058", "tag": "58edeaa5-c714-4c3a-ba92-ec3de4a8bbb9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:54.626690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a12ffd0d-f2b3-42ed-9137-6b4a796147e0 req-b0174bf3-f1da-438b-9d5f-d00beaed3168 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:54.627452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a12ffd0d-f2b3-42ed-9137-6b4a796147e0 req-b0174bf3-f1da-438b-9d5f-d00beaed3168 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:54.628091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a12ffd0d-f2b3-42ed-9137-6b4a796147e0 req-b0174bf3-f1da-438b-9d5f-d00beaed3168 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:54.654174 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a12ffd0d-f2b3-42ed-9137-6b4a796147e0 req-b0174bf3-f1da-438b-9d5f-d00beaed3168 service nova] Creating event network-changed:58edeaa5-c714-4c3a-ba92-ec3de4a8bbb9 for instance 728b11ec-aba0-40d7-a1bf-053a236b4058 on n-h2-862416-2 Oct 22 03:21:54.676324 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a12ffd0d-f2b3-42ed-9137-6b4a796147e0 req-b0174bf3-f1da-438b-9d5f-d00beaed3168 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088045 Oct 22 03:21:54.677267 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2054/4059] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:55.247376 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2869b6f1-b532-49d9-9edb-962fe9cda9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.232104 Oct 22 03:21:55.248259 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2006/4060] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:21:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:55.262703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.148"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:55.266064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:55.285703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:55.287066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:55.289076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:55.290063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:55.291473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:55.299584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:55.300502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:55.306999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:55.312545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:55.314046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:55.316231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:55.317489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:55.318114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:55.321147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:55.374558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:21:55.380543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquired lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:21:55.719001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:55.729680 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2670deae-204b-4b8b-8482-1ba9b899a772 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.434430 Oct 22 03:21:55.730554 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2007/4061] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:55 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:55.742178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:55.742801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:55.761087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:55.763778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:55.764274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:55.765038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:55.765496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:55.765932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:56.130003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:56.141886 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e3fe5546-729d-49f0-af11-c90e3838007a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1272 microversion: 2.1 time: 0.408478 Oct 22 03:21:56.142481 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2008/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:55 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1272 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:56.714866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a6aac22a-60c2-47d4-81ce-ad04cb14fde5 req-7639c1f8-5262-40fd-9d7d-8ef2721f17bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728b11ec-aba0-40d7-a1bf-053a236b4058", "tag": "e3ba5b77-9487-4929-b98f-06b9b516260b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:56.729821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a6aac22a-60c2-47d4-81ce-ad04cb14fde5 req-7639c1f8-5262-40fd-9d7d-8ef2721f17bf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:56.731299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a6aac22a-60c2-47d4-81ce-ad04cb14fde5 req-7639c1f8-5262-40fd-9d7d-8ef2721f17bf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:56.731924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a6aac22a-60c2-47d4-81ce-ad04cb14fde5 req-7639c1f8-5262-40fd-9d7d-8ef2721f17bf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:56.758551 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a6aac22a-60c2-47d4-81ce-ad04cb14fde5 req-7639c1f8-5262-40fd-9d7d-8ef2721f17bf service nova] Creating event network-changed:e3ba5b77-9487-4929-b98f-06b9b516260b for instance 728b11ec-aba0-40d7-a1bf-053a236b4058 on n-h2-862416-2 Oct 22 03:21:56.775021 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a6aac22a-60c2-47d4-81ce-ad04cb14fde5 req-7639c1f8-5262-40fd-9d7d-8ef2721f17bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066014 Oct 22 03:21:56.779376 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2009/4063] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:21:56.794523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:56.795526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:56.809222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:56.810424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:56.811058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:56.811951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:56.812656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:56.813259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:57.221045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:57.247344 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-53e83e8b-e096-49bd-9a09-b80c5bf537e9 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.466380 Oct 22 03:21:57.249002 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2010/4064] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:56 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:57.257343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:57.266287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:57.289135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:57.290053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:57.290994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:57.291996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:57.293993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:57.294702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:57.604139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:57.613146 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63e1e948-ec55-4eb9-bf12-3450d0b66137 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1314 microversion: 2.1 time: 0.361794 Oct 22 03:21:57.614829 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2011/4065] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:57 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:21:58.275303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:58.275950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:58.284855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:58.285606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:58.286232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:58.287130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:58.287769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:58.289095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:58.603084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:58.610092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:21:58.618249 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4665fbaf-77dd-4d87-82e5-d98262b84d3a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.347180 Oct 22 03:21:58.618857 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2012/4066] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:58 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:58.642447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:58.643083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:58.662493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:58.664055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:58.664703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:58.665433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:58.665889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:58.666322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:58.950331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:21:58.958861 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-924e87ad-f868-45e7-905d-90fbca989d20 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1314 microversion: 2.1 time: 0.320598 Oct 22 03:21:58.962754 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2013/4067] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:58 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:21:59.033815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1e6401de-2c57-4552-9a1e-263fb420d4a5 req-271fcce7-1a65-4ae3-bdb9-3f1cde650297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "434ada49-cfb0-4e8a-9f6e-7131ae07f59e", "tag": "5b6b44b1-e880-408c-812e-4a8ec523821e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:21:59.093949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1e6401de-2c57-4552-9a1e-263fb420d4a5 req-271fcce7-1a65-4ae3-bdb9-3f1cde650297 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:59.097193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1e6401de-2c57-4552-9a1e-263fb420d4a5 req-271fcce7-1a65-4ae3-bdb9-3f1cde650297 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:59.098118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1e6401de-2c57-4552-9a1e-263fb420d4a5 req-271fcce7-1a65-4ae3-bdb9-3f1cde650297 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:59.121233 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1e6401de-2c57-4552-9a1e-263fb420d4a5 req-271fcce7-1a65-4ae3-bdb9-3f1cde650297 service nova] Creating event network-changed:5b6b44b1-e880-408c-812e-4a8ec523821e for instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e on n-h1-862416-2 Oct 22 03:21:59.129267 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1e6401de-2c57-4552-9a1e-263fb420d4a5 req-271fcce7-1a65-4ae3-bdb9-3f1cde650297 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124998 Oct 22 03:21:59.130675 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2014/4068] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:21:59.673659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:21:59.681430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:21:59.733856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:59.734861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:59.736664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:59.737665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:21:59.738692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:21:59.740509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:21:59.997866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:00.025175 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2998bae-ca91-4256-80eb-bba9b9ff6b92 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.382830 Oct 22 03:22:00.043765 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2015/4069] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:21:59 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:00.055886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:00.056758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:00.068668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:00.070485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:00.071678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:00.072761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:00.073343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:00.075096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:00.297798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:00.312120 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d44a450c-d570-421a-9ff8-9e65d4b08a31 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1314 microversion: 2.1 time: 0.266017 Oct 22 03:22:00.313165 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2016/4070] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:00 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:00.550447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:00.671013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-118974726", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bae3ff0-f144-4ed3-bbbc-59fa25cecb10"}], "security_groups": [{"name": "tempest-securitygroup--1631383886"}], "key_name": "tempest-keypair-25466774", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:00.900850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] validate_networks() for [('6bae3ff0-f144-4ed3-bbbc-59fa25cecb10', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:22:01.444763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Building network info cache for instance {{(pid=120581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:22:02.247996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:02.294851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:02.414399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:22:02.415597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:22:02.416297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:22:02.419314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:22:02.419989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:22:02.451092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:02.451977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:02.453679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:02.454845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:02.455601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:02.456248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:02.500923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Getting quotas for project 0acbea2993cb4d1d81f171c1b7f07443. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:02.509761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Getting quotas for user 538f74faf48e4343b1794378636552d2 and project 0acbea2993cb4d1d81f171c1b7f07443. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:02.547332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:22:02.550181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:22:02.722794 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08939a77-df25-4d61-bf63-cd767038c28b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.347146 Oct 22 03:22:02.738741 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2017/4071] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:22:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2366 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 22 03:22:02.753472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:02.754094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:02.776877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:02.777364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:02.783522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:02.790524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:02.791219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:02.792784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:03.299981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:03.309169 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-52f4de09-a180-4411-b909-391f695d8ca6 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.569356 Oct 22 03:22:03.314400 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2018/4072] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:02 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:03.328631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:03.329278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:03.360683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:03.361179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:03.361618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:03.362338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:03.362790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:03.363216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:03.993613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Updating instance_info_cache with network_info: [{"id": "735b21da-4bcb-43ae-a866-b324d932cd4d", "address": "fa:16:3e:f3:d5:d9", "network": {"id": "c1717994-f451-40dc-8e07-a83aa4c6ac42", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-317180432-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e2b547f13734416291736f3c199b6a35", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap735b21da-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:22:04.011943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Releasing lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:22:04.013061 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea285715-6f5a-45c3-82fc-bafee8e1a0ad tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action" status: 202 len: 0 microversion: 2.1 time: 8.756181 Oct 22 03:22:04.014135 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2055/4073] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:21:55 2022] POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action => generated 0 bytes in 8758 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 22 03:22:04.146763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-234f785b-ce11-494f-83d1-f7397a285a29 req-c42f7ca2-fb1b-4383-9c9c-11bf0d92dfba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67d3dae-96e2-4911-a260-0e046834d498", "tag": "735b21da-4bcb-43ae-a866-b324d932cd4d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:04.175099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-234f785b-ce11-494f-83d1-f7397a285a29 req-c42f7ca2-fb1b-4383-9c9c-11bf0d92dfba service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:04.175673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-234f785b-ce11-494f-83d1-f7397a285a29 req-c42f7ca2-fb1b-4383-9c9c-11bf0d92dfba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:04.176132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-234f785b-ce11-494f-83d1-f7397a285a29 req-c42f7ca2-fb1b-4383-9c9c-11bf0d92dfba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:04.176377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:04.187128 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-58011b01-055e-483f-9284-97a294543ee1 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1314 microversion: 2.1 time: 0.871148 Oct 22 03:22:04.210968 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2019/4074] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:03 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1314 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:04.212036 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-234f785b-ce11-494f-83d1-f7397a285a29 req-c42f7ca2-fb1b-4383-9c9c-11bf0d92dfba service nova] Creating event network-changed:735b21da-4bcb-43ae-a866-b324d932cd4d for instance d67d3dae-96e2-4911-a260-0e046834d498 on n-h2-862416-2 Oct 22 03:22:04.221666 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-234f785b-ce11-494f-83d1-f7397a285a29 req-c42f7ca2-fb1b-4383-9c9c-11bf0d92dfba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203179 Oct 22 03:22:04.227028 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2056/4075] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:04.234148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-265d9967-a824-412a-8e5a-5e1bc117b9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'create', calling method: .version_select at 0x7f0d19a4fdc0>, body: {"pool": "55370f84-6f6d-40f1-8b4b-a7511a9ada23"} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:04.243451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:04.245366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:04.259318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:04.262396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:04.263120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:04.264273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:04.269384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:04.270150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:04.523251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:04.544740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:04.546668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:04.551172 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7eb1adc4-3f10-4623-99e7-39d5bbe01815 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1275 microversion: 2.20 time: 0.335739 Oct 22 03:22:04.555527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2020/4076] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:04 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1275 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:04.563163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:04.567994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:04.576385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:04.577234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:04.578144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:04.579809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:04.580612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:04.582173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:05.494780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:05.528333 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-df98210c-c07e-495a-9afe-49b785f5699e tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.971140 Oct 22 03:22:05.534095 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2021/4077] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:04 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:05.543337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:05.544268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:05.559058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:05.560565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:05.561360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:05.562670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:05.563512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:05.565266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:06.108055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:06.118789 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f2821816-ab5b-419c-ad08-9f630fdb3d9a tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1314 microversion: 2.1 time: 0.582380 Oct 22 03:22:06.119588 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2022/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:05 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:06.147959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:06.149499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:06.161490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:06.162157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:06.163256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:06.164361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:06.165707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:06.166221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:06.320507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:06.329797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:06.342301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:06.346840 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e91e6469-583a-4c6c-82b6-58698ff76c77 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1337 microversion: 2.20 time: 0.211066 Oct 22 03:22:06.350110 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2023/4079] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:06 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1337 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:06.615716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1710791551", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "6425d219-4ca9-4edb-a016-e57fca2dd877"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:06.759759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] validate_networks() for [('6425d219-4ca9-4edb-a016-e57fca2dd877', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:22:07.551269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:22:07.551699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:22:07.552172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:22:07.552675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:22:07.553086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:22:07.569717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:07.570412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:07.571038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:07.571772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:07.574752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:07.575199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:07.641931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Getting quotas for project f8f40fccecee4aa78ece1199e723fe92. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:07.666396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:07.670716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Getting quotas for user 1c3a5cbf892f4dacb0df384cdc4596fb and project f8f40fccecee4aa78ece1199e723fe92. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:07.724234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:22:07.729358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:22:07.897939 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9f87abff-57a1-4d6f-ab57-1513d3dc7d7d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541568 Oct 22 03:22:07.904657 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2024/4080] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:22:07.920234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:07.920699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:07.939535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:07.940484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:07.940603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:07.947515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:07.952588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:07.953070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:08.224645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:08.240118 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aedd1180-ebbd-4338-a4d3-9d2a6c7e4f67 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.339579 Oct 22 03:22:08.242287 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2025/4081] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:07 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:08.250618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:08.251724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:08.275939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:08.276765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:08.277452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:08.278640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:08.279374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:08.280129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:08.909750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:08.924553 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b559032-1756-44fb-a1dd-a60fab69a719 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1314 microversion: 2.1 time: 0.678974 Oct 22 03:22:08.926873 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2026/4082] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:08 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:08.960055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:08.963233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:08.983947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:08.984806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:08.985446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:08.986365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:08.989064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:08.989725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.266776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:09.276961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:09.278857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:09.280988 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9287fc08-a2e4-49a1-9da2-77a57b1fd2ea tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1405 microversion: 2.20 time: 0.334178 Oct 22 03:22:09.283562 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2027/4083] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:08 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1405 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:09.298045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:09.301541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:09.314100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.315409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.316029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.316962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.317872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.318483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.376132 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-265d9967-a824-412a-8e5a-5e1bc117b9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.147043 Oct 22 03:22:09.377589 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2057/4084] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:22:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:09.389965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:09.390781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:09.393009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:09.400106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:09.403826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.404649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.409364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.410529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.411601 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-26bda5c2-7f98-4a97-b068-0e7ee8fadf49 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1277 microversion: 2.1 time: 0.126485 Oct 22 03:22:09.412540 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2028/4085] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:09 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:09.413456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.414293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.467302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:09.701647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:09.702429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:09.712414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.712917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.713394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.714123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.714571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.715006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.768847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:22:09.789881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:09.800650 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a9903c7e-ebeb-481c-9b80-4dae734b6552 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.421515 Oct 22 03:22:09.801646 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2058/4086] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:09 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:09.808438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8370bcfb-ad4a-49aa-8bc9-594ade195e07 req-955f0442-389f-4e0b-b40d-e4ce6228e89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728b11ec-aba0-40d7-a1bf-053a236b4058", "name": "network-vif-plugged", "status": "completed", "tag": "58edeaa5-c714-4c3a-ba92-ec3de4a8bbb9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:09.822927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8370bcfb-ad4a-49aa-8bc9-594ade195e07 req-955f0442-389f-4e0b-b40d-e4ce6228e89a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.824918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8370bcfb-ad4a-49aa-8bc9-594ade195e07 req-955f0442-389f-4e0b-b40d-e4ce6228e89a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.825994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8370bcfb-ad4a-49aa-8bc9-594ade195e07 req-955f0442-389f-4e0b-b40d-e4ce6228e89a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.844647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:09.845618 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8370bcfb-ad4a-49aa-8bc9-594ade195e07 req-955f0442-389f-4e0b-b40d-e4ce6228e89a service nova] Creating event network-vif-plugged:58edeaa5-c714-4c3a-ba92-ec3de4a8bbb9 for instance 728b11ec-aba0-40d7-a1bf-053a236b4058 on n-h2-862416-2 Oct 22 03:22:09.855371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8370bcfb-ad4a-49aa-8bc9-594ade195e07 req-955f0442-389f-4e0b-b40d-e4ce6228e89a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052243 Oct 22 03:22:09.856194 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2059/4087] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:09.867139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:09.868246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:09.875877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.877347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.878050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.879033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.879733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.880462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.897268 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2037c413-ed47-44fd-bb03-3c04954dab0b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 204 len: 0 microversion: 2.42 time: 0.479901 Oct 22 03:22:09.898488 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2029/4088] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:22:09 2022] DELETE /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:22:09.914133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.33"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:09.917732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:09.926395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.927449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.929262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.930466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:09.930977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:09.931481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:09.968445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:22:09.969150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquired lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:22:10.210859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:10.223302 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0777951d-4ada-4221-b049-b8817a979a50 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.365759 Oct 22 03:22:10.241241 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2060/4089] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:09 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:10.247200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-637582660"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:10.249977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:10.257767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.258811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.259527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.260701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.261313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.262124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.507983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.33 (57c6ebe6-0ef4-44c8-b496-2e9d3656601a) with port 735b21da-4bcb-43ae-a866-b324d932cd4d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55370f84-6f6d-40f1-8b4b-a7511a9ada23.", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:22:10.508597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Releasing lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:22:10.509153 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.33 (57c6ebe6-0ef4-44c8-b496-2e9d3656601a) with port 735b21da-4bcb-43ae-a866-b324d932cd4d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55370f84-6f6d-40f1-8b4b-a7511a9ada23. Oct 22 03:22:10.509153 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-ba50c004-0d3c-4548-ae65-70694de84b50'] Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Request method failure captured: Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action HTTP/1.1 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 45 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2G1_HUmrXbohU4eDrSzv28KAkxqiBoWds-XZThrbM2VAiUtQVJGHDOc-nXSiXUKQ-gIiCYtn1N6VRUXWiJflvhE8ZIgzBvDptop-nw_0wA28GsW2rkZJkYpblZmnNv_uJx4xA7-_9h2lCJdRzpgeL1hIiYymbhoFibIDVUerv5Xwlw Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2b547f13734416291736f3c199b6a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2b547f13734416291736f3c199b6a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}] Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 25678cce32e1475b9b56524158727f47 Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: {"addFloatingIp": {"address": "172.25.2.33"}} Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot associate floating IP 172.25.2.33 (57c6ebe6-0ef4-44c8-b496-2e9d3656601a) with port 735b21da-4bcb-43ae-a866-b324d932cd4d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55370f84-6f6d-40f1-8b4b-a7511a9ada23. Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-ba50c004-0d3c-4548-ae65-70694de84b50'] Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd67d3dae-96e2-4911-a260-0e046834d498', 'body': {'addFloatingIp': {'address': '172.25.2.33'}}} Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:22:10.511375 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.33 (57c6ebe6-0ef4-44c8-b496-2e9d3656601a) with port 735b21da-4bcb-43ae-a866-b324d932cd4d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55370f84-6f6d-40f1-8b4b-a7511a9ada23. Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba50c004-0d3c-4548-ae65-70694de84b50'] Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.33 (57c6ebe6-0ef4-44c8-b496-2e9d3656601a) with port 735b21da-4bcb-43ae-a866-b324d932cd4d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55370f84-6f6d-40f1-8b4b-a7511a9ada23. Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba50c004-0d3c-4548-ae65-70694de84b50'] Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.33 (57c6ebe6-0ef4-44c8-b496-2e9d3656601a) with port 735b21da-4bcb-43ae-a866-b324d932cd4d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55370f84-6f6d-40f1-8b4b-a7511a9ada23. Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba50c004-0d3c-4548-ae65-70694de84b50'] Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.33 (57c6ebe6-0ef4-44c8-b496-2e9d3656601a) with port 735b21da-4bcb-43ae-a866-b324d932cd4d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55370f84-6f6d-40f1-8b4b-a7511a9ada23. Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba50c004-0d3c-4548-ae65-70694de84b50'] Oct 22 03:22:10.517717 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Returning 400 to user: Cannot associate floating IP 172.25.2.33 (57c6ebe6-0ef4-44c8-b496-2e9d3656601a) with port 735b21da-4bcb-43ae-a866-b324d932cd4d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55370f84-6f6d-40f1-8b4b-a7511a9ada23. Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-ba50c004-0d3c-4548-ae65-70694de84b50'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3bec74e9-e16c-443e-90da-0a3271f34c4d tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action" status: 400 len: 380 microversion: 2.1 time: 0.613353 Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2030/4090] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:09 2022] POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action => generated 380 bytes in 615 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.528882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.530426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.530426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.530748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.550429 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e0a558b-6653-478e-a74d-f85b737266f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.307242 Oct 22 03:22:10.551122 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2061/4091] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:10 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 22 03:22:10.560871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:10.561567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:10.574934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.575324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.575705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.576439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.577270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.577874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.759129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:10.771191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:10.773503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:10.775442 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a23ead04-37a5-4cac-b4cd-44722a7902bd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2960 microversion: 2.42 time: 0.260116 Oct 22 03:22:10.776910 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2031/4092] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:10 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2960 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:10.785719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:10.786636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:10.796796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.798204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.798748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.800449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.801401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.801856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.932688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:10.944296 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3779e752-d668-49fa-a3b8-1e79be67b858 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1314 microversion: 2.1 time: 0.389110 Oct 22 03:22:10.946941 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2062/4093] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:10 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:10.953016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:10.953747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:10.962330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.962822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.964044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:10.965118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:10.965744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:10.966576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:11.003316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:11.013643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:11.015395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:11.016677 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5e0e461-af23-45f7-9b6b-c70bc9e64ecd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1405 microversion: 2.20 time: 0.238579 Oct 22 03:22:11.017808 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2032/4094] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:10 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:11.024055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7249982-2732-4723-b479-c341a9e5695b tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '.version_select at 0x7f0d196d6ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:11.114550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:11.126296 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ae4bed7-991e-4738-8ff2-8b94e53a3ef1 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1285 microversion: 2.1 time: 0.177963 Oct 22 03:22:11.129108 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2063/4095] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:10 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:11.140829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:11.141464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:11.156704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:11.156876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:11.157730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:11.158657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:11.159288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:11.162185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:11.577836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:11.590883 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-121ff678-3197-4146-b993-065724e84761 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.460029 Oct 22 03:22:11.591956 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2064/4096] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:11 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:11.603959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2e5a9d8d-2382-4992-aef8-68269a0a2ed4 req-d1b36662-4cdb-409b-ad4a-e4b81f852937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d2acf4-a7dd-46af-ae59-83a28eccaa4f", "tag": "01c4850c-25d7-4312-836a-b864a1ef4bed"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:11.619205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2e5a9d8d-2382-4992-aef8-68269a0a2ed4 req-d1b36662-4cdb-409b-ad4a-e4b81f852937 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:11.619978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2e5a9d8d-2382-4992-aef8-68269a0a2ed4 req-d1b36662-4cdb-409b-ad4a-e4b81f852937 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:11.620282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2e5a9d8d-2382-4992-aef8-68269a0a2ed4 req-d1b36662-4cdb-409b-ad4a-e4b81f852937 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:11.635810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2e5a9d8d-2382-4992-aef8-68269a0a2ed4 req-d1b36662-4cdb-409b-ad4a-e4b81f852937 service nova] Creating event network-changed:01c4850c-25d7-4312-836a-b864a1ef4bed for instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f on n-h2-862416-2 Oct 22 03:22:11.641274 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2e5a9d8d-2382-4992-aef8-68269a0a2ed4 req-d1b36662-4cdb-409b-ad4a-e4b81f852937 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045656 Oct 22 03:22:11.642340 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2065/4097] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:11.648823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:11.649470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:11.656844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:11.657403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:11.657846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:11.658587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:11.659038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:11.660012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:11.905802 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e7249982-2732-4723-b479-c341a9e5695b tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/57c6ebe6-0ef4-44c8-b496-2e9d3656601a" status: 202 len: 0 microversion: 2.1 time: 0.886647 Oct 22 03:22:11.906708 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2033/4098] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:22:11 2022] DELETE /compute/v2.1/os-floating-ips/57c6ebe6-0ef4-44c8-b496-2e9d3656601a => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:22:11.911490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:11.912085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:11.919579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:11.920340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:11.920778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:11.921487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:11.921938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:11.922360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:12.015102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:12.028411 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ccd36f1-c03b-4173-8db1-5f938c60ad01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.381243 Oct 22 03:22:12.029093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2066/4099] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:11 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:12.044717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-be95f79b-1ded-475d-9621-687752fefd10 req-7cf1507c-933b-4786-a58c-e5014698484b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ada49-cfb0-4e8a-9f6e-7131ae07f59e", "name": "network-vif-plugged", "status": "completed", "tag": "5b6b44b1-e880-408c-812e-4a8ec523821e"}, {"server_uuid": "728b11ec-aba0-40d7-a1bf-053a236b4058", "name": "network-vif-plugged", "status": "completed", "tag": "e3ba5b77-9487-4929-b98f-06b9b516260b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:12.069234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-be95f79b-1ded-475d-9621-687752fefd10 req-7cf1507c-933b-4786-a58c-e5014698484b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:12.069713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-be95f79b-1ded-475d-9621-687752fefd10 req-7cf1507c-933b-4786-a58c-e5014698484b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:12.074044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-be95f79b-1ded-475d-9621-687752fefd10 req-7cf1507c-933b-4786-a58c-e5014698484b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:12.108806 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-be95f79b-1ded-475d-9621-687752fefd10 req-7cf1507c-933b-4786-a58c-e5014698484b service nova] Creating event network-vif-plugged:5b6b44b1-e880-408c-812e-4a8ec523821e for instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e on n-h1-862416-2 Oct 22 03:22:12.109483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-be95f79b-1ded-475d-9621-687752fefd10 req-7cf1507c-933b-4786-a58c-e5014698484b service nova] Creating event network-vif-plugged:e3ba5b77-9487-4929-b98f-06b9b516260b for instance 728b11ec-aba0-40d7-a1bf-053a236b4058 on n-h2-862416-2 Oct 22 03:22:12.129670 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-be95f79b-1ded-475d-9621-687752fefd10 req-7cf1507c-933b-4786-a58c-e5014698484b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097342 Oct 22 03:22:12.136725 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2067/4100] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:12.149699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.148"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:12.290828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:12.302064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:12.304067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:12.306717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d154e075-1135-423f-8d22-d72886eb5548 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2960 microversion: 2.42 time: 0.398954 Oct 22 03:22:12.324835 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2034/4101] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:11 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2960 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:12.329891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:12.330509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:12.344986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:12.345755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:12.346627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:12.347537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:12.348172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:12.348793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:12.726856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:12.752679 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b9b5102-b3b6-42b8-b582-67cab86fa029 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1314 microversion: 2.1 time: 0.415234 Oct 22 03:22:12.753708 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2035/4102] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:12 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:12.775052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:12.775895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:12.781281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:12.784384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:12.785066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:12.785665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:12.786579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:12.787042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:12.787439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:12.788825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:12.789332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:12.789775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:12.790492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:12.790951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:12.791384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:13.238108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:22:13.238689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquired lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:22:13.354086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:13.366540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:13.368196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:13.369633 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea489dff-38dd-467a-b269-24fe05e1e797 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1405 microversion: 2.20 time: 0.600013 Oct 22 03:22:13.370542 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2036/4103] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:12 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1405 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:13.377466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:13.378248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:13.386265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:13.389011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:13.389702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:13.390613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:13.391244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:13.391839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:13.500808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:13.510256 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39c8f886-ccf4-4311-a9ed-c5e7ce22f57a tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1283 microversion: 2.1 time: 0.138255 Oct 22 03:22:13.510839 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2037/4104] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:13 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:13.515827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:13.516808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:13.523522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:13.524449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:13.525214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:13.526176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:13.526893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:13.527541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:13.862790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:13.871614 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bdf79fb0-f435-46fb-a975-e950a228bcad tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.359307 Oct 22 03:22:13.872590 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2038/4105] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:13 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:13.899347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:13.900941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:13.914953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:13.916957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:13.917579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:13.920348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:13.922224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:13.922887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:14.300663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Building network info cache for instance {{(pid=120581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:22:14.305804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:14.313851 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d81c9674-7b3c-4119-b6d0-609bf66386d0 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1334 microversion: 2.1 time: 0.439808 Oct 22 03:22:14.331028 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2039/4106] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:13 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1334 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:14.337688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:14.338666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:14.345220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:14.346037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:14.346867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:14.347810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:14.348536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:14.349211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:15.440199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:15.454704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:15.462272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:15.464099 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dbd5a82f-6029-4efe-9f4a-0ac837c68e9f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2960 microversion: 2.42 time: 1.131714 Oct 22 03:22:15.465193 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2040/4107] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:14 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2960 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:15.479998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:15.480972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:15.494320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:15.495071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:15.496610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:15.497535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:15.497993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:15.498418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:15.623005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Updating instance_info_cache with network_info: [{"id": "735b21da-4bcb-43ae-a866-b324d932cd4d", "address": "fa:16:3e:f3:d5:d9", "network": {"id": "c1717994-f451-40dc-8e07-a83aa4c6ac42", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-317180432-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e2b547f13734416291736f3c199b6a35", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap735b21da-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:22:15.656754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Releasing lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:22:15.663279 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fd2280eb-db4f-430f-854b-25541b7be568 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action" status: 202 len: 0 microversion: 2.1 time: 3.519861 Oct 22 03:22:15.664369 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2068/4108] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:12 2022] POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action => generated 0 bytes in 3527 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 03:22:15.676086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-65a75efe-20eb-47d8-8257-1aaac0af8940 req-96d7bcd9-d8d3-419f-9fe4-97801827b411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "name": "network-vif-unplugged", "status": "completed", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:15.699111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-65a75efe-20eb-47d8-8257-1aaac0af8940 req-96d7bcd9-d8d3-419f-9fe4-97801827b411 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:15.699965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-65a75efe-20eb-47d8-8257-1aaac0af8940 req-96d7bcd9-d8d3-419f-9fe4-97801827b411 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:15.700605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-65a75efe-20eb-47d8-8257-1aaac0af8940 req-96d7bcd9-d8d3-419f-9fe4-97801827b411 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:15.716889 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-65a75efe-20eb-47d8-8257-1aaac0af8940 req-96d7bcd9-d8d3-419f-9fe4-97801827b411 service nova] Creating event network-vif-unplugged:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:22:15.731850 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-65a75efe-20eb-47d8-8257-1aaac0af8940 req-96d7bcd9-d8d3-419f-9fe4-97801827b411 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066003 Oct 22 03:22:15.740368 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2069/4109] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:15.747693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6b79d1a1-dd6b-4fe7-bf3b-6663ac48e3cd req-ba7c7544-1ffa-41a9-a585-b9aa5b8fc261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67d3dae-96e2-4911-a260-0e046834d498", "tag": "735b21da-4bcb-43ae-a866-b324d932cd4d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:15.759679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6b79d1a1-dd6b-4fe7-bf3b-6663ac48e3cd req-ba7c7544-1ffa-41a9-a585-b9aa5b8fc261 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:15.760867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6b79d1a1-dd6b-4fe7-bf3b-6663ac48e3cd req-ba7c7544-1ffa-41a9-a585-b9aa5b8fc261 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:15.761542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6b79d1a1-dd6b-4fe7-bf3b-6663ac48e3cd req-ba7c7544-1ffa-41a9-a585-b9aa5b8fc261 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:15.797123 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6b79d1a1-dd6b-4fe7-bf3b-6663ac48e3cd req-ba7c7544-1ffa-41a9-a585-b9aa5b8fc261 service nova] Creating event network-changed:735b21da-4bcb-43ae-a866-b324d932cd4d for instance d67d3dae-96e2-4911-a260-0e046834d498 on n-h2-862416-2 Oct 22 03:22:15.811764 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6b79d1a1-dd6b-4fe7-bf3b-6663ac48e3cd req-ba7c7544-1ffa-41a9-a585-b9aa5b8fc261 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068349 Oct 22 03:22:15.812651 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2070/4110] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:15.842209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:15.842918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:15.857876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:15.858452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:15.859891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:15.861741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:15.862565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:15.863347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:16.014761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:16.023077 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4e1a14c6-eb2e-4300-9ddb-396656fc25ab tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1501 microversion: 2.1 time: 0.556530 Oct 22 03:22:16.026924 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2041/4111] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:15 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1501 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:16.054153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:16.063595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:16.088270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:16.089053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:16.089714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:16.090646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:16.091340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:16.091994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:16.947613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:16.960316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:16.966937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:16.971111 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0125f9b-42dd-4d15-b820-be154957dfbd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1405 microversion: 2.20 time: 1.154272 Oct 22 03:22:16.994804 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2071/4112] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:15 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1405 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:17.012265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:17.014147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:17.032289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:17.032892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:17.033333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:17.035051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:17.035759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:17.039353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:17.484257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:17.505597 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86fa0452-6806-43bf-b745-057475c40cfa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.509216 Oct 22 03:22:17.507127 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2072/4113] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:16 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:17.512143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:17.512989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:17.528548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:17.529322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:17.529935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:17.530848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:17.532824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:17.533467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:17.615194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:17.681322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:17.695270 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5ffa725b-4526-40f1-894b-a7429eb4a5eb tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1325 microversion: 2.1 time: 1.664753 Oct 22 03:22:17.708250 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2042/4114] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:16 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1325 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:17.718305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b57eef0-e37a-4dd6-a299-0a0676c9fd65 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '.version_select at 0x7f0d196858b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:17.730414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:17.896533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:17.913746 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3056680a-5df6-439e-a260-129f6b53ada5 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1669 microversion: 2.1 time: 0.405146 Oct 22 03:22:17.914638 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2073/4115] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:17 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1669 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:17.919817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:17.926182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:17.939880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:17.940428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:17.940873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:17.941602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:17.942055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:17.942488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:17.995015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lazy-loading 'flavor' on Instance uuid 434ada49-cfb0-4e8a-9f6e-7131ae07f59e {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:22:18.087209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:18.173800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d51b1bf2-eb03-4fc3-9cb6-cd2014a61dc9 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "POST /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e/action" status: 200 len: 32 microversion: 2.1 time: 0.257087 Oct 22 03:22:18.181856 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2074/4116] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:17 2022] POST /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:18.220650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:18.222073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:18.259262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:18.262630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:18.264528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:18.267978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:18.268714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:18.269410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:18.888345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:18.902855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:18.905946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:18.908403 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34c3d58c-0e79-436a-bb0e-fc2b64315a4b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2939 microversion: 2.42 time: 0.715198 Oct 22 03:22:18.913167 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2075/4117] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:18 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2939 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:18.922436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-47ae5afb-03d8-400d-9520-b653a175cd28 req-f6979f53-002b-4589-adb3-adbfc867d444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-unplugged", "status": "completed", "tag": "d5499ec1-d470-43a9-917f-7d60133064b3"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-unplugged", "status": "completed", "tag": "1803c5cf-d162-456c-9d47-fbf742cc2117"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:18.939420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-47ae5afb-03d8-400d-9520-b653a175cd28 req-f6979f53-002b-4589-adb3-adbfc867d444 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:18.940527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-47ae5afb-03d8-400d-9520-b653a175cd28 req-f6979f53-002b-4589-adb3-adbfc867d444 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:18.941237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-47ae5afb-03d8-400d-9520-b653a175cd28 req-f6979f53-002b-4589-adb3-adbfc867d444 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:18.976200 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-47ae5afb-03d8-400d-9520-b653a175cd28 req-f6979f53-002b-4589-adb3-adbfc867d444 service nova] Creating event network-vif-unplugged:d5499ec1-d470-43a9-917f-7d60133064b3 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:18.977851 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-47ae5afb-03d8-400d-9520-b653a175cd28 req-f6979f53-002b-4589-adb3-adbfc867d444 service nova] Creating event network-vif-unplugged:1803c5cf-d162-456c-9d47-fbf742cc2117 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:18.992032 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-47ae5afb-03d8-400d-9520-b653a175cd28 req-f6979f53-002b-4589-adb3-adbfc867d444 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.077103 Oct 22 03:22:18.994058 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2076/4118] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:19.001867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:19.003117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:19.016905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:19.017828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:19.018988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:19.019868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:19.020719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:19.021313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:19.101569 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1f3b8e0-5e05-4530-a3e7-da6ceb403e01 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058/ips" status: 200 len: 179 microversion: 2.1 time: 0.104713 Oct 22 03:22:19.111780 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2077/4119] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:22:18 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058/ips => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:19.126078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:19.128407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:19.145888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:19.146437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:19.146983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:19.148148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:19.150414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:19.152971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:19.639917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:19.653059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:19.654923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:19.656742 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13667228-f2d6-49a1-b11b-46ab79b10dd1 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1405 microversion: 2.20 time: 0.541966 Oct 22 03:22:19.658057 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2078/4120] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:19 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1405 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:19.664866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:19.666477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:19.674591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:19.675424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:19.676098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:19.677972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:19.678761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:19.679807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:19.927955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:19.962197 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb29e2d6-03ed-4072-8e0a-db68f332d4fa tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.302372 Oct 22 03:22:19.964356 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2079/4121] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:19 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:19.979901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:19.981633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:19.997329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.000341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.001140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:20.003086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.005156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.006931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:20.183813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:20.197084 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8aef5d4-4645-4cbb-8a2c-2c0ca1bed5cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.231035 Oct 22 03:22:20.198561 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2080/4122] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:19 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:20.203952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a76ff424-06c0-4107-bf11-c4ddd42c804e req-0b8b17be-988a-4939-911e-7e078bdd4594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133f8b66-bf51-4dbb-a70a-d1c7f70c0206", "tag": "742b49da-9e30-4f20-b7f1-764eee67595b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:20.227379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a76ff424-06c0-4107-bf11-c4ddd42c804e req-0b8b17be-988a-4939-911e-7e078bdd4594 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.228583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a76ff424-06c0-4107-bf11-c4ddd42c804e req-0b8b17be-988a-4939-911e-7e078bdd4594 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.229345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a76ff424-06c0-4107-bf11-c4ddd42c804e req-0b8b17be-988a-4939-911e-7e078bdd4594 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:20.246722 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a76ff424-06c0-4107-bf11-c4ddd42c804e req-0b8b17be-988a-4939-911e-7e078bdd4594 service nova] Creating event network-changed:742b49da-9e30-4f20-b7f1-764eee67595b for instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 on n-h1-862416-2 Oct 22 03:22:20.253452 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a76ff424-06c0-4107-bf11-c4ddd42c804e req-0b8b17be-988a-4939-911e-7e078bdd4594 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052939 Oct 22 03:22:20.255093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2081/4123] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:20.263492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:20.264602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:20.273475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.274319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.275060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:20.276358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.277076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.277771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:20.520454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:20.534676 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d730da32-6ad9-4af7-a6cd-e9de27ab827f tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1325 microversion: 2.1 time: 0.277971 Oct 22 03:22:20.553899 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2082/4124] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:20 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:20.561207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:20.562342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:20.574594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.575472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.576149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:20.577547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.578261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.578889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:20.629014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:22:20.813192 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6852a15d-8c10-499a-861a-5a9af3ea0a4c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 204 len: 0 microversion: 2.1 time: 0.256185 Oct 22 03:22:20.817490 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2083/4125] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:22:20 2022] DELETE /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:22:20.824998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:20.825726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:20.833836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.834395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.834884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:20.835551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:20.836379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:20.836506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.051201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:21.064380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:21.066162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:21.067456 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aab04b53-c8ad-41e9-8ef6-dc0ddc1efc8b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2918 microversion: 2.42 time: 0.248725 Oct 22 03:22:21.085437 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b57eef0-e37a-4dd6-a299-0a0676c9fd65 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/ac36ad91-c428-4dae-bd85-a86ff145888b" status: 202 len: 0 microversion: 2.1 time: 3.384677 Oct 22 03:22:21.088916 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2043/4126] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:22:17 2022] DELETE /compute/v2.1/os-floating-ips/ac36ad91-c428-4dae-bd85-a86ff145888b => generated 0 bytes in 3388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:22:21.090837 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2084/4127] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:20 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2918 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:21.091578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:21.092735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:21.097597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:21.105422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:21.111481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.113256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.114200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.115167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.116840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.117463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.119037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.122439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.128569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.129509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.130118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.130676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.405672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:21.418054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cdc786e8-a094-4f12-9654-d98939f789d3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1675 microversion: 2.1 time: 0.324547 Oct 22 03:22:21.419233 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2085/4128] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:21 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1675 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:21.424075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:21.425026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:21.439343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.439859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.440351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.441061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.441545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.441958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.667111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:21.675919 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6e24418-48d8-4467-af01-28b12f66d8af tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.255474 Oct 22 03:22:21.679595 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2086/4129] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:21 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:21.684585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-unplugged", "status": "completed", "tag": "6d3eca57-341f-44a5-8d5c-6b4ad5b49b6f"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-unplugged", "status": "completed", "tag": "68f3580a-51db-4299-85ac-3cbfb72ad4d5"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-unplugged", "status": "completed", "tag": "43dc5922-98fe-4209-b3a5-149d285766a6"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-unplugged", "status": "completed", "tag": "e8806837-4020-40fd-8dd1-cf247a8a5b36"}, {"server_uuid": "52d2acf4-a7dd-46af-ae59-83a28eccaa4f", "name": "network-vif-plugged", "status": "completed", "tag": "01c4850c-25d7-4312-836a-b864a1ef4bed"}, {"server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "name": "network-vif-plugged", "status": "completed", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:21.706453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.706943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.707599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.725912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Creating event network-vif-unplugged:6d3eca57-341f-44a5-8d5c-6b4ad5b49b6f for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:21.726296 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Creating event network-vif-unplugged:68f3580a-51db-4299-85ac-3cbfb72ad4d5 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:21.726786 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Creating event network-vif-unplugged:43dc5922-98fe-4209-b3a5-149d285766a6 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:21.730118 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Creating event network-vif-unplugged:e8806837-4020-40fd-8dd1-cf247a8a5b36 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:21.730539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Creating event network-vif-plugged:01c4850c-25d7-4312-836a-b864a1ef4bed for instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f on n-h2-862416-2 Oct 22 03:22:21.731518 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] Creating event network-vif-plugged:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:22:21.742932 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-825f9819-4caa-4f98-b224-241009ffd0c5 req-1c8ec88d-93e1-4308-a928-13b9fcaa8975 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1046 microversion: 2.1 time: 0.061988 Oct 22 03:22:21.743693 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2087/4130] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 1046 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:21.754302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25e8f7c3-ba2d-4177-bf61-31114f25f1f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25e8f7c3-ba2d-4177-bf61-31114f25f1f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Request method failure captured: Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action HTTP/1.1 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 34 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2G1_HUmrXbohU4eDrSzv28KAkxqiBoWds-XZThrbM2VAiUtQVJGHDOc-nXSiXUKQ-gIiCYtn1N6VRUXWiJflvhE8ZIgzBvDptop-nw_0wA28GsW2rkZJkYpblZmnNv_uJx4xA7-_9h2lCJdRzpgeL1hIiYymbhoFibIDVUerv5Xwlw Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2b547f13734416291736f3c199b6a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2b547f13734416291736f3c199b6a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}] Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 25678cce32e1475b9b56524158727f47 Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: {"addFloatingIp": {"address": ""}} Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd67d3dae-96e2-4911-a260-0e046834d498', 'body': {'addFloatingIp': {'address': ''}}} Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '' Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:22:21.762585 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25e8f7c3-ba2d-4177-bf61-31114f25f1f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25e8f7c3-ba2d-4177-bf61-31114f25f1f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action" status: 400 len: 142 microversion: 2.1 time: 0.015517 Oct 22 03:22:21.774050 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2088/4131] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:21 2022] POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:22:21.778397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:21.779141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:21.787407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.787952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.788567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.789208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.789667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.790101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.799920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:21.810658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:21.812963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:21.814621 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ceb65773-9843-4e94-8f4c-d7aa920b61b3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1405 microversion: 2.20 time: 0.727463 Oct 22 03:22:21.816035 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2044/4132] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:21 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1405 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:21.823540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:21.824787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:21.831821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.832573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.833183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.834711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:21.835345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:21.835942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:21.989383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:22.008495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4369a979-3b51-4b99-8d1e-14b03b135a53 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.234380 Oct 22 03:22:22.010074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2089/4133] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:21 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:22.018485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:22.022532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:22.030679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:22.031823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:22.032560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:22.033656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:22.034330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:22.035244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:22.095488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:22:22.096129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquired lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:22:22.263821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Releasing lock "refresh_cache-d67d3dae-96e2-4911-a260-0e046834d498" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:22:22.265007 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] HTTP exception thrown: floating IP not found Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Request method failure captured: Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action HTTP/1.1 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 41 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2G1_HUmrXbohU4eDrSzv28KAkxqiBoWds-XZThrbM2VAiUtQVJGHDOc-nXSiXUKQ-gIiCYtn1N6VRUXWiJflvhE8ZIgzBvDptop-nw_0wA28GsW2rkZJkYpblZmnNv_uJx4xA7-_9h2lCJdRzpgeL1hIiYymbhoFibIDVUerv5Xwlw Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2b547f13734416291736f3c199b6a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2b547f13734416291736f3c199b6a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}] Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 25678cce32e1475b9b56524158727f47 Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: exception: floating IP not found Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd67d3dae-96e2-4911-a260-0e046834d498', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 22 03:22:22.267503 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.272892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Returning 404 to user: floating IP not found {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:22.274068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c527eedc-160e-4088-95e2-2edf473955f3 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action" status: 404 len: 67 microversion: 2.1 time: 0.261797 Oct 22 03:22:22.275451 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2090/4134] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:22 2022] POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action => generated 67 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:22:22.281378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:22.282283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:22.290321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:22.291081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:22.291506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:22.292523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:22.293085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:22.293601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:22.540300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:22.548310 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1823ef09-cfe3-443e-b1b8-d718cc105ac9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1325 microversion: 2.1 time: 0.730997 Oct 22 03:22:22.548899 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2045/4135] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:21 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1325 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:22.566246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4fdbf62-6297-4180-83bb-1083e36669c1 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:22.647804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:22.667522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:22.674754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:22.676633 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-07dc5263-302f-4e2e-879b-06539e13f7a9 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2871 microversion: 2.42 time: 0.400069 Oct 22 03:22:22.679485 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2091/4136] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:22 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2871 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:22.690735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:22.691779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:22.701486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:22.702261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:22.705500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:22.706680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:22.707412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:22.710769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:22.809671 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e4fdbf62-6297-4180-83bb-1083e36669c1 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4fdbf62-6297-4180-83bb-1083e36669c1 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Request method failure captured: Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action HTTP/1.1 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 44 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2G1_HUmrXbohU4eDrSzv28KAkxqiBoWds-XZThrbM2VAiUtQVJGHDOc-nXSiXUKQ-gIiCYtn1N6VRUXWiJflvhE8ZIgzBvDptop-nw_0wA28GsW2rkZJkYpblZmnNv_uJx4xA7-_9h2lCJdRzpgeL1hIiYymbhoFibIDVUerv5Xwlw Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2b547f13734416291736f3c199b6a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2b547f13734416291736f3c199b6a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}] Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 25678cce32e1475b9b56524158727f47 Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: exception: Floating IP not found for address 0.0.0.0. Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd67d3dae-96e2-4911-a260-0e046834d498', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 22 03:22:22.812305 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 22 03:22:22.820741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:22.824017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4fdbf62-6297-4180-83bb-1083e36669c1 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:22.825163 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4fdbf62-6297-4180-83bb-1083e36669c1 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action" status: 404 len: 88 microversion: 2.1 time: 0.275337 Oct 22 03:22:22.830624 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2046/4137] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:22 2022] POST /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498/action => generated 88 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:22:22.935316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2033218398", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "58ff6c47-8a33-456d-82ed-98e75d34b28d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:23.130816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] validate_networks() for [('58ff6c47-8a33-456d-82ed-98e75d34b28d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:22:23.176669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:23.181083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:23.189201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b73e32df-e20c-40f5-a142-ded996ebca31 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1675 microversion: 2.1 time: 0.508219 Oct 22 03:22:23.192803 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2092/4138] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:22 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1675 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:23.200364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9a9a8621-7d23-412c-b967-a2d60328c527 req-c92d5abe-9e9d-49c3-a8db-0c7f341184b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-deleted", "tag": "1803c5cf-d162-456c-9d47-fbf742cc2117"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:23.239354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9a9a8621-7d23-412c-b967-a2d60328c527 req-c92d5abe-9e9d-49c3-a8db-0c7f341184b5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:23.240221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9a9a8621-7d23-412c-b967-a2d60328c527 req-c92d5abe-9e9d-49c3-a8db-0c7f341184b5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:23.241699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9a9a8621-7d23-412c-b967-a2d60328c527 req-c92d5abe-9e9d-49c3-a8db-0c7f341184b5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:23.267605 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9a9a8621-7d23-412c-b967-a2d60328c527 req-c92d5abe-9e9d-49c3-a8db-0c7f341184b5 service nova] Creating event network-vif-deleted:1803c5cf-d162-456c-9d47-fbf742cc2117 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:23.285028 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9a9a8621-7d23-412c-b967-a2d60328c527 req-c92d5abe-9e9d-49c3-a8db-0c7f341184b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089908 Oct 22 03:22:23.286009 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2093/4139] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:23.295140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:23.298118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:23.306499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:23.307339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:23.308707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:23.309675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:23.310424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:23.311250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:23.596773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:23.608755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af9effeb-40bd-41dc-b29a-ba35d37b1624 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.320012 Oct 22 03:22:23.609598 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2094/4140] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:23 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:23.617735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:23.618974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:23.642233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:23.642746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:23.643356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:23.644087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:23.644669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:23.645107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:23.701665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:22:23.981527 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b7a56b6-b999-4fc1-9e3e-5db8ab136152 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 204 len: 0 microversion: 2.1 time: 0.370853 Oct 22 03:22:23.982128 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2095/4141] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:22:23 2022] DELETE /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:22:23.987868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:23.993718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:24.021902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:24.022767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:24.023536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:24.024543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:24.025194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:24.025875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:24.330215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:24.345477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:24.347000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:24.348162 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a7403edd-2f05-4141-b355-24098b47804e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1405 microversion: 2.20 time: 0.364465 Oct 22 03:22:24.351815 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2096/4142] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:23 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1405 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:24.356470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:24.357059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:24.378349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:24.378696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:24.379779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:24.379921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:24.381562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:24.381562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:24.689374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:24.701850 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b78d80f1-9ca8-47ef-9b9d-34a82451c2a0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.349040 Oct 22 03:22:24.705512 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2097/4143] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:24 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:24.715888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:24.726800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:24.742525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:24.754603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:24.755362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:24.759436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:24.760131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:24.760785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:24.784218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:22:24.785266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:22:24.785758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:22:24.786172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:22:24.791635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:22:24.812882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:24.813329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:24.816477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:24.817557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:24.819615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:24.822351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:24.879844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Getting quotas for project baeef71a21d248e49eb2548a4a69bb2c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:24.901845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Getting quotas for user a0d479faa1f14d0ca72a1931b89aea08 and project baeef71a21d248e49eb2548a4a69bb2c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:24.946224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Going to run 2 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:22:24.950512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:22:25.039678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:22:25.204140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:25.220637 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e6c63ab-1d27-4f5e-9886-64cc4515eed2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1325 microversion: 2.1 time: 0.506092 Oct 22 03:22:25.223537 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2098/4144] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:24 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:25.236835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:25.245130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:25.263713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.264687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.265532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:25.267018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.267714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.268706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:25.286041 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bda906f6-92b3-47d3-ba54-5b4c9caf812f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.453870 Oct 22 03:22:25.287027 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2047/4145] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:22:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:22:25.307397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fa055a36-d6d3-4adf-8a55-49d136d7e2ca req-c2ba093a-271f-4df9-86ea-30c335a11f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728b11ec-aba0-40d7-a1bf-053a236b4058", "name": "network-vif-deleted", "tag": "58edeaa5-c714-4c3a-ba92-ec3de4a8bbb9"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:25.347556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fa055a36-d6d3-4adf-8a55-49d136d7e2ca req-c2ba093a-271f-4df9-86ea-30c335a11f76 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.348055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fa055a36-d6d3-4adf-8a55-49d136d7e2ca req-c2ba093a-271f-4df9-86ea-30c335a11f76 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.348523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fa055a36-d6d3-4adf-8a55-49d136d7e2ca req-c2ba093a-271f-4df9-86ea-30c335a11f76 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:25.380168 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fa055a36-d6d3-4adf-8a55-49d136d7e2ca req-c2ba093a-271f-4df9-86ea-30c335a11f76 service nova] Creating event network-vif-deleted:58edeaa5-c714-4c3a-ba92-ec3de4a8bbb9 for instance 728b11ec-aba0-40d7-a1bf-053a236b4058 on n-h2-862416-2 Oct 22 03:22:25.389127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fa055a36-d6d3-4adf-8a55-49d136d7e2ca req-c2ba093a-271f-4df9-86ea-30c335a11f76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100439 Oct 22 03:22:25.391596 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2048/4146] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:25.420036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:25.424971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:25.433120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.434158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.434774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:25.435678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.436402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.437029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:25.763362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:25.784138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:25.799277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:25.802893 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-257cb61f-4728-4b10-9009-e762ca1d39ad tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2710 microversion: 2.42 time: 0.578285 Oct 22 03:22:25.822700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:25.829219 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2099/4147] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:25 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2710 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:25.839958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:25.844139 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e1d6382a-b1c1-4379-8ebf-0f5a436d582a tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1541 microversion: 2.1 time: 0.450620 Oct 22 03:22:25.845329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:25.845764 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2049/4148] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:25 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1541 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:25.857539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:25.859911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:25.863131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.866766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.879113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:25.881760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.883987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.884841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.885496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:25.886252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.889410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:25.890586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:25.891074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:25.891515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:26.017633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:26.019743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:26.020894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:26.026848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lazy-loading 'fault' on Instance uuid 728b11ec-aba0-40d7-a1bf-053a236b4058 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:22:26.143094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50827aa842ce4e0bb8b21e57a3d5b318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f91285c5cf439194c1da640b4e1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:26.152877 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1586ec09-17fd-4096-b078-6645589ab97c tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 200 len: 1303 microversion: 2.1 time: 0.320856 Oct 22 03:22:26.157060 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2100/4149] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:25 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 1303 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:26.186923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:26.197223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:26.203244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Searching by: {'deleted': False, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:22:26.273044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:26.273693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:26.274224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:26.277729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:26.278340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:26.278872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:26.364277 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cdca86a1-e695-43e5-b5ec-3996ce3266c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.204816 Oct 22 03:22:26.370337 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2101/4150] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:22:26 2022] GET /compute/v2.1/servers => generated 677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:26.390077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:26.394986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:26.412619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:26.417124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:26.419355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:26.423068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:26.426452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:26.429004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:26.429161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:26.790274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:26.807502 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20d8ffd1-dfe1-46cd-8afa-d99207c1ab79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.960432 Oct 22 03:22:26.810220 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2050/4151] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:25 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:26.832419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:26.845617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:26.876162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:26.876616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:26.878638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:26.880110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:26.882210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:26.885086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:26.923112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:27.149636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:27.172617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:27.177177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:27.187076 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3934e9be-0306-461d-a981-ed16455572ab tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1597 microversion: 2.20 time: 0.813392 Oct 22 03:22:27.220417 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2102/4152] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:26 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1597 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:27.233998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b26d8544-a127-404e-ab04-ef5b4fb2742a req-9d72006b-bfd9-4386-b622-9de2206e7752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-deleted", "tag": "68f3580a-51db-4299-85ac-3cbfb72ad4d5"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:27.264840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b26d8544-a127-404e-ab04-ef5b4fb2742a req-9d72006b-bfd9-4386-b622-9de2206e7752 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:27.267398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b26d8544-a127-404e-ab04-ef5b4fb2742a req-9d72006b-bfd9-4386-b622-9de2206e7752 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:27.268024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b26d8544-a127-404e-ab04-ef5b4fb2742a req-9d72006b-bfd9-4386-b622-9de2206e7752 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:27.299750 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b26d8544-a127-404e-ab04-ef5b4fb2742a req-9d72006b-bfd9-4386-b622-9de2206e7752 service nova] Creating event network-vif-deleted:68f3580a-51db-4299-85ac-3cbfb72ad4d5 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:27.311386 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b26d8544-a127-404e-ab04-ef5b4fb2742a req-9d72006b-bfd9-4386-b622-9de2206e7752 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084526 Oct 22 03:22:27.314203 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2103/4153] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:27.345648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:27.351333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:27.369926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:27.371524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:27.373212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:27.377761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:27.379079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:27.380899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:27.770369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:27.780585 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-140985f1-c496-4554-b28d-e48e87f5d933 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.954764 Oct 22 03:22:27.787942 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2051/4154] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:26 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:27.810711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:27.816636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:27.845411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:27.847581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:27.849348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:27.856375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:27.857444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:27.859571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:27.940779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:27.972667 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-64971d6e-e1b2-45aa-86ae-049d798d0bd7 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1325 microversion: 2.1 time: 0.656975 Oct 22 03:22:27.976835 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2104/4155] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:27 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1325 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:27.999904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8cf8d94b-fa0f-4ee4-a3db-d3f27523b60a req-246c57eb-6836-4e25-965c-55a599e8a8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133f8b66-bf51-4dbb-a70a-d1c7f70c0206", "name": "network-vif-plugged", "status": "completed", "tag": "742b49da-9e30-4f20-b7f1-764eee67595b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:28.050533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8cf8d94b-fa0f-4ee4-a3db-d3f27523b60a req-246c57eb-6836-4e25-965c-55a599e8a8be service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.052152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8cf8d94b-fa0f-4ee4-a3db-d3f27523b60a req-246c57eb-6836-4e25-965c-55a599e8a8be service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.053724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8cf8d94b-fa0f-4ee4-a3db-d3f27523b60a req-246c57eb-6836-4e25-965c-55a599e8a8be service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.088358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8cf8d94b-fa0f-4ee4-a3db-d3f27523b60a req-246c57eb-6836-4e25-965c-55a599e8a8be service nova] Creating event network-vif-plugged:742b49da-9e30-4f20-b7f1-764eee67595b for instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 on n-h1-862416-2 Oct 22 03:22:28.093982 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8cf8d94b-fa0f-4ee4-a3db-d3f27523b60a req-246c57eb-6836-4e25-965c-55a599e8a8be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108635 Oct 22 03:22:28.095518 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2105/4156] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:28.102126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:28.103196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:28.112551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.113933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.114611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.116564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.117271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.117933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.539845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:28.563778 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98df330d-2ca5-4458-be10-6310ce2831d8 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1216 microversion: 2.1 time: 0.773041 Oct 22 03:22:28.564812 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2052/4157] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:27 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1216 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:28.572092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:28.573882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:28.583315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.584445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.585155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.586957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.588315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.591433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.598996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:28.613732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:28.618113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:28.622925 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8718739-36b6-4a33-b2f6-b49a462f9a49 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 2371 microversion: 2.42 time: 0.525986 Oct 22 03:22:28.647259 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2106/4158] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:28 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 2371 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:28.661662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:28.662929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:28.689493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.692181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.692729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.694001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.694485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.694921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.727545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.728054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.729891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.730380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lazy-loading 'fault' on Instance uuid d67d3dae-96e2-4911-a260-0e046834d498 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:22:28.744512 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] HTTP exception thrown: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Request method failure captured: Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 HTTP/1.1 Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2GMT0ek3fu-YE3f7R1oPbuLVDKYnEKw0PAqsmaoV1E2-DqwXcxTJTmKjTwixO_AFwra-7RH8UDeUg-YB20fLtNU6R36gUcfRAZA-XnRFWdvq3abaj2zLJ0MVvb_EX5gBI4i9JSr3PCKGghPIjll1NIIzSNfqgyuG39hSqVP6iOWmbY Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}] Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 50827aa842ce4e0bb8b21e57a3d5b318 Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '728b11ec-aba0-40d7-a1bf-053a236b4058'} Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:28.746274 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Returning 404 to user: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:28.751472 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2fe1f806-8083-4d4e-93d3-d5dc5d375ae3 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 404 len: 111 microversion: 2.1 time: 0.108994 Oct 22 03:22:28.756885 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2107/4159] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:28 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:22:28.772991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:28.773506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:28.783752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.784284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.784756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.785477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:28.785939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:28.786373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:28.959786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25678cce32e1475b9b56524158727f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b547f13734416291736f3c199b6a35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:28.979379 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1200f15b-efea-4d4c-be90-a43b36d97746 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 200 len: 1322 microversion: 2.1 time: 0.411091 Oct 22 03:22:28.980820 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2053/4160] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:28 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:28.981469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25bd3029-6d5f-494a-bc69-5741dca1608c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.223343 Oct 22 03:22:28.982560 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2108/4161] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Oct 22 03:22:28 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:22:28.987612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:28.988446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:28.999775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:29.003047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-01600ad2-db8a-4819-9730-52e492f2dbad req-830785cb-6362-42c1-916f-43362051cc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728b11ec-aba0-40d7-a1bf-053a236b4058", "name": "network-vif-deleted", "tag": "e3ba5b77-9487-4929-b98f-06b9b516260b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:29.007650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:29.008121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:29.010917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:29.014317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:29.014735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:29.038596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-01600ad2-db8a-4819-9730-52e492f2dbad req-830785cb-6362-42c1-916f-43362051cc12 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:29.039220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-01600ad2-db8a-4819-9730-52e492f2dbad req-830785cb-6362-42c1-916f-43362051cc12 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:29.039753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-01600ad2-db8a-4819-9730-52e492f2dbad req-830785cb-6362-42c1-916f-43362051cc12 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:29.115843 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-01600ad2-db8a-4819-9730-52e492f2dbad req-830785cb-6362-42c1-916f-43362051cc12 service nova] Creating event network-vif-deleted:e3ba5b77-9487-4929-b98f-06b9b516260b for instance 728b11ec-aba0-40d7-a1bf-053a236b4058 on n-h2-862416-2 Oct 22 03:22:29.129738 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-01600ad2-db8a-4819-9730-52e492f2dbad req-830785cb-6362-42c1-916f-43362051cc12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147217 Oct 22 03:22:29.130649 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2054/4162] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:29.136557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:29.137238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:29.167670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:29.176360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:29.180600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:29.181568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:29.182205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:29.187455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:29.849377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:29.863339 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0fd7ab65-a384-4423-9ea3-ee1fc39e23d7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.730907 Oct 22 03:22:29.867306 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2055/4163] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:29 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:29.868595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:29.875378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:29.875997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:29.884942 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c59a945-2d10-4e38-baba-11827a6c119d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.900898 Oct 22 03:22:29.889212 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2109/4164] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:28 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:29.894410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7afbb103-e6c0-43ef-a4fc-c3002aa74d76 req-cf08c462-87ab-45fb-b2b8-41d43867c397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-deleted", "tag": "43dc5922-98fe-4209-b3a5-149d285766a6"}, {"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-deleted", "tag": "e8806837-4020-40fd-8dd1-cf247a8a5b36"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:29.895331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:29.897322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:29.898878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:29.899957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:29.900928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:29.901909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:29.930297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7afbb103-e6c0-43ef-a4fc-c3002aa74d76 req-cf08c462-87ab-45fb-b2b8-41d43867c397 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:29.937682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7afbb103-e6c0-43ef-a4fc-c3002aa74d76 req-cf08c462-87ab-45fb-b2b8-41d43867c397 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:29.940624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7afbb103-e6c0-43ef-a4fc-c3002aa74d76 req-cf08c462-87ab-45fb-b2b8-41d43867c397 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:29.969207 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7afbb103-e6c0-43ef-a4fc-c3002aa74d76 req-cf08c462-87ab-45fb-b2b8-41d43867c397 service nova] Creating event network-vif-deleted:43dc5922-98fe-4209-b3a5-149d285766a6 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:29.993087 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7afbb103-e6c0-43ef-a4fc-c3002aa74d76 req-cf08c462-87ab-45fb-b2b8-41d43867c397 service nova] Creating event network-vif-deleted:e8806837-4020-40fd-8dd1-cf247a8a5b36 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:29.999007 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7afbb103-e6c0-43ef-a4fc-c3002aa74d76 req-cf08c462-87ab-45fb-b2b8-41d43867c397 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108354 Oct 22 03:22:30.001703 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2110/4165] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:30.007100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:30.010665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:30.017987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.018732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.019408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.020331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.021116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.022373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.229469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:30.241389 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-36e9844a-34d8-41df-b4f5-3d1d8d24217b tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1325 microversion: 2.1 time: 0.373986 Oct 22 03:22:30.272260 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2056/4166] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:29 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1325 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:30.277928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:30.285900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:30.304825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.310021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.313189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.314948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.315777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.318003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.421153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:30.440156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:30.441901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:30.444306 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d6ba3fc-200e-45fe-b2d3-7927859fd184 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.169866 Oct 22 03:22:30.452598 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2057/4167] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:30 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:30.458984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:30.463799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] [instance: d67d3dae-96e2-4911-a260-0e046834d498] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:30.482549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.483289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.483726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.484538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.485033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.485453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.521457 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] HTTP exception thrown: Instance d67d3dae-96e2-4911-a260-0e046834d498 could not be found. Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Request method failure captured: Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 HTTP/1.1 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2G1_HUmrXbohU4eDrSzv28KAkxqiBoWds-XZThrbM2VAiUtQVJGHDOc-nXSiXUKQ-gIiCYtn1N6VRUXWiJflvhE8ZIgzBvDptop-nw_0wA28GsW2rkZJkYpblZmnNv_uJx4xA7-_9h2lCJdRzpgeL1hIiYymbhoFibIDVUerv5Xwlw Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2b547f13734416291736f3c199b6a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2b547f13734416291736f3c199b6a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2b547f13734416291736f3c199b6a35"}]}] Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: e2b547f13734416291736f3c199b6a35 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 25678cce32e1475b9b56524158727f47 Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance d67d3dae-96e2-4911-a260-0e046834d498 could not be found. Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd67d3dae-96e2-4911-a260-0e046834d498'} Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67d3dae-96e2-4911-a260-0e046834d498 could not be found. Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67d3dae-96e2-4911-a260-0e046834d498 could not be found. Oct 22 03:22:30.523603 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67d3dae-96e2-4911-a260-0e046834d498 could not be found. Oct 22 03:22:30.528069 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:30.530330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] Returning 404 to user: Instance d67d3dae-96e2-4911-a260-0e046834d498 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:30.531410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-236070ce-b8a2-4ddf-8712-43f6b6501f88 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277 tempest-FloatingIPsAssociationNegativeTestJSON-1739102277-project] 10.222.0.25 "GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498" status: 404 len: 111 microversion: 2.1 time: 0.077582 Oct 22 03:22:30.532178 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2058/4168] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:30 2022] GET /compute/v2.1/servers/d67d3dae-96e2-4911-a260-0e046834d498 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:22:30.650592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:30.654899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:30.670209 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1cf10f3-b6f0-417e-8c3d-e771a1a7741e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1278 microversion: 2.1 time: 0.667218 Oct 22 03:22:30.685100 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2111/4169] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:30 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1278 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:30.890625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:30.891660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:30.898824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.899665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.900399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.902154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.908555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.909330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.914355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:30.915124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:30.927039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.927542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.931153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:30.932518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:30.938998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:30.939531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:31.247547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:31.266607 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7505a0ce-a075-4a2c-b53f-8297e5ffdda5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.380398 Oct 22 03:22:31.268685 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2059/4170] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:30 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:31.280023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:31.282143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:31.295312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:31.297844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:31.300039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:31.302446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:31.303493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:31.304994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:31.305644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:31.741791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:31.757121 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4e465fb-4357-4b56-a764-b095f3afa69b tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.846796 Oct 22 03:22:31.772386 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2112/4171] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:30 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:31.781332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-84a58dca-2674-4d5f-96e2-ed9c4508d44d req-149a9d71-ffef-46f1-8b5a-22b59ac0b4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67d3dae-96e2-4911-a260-0e046834d498", "name": "network-vif-deleted", "tag": "735b21da-4bcb-43ae-a866-b324d932cd4d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:31.825564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-84a58dca-2674-4d5f-96e2-ed9c4508d44d req-149a9d71-ffef-46f1-8b5a-22b59ac0b4fb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:31.828099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-84a58dca-2674-4d5f-96e2-ed9c4508d44d req-149a9d71-ffef-46f1-8b5a-22b59ac0b4fb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:31.830790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-84a58dca-2674-4d5f-96e2-ed9c4508d44d req-149a9d71-ffef-46f1-8b5a-22b59ac0b4fb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:31.865250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:31.874929 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a493607-8c7f-4638-ad85-ba08f1694b71 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1522 microversion: 2.1 time: 0.605158 Oct 22 03:22:31.876579 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-84a58dca-2674-4d5f-96e2-ed9c4508d44d req-149a9d71-ffef-46f1-8b5a-22b59ac0b4fb service nova] Creating event network-vif-deleted:735b21da-4bcb-43ae-a866-b324d932cd4d for instance d67d3dae-96e2-4911-a260-0e046834d498 on n-h2-862416-2 Oct 22 03:22:31.892779 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2060/4172] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:31 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:31.892779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:31.892779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:31.900194 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-84a58dca-2674-4d5f-96e2-ed9c4508d44d req-149a9d71-ffef-46f1-8b5a-22b59ac0b4fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137582 Oct 22 03:22:31.906019 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2113/4173] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:31.911745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:31.915054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:31.915541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:31.918405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:31.918891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:31.919329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:31.924056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:31.929875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:31.954673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:31.955174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:31.955608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:31.968510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:31.970196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:31.973879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.125832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:32.136535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:32.141745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:32.155760 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6cc85419-4e1c-4b0a-b0ad-338d1c693484 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.273290 Oct 22 03:22:32.181707 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2061/4174] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:31 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:32.191320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:32.192081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:32.201985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.202715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.203336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.204225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.205916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.206542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.217687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:32.227553 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb4e5ecb-8a55-46ae-bf5a-8222eea84f0e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1278 microversion: 2.1 time: 0.318980 Oct 22 03:22:32.247372 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2114/4175] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:31 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1278 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:32.263964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-629b7524-7d81-4114-890d-ec0a5112edfb req-1e666c96-8ca8-4f36-9f85-4d237545763b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d66b53-cee2-442c-b4ee-6fea13305813", "name": "network-vif-deleted", "tag": "d5499ec1-d470-43a9-917f-7d60133064b3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:32.270789 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] HTTP exception thrown: Action 999 not found Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Request method failure captured: Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206/os-instance-actions/999 HTTP/1.1 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Hd388XigYSAxGGZ_1A3k3Tc46eMa0hMXyqsFfl8Sr7bg4LIjKD_qCKuVWcjB_8dWnNNQCV7t6Om--KhYNulfBg-Z1tPO1JPVMfMJ7PTJtzuSYSpVThLPao9dUgO1svaZTXfEtJusNxGR1Xrfw2ng_SnAelBm965dzU7zNREr78VEg Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f8f40fccecee4aa78ece1199e723fe92 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f40fccecee4aa78ece1199e723fe92"}]}] Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f8f40fccecee4aa78ece1199e723fe92 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-InstanceActionsNegativeTestJSON-446186224-project Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 1c3a5cbf892f4dacb0df384cdc4596fb Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-446186224-project Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: exception: Action 999 not found Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': '133f8b66-bf51-4dbb-a70a-d1c7f70c0206', 'id': '999'} Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 22 03:22:32.280271 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:32.284369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Returning 404 to user: Action 999 not found {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:32.284369 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-48b61b8b-95c7-49d4-8a04-06ac04e51c87 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.098366 Oct 22 03:22:32.284369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2062/4176] 10.222.0.25 () {58 vars in 1308 bytes} [Sat Oct 22 03:22:32 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206/os-instance-actions/999 => generated 66 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:22:32.293495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f3a4823-3255-4808-9eb5-21759799afb2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '.version_select at 0x7f0d19634f70>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:32.294167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1f3a4823-3255-4808-9eb5-21759799afb2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 0be3efcb-5697-4b06-955f-f965e8a52ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:32.295946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-629b7524-7d81-4114-890d-ec0a5112edfb req-1e666c96-8ca8-4f36-9f85-4d237545763b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.296743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-629b7524-7d81-4114-890d-ec0a5112edfb req-1e666c96-8ca8-4f36-9f85-4d237545763b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.297413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-629b7524-7d81-4114-890d-ec0a5112edfb req-1e666c96-8ca8-4f36-9f85-4d237545763b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.309921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1f3a4823-3255-4808-9eb5-21759799afb2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] HTTP exception thrown: Instance 0be3efcb-5697-4b06-955f-f965e8a52ae5 could not be found. Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f3a4823-3255-4808-9eb5-21759799afb2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Request method failure captured: Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/0be3efcb-5697-4b06-955f-f965e8a52ae5/os-instance-actions HTTP/1.1 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Hd388XigYSAxGGZ_1A3k3Tc46eMa0hMXyqsFfl8Sr7bg4LIjKD_qCKuVWcjB_8dWnNNQCV7t6Om--KhYNulfBg-Z1tPO1JPVMfMJ7PTJtzuSYSpVThLPao9dUgO1svaZTXfEtJusNxGR1Xrfw2ng_SnAelBm965dzU7zNREr78VEg Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f8f40fccecee4aa78ece1199e723fe92 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f40fccecee4aa78ece1199e723fe92"}]}] Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f8f40fccecee4aa78ece1199e723fe92 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-InstanceActionsNegativeTestJSON-446186224-project Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 1c3a5cbf892f4dacb0df384cdc4596fb Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-446186224-project Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 0be3efcb-5697-4b06-955f-f965e8a52ae5 could not be found. Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': '0be3efcb-5697-4b06-955f-f965e8a52ae5'} Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be3efcb-5697-4b06-955f-f965e8a52ae5 could not be found. Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:32.311491 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be3efcb-5697-4b06-955f-f965e8a52ae5 could not be found. Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be3efcb-5697-4b06-955f-f965e8a52ae5 could not be found. Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f3a4823-3255-4808-9eb5-21759799afb2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Returning 404 to user: Instance 0be3efcb-5697-4b06-955f-f965e8a52ae5 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1f3a4823-3255-4808-9eb5-21759799afb2 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/0be3efcb-5697-4b06-955f-f965e8a52ae5/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.023699 Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2063/4177] 10.222.0.25 () {58 vars in 1296 bytes} [Sat Oct 22 03:22:32 2022] GET /compute/v2.1/servers/0be3efcb-5697-4b06-955f-f965e8a52ae5/os-instance-actions => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:22:32.319070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:32.321449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:32.338851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.339349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.339784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.340532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.340983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.341403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.343488 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-629b7524-7d81-4114-890d-ec0a5112edfb req-1e666c96-8ca8-4f36-9f85-4d237545763b service nova] Creating event network-vif-deleted:d5499ec1-d470-43a9-917f-7d60133064b3 for instance 22d66b53-cee2-442c-b4ee-6fea13305813 on n-h1-862416-2 Oct 22 03:22:32.352826 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-629b7524-7d81-4114-890d-ec0a5112edfb req-1e666c96-8ca8-4f36-9f85-4d237545763b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103250 Oct 22 03:22:32.354083 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2115/4178] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:32.373660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:32.373660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:32.390298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.390797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.391347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.391967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.396403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.397919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.451370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:22:32.631738 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c9a394d6-3942-40f1-9884-7ab878f7b57d tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "DELETE /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 204 len: 0 microversion: 2.1 time: 0.275474 Oct 22 03:22:32.632878 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2116/4179] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:22:32 2022] DELETE /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:22:32.641846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:32.642844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:32.657162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.659084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.669879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:32.673947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:32.676645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:32.677294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:33.605490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:33.626721 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4dcd5d46-927a-4dc6-af7a-d9e94bb5f6d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 1.311726 Oct 22 03:22:33.627772 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2064/4180] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:32 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:33.633011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:33.637594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:33.638756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:33.649339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:33.651878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:33.652683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:33.653380 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b9a613d-65c7-4898-9aae-614d25cb2a65 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1528 microversion: 2.1 time: 1.011304 Oct 22 03:22:33.658500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:33.658984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:33.659429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:33.676639 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2117/4181] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:32 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1528 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:22:33.688432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:33.697079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:33.711491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:33.712330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:33.713029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:33.714262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:33.714969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:33.715645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:33.862597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:33.874769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:33.880633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:33.888722 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9684eca6-6e1d-4bee-9d60-72d74a8ad1f3 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.210603 Oct 22 03:22:33.890189 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2118/4182] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:33 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:33.895639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:33.900148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:33.924796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:33.929095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:33.929999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:33.930985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:33.931676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:33.932392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:34.548742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:34.579055 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8999857-5c4c-4624-b21e-1a4f939fee12 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1320 microversion: 2.1 time: 0.686910 Oct 22 03:22:34.585193 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2119/4183] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:33 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1320 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:34.641814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-eb4b9f32-c32b-48f5-a7b8-bde21e301ef9 req-f02ba0d7-3ec8-4c12-8210-d92e0d7fc11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d2acf4-a7dd-46af-ae59-83a28eccaa4f", "tag": "01c4850c-25d7-4312-836a-b864a1ef4bed"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:34.680698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-eb4b9f32-c32b-48f5-a7b8-bde21e301ef9 req-f02ba0d7-3ec8-4c12-8210-d92e0d7fc11b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:34.680949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-eb4b9f32-c32b-48f5-a7b8-bde21e301ef9 req-f02ba0d7-3ec8-4c12-8210-d92e0d7fc11b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:34.685593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-eb4b9f32-c32b-48f5-a7b8-bde21e301ef9 req-f02ba0d7-3ec8-4c12-8210-d92e0d7fc11b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:34.729986 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-eb4b9f32-c32b-48f5-a7b8-bde21e301ef9 req-f02ba0d7-3ec8-4c12-8210-d92e0d7fc11b service nova] Creating event network-changed:01c4850c-25d7-4312-836a-b864a1ef4bed for instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f on n-h2-862416-2 Oct 22 03:22:34.775542 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-eb4b9f32-c32b-48f5-a7b8-bde21e301ef9 req-f02ba0d7-3ec8-4c12-8210-d92e0d7fc11b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137510 Oct 22 03:22:34.785769 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2120/4184] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:22:34.816450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:34.817486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:34.840416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:34.844664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:34.849182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:34.850252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:34.851073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:34.857445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:34.868750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:34.925218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:35.016017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:35.028020 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2cab7ac1-8439-495f-82af-c6611eac2733 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 1.398787 Oct 22 03:22:35.038842 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2065/4185] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:33 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:35.043706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:35.044347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:35.059432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:35.059937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:35.060642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:35.062036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:35.062781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:35.063408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:35.551999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:35.568890 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-24dc7bef-317d-4b70-9e8a-a1f7d9e9326b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.780519 Oct 22 03:22:35.586717 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2121/4186] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:34 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:35.594217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:35.596686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:35.617850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:35.618724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:35.619426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:35.620453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:35.621161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:35.621821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:35.837747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:35.863166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:35.872082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:35.873731 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2ccd9e6-63b3-4c33-876f-c84de084e626 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.285582 Oct 22 03:22:35.877717 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2122/4187] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:35 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:35.897469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:35.904906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:35.922463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:35.926917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:35.928654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:35.931748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:35.933379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:35.936831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:36.321707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:36.355715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:36.382029 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a78be11-89f3-4122-bf21-f3d8d8fe01f9 tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1528 microversion: 2.1 time: 1.340263 Oct 22 03:22:36.408627 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2066/4188] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:35 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1528 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:36.425503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:36.426142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:36.451053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:36.451558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:36.452005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:36.457015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:36.457508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:36.457966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:37.038489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:37.065777 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-37398a8c-9285-409f-8c30-dd5036f01e93 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1320 microversion: 2.1 time: 1.186328 Oct 22 03:22:37.067261 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2123/4189] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:35 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1320 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:37.078184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:37.079295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:37.108305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:37.108809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:37.112925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:37.114069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:37.121374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:37.122206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:37.965036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:37.983743 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-558e7675-0a79-41dd-a919-4471db4a50c7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.910591 Oct 22 03:22:37.985087 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2124/4190] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:37 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:37.990427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:37.998147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:38.013309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:38.018090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:38.018675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:38.019551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:38.020126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:38.027618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:38.280696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:38.290299 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32ab91e6-549a-44be-80c8-9aecb34442d3 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 1.880466 Oct 22 03:22:38.297486 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2067/4191] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:36 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:38.304121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:38.318130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:38.321623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:38.329625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:38.330492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:38.331157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:38.332095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:38.332939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:38.333183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:38.335314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:38.338651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:38.339920 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2112d5c5-24d8-4c41-adb3-159478586c8e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.353613 Oct 22 03:22:38.348093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2125/4192] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:37 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:38.353587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:38.360834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:38.376227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:38.378326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:38.382047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:38.383089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:38.383759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:38.384577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:38.711307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3a5cbf892f4dacb0df384cdc4596fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f40fccecee4aa78ece1199e723fe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:38.720272 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b572f303-82c3-474e-af4e-d3e1d011726e tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 200 len: 1486 microversion: 2.1 time: 0.421399 Oct 22 03:22:38.727562 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2068/4193] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:38 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:38.761722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-cf672456-6100-433f-a9b6-6df4a1dffd7a req-00fa4bec-9159-4639-853f-155e1ca17658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133f8b66-bf51-4dbb-a70a-d1c7f70c0206", "name": "network-vif-deleted", "tag": "742b49da-9e30-4f20-b7f1-764eee67595b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:38.782163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cf672456-6100-433f-a9b6-6df4a1dffd7a req-00fa4bec-9159-4639-853f-155e1ca17658 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:38.789950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cf672456-6100-433f-a9b6-6df4a1dffd7a req-00fa4bec-9159-4639-853f-155e1ca17658 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:38.790861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cf672456-6100-433f-a9b6-6df4a1dffd7a req-00fa4bec-9159-4639-853f-155e1ca17658 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:38.824002 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-cf672456-6100-433f-a9b6-6df4a1dffd7a req-00fa4bec-9159-4639-853f-155e1ca17658 service nova] Creating event network-vif-deleted:742b49da-9e30-4f20-b7f1-764eee67595b for instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 on n-h1-862416-2 Oct 22 03:22:38.853923 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-cf672456-6100-433f-a9b6-6df4a1dffd7a req-00fa4bec-9159-4639-853f-155e1ca17658 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095348 Oct 22 03:22:38.856220 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2069/4194] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:39.011494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:39.012592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:39.022640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.023133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.023570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.024313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.024766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.025187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.071003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:39.078834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:39.087889 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8026b73b-e78a-46e2-9bed-1368412c4e96 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1320 microversion: 2.1 time: 0.738657 Oct 22 03:22:39.096778 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2126/4195] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:38 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1320 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:39.184648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:39.186311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:39.200867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.201686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.202358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.203302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.203953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.204619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.253398 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] HTTP exception thrown: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Request method failure captured: Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 HTTP/1.1 Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2GMT0ek3fu-YE3f7R1oPbuLVDKYnEKw0PAqsmaoV1E2-DqwXcxTJTmKjTwixO_AFwra-7RH8UDeUg-YB20fLtNU6R36gUcfRAZA-XnRFWdvq3abaj2zLJ0MVvb_EX5gBI4i9JSr3PCKGghPIjll1NIIzSNfqgyuG39hSqVP6iOWmbY Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}] Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 50827aa842ce4e0bb8b21e57a3d5b318 Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '728b11ec-aba0-40d7-a1bf-053a236b4058'} Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:39.261500 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.266804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.268723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Returning 404 to user: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:39.272784 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-37128b0c-d0ca-4c47-8a7c-453b0821a1e8 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 404 len: 111 microversion: 2.1 time: 0.092001 Oct 22 03:22:39.286297 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2127/4196] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:22:39 2022] DELETE /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:22:39.303846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:39.306550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 728b11ec-aba0-40d7-a1bf-053a236b4058] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:39.319676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.320272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.320733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.322580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.323263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.323880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.341757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:39.357053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1c5e774a-fb17-43cd-84bc-003c857c3428 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.349526 Oct 22 03:22:39.372233 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2070/4197] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:39 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] HTTP exception thrown: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Request method failure captured: Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 HTTP/1.1 Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2GMT0ek3fu-YE3f7R1oPbuLVDKYnEKw0PAqsmaoV1E2-DqwXcxTJTmKjTwixO_AFwra-7RH8UDeUg-YB20fLtNU6R36gUcfRAZA-XnRFWdvq3abaj2zLJ0MVvb_EX5gBI4i9JSr3PCKGghPIjll1NIIzSNfqgyuG39hSqVP6iOWmbY Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}] Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 50827aa842ce4e0bb8b21e57a3d5b318 Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '728b11ec-aba0-40d7-a1bf-053a236b4058'} Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:39.372455 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. Oct 22 03:22:39.379046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.380076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-3c6f0246-7ad0-4e15-9cfb-711a8e9d2560 req-2127e0b4-5c11-45cf-bd88-b3459ea4f57e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6", "tag": "eae0ba14-f85e-49d7-9bcf-4ddd354a2b62"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:39.380234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Returning 404 to user: Instance 728b11ec-aba0-40d7-a1bf-053a236b4058 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:39.382012 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a89816b5-6610-45fa-82f9-833b60700a9a tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058" status: 404 len: 111 microversion: 2.1 time: 0.091606 Oct 22 03:22:39.386770 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2128/4198] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:39 2022] GET /compute/v2.1/servers/728b11ec-aba0-40d7-a1bf-053a236b4058 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:22:39.402540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3c6f0246-7ad0-4e15-9cfb-711a8e9d2560 req-2127e0b4-5c11-45cf-bd88-b3459ea4f57e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.403328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3c6f0246-7ad0-4e15-9cfb-711a8e9d2560 req-2127e0b4-5c11-45cf-bd88-b3459ea4f57e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.404084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3c6f0246-7ad0-4e15-9cfb-711a8e9d2560 req-2127e0b4-5c11-45cf-bd88-b3459ea4f57e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.405602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:39.406251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:39.417082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-3c6f0246-7ad0-4e15-9cfb-711a8e9d2560 req-2127e0b4-5c11-45cf-bd88-b3459ea4f57e service nova] Creating event network-changed:eae0ba14-f85e-49d7-9bcf-4ddd354a2b62 for instance e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6 on n-h2-862416-2 Oct 22 03:22:39.422667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-3c6f0246-7ad0-4e15-9cfb-711a8e9d2560 req-2127e0b4-5c11-45cf-bd88-b3459ea4f57e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061340 Oct 22 03:22:39.427079 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2071/4199] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:39.431361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.433457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.434075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.437142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.437860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.438681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.440133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:39.448371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:39.458663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.467803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.468560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.469496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.470122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.470719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.655283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:39.673561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:39.684913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:39.686542 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1e335b63-c5cb-45f8-9ce5-d2dac8334f78 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.258112 Oct 22 03:22:39.687495 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2072/4200] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:39 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:39.692355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:39.700323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:39.716300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.717464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.718203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.719181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.719937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.720635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.758276 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] HTTP exception thrown: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Request method failure captured: Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 HTTP/1.1 Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2GMT0ek3fu-YE3f7R1oPbuLVDKYnEKw0PAqsmaoV1E2-DqwXcxTJTmKjTwixO_AFwra-7RH8UDeUg-YB20fLtNU6R36gUcfRAZA-XnRFWdvq3abaj2zLJ0MVvb_EX5gBI4i9JSr3PCKGghPIjll1NIIzSNfqgyuG39hSqVP6iOWmbY Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}] Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 50827aa842ce4e0bb8b21e57a3d5b318 Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '58f40efd-b160-4f9c-8147-057e39a987d7'} Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:39.760350 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.764743 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.767056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Returning 404 to user: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:39.768127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-797d7607-2df3-4448-88c8-c18b0ba6e10b tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 404 len: 111 microversion: 2.1 time: 0.079443 Oct 22 03:22:39.769230 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2073/4201] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:22:39 2022] DELETE /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:22:39.776353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:39.781080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] [instance: 133f8b66-bf51-4dbb-a70a-d1c7f70c0206] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:39.801024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.801871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.803094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.804345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.805007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.805635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.837797 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] HTTP exception thrown: Instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 could not be found. Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Request method failure captured: Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 HTTP/1.1 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Hd388XigYSAxGGZ_1A3k3Tc46eMa0hMXyqsFfl8Sr7bg4LIjKD_qCKuVWcjB_8dWnNNQCV7t6Om--KhYNulfBg-Z1tPO1JPVMfMJ7PTJtzuSYSpVThLPao9dUgO1svaZTXfEtJusNxGR1Xrfw2ng_SnAelBm965dzU7zNREr78VEg Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f8f40fccecee4aa78ece1199e723fe92 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f8f40fccecee4aa78ece1199e723fe92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f40fccecee4aa78ece1199e723fe92"}]}] Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f8f40fccecee4aa78ece1199e723fe92 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-446186224 Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-InstanceActionsNegativeTestJSON-446186224-project Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 1c3a5cbf892f4dacb0df384cdc4596fb Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-446186224-project Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 could not be found. Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '133f8b66-bf51-4dbb-a70a-d1c7f70c0206'} Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 could not be found. Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 could not be found. Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.839775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.844422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.844422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.844422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.844422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.844422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:39.844422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:39.844422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 could not be found. Oct 22 03:22:39.844422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.847179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] Returning 404 to user: Instance 133f8b66-bf51-4dbb-a70a-d1c7f70c0206 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:39.848294 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-14cf6390-1573-43b5-b06c-1d3158252b7c tempest-InstanceActionsNegativeTestJSON-446186224 tempest-InstanceActionsNegativeTestJSON-446186224-project] 10.222.0.25 "GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206" status: 404 len: 111 microversion: 2.1 time: 0.077928 Oct 22 03:22:39.849375 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2074/4202] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:39 2022] GET /compute/v2.1/servers/133f8b66-bf51-4dbb-a70a-d1c7f70c0206 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:22:39.854708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:39.865695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] [instance: 58f40efd-b160-4f9c-8147-057e39a987d7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:39.878049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.879010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.879661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.880594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:39.881273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:39.881898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:39.897079 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] HTTP exception thrown: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Request method failure captured: Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 HTTP/1.1 Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2GMT0ek3fu-YE3f7R1oPbuLVDKYnEKw0PAqsmaoV1E2-DqwXcxTJTmKjTwixO_AFwra-7RH8UDeUg-YB20fLtNU6R36gUcfRAZA-XnRFWdvq3abaj2zLJ0MVvb_EX5gBI4i9JSr3PCKGghPIjll1NIIzSNfqgyuG39hSqVP6iOWmbY Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1f91285c5cf439194c1da640b4e1f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1f91285c5cf439194c1da640b4e1f4d"}]}] Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f1f91285c5cf439194c1da640b4e1f4d Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestMultiNic-473468253 Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 50827aa842ce4e0bb8b21e57a3d5b318 Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestMultiNic-473468253-project Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '58f40efd-b160-4f9c-8147-057e39a987d7'} Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:39.898858 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.903415 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:39.903415 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:39.903415 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:39.903415 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:39.903415 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:39.903415 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. Oct 22 03:22:39.903415 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:22:39.905402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] Returning 404 to user: Instance 58f40efd-b160-4f9c-8147-057e39a987d7 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:39.906650 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dd9e67f5-0c94-4871-9d17-dec47cf865d7 tempest-ServersTestMultiNic-473468253 tempest-ServersTestMultiNic-473468253-project] 10.222.0.25 "GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7" status: 404 len: 111 microversion: 2.1 time: 0.055608 Oct 22 03:22:39.911029 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2075/4203] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:39 2022] GET /compute/v2.1/servers/58f40efd-b160-4f9c-8147-057e39a987d7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:22:40.057953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:40.068465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a09dccc-5b32-4408-b4c4-c0c63947bea4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.674313 Oct 22 03:22:40.086264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2129/4204] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:39 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:40.125310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:40.126416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:40.141157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:40.142061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:40.142717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:40.143655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:40.144349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:40.145000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:40.386964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:40.387845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:40.398980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:40.399619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:40.404777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:40.405660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:40.406227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:40.406773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:40.411333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:41.168129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:41.179060 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4287d07-239a-4e44-a7bb-07f88deb16a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 0.796114 Oct 22 03:22:41.182852 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2130/4205] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:40 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:22:41.196927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:41.197948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:41.212444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:41.213380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:41.214394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:41.216861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:41.218203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:41.218881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:41.561551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:41.579319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:41.587664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:41.593433 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f67a310-c51f-4324-8699-3dacdec51b8f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.409141 Oct 22 03:22:41.617466 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2131/4206] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:41 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:41.658470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:41.668624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:41.676851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:41.678381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:41.679239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:41.680399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:41.681099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:41.681879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:42.031428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:42.042475 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4366f9cb-c600-44d9-a7d8-1ddc2f898601 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.423030 Oct 22 03:22:42.044466 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2132/4207] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:41 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:42.056722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-722ef152-f856-4593-8c08-82eca4a81eb4 req-25afd008-117a-482b-bb73-b483e3ab76ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874", "tag": "3b63a3f8-5415-4205-a0da-cf4945bfcd90"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:42.063315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:42.079210 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb89e14f-fa90-48b1-9adb-3302593020d2 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1320 microversion: 2.1 time: 1.957637 Oct 22 03:22:42.079790 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2076/4208] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:40 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1320 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:42.084008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-722ef152-f856-4593-8c08-82eca4a81eb4 req-25afd008-117a-482b-bb73-b483e3ab76ed service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:42.084515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-722ef152-f856-4593-8c08-82eca4a81eb4 req-25afd008-117a-482b-bb73-b483e3ab76ed service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:42.085041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-722ef152-f856-4593-8c08-82eca4a81eb4 req-25afd008-117a-482b-bb73-b483e3ab76ed service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:42.119771 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-722ef152-f856-4593-8c08-82eca4a81eb4 req-25afd008-117a-482b-bb73-b483e3ab76ed service nova] Creating event network-changed:3b63a3f8-5415-4205-a0da-cf4945bfcd90 for instance 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 on n-h2-862416-2 Oct 22 03:22:42.131716 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-722ef152-f856-4593-8c08-82eca4a81eb4 req-25afd008-117a-482b-bb73-b483e3ab76ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084490 Oct 22 03:22:42.132659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2133/4209] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:42.211953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:42.212860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:42.223457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:42.227264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:42.228109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:42.233068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:42.233808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:42.234469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:42.636771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:42.638979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:42.659778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:42.661904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:42.663252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:42.665751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:42.668396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:42.669108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:42.802333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:42.823347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:42.825858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:42.827338 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45f7fd96-a629-4a86-8260-f72f7c39a42f tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.207415 Oct 22 03:22:42.844131 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2134/4210] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:42 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:43.067413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:43.068176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:43.114182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:43.114879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:43.119841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:43.120753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:43.121237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:43.122567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:43.240797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:43.256178 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4398a3f5-6de5-4d58-8971-03071493304d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1680 microversion: 2.1 time: 1.050064 Oct 22 03:22:43.274456 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2077/4211] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:42 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1680 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:43.294733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:43.295373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:43.341467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:43.342269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:43.343209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:43.345753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:43.346433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:43.347092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:43.675505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:43.688224 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c57194c9-65df-404a-bf57-9520fcca9929 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.624677 Oct 22 03:22:43.689441 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2135/4212] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:43 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:43.859030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:43.859978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:43.878020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:43.879645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:43.880300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:43.882028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:43.882857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:43.891596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:44.080713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:44.105881 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4320c7fc-8b4f-4188-8743-0402a8ffb6ce tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1320 microversion: 2.1 time: 0.827951 Oct 22 03:22:44.107105 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2078/4213] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:43 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1320 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:44.284738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:44.285653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:44.293415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:44.304873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:44.305636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:44.307131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:44.308478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:44.311947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:44.312661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:44.312809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:44.314386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:44.315767 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-091d9476-ab9d-4787-a874-1f7389528ad6 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.462566 Oct 22 03:22:44.319158 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2136/4214] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:43 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:22:44.717080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:44.717848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:44.735573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:44.736452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:44.737139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:44.738161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:44.738953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:44.739551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:44.823199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:44.832832 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1613034-e538-46ad-99b8-d1bae52ff1d2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.556932 Oct 22 03:22:44.838206 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2079/4215] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:44 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:45.083809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:45.093038 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4a22f70-eb69-429f-b84e-050423d5bd08 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.380772 Oct 22 03:22:45.096659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2137/4216] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:44 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:22:45.130446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:45.132935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:45.152140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:45.152901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:45.153259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:45.154566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:45.156654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:45.157428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:45.343261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:45.343878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:45.355655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:45.356153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:45.356617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:45.365590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:45.368834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:45.369507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:45.519337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:45.531324 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3b9b81e-aa5f-4bcb-810a-82ed0eebeae0 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1320 microversion: 2.1 time: 0.403293 Oct 22 03:22:45.548948 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2080/4217] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:45 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1320 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:45.573092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:45.590299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:45.595200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:45.597230 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc79ee7e-42a0-4793-937c-57b7923eff5b tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.258141 Oct 22 03:22:45.627890 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2138/4218] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:45 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:22:46.050931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:46.051593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:46.070806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:46.071313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:46.071764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:46.072517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:46.072971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:46.073396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:46.121118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:46.121666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:46.133944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:46.134449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:46.134893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:46.135609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:46.136052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:46.136548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:46.719681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:46.729346 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-190d4dc1-6eb8-485a-85dd-150d83128091 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.612674 Oct 22 03:22:46.748241 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2139/4219] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:46 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:46.781171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:46.781914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:46.804777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:46.806779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:46.806779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:46.807423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:46.807889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:46.811729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:47.219851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:47.233271 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-246305f8-390a-408c-a7ee-e4696ea63406 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 1.187159 Oct 22 03:22:47.248915 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2081/4220] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:46 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:47.268569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:47.273307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:47.298695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:47.299188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:47.303648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:47.318972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:47.319601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:47.323446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:47.563671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:47.579294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:47.586094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:47.590586 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80dc8d69-71f6-4abe-af42-35678435b990 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.332470 Oct 22 03:22:47.593069 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2082/4221] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:47 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:47.767805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:47.768924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:47.780628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:47.781127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:47.784768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:47.785752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:47.786228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:47.786669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:48.534051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:48.563645 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95c36bc9-ea00-49f1-acd0-4a1056d15797 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1320 microversion: 2.1 time: 1.816672 Oct 22 03:22:48.579688 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2140/4222] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:46 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1320 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:48.626790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:48.629829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:48.663992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:48.664649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:48.670458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:48.671236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:48.671707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:48.672139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:48.733703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:48.745296 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a5c46dc-b865-4d11-9300-6271cdb3ba34 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.982071 Oct 22 03:22:48.766454 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2083/4223] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:47 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:48.778553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f0ff3810-2826-4aa4-afac-3267658a804e tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Calling method '.version_select at 0x7f0d1989eb80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:48.927653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f0ff3810-2826-4aa4-afac-3267658a804e tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981" status: 200 len: 636 microversion: 2.1 time: 0.158804 Oct 22 03:22:48.948555 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2084/4224] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Oct 22 03:22:48 2022] GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981 => generated 636 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:48.960621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-76882e86-cb01-4241-b8fa-d9a05f0f00a1 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'update_all', calling method: .version_select at 0x7f0d1987b9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:49.065327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-76882e86-cb01-4241-b8fa-d9a05f0f00a1 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:49.072055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-76882e86-cb01-4241-b8fa-d9a05f0f00a1 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:49.073799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:49.091324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:49.094819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:49.139535 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8ac10114-2277-4173-b438-4533e5a4e77e tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.480169 Oct 22 03:22:49.140275 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2141/4225] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:48 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:49.588894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:49.590808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:49.612586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:49.615450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:49.618566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:49.619913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:49.625695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:49.628144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:49.743563 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-76882e86-cb01-4241-b8fa-d9a05f0f00a1 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 61 microversion: 2.1 time: 0.793411 Oct 22 03:22:49.749642 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2085/4226] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:22:48 2022] PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 61 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:49.758376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6ddf5b6a-6809-441d-8e49-d4c48bb811fd req-d3969bc2-f13b-4998-925f-93df036d4809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "name": "network-vif-unplugged", "status": "completed", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}, {"server_uuid": "6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874", "name": "network-vif-plugged", "status": "completed", "tag": "3b63a3f8-5415-4205-a0da-cf4945bfcd90"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:49.790338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6ddf5b6a-6809-441d-8e49-d4c48bb811fd req-d3969bc2-f13b-4998-925f-93df036d4809 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:49.791503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6ddf5b6a-6809-441d-8e49-d4c48bb811fd req-d3969bc2-f13b-4998-925f-93df036d4809 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:49.792807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6ddf5b6a-6809-441d-8e49-d4c48bb811fd req-d3969bc2-f13b-4998-925f-93df036d4809 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:49.823273 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6ddf5b6a-6809-441d-8e49-d4c48bb811fd req-d3969bc2-f13b-4998-925f-93df036d4809 service nova] Creating event network-vif-unplugged:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:22:49.824566 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6ddf5b6a-6809-441d-8e49-d4c48bb811fd req-d3969bc2-f13b-4998-925f-93df036d4809 service nova] Creating event network-vif-plugged:3b63a3f8-5415-4205-a0da-cf4945bfcd90 for instance 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 on n-h2-862416-2 Oct 22 03:22:49.839508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6ddf5b6a-6809-441d-8e49-d4c48bb811fd req-d3969bc2-f13b-4998-925f-93df036d4809 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.088076 Oct 22 03:22:49.840527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2086/4227] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:49.858512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5257519e-6ff3-4d45-999c-94de069bb2d0 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Calling method '.version_select at 0x7f0d19670e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:50.357147 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5257519e-6ff3-4d45-999c-94de069bb2d0 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "DELETE /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.514183 Oct 22 03:22:50.361665 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2087/4228] 10.222.0.25 () {58 vars in 1296 bytes} [Sat Oct 22 03:22:49 2022] DELETE /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata/os_version => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:22:50.367576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:50.368764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:50.375532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:50.376688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:50.377363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:50.378304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:50.379079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:50.379886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:50.549618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:50.559140 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39b9a63c-05d3-49be-ae44-945a46465857 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1320 microversion: 2.1 time: 0.976575 Oct 22 03:22:50.559753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2142/4229] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:49 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1320 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:50.586625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:50.587170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:50.589220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:50.598772 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-861b9746-208f-4a0b-81dc-e57c671761d6 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1487 microversion: 2.1 time: 0.235680 Oct 22 03:22:50.602823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:50.604532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:50.605456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:50.606730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:50.609160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:50.609413 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2088/4230] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:50 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1487 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:50.610771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:50.627797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:50.633691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:50.652225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:50.652747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:50.653188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:50.657078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:50.657924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:50.659023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:50.778715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:50.793274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:50.795061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:50.796678 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-df788b5c-a1d2-4daa-b031-4878480ab70d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.184603 Oct 22 03:22:50.797997 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2089/4231] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:50 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:50.812906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f81027bb-01b8-4ed6-a8f9-801515380d8f tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Calling method '.version_select at 0x7f0d1965e8b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:50.889834 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f81027bb-01b8-4ed6-a8f9-801515380d8f tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 37 microversion: 2.1 time: 0.089845 Oct 22 03:22:50.901951 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2090/4232] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:22:50 2022] GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 37 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:50.915481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:50.919684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:50.929597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:50.935126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:50.938773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:50.939859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:50.940622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:50.941301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:51.092273 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72cef15c-6bd2-484a-bd63-5ddba75f8130 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "POST /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e/action" status: 202 len: 0 microversion: 2.1 time: 0.188649 Oct 22 03:22:51.098545 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2091/4233] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:50 2022] POST /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:22:51.127950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4adfe2da-ee36-4db6-9ad0-114a56bbbf98 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'update_all', calling method: .version_select at 0x7f0d1993daf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:51.234019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4adfe2da-ee36-4db6-9ad0-114a56bbbf98 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:51.249551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4adfe2da-ee36-4db6-9ad0-114a56bbbf98 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:51.255082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:51.270716 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97e7830b-e43b-4cf4-a7ae-8e698c796019 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.688825 Oct 22 03:22:51.271329 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2143/4234] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:50 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:51.293264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:51.294080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:51.302000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:51.318585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:51.322234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:51.325198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:51.326223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:51.332162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:51.761547 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4adfe2da-ee36-4db6-9ad0-114a56bbbf98 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 61 microversion: 2.1 time: 0.660776 Oct 22 03:22:51.762324 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2092/4235] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:22:51 2022] PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 61 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:51.770701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:51.772585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:51.795427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:51.796050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:51.798958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:51.799817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:51.800575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:51.800783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.052971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:52.064857 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e9abfc6-850d-4a1e-8e4a-2ca0b8fd3dcf tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1495 microversion: 2.1 time: 0.789256 Oct 22 03:22:52.066273 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2144/4236] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:51 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1495 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:52.078656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:52.081351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:52.102890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.105487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:52.107028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.107517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.108808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.112768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.113252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.120860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff9768cd-344a-459f-b60d-a6cdc4cadd16 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.356862 Oct 22 03:22:52.121770 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2093/4237] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:51 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:52.137146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-66f4a26a-29e0-4ef4-b63d-34d319423b26 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Calling method '.version_select at 0x7f0d19649160>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:52.195470 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-66f4a26a-29e0-4ef4-b63d-34d319423b26 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.071973 Oct 22 03:22:52.203668 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2094/4238] 10.222.0.25 () {58 vars in 1290 bytes} [Sat Oct 22 03:22:52 2022] GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata/os_distro => generated 33 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:52.208710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:52.209335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:52.234637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.235143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.236004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.236767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.237359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.237787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.297484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:52.404883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:52.419789 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-79cdd7fa-c521-444e-a1ff-4f661821c807 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 200 len: 1508 microversion: 2.1 time: 0.351836 Oct 22 03:22:52.421536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:52.424199 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2145/4239] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:52 2022] GET /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:52.446547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:52.447172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:52.454909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.455711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.456449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.457426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.458117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.459319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.465267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:52.478621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:52.481500 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1afcb093-ad27-44c5-af59-60acf2350b0d tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.276746 Oct 22 03:22:52.489053 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2095/4240] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:52 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:52.495248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-c2b152b2-99df-4aa4-8517-40c86576424a req-3e668492-a563-4d33-9129-46f36938a460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6", "name": "network-vif-plugged", "status": "completed", "tag": "eae0ba14-f85e-49d7-9bcf-4ddd354a2b62"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:52.522465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c2b152b2-99df-4aa4-8517-40c86576424a req-3e668492-a563-4d33-9129-46f36938a460 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.523079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c2b152b2-99df-4aa4-8517-40c86576424a req-3e668492-a563-4d33-9129-46f36938a460 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.523616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c2b152b2-99df-4aa4-8517-40c86576424a req-3e668492-a563-4d33-9129-46f36938a460 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.536103 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-c2b152b2-99df-4aa4-8517-40c86576424a req-3e668492-a563-4d33-9129-46f36938a460 service nova] Creating event network-vif-plugged:eae0ba14-f85e-49d7-9bcf-4ddd354a2b62 for instance e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6 on n-h2-862416-2 Oct 22 03:22:52.541808 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-c2b152b2-99df-4aa4-8517-40c86576424a req-3e668492-a563-4d33-9129-46f36938a460 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051454 Oct 22 03:22:52.543548 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2096/4241] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:22:52.550528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-538b542b-d9ae-4157-b991-db9ecba7f390 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'update_all', calling method: .version_select at 0x7f0d19699e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:52.643121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-538b542b-d9ae-4157-b991-db9ecba7f390 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:52.652445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-538b542b-d9ae-4157-b991-db9ecba7f390 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:52.871976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:52.881477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-561446ad-3747-49bb-84da-88a1a3a0d116 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.449957 Oct 22 03:22:52.889730 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2146/4242] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:52 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:52.895309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:52.896937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:52.912838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.913453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.914005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.916851 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-538b542b-d9ae-4157-b991-db9ecba7f390 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 61 microversion: 2.1 time: 0.371468 Oct 22 03:22:52.917863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.918460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.918790 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2097/4243] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:22:52 2022] PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 61 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:52.919105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.926783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:52.951178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:52.953019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:52.965238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.965741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.966185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:52.971060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:52.971626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:52.972254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:53.108284 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5ef183c1-974c-41ef-9444-479031c6fc20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.187178 Oct 22 03:22:53.111961 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2098/4244] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:22:52 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:22:53.124335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e433e6b5-ec2f-4979-8417-dbc0814a6719 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Calling method '.version_select at 0x7f0d19699310>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:53.142938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:53.153313 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5cb8eb2-575c-4cdf-8161-f02f5e13c4d5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6" status: 200 len: 1320 microversion: 2.1 time: 0.262087 Oct 22 03:22:53.162051 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2147/4245] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:52 2022] GET /compute/v2.1/servers/e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6 => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:53.169321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:53.179452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:53.186376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:53.187240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:53.187922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:53.188871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:53.189535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:53.192569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:53.199447 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e433e6b5-ec2f-4979-8417-dbc0814a6719 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 61 microversion: 2.1 time: 0.089297 Oct 22 03:22:53.207590 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2099/4246] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:22:53 2022] GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 61 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:53.213095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:53.214120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:53.226689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:53.227954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:53.228738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:53.229744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:53.231878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:53.232617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:53.393471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:53.405281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f56303e3-2247-48f7-9a5f-4182ab13132b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1669 microversion: 2.1 time: 0.196271 Oct 22 03:22:53.407146 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2100/4247] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:53 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1669 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:53.425008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff64cc9b-99c9-42b2-bae3-1d6d44e3d4df tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'update_all', calling method: .version_select at 0x7f0d1965e670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:53.498918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ff64cc9b-99c9-42b2-bae3-1d6d44e3d4df tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:53.507293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ff64cc9b-99c9-42b2-bae3-1d6d44e3d4df tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:53.745326 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff64cc9b-99c9-42b2-bae3-1d6d44e3d4df tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 61 microversion: 2.1 time: 0.336671 Oct 22 03:22:53.750209 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2101/4248] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:22:53 2022] PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 61 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:53.755692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:53.756449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:53.763205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:53.763696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:53.764197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:53.764938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:53.765391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:53.765815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:53.817200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:53.828198 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-879a1699-d7b8-4ec7-915f-d9992cd3d855 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1495 microversion: 2.1 time: 0.664641 Oct 22 03:22:53.829457 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2148/4249] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:53 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1495 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:53.840391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a520f47e-e347-4867-8013-29930cd3ce09 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'update_all', calling method: .version_select at 0x7f0d19937430>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:53.880532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:53.895472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:53.905541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:53.907821 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82cf64bc-d5e1-48c3-bcbd-dda362c4d3e2 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1604 microversion: 2.42 time: 0.156192 Oct 22 03:22:53.911863 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2102/4250] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:53 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:53.928986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:53.936228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a520f47e-e347-4867-8013-29930cd3ce09 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:53.945419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a520f47e-e347-4867-8013-29930cd3ce09 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:54.186499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:54.187706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:54.191784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:22:54.201830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:54.204066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:54.204560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:54.205285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:54.205742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:54.208555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:54.379169 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a520f47e-e347-4867-8013-29930cd3ce09 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 64 microversion: 2.1 time: 0.548321 Oct 22 03:22:54.382214 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2149/4251] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:22:53 2022] PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 64 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:54.392477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12b99ae7-869b-4706-9514-fe47a6e4c5e0 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Calling method '.version_select at 0x7f0d1aca6ee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:54.442712 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-12b99ae7-869b-4706-9514-fe47a6e4c5e0 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 64 microversion: 2.1 time: 0.054458 Oct 22 03:22:54.451115 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2150/4252] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:22:54 2022] GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 64 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:54.451115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:54.451115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:54.457306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:54.457810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:54.458256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:54.459924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:54.460592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:54.461038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:54.554877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:54.565690 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a3b2744-f5ea-4dd4-b843-5c7a0dd06acc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6" status: 200 len: 1320 microversion: 2.1 time: 0.383793 Oct 22 03:22:54.566399 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2103/4253] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:54 2022] GET /compute/v2.1/servers/e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6 => generated 1320 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:22:54.571333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e17b8c4-dddd-47b3-9a15-0110012f2679 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'update_all', calling method: .version_select at 0x7f0d1e509700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:54.690766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5e17b8c4-dddd-47b3-9a15-0110012f2679 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:54.697280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5e17b8c4-dddd-47b3-9a15-0110012f2679 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:54.734700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:54.745228 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac6cf942-cbee-4963-a6f3-7958ffd2347c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1669 microversion: 2.1 time: 0.299659 Oct 22 03:22:54.748848 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2151/4254] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:54 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1669 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:54.853706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:54.854424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:54.861379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:54.862732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:54.863387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:54.864512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:54.865787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:54.866401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.137453 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e17b8c4-dddd-47b3-9a15-0110012f2679 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 61 microversion: 2.1 time: 0.569691 Oct 22 03:22:55.139100 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2104/4255] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:22:54 2022] PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 61 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:55.148149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:55.149138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:55.157832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.158607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.159262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.160259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.160933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.162045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.197046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:55.208149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f608f716-745f-401d-a0e0-082cb70ef782 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1501 microversion: 2.1 time: 0.359047 Oct 22 03:22:55.210514 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2152/4256] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:54 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1501 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:55.216035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.217251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.218521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.220482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lazy-loading 'fault' on Instance uuid 22d66b53-cee2-442c-b4ee-6fea13305813 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:22:55.222808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-68979c8d-7ea5-4ac0-848b-b45893736887 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'update', calling method: .version_select at 0x7f0d1a991ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:55.308072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-68979c8d-7ea5-4ac0-848b-b45893736887 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:55.311094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:55.321567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:55.325176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f85a274b68543fbbbc0a97d7cb6b8a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42016e2241264da88579fb9b9192087c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:55.326673 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a6f0519-0119-45df-a3d9-8421aa338330 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 200 len: 1371 microversion: 2.42 time: 0.185258 Oct 22 03:22:55.329795 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2105/4257] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:55 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:22:55.334374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-68979c8d-7ea5-4ac0-848b-b45893736887 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:55.341010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:55.342720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:55.360844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.363792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.366719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.367590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.371408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.371928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.435873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:22:55.573885 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-685d142f-c5a2-4153-bafd-f89eb0d34288 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "DELETE /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 204 len: 0 microversion: 2.1 time: 0.240621 Oct 22 03:22:55.574880 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2106/4258] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:22:55 2022] DELETE /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:22:55.586172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:55.587541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:55.595634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.596450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.597190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.599862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.600956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.601617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.730966 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-68979c8d-7ea5-4ac0-848b-b45893736887 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.519035 Oct 22 03:22:55.732160 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2153/4259] 10.222.0.25 () {60 vars in 1313 bytes} [Sat Oct 22 03:22:55 2022] PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata/os_version => generated 31 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:55.738431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:55.740016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:55.748201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.749042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.749865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.750746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.751650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.752311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.906560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:55.920381 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65185af8-6036-4d56-8bcb-b4e465d1ef8e tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.340314 Oct 22 03:22:55.925878 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2107/4260] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:55 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:22:55.934999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7bc18edb-7225-483d-b792-6df9c3f96bd9 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Calling method '.version_select at 0x7f0d19649940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:55.963941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:55.972898 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-742ad5ba-52ac-4dfc-beed-277418346efa tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6" status: 200 len: 1507 microversion: 2.1 time: 0.239207 Oct 22 03:22:55.980277 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2154/4261] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:55 2022] GET /compute/v2.1/servers/e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:55.980277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:55.981635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:55.989092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.990718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.991621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:55.992603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:55.993314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:55.993982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:56.010914 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7bc18edb-7225-483d-b792-6df9c3f96bd9 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 58 microversion: 2.1 time: 0.083325 Oct 22 03:22:56.011925 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2108/4262] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:22:55 2022] GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 58 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:56.174546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:56.183664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1423212621", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "2d1cca5b-25a9-46f8-b226-444686dedc9d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:56.184904 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-21ea28f3-afda-49c4-a7ca-d7f6e0044c4b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1674 microversion: 2.1 time: 0.209116 Oct 22 03:22:56.185495 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2155/4263] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:55 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:56.190320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:56.191160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:56.197590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:56.198324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:56.198991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:56.199906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:56.200585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:56.201344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:56.233760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:22:56.262599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] validate_networks() for [('2d1cca5b-25a9-46f8-b226-444686dedc9d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:22:56.343093 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01876c1e-024f-4436-819c-caf8410c28c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6" status: 204 len: 0 microversion: 2.1 time: 0.155981 Oct 22 03:22:56.348447 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2156/4264] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:22:56 2022] DELETE /compute/v2.1/servers/e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:22:56.357345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca7371ef-7ff5-4a3e-953e-902c9677ca67 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'update_all', calling method: .version_select at 0x7f0d1a991e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:56.430218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ca7371ef-7ff5-4a3e-953e-902c9677ca67 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:56.437759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ca7371ef-7ff5-4a3e-953e-902c9677ca67 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:56.800000 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca7371ef-7ff5-4a3e-953e-902c9677ca67 tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 61 microversion: 2.1 time: 0.448802 Oct 22 03:22:56.800704 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2157/4265] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:22:56 2022] PUT /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 61 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:56.806558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:56.807182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:56.827071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:56.828565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:56.829764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:56.832108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:56.834058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:56.840740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:56.883726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:22:57.078134 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-22273eac-b73e-4cdf-82bf-cbfaad73502f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874" status: 204 len: 0 microversion: 2.1 time: 0.275536 Oct 22 03:22:57.079367 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2158/4266] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:22:56 2022] DELETE /compute/v2.1/servers/6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:22:57.091267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:57.092245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:57.108446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:57.110022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:57.110868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:57.111920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:57.112710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:57.113571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:57.152020 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] HTTP exception thrown: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Request method failure captured: Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 HTTP/1.1 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BobvmuWJSK6P6gFZd_qaNO77AKj2eJ9Ax8GA4t9BIS8oBQlztX4IIjciCxyb08OFhIS0Zttu6MEbT_QI1BSM7IuHjjus8qJjCVOEYpJy-5angw7r_5GD-d_9fBG7rPJcZoeQwd-VBO2HFqcSbILFeeSJ7sCtQa8kwJQS38BEaYnSw Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.42 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 42016e2241264da88579fb9b9192087c Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42016e2241264da88579fb9b9192087c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42016e2241264da88579fb9b9192087c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42016e2241264da88579fb9b9192087c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42016e2241264da88579fb9b9192087c"}]}] Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 42016e2241264da88579fb9b9192087c Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TaggedBootDevicesTest_v242-773605929-project Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0f85a274b68543fbbbc0a97d7cb6b8a6 Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TaggedBootDevicesTest_v242-773605929-project Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '22d66b53-cee2-442c-b4ee-6fea13305813'} Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:57.158545 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:22:57.165570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:57.165570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:22:57.165570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:22:57.165570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:22:57.165570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:22:57.165570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:22:57.165570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:22:57.165570 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:22:57.173925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:22:57.174591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:22:57.175628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:22:57.176227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:22:57.176998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:22:57.198714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Returning 404 to user: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:22:57.205014 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20fbe7c6-8cd4-465c-a3dd-2e85d1948dd4 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 404 len: 111 microversion: 2.42 time: 0.116265 Oct 22 03:22:57.207189 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2159/4267] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:22:57 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:22:57.221539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2da5a92c-a791-45a1-a858-855e4de1a18e tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Action: 'create', calling method: .version_select at 0x7f0d1a9984c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:57.223222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:57.224306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:57.225120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:57.226253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:57.227128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:57.227867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:57.257906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Getting quotas for project 1a8fafd6eb6c4ed99ea6584eaa795c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:57.265785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Getting quotas for user 3e822e3631634aa083e0996b7d99737c and project 1a8fafd6eb6c4ed99ea6584eaa795c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:57.284732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:22:57.288688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:22:57.316261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2da5a92c-a791-45a1-a858-855e4de1a18e tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:57.329737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2da5a92c-a791-45a1-a858-855e4de1a18e tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Getting quotas for user 79ac15b5205543168fe44a6241d0a004 and project 9014c3d108d446afa05d531008b1fa2c. Resources: dict_keys(['metadata_items']) {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:57.359097 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b89c9ce8-72c7-4ae4-9980-9a18aa2bfec5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345634 Oct 22 03:22:57.360027 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2109/4268] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:22:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:22:57.365192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:57.366066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:57.373318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:57.374130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:57.374771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:57.375763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:57.376491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:57.377129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:57.581484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:57.591401 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2de45a94-b854-4db4-9a36-617f06e724a4 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.229982 Oct 22 03:22:57.592352 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2110/4269] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:57 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:57.619010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:57.621024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:57.636410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:57.636910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:57.638032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:57.648799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:57.655398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:57.656100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:57.921403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:22:57.930082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0443123-4221-4776-8188-85c3035fc59c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1674 microversion: 2.1 time: 0.325179 Oct 22 03:22:57.931329 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2111/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:57 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1674 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:22:57.947727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-712e0f88-d36b-4503-ae2a-9ca8394d9d83 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '.version_select at 0x7f0d19636430>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:57.975914 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2da5a92c-a791-45a1-a858-855e4de1a18e tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "POST /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 85 microversion: 2.1 time: 0.762591 Oct 22 03:22:57.977775 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2160/4271] 10.222.0.25 () {60 vars in 1281 bytes} [Sat Oct 22 03:22:57 2022] POST /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 85 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:57.987131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-794297828", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "58ff6c47-8a33-456d-82ed-98e75d34b28d"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:57.994699 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-712e0f88-d36b-4503-ae2a-9ca8394d9d83 tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017535961" status: 204 len: 0 microversion: 2.42 time: 0.055552 Oct 22 03:22:57.996729 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2112/4272] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Oct 22 03:22:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017535961 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:22:58.021931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1373025786", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "2d1cca5b-25a9-46f8-b226-444686dedc9d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:22:58.109174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] validate_networks() for [('58ff6c47-8a33-456d-82ed-98e75d34b28d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:22:58.185658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] validate_networks() for [('2d1cca5b-25a9-46f8-b226-444686dedc9d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:22:59.045444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:22:59.046107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:22:59.046334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:22:59.047043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:22:59.047634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:22:59.063641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:59.067443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:59.069851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:59.071008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:59.074893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:59.075607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:59.095660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Getting quotas for project 1a8fafd6eb6c4ed99ea6584eaa795c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:22:59.102154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Getting quotas for user 3e822e3631634aa083e0996b7d99737c and project 1a8fafd6eb6c4ed99ea6584eaa795c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:22:59.117802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:22:59.125650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:22:59.221285 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ebdc044-fa73-4fad-b8ea-839d41b89285 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.222893 Oct 22 03:22:59.223070 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2113/4273] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:22:59.230749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e359f83-276f-41df-9984-43d3b8cde3ff tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] Calling method '.version_select at 0x7f0d1e4ea550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:59.329457 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e359f83-276f-41df-9984-43d3b8cde3ff tempest-ImagesMetadataTestJSON-860693189 tempest-ImagesMetadataTestJSON-860693189-project] 10.222.0.25 "GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata" status: 200 len: 85 microversion: 2.1 time: 0.104010 Oct 22 03:22:59.334492 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2114/4274] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:22:59 2022] GET /compute/v2.1/images/7f06f961-dba7-4399-b334-b461e8944981/metadata => generated 85 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:22:59.373522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:22:59.384465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:22:59.411199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:59.412757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:59.415644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:22:59.417959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:22:59.419865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:22:59.420681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:00.133969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:00.158324 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-976bd8de-91cf-4cbe-9d01-4a01d6f3fb73 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 200 len: 1507 microversion: 2.1 time: 0.822654 Oct 22 03:23:00.168595 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2115/4275] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:22:59 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 1507 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:00.181262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:00.181880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:00.206616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:00.214689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:00.215629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:00.217266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:00.218232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:00.218796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:00.553437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:00.564922 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b08e8fb5-27d0-43f3-9926-69626f0a2b56 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.395116 Oct 22 03:23:00.589343 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2116/4276] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:00 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:00.601090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-308612918", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "451", "networks": [{"uuid": "2d1cca5b-25a9-46f8-b226-444686dedc9d"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:00.714661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] validate_networks() for [('2d1cca5b-25a9-46f8-b226-444686dedc9d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:23:01.316187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:23:01.316749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:23:01.317271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:23:01.318119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:23:01.318809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:23:01.338525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.339735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.340190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.341477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.342471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.343124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.403565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Getting quotas for project baeef71a21d248e49eb2548a4a69bb2c. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:01.414329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Getting quotas for user a0d479faa1f14d0ca72a1931b89aea08 and project baeef71a21d248e49eb2548a4a69bb2c. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:01.456945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Going to run 2 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:23:01.459919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:23:01.515378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=c03dd7ae-c54a-440e-b9de-0eb4b8b31359,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:23:01.588534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-52e49cff-15d3-4e7d-b61f-e57663504176 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.608703 Oct 22 03:23:01.589852 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2161/4277] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:22:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 3611 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 22 03:23:01.600090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8a73a977-d26b-42a6-9283-99435cb73664 req-e742584a-e376-4672-b2ac-d826598ad8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ada49-cfb0-4e8a-9f6e-7131ae07f59e", "name": "network-vif-deleted", "tag": "5b6b44b1-e880-408c-812e-4a8ec523821e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:01.616088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8a73a977-d26b-42a6-9283-99435cb73664 req-e742584a-e376-4672-b2ac-d826598ad8dd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.616334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8a73a977-d26b-42a6-9283-99435cb73664 req-e742584a-e376-4672-b2ac-d826598ad8dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.616995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8a73a977-d26b-42a6-9283-99435cb73664 req-e742584a-e376-4672-b2ac-d826598ad8dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.641117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8a73a977-d26b-42a6-9283-99435cb73664 req-e742584a-e376-4672-b2ac-d826598ad8dd service nova] Creating event network-vif-deleted:5b6b44b1-e880-408c-812e-4a8ec523821e for instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e on n-h1-862416-2 Oct 22 03:23:01.651725 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8a73a977-d26b-42a6-9283-99435cb73664 req-e742584a-e376-4672-b2ac-d826598ad8dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057910 Oct 22 03:23:01.652737 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2162/4278] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:01.659096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:01.663349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:01.672462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.673225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.673850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.674739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.675452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.676168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.735287 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a1905b4-f8ce-4b94-a98b-2984ebbed523 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 200 len: 322 microversion: 2.1 time: 0.080257 Oct 22 03:23:01.736649 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2163/4279] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:23:01 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 322 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:01.744587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:01.745674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: 434ada49-cfb0-4e8a-9f6e-7131ae07f59e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:01.757559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.758452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.760655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.761802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.763465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.764265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.783357 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] HTTP exception thrown: Instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e could not be found. Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Request method failure captured: Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e HTTP/1.1 Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2GaY4L0W07K_lGPmR4MJASBgGSOo0E0e1OwhXF0YFvAwbmbv0usRMvC8eK7D4XowW2vojpCePPenm4Koe9iMNzAGZmRKv_I-tWORchBnDzWpVOghNVnh7RkZQawNwf4WiDvLqecf3V9KGfd7YTqNNz0dM3Fa1pCGAQxiq2_0nBm79k Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: d98cea0b45fe423ea345888fe03ad61f Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueTestJSON-1073400333 Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d98cea0b45fe423ea345888fe03ad61f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d98cea0b45fe423ea345888fe03ad61f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d98cea0b45fe423ea345888fe03ad61f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d98cea0b45fe423ea345888fe03ad61f"}]}] Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueTestJSON-1073400333 Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: d98cea0b45fe423ea345888fe03ad61f Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueTestJSON-1073400333 Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueTestJSON-1073400333-project Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2bfdbcbd066b4e6589f216a9c8bb685c Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueTestJSON-1073400333-project Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e could not be found. Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '434ada49-cfb0-4e8a-9f6e-7131ae07f59e'} Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e could not be found. Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e could not be found. Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:01.788050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e could not be found. Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Returning 404 to user: Instance 434ada49-cfb0-4e8a-9f6e-7131ae07f59e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f5910fd-4b99-40b9-a36a-c130215e915d tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e" status: 404 len: 111 microversion: 2.1 time: 0.049484 Oct 22 03:23:01.793706 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2164/4280] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:01 2022] GET /compute/v2.1/servers/434ada49-cfb0-4e8a-9f6e-7131ae07f59e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:01.797231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:01.802636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:01.803516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Searching by: {'deleted': False, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:01.829413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.830007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.830556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.831376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:01.837224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:01.838270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:01.886885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:01.970095 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e287f08-a2d0-4ff0-91df-b7497fa5e0e7 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.180275 Oct 22 03:23:01.971253 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2165/4281] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:23:01 2022] GET /compute/v2.1/servers => generated 1335 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:01.984825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:01.987473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:02.000340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:02.006568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:02.007361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:02.008440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:02.009147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:02.009880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:02.736285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:23:02.738393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:23:02.739035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:23:02.740531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:23:02.741589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:23:02.760889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:02.761546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:02.762226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:02.764066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:02.765086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:02.765638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:02.788859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Getting quotas for project 1a8fafd6eb6c4ed99ea6584eaa795c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:02.795887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Getting quotas for user 3e822e3631634aa083e0996b7d99737c and project 1a8fafd6eb6c4ed99ea6584eaa795c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:02.804663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:02.817953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:23:02.823124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:23:02.823991 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5d39f9b0-8b5b-43d6-8236-8d4fa860f775 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.851384 Oct 22 03:23:02.838125 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2166/4282] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:01 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:02.864226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:02.871435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:02.889964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:02.892178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:02.893135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:02.896912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:02.901316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:02.904863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:03.038490 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7be27ba3-e8b6-48d2-b78e-6e6f5e2657c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.446442 Oct 22 03:23:03.039158 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2117/4283] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:23:03.040381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:23:03.065077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:03.068594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:03.111288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:03.115272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:03.121164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:03.123095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:03.124762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:03.125460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:03.159191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:03.292807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fb722f70-7f9c-444f-b908-6dbe7e31ff06 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 204 len: 0 microversion: 2.1 time: 0.448354 Oct 22 03:23:03.297271 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2167/4284] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:23:02 2022] DELETE /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:23:03.303591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-02c9824e-f078-42ca-ab55-46a1593cccec req-7afbdfc8-73e1-4628-83d8-b2580810ba8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874", "name": "network-vif-deleted", "tag": "3b63a3f8-5415-4205-a0da-cf4945bfcd90"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:03.319988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-02c9824e-f078-42ca-ab55-46a1593cccec req-7afbdfc8-73e1-4628-83d8-b2580810ba8b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:03.320754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-02c9824e-f078-42ca-ab55-46a1593cccec req-7afbdfc8-73e1-4628-83d8-b2580810ba8b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:03.321361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-02c9824e-f078-42ca-ab55-46a1593cccec req-7afbdfc8-73e1-4628-83d8-b2580810ba8b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:03.336611 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-02c9824e-f078-42ca-ab55-46a1593cccec req-7afbdfc8-73e1-4628-83d8-b2580810ba8b service nova] Creating event network-vif-deleted:3b63a3f8-5415-4205-a0da-cf4945bfcd90 for instance 6a0d2a34-73c1-4c7c-a0ae-bf59d54b5874 on n-h2-862416-2 Oct 22 03:23:03.342979 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-02c9824e-f078-42ca-ab55-46a1593cccec req-7afbdfc8-73e1-4628-83d8-b2580810ba8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044078 Oct 22 03:23:03.344394 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2168/4285] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:03.351362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:03.352727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:03.364853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:03.366914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:03.367927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:03.370278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:03.370848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:03.371531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:03.613059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:03.617619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:03.634779 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5614c80e-6def-4c2d-9fd6-8adca1589be9 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1221 microversion: 2.1 time: 0.588773 Oct 22 03:23:03.639572 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2118/4286] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:03 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1221 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:03.656063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0692ee8e-7319-4c90-966b-2b681f0b497f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:03.656715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0692ee8e-7319-4c90-966b-2b681f0b497f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:03.842918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0692ee8e-7319-4c90-966b-2b681f0b497f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:03.852648 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0692ee8e-7319-4c90-966b-2b681f0b497f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1220 microversion: 2.1 time: 0.207415 Oct 22 03:23:03.857713 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2119/4287] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:03 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1220 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:03.870757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:03.871987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:03.886156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:03.886661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:03.889474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:03.890581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:03.892732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:03.893466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:04.054678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:04.076234 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce43770f-f453-4d4f-8b80-7f92d3462926 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.718151 Oct 22 03:23:04.076234 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2169/4288] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:03 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:04.089249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:04.089957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:04.091848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:04.109037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:04.109546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:04.109970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:04.110814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:04.111277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:04.111800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:04.416896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:04.425051 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b14f6740-4c17-4e5a-85f2-704f6fafd014 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1492 microversion: 2.1 time: 0.565582 Oct 22 03:23:04.430672 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2120/4289] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:03 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1492 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:04.572022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:04.581198 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8070d78-f881-4b01-8db2-8fa6b3ac2b6f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.496110 Oct 22 03:23:04.593002 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2170/4290] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:04 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:04.620286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:04.621442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:04.628237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:04.634849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:04.636738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:04.637564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:04.644822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:04.652844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:04.759703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ac8788f-5c7e-4fad-97e0-f65a2dddc465 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Calling method '.version_select at 0x7f0d19aa7ee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:04.789139 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-0ac8788f-5c7e-4fad-97e0-f65a2dddc465 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] HTTP exception thrown: Image not found. Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ac8788f-5c7e-4fad-97e0-f65a2dddc465 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Request method failure captured: Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/images/64bf8892-1436-4078-b2b2-6ee36ee7e184/metadata/os_distro HTTP/1.1 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IYLOSH5cE4EnLzSTVbKujM6LdIyY66L7qBXA_4ih8FNKCvJcQsso7jYty-c7xE2UXAup79g16ZxFybvXFKpiifC6x5Szsm9bxgkBvSIQ6RbvcQ9omIVZtgH8fXh4-WFqJrUp9Jh-zQllC6ZeYs_jbhXnIviycshJbJQfab5O8ohac Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41d27a995d7c464193bb30037d583cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}] Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8980148089c1404eaed213e95839c4a9 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: exception: Image not found. Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'image_id': '64bf8892-1436-4078-b2b2-6ee36ee7e184', 'id': 'os_distro'} Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 64bf8892-1436-4078-b2b2-6ee36ee7e184 Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:23:04.800046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 64bf8892-1436-4078-b2b2-6ee36ee7e184 could not be found. Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ac8788f-5c7e-4fad-97e0-f65a2dddc465 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Returning 404 to user: Image not found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:04.805834 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ac8788f-5c7e-4fad-97e0-f65a2dddc465 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] 10.222.0.25 "DELETE /compute/v2.1/images/64bf8892-1436-4078-b2b2-6ee36ee7e184/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.371286 Oct 22 03:23:04.814125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2121/4291] 10.222.0.25 () {58 vars in 1293 bytes} [Sat Oct 22 03:23:04 2022] DELETE /compute/v2.1/images/64bf8892-1436-4078-b2b2-6ee36ee7e184/metadata/os_distro => generated 62 bytes in 375 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:23:04.816908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:04.817540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:04.827083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:04.827591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:04.828045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:04.828804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:04.829260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:04.829935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:04.925623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:04.938277 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ea47118-2412-4f4e-9f08-4f2890f8525f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1213 microversion: 2.1 time: 0.128291 Oct 22 03:23:04.949287 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2122/4292] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:04 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:04.958005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed06a1f9-849b-47fe-a8b2-6fcdac415194 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Calling method '.version_select at 0x7f0d19aa7af0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:04.999779 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ed06a1f9-849b-47fe-a8b2-6fcdac415194 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] HTTP exception thrown: Image not found. Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed06a1f9-849b-47fe-a8b2-6fcdac415194 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Request method failure captured: Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/images/65a215b8-19e9-4d8e-bf6b-ae1a9fa51ecc/metadata/os_version HTTP/1.1 Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IYLOSH5cE4EnLzSTVbKujM6LdIyY66L7qBXA_4ih8FNKCvJcQsso7jYty-c7xE2UXAup79g16ZxFybvXFKpiifC6x5Szsm9bxgkBvSIQ6RbvcQ9omIVZtgH8fXh4-WFqJrUp9Jh-zQllC6ZeYs_jbhXnIviycshJbJQfab5O8ohac Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41d27a995d7c464193bb30037d583cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}] Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8980148089c1404eaed213e95839c4a9 Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: exception: Image not found. Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'image_id': '65a215b8-19e9-4d8e-bf6b-ae1a9fa51ecc', 'id': 'os_version'} Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 65a215b8-19e9-4d8e-bf6b-ae1a9fa51ecc Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:23:05.002429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65a215b8-19e9-4d8e-bf6b-ae1a9fa51ecc could not be found. Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:23:05.008996 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.017100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed06a1f9-849b-47fe-a8b2-6fcdac415194 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Returning 404 to user: Image not found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:05.018784 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ed06a1f9-849b-47fe-a8b2-6fcdac415194 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] 10.222.0.25 "GET /compute/v2.1/images/65a215b8-19e9-4d8e-bf6b-ae1a9fa51ecc/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.067516 Oct 22 03:23:05.019842 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2123/4293] 10.222.0.25 () {58 vars in 1293 bytes} [Sat Oct 22 03:23:04 2022] GET /compute/v2.1/images/65a215b8-19e9-4d8e-bf6b-ae1a9fa51ecc/metadata/os_version => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:23:05.032067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:05.033622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:05.046499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:05.047022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:05.048117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:05.049126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:05.049683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:05.050336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:05.160103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:05.169365 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2fde62f4-97e1-4fa5-bb84-7b45b7c2c829 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.553189 Oct 22 03:23:05.172745 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2171/4294] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:04 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:05.190847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-288c4bcd-338d-46f1-9655-c9b7576dc836 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Calling method '.version_select at 0x7f0d1a3691f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:05.223130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:05.263704 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-288c4bcd-338d-46f1-9655-c9b7576dc836 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] HTTP exception thrown: Image not found. Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-288c4bcd-338d-46f1-9655-c9b7576dc836 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Request method failure captured: Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/images/9db3e5e0-3f7c-45b9-8233-b3d288e7bb6d/metadata HTTP/1.1 Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IYLOSH5cE4EnLzSTVbKujM6LdIyY66L7qBXA_4ih8FNKCvJcQsso7jYty-c7xE2UXAup79g16ZxFybvXFKpiifC6x5Szsm9bxgkBvSIQ6RbvcQ9omIVZtgH8fXh4-WFqJrUp9Jh-zQllC6ZeYs_jbhXnIviycshJbJQfab5O8ohac Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41d27a995d7c464193bb30037d583cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}] Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8980148089c1404eaed213e95839c4a9 Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'image_id': '9db3e5e0-3f7c-45b9-8233-b3d288e7bb6d'} Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9db3e5e0-3f7c-45b9-8233-b3d288e7bb6d Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:23:05.266348 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9db3e5e0-3f7c-45b9-8233-b3d288e7bb6d could not be found. Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-288c4bcd-338d-46f1-9655-c9b7576dc836 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:05.269174 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-288c4bcd-338d-46f1-9655-c9b7576dc836 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] 10.222.0.25 "GET /compute/v2.1/images/9db3e5e0-3f7c-45b9-8233-b3d288e7bb6d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.092403 Oct 22 03:23:05.273776 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2172/4295] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Oct 22 03:23:05 2022] GET /compute/v2.1/images/9db3e5e0-3f7c-45b9-8233-b3d288e7bb6d/metadata => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:23:05.278703 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a2c55a3c-dbb7-4d7b-84cb-7e0cb67a1f9c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1272 microversion: 2.1 time: 0.248775 Oct 22 03:23:05.279392 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2124/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:05 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:05.292980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a993b0e-5fc0-4834-9f85-07938fece764 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Action: 'update_all', calling method: .version_select at 0x7f0d1a369430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:05.320016 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1a993b0e-5fc0-4834-9f85-07938fece764 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] HTTP exception thrown: Image not found. Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a993b0e-5fc0-4834-9f85-07938fece764 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Request method failure captured: Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: request: PUT /compute/v2.1/images/e015caac-df5f-4e7d-99ff-8ee07f5a555d/metadata HTTP/1.1 Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 57 Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IYLOSH5cE4EnLzSTVbKujM6LdIyY66L7qBXA_4ih8FNKCvJcQsso7jYty-c7xE2UXAup79g16ZxFybvXFKpiifC6x5Szsm9bxgkBvSIQ6RbvcQ9omIVZtgH8fXh4-WFqJrUp9Jh-zQllC6ZeYs_jbhXnIviycshJbJQfab5O8ohac Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41d27a995d7c464193bb30037d583cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}] Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8980148089c1404eaed213e95839c4a9 Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'image_id': 'e015caac-df5f-4e7d-99ff-8ee07f5a555d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e015caac-df5f-4e7d-99ff-8ee07f5a555d Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:23:05.325219 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e015caac-df5f-4e7d-99ff-8ee07f5a555d could not be found. Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a993b0e-5fc0-4834-9f85-07938fece764 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:05.328154 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a993b0e-5fc0-4834-9f85-07938fece764 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] 10.222.0.25 "PUT /compute/v2.1/images/e015caac-df5f-4e7d-99ff-8ee07f5a555d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051350 Oct 22 03:23:05.333796 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2173/4297] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:23:05 2022] PUT /compute/v2.1/images/e015caac-df5f-4e7d-99ff-8ee07f5a555d/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:23:05.339079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-348697d0-f528-434a-ad1f-af4d12f31cd6 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Action: 'update', calling method: .version_select at 0x7f0d1989e4c0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:05.350844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-af9096aa-bca1-4422-aac9-a91339738124 req-f3fd7bce-e359-4b2d-81d5-91c32531b3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451170a5-0891-4542-a8e8-119f7fbc6c6d", "tag": "2b10c880-6807-4afc-860e-4b8209440b56"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:05.400420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-af9096aa-bca1-4422-aac9-a91339738124 req-f3fd7bce-e359-4b2d-81d5-91c32531b3f4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:05.401959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-af9096aa-bca1-4422-aac9-a91339738124 req-f3fd7bce-e359-4b2d-81d5-91c32531b3f4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:05.402077 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-348697d0-f528-434a-ad1f-af4d12f31cd6 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] HTTP exception thrown: Image not found. Oct 22 03:23:05.403283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-af9096aa-bca1-4422-aac9-a91339738124 req-f3fd7bce-e359-4b2d-81d5-91c32531b3f4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-348697d0-f528-434a-ad1f-af4d12f31cd6 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Request method failure captured: Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/images/76f04f85-3cc4-410f-9b45-82c11a1da9a0/metadata/os_distro HTTP/1.1 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 30 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IYLOSH5cE4EnLzSTVbKujM6LdIyY66L7qBXA_4ih8FNKCvJcQsso7jYty-c7xE2UXAup79g16ZxFybvXFKpiifC6x5Szsm9bxgkBvSIQ6RbvcQ9omIVZtgH8fXh4-WFqJrUp9Jh-zQllC6ZeYs_jbhXnIviycshJbJQfab5O8ohac Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41d27a995d7c464193bb30037d583cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}] Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8980148089c1404eaed213e95839c4a9 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: {"meta": {"os_distro": "alt"}} Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: exception: Image not found. Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'image_id': '76f04f85-3cc4-410f-9b45-82c11a1da9a0', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 76f04f85-3cc4-410f-9b45-82c11a1da9a0 Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:23:05.405133 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 76f04f85-3cc4-410f-9b45-82c11a1da9a0 could not be found. Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-348697d0-f528-434a-ad1f-af4d12f31cd6 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Returning 404 to user: Image not found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-348697d0-f528-434a-ad1f-af4d12f31cd6 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] 10.222.0.25 "PUT /compute/v2.1/images/76f04f85-3cc4-410f-9b45-82c11a1da9a0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.073678 Oct 22 03:23:05.408440 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2125/4298] 10.222.0.25 () {60 vars in 1310 bytes} [Sat Oct 22 03:23:05 2022] PUT /compute/v2.1/images/76f04f85-3cc4-410f-9b45-82c11a1da9a0/metadata/os_distro => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:23:05.439226 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-af9096aa-bca1-4422-aac9-a91339738124 req-f3fd7bce-e359-4b2d-81d5-91c32531b3f4 service nova] Creating event network-changed:2b10c880-6807-4afc-860e-4b8209440b56 for instance 451170a5-0891-4542-a8e8-119f7fbc6c6d on n-h1-862416-2 Oct 22 03:23:05.451221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4ec86e29-645d-4965-a94c-07e2f01ce039 req-2ae62264-6c75-4a1d-8fac-a9c90bedc9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6", "name": "network-vif-deleted", "tag": "eae0ba14-f85e-49d7-9bcf-4ddd354a2b62"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:05.462672 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-af9096aa-bca1-4422-aac9-a91339738124 req-f3fd7bce-e359-4b2d-81d5-91c32531b3f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114437 Oct 22 03:23:05.465248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2174/4299] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:05.496522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c757a37-4a59-47f0-b608-9b8d764e7e68 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Action: 'create', calling method: .version_select at 0x7f0d19ffc550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:05.526320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4ec86e29-645d-4965-a94c-07e2f01ce039 req-2ae62264-6c75-4a1d-8fac-a9c90bedc9c1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:05.527031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4ec86e29-645d-4965-a94c-07e2f01ce039 req-2ae62264-6c75-4a1d-8fac-a9c90bedc9c1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:05.527374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4ec86e29-645d-4965-a94c-07e2f01ce039 req-2ae62264-6c75-4a1d-8fac-a9c90bedc9c1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:05.545247 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-3c757a37-4a59-47f0-b608-9b8d764e7e68 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] HTTP exception thrown: Image not found. Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c757a37-4a59-47f0-b608-9b8d764e7e68 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Request method failure captured: Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/images/d733e3de-a1aa-473a-8b23-009a464e43ce/metadata HTTP/1.1 Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 57 Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IYLOSH5cE4EnLzSTVbKujM6LdIyY66L7qBXA_4ih8FNKCvJcQsso7jYty-c7xE2UXAup79g16ZxFybvXFKpiifC6x5Szsm9bxgkBvSIQ6RbvcQ9omIVZtgH8fXh4-WFqJrUp9Jh-zQllC6ZeYs_jbhXnIviycshJbJQfab5O8ohac Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41d27a995d7c464193bb30037d583cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41d27a995d7c464193bb30037d583cbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41d27a995d7c464193bb30037d583cbc"}]}] Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 41d27a995d7c464193bb30037d583cbc Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124 Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8980148089c1404eaed213e95839c4a9 Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1106887124-project Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: exception: Image not found. Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'image_id': 'd733e3de-a1aa-473a-8b23-009a464e43ce', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d733e3de-a1aa-473a-8b23-009a464e43ce Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 22 03:23:05.551723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d733e3de-a1aa-473a-8b23-009a464e43ce could not be found. Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 22 03:23:05.555322 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:05.560972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c757a37-4a59-47f0-b608-9b8d764e7e68 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] Returning 404 to user: Image not found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:05.566685 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c757a37-4a59-47f0-b608-9b8d764e7e68 tempest-ImagesMetadataNegativeTestJSON-1106887124 tempest-ImagesMetadataNegativeTestJSON-1106887124-project] 10.222.0.25 "POST /compute/v2.1/images/d733e3de-a1aa-473a-8b23-009a464e43ce/metadata" status: 404 len: 62 microversion: 2.1 time: 0.100028 Oct 22 03:23:05.579747 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2175/4300] 10.222.0.25 () {60 vars in 1281 bytes} [Sat Oct 22 03:23:05 2022] POST /compute/v2.1/images/d733e3de-a1aa-473a-8b23-009a464e43ce/metadata => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:23:05.590562 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4ec86e29-645d-4965-a94c-07e2f01ce039 req-2ae62264-6c75-4a1d-8fac-a9c90bedc9c1 service nova] Creating event network-vif-deleted:eae0ba14-f85e-49d7-9bcf-4ddd354a2b62 for instance e6dfcd85-eda3-430d-a0eb-c8eb944cfbf6 on n-h2-862416-2 Oct 22 03:23:05.602067 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4ec86e29-645d-4965-a94c-07e2f01ce039 req-2ae62264-6c75-4a1d-8fac-a9c90bedc9c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173696 Oct 22 03:23:05.602685 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2126/4301] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:05.617078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:05.617976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:05.629048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-997425682", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "316c23c4-6eda-4626-bced-03168617187b"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:05.642293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:05.643035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:05.644055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:05.645236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:05.645904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:05.648786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:05.763237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] validate_networks() for [('316c23c4-6eda-4626-bced-03168617187b', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:23:06.797528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:06.813299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5cc2f45c-e5bb-4c6c-958b-9f4882e095df tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1492 microversion: 2.1 time: 1.220794 Oct 22 03:23:06.815022 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2176/4302] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:05 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1492 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:06.821221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:06.822269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:06.830435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:06.831327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:06.832132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:06.833430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:06.834077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:06.834686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:07.049926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:07.065983 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b044726-936a-4e78-a55e-78ec50de3df1 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1277 microversion: 2.1 time: 0.249403 Oct 22 03:23:07.069748 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2177/4303] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:06 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:07.079971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:07.081092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:07.118099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:07.118620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:07.119072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:07.119813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:07.120308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:07.121190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:07.327302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:07.342023 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5dec966f-6c70-4a7a-aec9-479303c4a257 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1278 microversion: 2.1 time: 0.270782 Oct 22 03:23:07.342632 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2178/4304] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:07 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1278 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:07.842919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:07.844018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:07.854123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:07.854795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:07.855905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:07.856605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:07.857067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:07.857784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:08.402982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:08.412629 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1aa35c4c-f231-4ca4-b2e4-c2f6d04a9cec tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1492 microversion: 2.1 time: 0.574827 Oct 22 03:23:08.413942 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2179/4305] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:07 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1492 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:08.441080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:08.442280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:08.460701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:08.462201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:08.462905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:08.464164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:08.464774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:08.465655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:08.668635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:08.684201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5625b80b-4d9d-4f72-a71c-ee0de899726c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1275 microversion: 2.1 time: 0.267942 Oct 22 03:23:08.702094 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2180/4306] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:08 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1275 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:08.707703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:08.709170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:08.719785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:08.720590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:08.722315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:08.723443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:08.727343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:08.728113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:08.804119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:23:08.804788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:23:08.806833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:23:08.807736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:23:08.809708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:23:08.819990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:08.875055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:08.877185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:08.877730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:08.883879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:08.885089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:08.893181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:08.917990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:08.919736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:08.926100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for user f89d04db39be473097b885f7465115a2 and project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:08.928836 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d9a995fe-dfbd-45a8-95e3-83137ecc6040 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1278 microversion: 2.1 time: 0.225083 Oct 22 03:23:08.940923 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2181/4307] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:08 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:08.946467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cef5a293-8271-4238-9d6d-a83ae3ca3e15 req-cd011dd2-7909-4f9b-b7bb-377875672c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbf3baa-77ae-48d3-83ea-2727e3b72219", "name": "network-vif-deleted", "tag": "88bf9269-36c5-4aea-8d89-252e85ba4c85"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:08.955089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:23:08.964392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:23:08.968744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cef5a293-8271-4238-9d6d-a83ae3ca3e15 req-cd011dd2-7909-4f9b-b7bb-377875672c91 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:08.969327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cef5a293-8271-4238-9d6d-a83ae3ca3e15 req-cd011dd2-7909-4f9b-b7bb-377875672c91 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:08.969942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cef5a293-8271-4238-9d6d-a83ae3ca3e15 req-cd011dd2-7909-4f9b-b7bb-377875672c91 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:08.995503 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cef5a293-8271-4238-9d6d-a83ae3ca3e15 req-cd011dd2-7909-4f9b-b7bb-377875672c91 service nova] Creating event network-vif-deleted:88bf9269-36c5-4aea-8d89-252e85ba4c85 for instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 on n-h1-862416-2 Oct 22 03:23:09.010727 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cef5a293-8271-4238-9d6d-a83ae3ca3e15 req-cd011dd2-7909-4f9b-b7bb-377875672c91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068228 Oct 22 03:23:09.014397 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2182/4308] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:09.055939 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5813ead2-e734-402d-b6df-3fa36eb448b3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.445775 Oct 22 03:23:09.058776 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2127/4309] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:23:09.070730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a53021b-7596-4330-b8d9-94ff33ade16e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:09.072480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a53021b-7596-4330-b8d9-94ff33ade16e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:09.276790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a53021b-7596-4330-b8d9-94ff33ade16e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:09.286093 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a53021b-7596-4330-b8d9-94ff33ade16e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1214 microversion: 2.1 time: 0.220769 Oct 22 03:23:09.297396 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2183/4310] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:09 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:09.439966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:09.442416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:09.472070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:09.472608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:09.473141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:09.479150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:09.481870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:09.482406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:09.570827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:09.570827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:09.570827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:09.570827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lazy-loading 'fault' on Instance uuid ddbf3baa-77ae-48d3-83ea-2727e3b72219 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:23:09.707099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:09.707840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:09.730892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:09.731822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:09.731822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:09.732572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:09.733397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:09.733832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:09.744753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:09.758292 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c8fb0f3-1e8f-48aa-a4a5-ce41f76f0a79 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1304 microversion: 2.1 time: 0.323385 Oct 22 03:23:09.777476 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2128/4311] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:09 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1304 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:09.964669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:09.966097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:09.975800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:09.978246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:09.979597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:09.980894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:09.981739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:09.984305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:10.491816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:10.516752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:10.525904 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-548d4911-2eb9-4425-b39b-c1eb6eb2401d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1275 microversion: 2.1 time: 0.822719 Oct 22 03:23:10.532081 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c1e9dfb-949b-4d59-957b-1df8498dbfbb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 0.569430 Oct 22 03:23:10.533126 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2184/4312] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:09 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1275 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:10.548245 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2129/4313] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:09 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:10.554359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:10.555417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:10.562466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:10.563034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:10.563731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:10.564708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:10.565397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:10.566034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:10.788474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:10.789312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:10.793448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:10.799832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:10.801199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:10.828057 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf197eba-2b06-4e2e-872b-d7af2f5e59ee tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1266 microversion: 2.1 time: 0.278327 Oct 22 03:23:10.842693 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2185/4314] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:10 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:10.842900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:10.842900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:10.842900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:10.842900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:10.942125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:10.946202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:10.946816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:10.947513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lazy-loading 'fault' on Instance uuid ddbf3baa-77ae-48d3-83ea-2727e3b72219 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:23:11.065202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c797ff32-c926-4497-995a-cf5d4ec12cf1 req-45eceaea-42e8-40dc-b186-645c228444ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34099294-0ec2-494a-a13d-7d2e2ae9effd", "tag": "472b9d3d-b211-49c2-92e5-0f393163b9f8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:11.082253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c797ff32-c926-4497-995a-cf5d4ec12cf1 req-45eceaea-42e8-40dc-b186-645c228444ae service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:11.084551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c797ff32-c926-4497-995a-cf5d4ec12cf1 req-45eceaea-42e8-40dc-b186-645c228444ae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:11.085314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c797ff32-c926-4497-995a-cf5d4ec12cf1 req-45eceaea-42e8-40dc-b186-645c228444ae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:11.136259 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c797ff32-c926-4497-995a-cf5d4ec12cf1 req-45eceaea-42e8-40dc-b186-645c228444ae service nova] Creating event network-changed:472b9d3d-b211-49c2-92e5-0f393163b9f8 for instance 34099294-0ec2-494a-a13d-7d2e2ae9effd on n-h2-862416-2 Oct 22 03:23:11.139929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfdbcbd066b4e6589f216a9c8bb685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98cea0b45fe423ea345888fe03ad61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:11.148950 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1923bbf-e1bf-420e-95dc-97f4a20934dc tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 200 len: 1304 microversion: 2.1 time: 0.367864 Oct 22 03:23:11.151600 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c797ff32-c926-4497-995a-cf5d4ec12cf1 req-45eceaea-42e8-40dc-b186-645c228444ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090102 Oct 22 03:23:11.152797 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2186/4315] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:23:11.158749 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2130/4316] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:10 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 1304 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:11.565566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:11.567246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:11.570238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:11.585936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:11.605842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:11.611513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:11.611513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:11.611513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:11.611513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:11.612589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:11.613198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:11.614523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:11.615459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:11.615744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:11.618099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:11.620307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:11.868010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:12.139160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:12.152819 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e359b43-95ca-4b60-bdff-31739e264a4a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 0.598058 Oct 22 03:23:12.174327 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2131/4317] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:11 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:12.196362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:12.197224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:12.215457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:12.217335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:12.220387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:12.221506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:12.222200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:12.225120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:12.297996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:12.307445 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8986e9a9-ec79-4d41-88f4-507f3ee013a6 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1317 microversion: 2.1 time: 0.754266 Oct 22 03:23:12.311852 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2187/4318] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:11 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:12.330870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:12.332036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] [instance: ddbf3baa-77ae-48d3-83ea-2727e3b72219] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:12.345461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:12.346995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:12.348634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:12.352253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:12.352960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:12.353522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:12.387069 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] HTTP exception thrown: Instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 could not be found. Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Request method failure captured: Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 HTTP/1.1 Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2GaY4L0W07K_lGPmR4MJASBgGSOo0E0e1OwhXF0YFvAwbmbv0usRMvC8eK7D4XowW2vojpCePPenm4Koe9iMNzAGZmRKv_I-tWORchBnDzWpVOghNVnh7RkZQawNwf4WiDvLqecf3V9KGfd7YTqNNz0dM3Fa1pCGAQxiq2_0nBm79k Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: d98cea0b45fe423ea345888fe03ad61f Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueTestJSON-1073400333 Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d98cea0b45fe423ea345888fe03ad61f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d98cea0b45fe423ea345888fe03ad61f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d98cea0b45fe423ea345888fe03ad61f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d98cea0b45fe423ea345888fe03ad61f"}]}] Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueTestJSON-1073400333 Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: d98cea0b45fe423ea345888fe03ad61f Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueTestJSON-1073400333 Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueTestJSON-1073400333-project Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2bfdbcbd066b4e6589f216a9c8bb685c Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueTestJSON-1073400333-project Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 could not be found. Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ddbf3baa-77ae-48d3-83ea-2727e3b72219'} Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 could not be found. Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 could not be found. Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:12.390780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 could not be found. Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] Returning 404 to user: Instance ddbf3baa-77ae-48d3-83ea-2727e3b72219 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:12.394534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38811a95-572f-4e2c-95ae-e861cb67f012 tempest-ServerRescueTestJSON-1073400333 tempest-ServerRescueTestJSON-1073400333-project] 10.222.0.25 "GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219" status: 404 len: 111 microversion: 2.1 time: 0.079577 Oct 22 03:23:12.398129 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2188/4319] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:12 2022] GET /compute/v2.1/servers/ddbf3baa-77ae-48d3-83ea-2727e3b72219 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:12.454306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:12.465312 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-96b6a32e-64e4-44b8-b259-881489bf539e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1272 microversion: 2.1 time: 0.289616 Oct 22 03:23:12.496371 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2132/4320] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:12 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:12.593879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be10747b-9997-4b31-b10f-845c515f0861 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Action: 'create', calling method: .version_select at 0x7f0d1a466160>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1654549433", "policies": ["affinity"]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:12.635736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-be10747b-9997-4b31-b10f-845c515f0861 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:12.654270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-be10747b-9997-4b31-b10f-845c515f0861 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:12.748707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-be10747b-9997-4b31-b10f-845c515f0861 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:12.757559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-be10747b-9997-4b31-b10f-845c515f0861 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:12.789413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be10747b-9997-4b31-b10f-845c515f0861 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.389934 Oct 22 03:23:12.791969 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2189/4321] 10.222.0.25 () {60 vars in 1174 bytes} [Sat Oct 22 03:23:12 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:12.803135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-707981e9-23f8-4920-aeed-30c8bef230e9 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Action: 'create', calling method: .version_select at 0x7f0d19abb790>, body: {"server_group": {"name": "tempest-server-group-1086458574", "policies": ["affinity"]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:12.860055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-707981e9-23f8-4920-aeed-30c8bef230e9 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:12.869271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-707981e9-23f8-4920-aeed-30c8bef230e9 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:13.007571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-707981e9-23f8-4920-aeed-30c8bef230e9 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:13.023078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-707981e9-23f8-4920-aeed-30c8bef230e9 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:13.068618 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-707981e9-23f8-4920-aeed-30c8bef230e9 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.265116 Oct 22 03:23:13.069541 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2133/4322] 10.222.0.25 () {60 vars in 1173 bytes} [Sat Oct 22 03:23:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:13.081199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a077639-d249-4dc0-b663-db97622c5e0e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Action: 'create', calling method: .version_select at 0x7f0d1a466ee0>, body: {"server_group": {"name": "tempest-server-group-1086458574", "policies": ["affinity"]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:13.123663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-8a077639-d249-4dc0-b663-db97622c5e0e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:13.144201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-8a077639-d249-4dc0-b663-db97622c5e0e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:13.182217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:13.182853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:13.197392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:13.199170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:13.202028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:13.204789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:13.206275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:13.206905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:13.242704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-8a077639-d249-4dc0-b663-db97622c5e0e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:13.248178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-8a077639-d249-4dc0-b663-db97622c5e0e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:13.281580 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a077639-d249-4dc0-b663-db97622c5e0e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.204375 Oct 22 03:23:13.288104 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2190/4323] 10.222.0.25 () {60 vars in 1173 bytes} [Sat Oct 22 03:23:13 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:13.295651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5b489b1-a2d5-4e85-8eea-405afa37bd7a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:13.354299 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5b489b1-a2d5-4e85-8eea-405afa37bd7a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/803c64bf-7019-4410-ad4c-3f4f42b9d01e" status: 204 len: 0 microversion: 2.1 time: 0.064522 Oct 22 03:23:13.358743 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2191/4324] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:13 2022] DELETE /compute/v2.1/os-server-groups/803c64bf-7019-4410-ad4c-3f4f42b9d01e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:23:13.363892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:13.368053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:13.384874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:13.385652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:13.386259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:13.387125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:13.387733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:13.388377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:14.182130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:14.191330 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4890957f-7d01-4951-9ede-663535a81e8c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 1.016051 Oct 22 03:23:14.195383 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2134/4325] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:13 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:14.209379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c21794a-37d9-46a4-9ee6-b754b79413c3 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:14.242081 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c21794a-37d9-46a4-9ee6-b754b79413c3 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.038324 Oct 22 03:23:14.243714 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2135/4326] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:23:14 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:14.254534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:14.256951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:14.274998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:14.275571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:14.276172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:14.277210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:14.279594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:14.280193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:14.545399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:14.554478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2a9c2675-ffc2-4642-871e-8e28da461ae5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1272 microversion: 2.1 time: 0.306719 Oct 22 03:23:14.584301 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2136/4327] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:14 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:14.590174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:14.591441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:14.603542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:14.604289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:14.604983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:14.605841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:14.606425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:14.607001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:14.629117 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] HTTP exception thrown: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Request method failure captured: Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 HTTP/1.1 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2BobvmuWJSK6P6gFZd_qaNO77AKj2eJ9Ax8GA4t9BIS8oBQlztX4IIjciCxyb08OFhIS0Zttu6MEbT_QI1BSM7IuHjjus8qJjCVOEYpJy-5angw7r_5GD-d_9fBG7rPJcZoeQwd-VBO2HFqcSbILFeeSJ7sCtQa8kwJQS38BEaYnSw Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.42 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 42016e2241264da88579fb9b9192087c Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42016e2241264da88579fb9b9192087c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42016e2241264da88579fb9b9192087c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42016e2241264da88579fb9b9192087c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42016e2241264da88579fb9b9192087c"}]}] Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 42016e2241264da88579fb9b9192087c Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TaggedBootDevicesTest_v242-773605929-project Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0f85a274b68543fbbbc0a97d7cb6b8a6 Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TaggedBootDevicesTest_v242-773605929-project Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '22d66b53-cee2-442c-b4ee-6fea13305813'} Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:14.633581 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.637372 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.638799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Returning 404 to user: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:14.644921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-07aceb56-9444-4085-86a6-f42a267e4b1c tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 404 len: 111 microversion: 2.42 time: 0.058896 Oct 22 03:23:14.646207 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2137/4328] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:23:14 2022] DELETE /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:23:14.651779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4e56fe7d-08d6-478c-ba7e-1da874cda0e1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:14.680845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:14.702870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-acbeb912-69ab-4b22-820c-a3f5d20df788 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1317 microversion: 2.1 time: 1.342728 Oct 22 03:23:14.713282 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2192/4329] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:13 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1317 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:14.728040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:14.729474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] [instance: 22d66b53-cee2-442c-b4ee-6fea13305813] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:14.747716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:14.748781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:14.749638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:14.750949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:14.752748 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4e56fe7d-08d6-478c-ba7e-1da874cda0e1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/4d148db2-763d-4139-a029-3cc1ec1ae4c6" status: 204 len: 0 microversion: 2.1 time: 0.105159 Oct 22 03:23:14.753411 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2138/4330] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:14 2022] DELETE /compute/v2.1/os-server-groups/4d148db2-763d-4139-a029-3cc1ec1ae4c6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:23:14.757170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:14.757935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:14.763214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dc9e9a12-abd1-47c2-aef4-6508df332fd8 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:14.776640 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] HTTP exception thrown: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.780385 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dc9e9a12-abd1-47c2-aef4-6508df332fd8 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.021487 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Request method failure captured: Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 HTTP/1.1 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2BobvmuWJSK6P6gFZd_qaNO77AKj2eJ9Ax8GA4t9BIS8oBQlztX4IIjciCxyb08OFhIS0Zttu6MEbT_QI1BSM7IuHjjus8qJjCVOEYpJy-5angw7r_5GD-d_9fBG7rPJcZoeQwd-VBO2HFqcSbILFeeSJ7sCtQa8kwJQS38BEaYnSw Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.42 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 42016e2241264da88579fb9b9192087c Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_42016e2241264da88579fb9b9192087c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42016e2241264da88579fb9b9192087c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/42016e2241264da88579fb9b9192087c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/42016e2241264da88579fb9b9192087c"}]}] Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 42016e2241264da88579fb9b9192087c Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-773605929 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TaggedBootDevicesTest_v242-773605929-project Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0f85a274b68543fbbbc0a97d7cb6b8a6 Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TaggedBootDevicesTest_v242-773605929-project Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '22d66b53-cee2-442c-b4ee-6fea13305813'} Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.781936 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:14.785215 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.785215 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:14.785215 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:14.785215 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:14.785215 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:14.785215 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:14.785215 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. Oct 22 03:23:14.785215 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:14.789668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] Returning 404 to user: Instance 22d66b53-cee2-442c-b4ee-6fea13305813 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:14.790555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-04e9b35c-33df-41a7-844b-c85526663ecd tempest-TaggedBootDevicesTest_v242-773605929 tempest-TaggedBootDevicesTest_v242-773605929-project] 10.222.0.25 "GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813" status: 404 len: 111 microversion: 2.42 time: 0.066654 Oct 22 03:23:14.791283 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2193/4332] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:14 2022] GET /compute/v2.1/servers/22d66b53-cee2-442c-b4ee-6fea13305813 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:23:14.791406 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2139/4332] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:23:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:14.796503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d76e7f9-6d17-49f3-81af-887c78c44d34 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Action: 'create', calling method: .version_select at 0x7f0d1a3b0160>, body: {"server_group": {"name": "tempest-server-group-616826252", "policies": ["affinity"]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:14.804613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:14.827374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5d76e7f9-6d17-49f3-81af-887c78c44d34 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:14.834258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5d76e7f9-6d17-49f3-81af-887c78c44d34 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:14.888528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6fad7d5b-e799-4bc4-90fe-184784f318f6 req-29862ddf-eab9-45f4-95b6-fd3018c1f764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451170a5-0891-4542-a8e8-119f7fbc6c6d", "name": "network-vif-plugged", "status": "completed", "tag": "2b10c880-6807-4afc-860e-4b8209440b56"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:14.920499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6fad7d5b-e799-4bc4-90fe-184784f318f6 req-29862ddf-eab9-45f4-95b6-fd3018c1f764 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:14.921135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6fad7d5b-e799-4bc4-90fe-184784f318f6 req-29862ddf-eab9-45f4-95b6-fd3018c1f764 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:14.921678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6fad7d5b-e799-4bc4-90fe-184784f318f6 req-29862ddf-eab9-45f4-95b6-fd3018c1f764 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:14.932433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5d76e7f9-6d17-49f3-81af-887c78c44d34 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:14.944059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5d76e7f9-6d17-49f3-81af-887c78c44d34 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:14.977105 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5d76e7f9-6d17-49f3-81af-887c78c44d34 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.184743 Oct 22 03:23:14.980456 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2194/4333] 10.222.0.25 () {60 vars in 1173 bytes} [Sat Oct 22 03:23:14 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:14.993334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f29724bb-4f3a-4c8d-9706-581b0a819454 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:15.000199 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6fad7d5b-e799-4bc4-90fe-184784f318f6 req-29862ddf-eab9-45f4-95b6-fd3018c1f764 service nova] Creating event network-vif-plugged:2b10c880-6807-4afc-860e-4b8209440b56 for instance 451170a5-0891-4542-a8e8-119f7fbc6c6d on n-h1-862416-2 Oct 22 03:23:15.018328 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6fad7d5b-e799-4bc4-90fe-184784f318f6 req-29862ddf-eab9-45f4-95b6-fd3018c1f764 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136187 Oct 22 03:23:15.019688 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2140/4334] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:15.049610 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f29724bb-4f3a-4c8d-9706-581b0a819454 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/745c80b5-f055-4db1-b414-1a6baaad3c2f" status: 204 len: 0 microversion: 2.1 time: 0.064693 Oct 22 03:23:15.050184 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2195/4335] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:14 2022] DELETE /compute/v2.1/os-server-groups/745c80b5-f055-4db1-b414-1a6baaad3c2f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:23:15.079287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c4d6dd98-35ef-43bf-aaca-49baeb814c89 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:15.100340 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c4d6dd98-35ef-43bf-aaca-49baeb814c89 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035509 Oct 22 03:23:15.115685 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2141/4336] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:23:15 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:15.128128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-291160a2-2bdc-4177-88d3-3c824b67abc3 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Action: 'create', calling method: .version_select at 0x7f0d1a369430>, body: {"server_group": {"name": "tempest-server-group-1016673261", "policies": ["anti-affinity"]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:15.187795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-291160a2-2bdc-4177-88d3-3c824b67abc3 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:15.195901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-291160a2-2bdc-4177-88d3-3c824b67abc3 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:15.230746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:15.235280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:15.259697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:15.260906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:15.261952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:15.264709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:15.283301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:15.284348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:15.393501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-291160a2-2bdc-4177-88d3-3c824b67abc3 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:15.421777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-291160a2-2bdc-4177-88d3-3c824b67abc3 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_groups'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:15.481026 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-291160a2-2bdc-4177-88d3-3c824b67abc3 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.356790 Oct 22 03:23:15.495254 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2196/4337] 10.222.0.25 () {60 vars in 1173 bytes} [Sat Oct 22 03:23:15 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:15.508183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e309575e-3728-49fe-97eb-f3f0c68306a7 req-e602ddcf-3ff6-418e-80e6-8060e707af37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbfd3a3-2c95-4826-8aec-85abbd265bd9", "tag": "c0b5c901-969c-4d38-a39e-297db0f29a5d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:15.540186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e309575e-3728-49fe-97eb-f3f0c68306a7 req-e602ddcf-3ff6-418e-80e6-8060e707af37 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:15.542988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e309575e-3728-49fe-97eb-f3f0c68306a7 req-e602ddcf-3ff6-418e-80e6-8060e707af37 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:15.543522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e309575e-3728-49fe-97eb-f3f0c68306a7 req-e602ddcf-3ff6-418e-80e6-8060e707af37 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:15.604576 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e309575e-3728-49fe-97eb-f3f0c68306a7 req-e602ddcf-3ff6-418e-80e6-8060e707af37 service nova] Creating event network-changed:c0b5c901-969c-4d38-a39e-297db0f29a5d for instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 on n-h1-862416-2 Oct 22 03:23:15.630638 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e309575e-3728-49fe-97eb-f3f0c68306a7 req-e602ddcf-3ff6-418e-80e6-8060e707af37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130153 Oct 22 03:23:15.640251 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2197/4338] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:15.647218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81220875-1317-4697-8e30-e76a2f3bff9e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:15.730058 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81220875-1317-4697-8e30-e76a2f3bff9e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/67a69f27-8463-4621-b1ec-75c15f60e3b3" status: 204 len: 0 microversion: 2.1 time: 0.088218 Oct 22 03:23:15.733370 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2198/4339] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:15 2022] DELETE /compute/v2.1/os-server-groups/67a69f27-8463-4621-b1ec-75c15f60e3b3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:23:15.744399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:15.745576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:15.772645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:15.773421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:15.774021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:15.774899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:15.775511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:15.780420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:15.838110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:15.971292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:15.982250 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15f8e756-0896-4a08-9232-6b6c69dc307f tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 0.763496 Oct 22 03:23:16.004237 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2142/4340] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:15 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:16.006603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:16.014825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:16.032296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:16.033656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:16.040752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:16.042740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:16.043358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:16.045880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:16.721792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:16.731850 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-69b16af1-4eac-41bc-9601-016d5ab27e05 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1317 microversion: 2.1 time: 0.738367 Oct 22 03:23:16.736900 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2143/4341] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:15 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:16.750613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7cbf425c-db24-4974-9646-90f058ffa8ee tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:16.797759 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7cbf425c-db24-4974-9646-90f058ffa8ee tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.058744 Oct 22 03:23:16.803997 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2144/4342] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:23:16 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:16.887670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1066864599", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "28f96f20-de32-4258-b0f3-6e85ff57443f"}]}, "os:scheduler_hints": {"group": "114a9260-3a48-4026-bfd9-5f45a7290e91"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:16.999870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] validate_networks() for [('28f96f20-de32-4258-b0f3-6e85ff57443f', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:23:17.970384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:23:17.971508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:23:17.972259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:23:17.974539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:23:17.975274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:23:18.001637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=55 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:18.008036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:18.008948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:18.009575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:18.010644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:18.011756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:18.012723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:18.048364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:18.059332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:18.078769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:23:18.082371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:23:18.132162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:18.160479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:18.167396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:18.199225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:18.211121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:18.214104 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ede2731f-13d1-42be-b83e-40e0305c6e88 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 2.479459 Oct 22 03:23:18.214958 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2199/4343] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:15 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:18.221727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:18.222767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:18.234835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Getting quotas for user ef5148f47860480084de17ba4e335f14 and project 5b462df9f4734b6a9c1b7c588a8592f7. Resources: {'server_group_members'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:18.237368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:18.238035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:18.238621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:18.239884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:18.240570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:18.241181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:18.277026 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b57b2a8-8e95-4689-a1e4-f296cdc026df tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393180 Oct 22 03:23:18.278242 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2145/4344] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:23:18.299793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7301de19-c703-427f-9103-cf35c4c2fdb8 req-b36ebe34-12e3-4c34-8417-5e29cd74d5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03dd7ae-c54a-440e-b9de-0eb4b8b31359", "tag": "3f338ab8-c350-45e6-a43e-6e3d948e35ef"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:18.347317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7301de19-c703-427f-9103-cf35c4c2fdb8 req-b36ebe34-12e3-4c34-8417-5e29cd74d5ba service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:18.347947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7301de19-c703-427f-9103-cf35c4c2fdb8 req-b36ebe34-12e3-4c34-8417-5e29cd74d5ba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:18.348427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7301de19-c703-427f-9103-cf35c4c2fdb8 req-b36ebe34-12e3-4c34-8417-5e29cd74d5ba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:18.369809 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7301de19-c703-427f-9103-cf35c4c2fdb8 req-b36ebe34-12e3-4c34-8417-5e29cd74d5ba service nova] Creating event network-changed:3f338ab8-c350-45e6-a43e-6e3d948e35ef for instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 on n-h1-862416-2 Oct 22 03:23:18.375967 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7301de19-c703-427f-9103-cf35c4c2fdb8 req-b36ebe34-12e3-4c34-8417-5e29cd74d5ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096066 Oct 22 03:23:18.377663 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2146/4345] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:18.386040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:18.386815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:18.396591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:18.397547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:18.398085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:18.399008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:18.399565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:18.400004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:18.602758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:18.614972 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a8bc31a-0dec-4524-99ac-67162c9fea5c tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1317 microversion: 2.1 time: 0.235120 Oct 22 03:23:18.620416 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2147/4346] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:18 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:18.620786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6183d475-5e72-42ad-bd6f-0329cf05314e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:18.621465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6183d475-5e72-42ad-bd6f-0329cf05314e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:18.689731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6183d475-5e72-42ad-bd6f-0329cf05314e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:18.704817 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6183d475-5e72-42ad-bd6f-0329cf05314e tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1213 microversion: 2.1 time: 0.087511 Oct 22 03:23:18.705419 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2148/4347] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:18 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:19.243954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:19.244669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:19.256695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:19.257228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:19.257689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:19.258438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:19.258962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:19.259347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:19.362362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:19.371423 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-facd958e-c665-4732-a46e-d6188e69cd01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 1.154927 Oct 22 03:23:19.379000 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2200/4348] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:18 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:19.574825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:19.578864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:19.586644 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19a0942d-b0ef-43d0-8587-cb8517572491 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.351094 Oct 22 03:23:19.587697 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2149/4349] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:19 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:19.639063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:19.639752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:19.646681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:19.647253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:19.647763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:19.648573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:19.649212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:19.649833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:19.729120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:19.729725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:19.741102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:19.741601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:19.742043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:19.742752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:19.743209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:19.743631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:19.834094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:19.844744 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1fd85900-6a71-4fa8-ad11-5900f146c840 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1265 microversion: 2.1 time: 0.119255 Oct 22 03:23:19.846488 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2150/4350] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:19 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:20.275527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-afa6eccf-612a-4673-9bca-a0638eac19e4 req-f1ed276f-f077-4d7d-84f2-909e36290a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34099294-0ec2-494a-a13d-7d2e2ae9effd", "name": "network-vif-plugged", "status": "completed", "tag": "472b9d3d-b211-49c2-92e5-0f393163b9f8"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:20.305742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afa6eccf-612a-4673-9bca-a0638eac19e4 req-f1ed276f-f077-4d7d-84f2-909e36290a02 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:20.306939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afa6eccf-612a-4673-9bca-a0638eac19e4 req-f1ed276f-f077-4d7d-84f2-909e36290a02 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:20.310645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afa6eccf-612a-4673-9bca-a0638eac19e4 req-f1ed276f-f077-4d7d-84f2-909e36290a02 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:20.352610 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-afa6eccf-612a-4673-9bca-a0638eac19e4 req-f1ed276f-f077-4d7d-84f2-909e36290a02 service nova] Creating event network-vif-plugged:472b9d3d-b211-49c2-92e5-0f393163b9f8 for instance 34099294-0ec2-494a-a13d-7d2e2ae9effd on n-h2-862416-2 Oct 22 03:23:20.359938 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-afa6eccf-612a-4673-9bca-a0638eac19e4 req-f1ed276f-f077-4d7d-84f2-909e36290a02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096599 Oct 22 03:23:20.361086 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2151/4351] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:20.414106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:20.431517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:20.453423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:20.454875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:20.455646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:20.456534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:20.459102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:20.459703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:20.643904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:20.659455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c7e69d54-ff82-4a9d-969f-9a609912b44b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1317 microversion: 2.1 time: 1.023263 Oct 22 03:23:20.661903 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2201/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:19 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1317 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:20.673973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-fbaa5013-1089-4ca4-b56b-56f2a7e817a5 req-9a0a40ac-ec8e-423c-ae66-304b11edb434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5504fb6-a051-4033-bd18-3fbfd2857ab3", "tag": "7a351819-bbcd-4346-a745-38dbb9d18497"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:20.698736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fbaa5013-1089-4ca4-b56b-56f2a7e817a5 req-9a0a40ac-ec8e-423c-ae66-304b11edb434 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:20.699408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fbaa5013-1089-4ca4-b56b-56f2a7e817a5 req-9a0a40ac-ec8e-423c-ae66-304b11edb434 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:20.707660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fbaa5013-1089-4ca4-b56b-56f2a7e817a5 req-9a0a40ac-ec8e-423c-ae66-304b11edb434 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:20.741328 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-fbaa5013-1089-4ca4-b56b-56f2a7e817a5 req-9a0a40ac-ec8e-423c-ae66-304b11edb434 service nova] Creating event network-changed:7a351819-bbcd-4346-a745-38dbb9d18497 for instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 on n-h2-862416-2 Oct 22 03:23:20.748162 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-fbaa5013-1089-4ca4-b56b-56f2a7e817a5 req-9a0a40ac-ec8e-423c-ae66-304b11edb434 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083523 Oct 22 03:23:20.749397 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2202/4353] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:20.756666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:20.757422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:20.764598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:20.765455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:20.766274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:20.767137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:20.767778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:20.768435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:20.992888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:21.019372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9f2b96e-4459-4a77-9a6a-4a426e747047 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 0.611377 Oct 22 03:23:21.020124 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2152/4354] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:20 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:21.034285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:21.037279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:21.059551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:21.060067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:21.060551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:21.061287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:21.061747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:21.062180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:21.269035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:21.283727 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-11748f75-490c-4aad-bf7f-9426b8d1d36a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1271 microversion: 2.1 time: 0.258992 Oct 22 03:23:21.299868 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2153/4355] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:21 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:21.542561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:21.550878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f4678d8-6774-4981-97d4-693bfbb0f7a3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.799944 Oct 22 03:23:21.555134 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2203/4356] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:20 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:21.688014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:21.688746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:21.696852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:21.715626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:21.717942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:21.719686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:21.720692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:21.721327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:21.903407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:21.924343 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7840e43a-3f74-470d-a495-8127f1488bc3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1317 microversion: 2.1 time: 0.240148 Oct 22 03:23:21.926510 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2154/4357] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:21 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:22.044140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:22.044950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:22.051676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.053224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.053955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:22.054909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.055637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.056318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:22.312057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:22.313777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:22.321888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.322723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.323666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:22.324709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.325394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.326057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:22.524283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:22.535888 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-91cca081-4199-4c58-a4fc-f1c1ae8e1c2f tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.229657 Oct 22 03:23:22.537252 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2155/4358] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:22 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:22.583744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:22.584588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:22.592799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.593981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.594723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:22.595438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.596198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.596705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:22.663593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:22.678329 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c1d00342-75c9-44be-a603-3c84e9ad97e2 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 0.638233 Oct 22 03:23:22.679797 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2204/4359] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:22 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:22.817085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-17312f2d-7a2f-414b-a0a6-3ef2ded14d15 req-54a38a8c-6196-44b2-9d5b-d233ba93c0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbfd3a3-2c95-4826-8aec-85abbd265bd9", "name": "network-vif-plugged", "status": "completed", "tag": "c0b5c901-969c-4d38-a39e-297db0f29a5d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:22.849894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-17312f2d-7a2f-414b-a0a6-3ef2ded14d15 req-54a38a8c-6196-44b2-9d5b-d233ba93c0b2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.852858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-17312f2d-7a2f-414b-a0a6-3ef2ded14d15 req-54a38a8c-6196-44b2-9d5b-d233ba93c0b2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.853312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-17312f2d-7a2f-414b-a0a6-3ef2ded14d15 req-54a38a8c-6196-44b2-9d5b-d233ba93c0b2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:22.880959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-17312f2d-7a2f-414b-a0a6-3ef2ded14d15 req-54a38a8c-6196-44b2-9d5b-d233ba93c0b2 service nova] Creating event network-vif-plugged:c0b5c901-969c-4d38-a39e-297db0f29a5d for instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 on n-h1-862416-2 Oct 22 03:23:22.884062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:22.892671 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-17312f2d-7a2f-414b-a0a6-3ef2ded14d15 req-54a38a8c-6196-44b2-9d5b-d233ba93c0b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082690 Oct 22 03:23:22.893802 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2205/4360] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:23:22.896352 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8f0e842-0d1a-46b2-bebe-c0d0ea0a2ecb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.318540 Oct 22 03:23:22.898125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2156/4361] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:22 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:22.952640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:22.953663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:22.967978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.969056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.969675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:22.970391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:22.970848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:22.971277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:23.130109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b5bb09bb-307c-47f5-851d-28bf7e2f0176 req-4ebbb18a-50d1-4214-aebf-ac30fcdd68b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea1e556-a429-4dd4-9289-49eb3c33e828", "tag": "89827cb1-c8eb-4fdc-b1a9-dbc40ef291fb"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:23.142363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b5bb09bb-307c-47f5-851d-28bf7e2f0176 req-4ebbb18a-50d1-4214-aebf-ac30fcdd68b9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:23.142363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b5bb09bb-307c-47f5-851d-28bf7e2f0176 req-4ebbb18a-50d1-4214-aebf-ac30fcdd68b9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:23.142363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b5bb09bb-307c-47f5-851d-28bf7e2f0176 req-4ebbb18a-50d1-4214-aebf-ac30fcdd68b9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:23.154683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b5bb09bb-307c-47f5-851d-28bf7e2f0176 req-4ebbb18a-50d1-4214-aebf-ac30fcdd68b9 service nova] Creating event network-changed:89827cb1-c8eb-4fdc-b1a9-dbc40ef291fb for instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 on n-h2-862416-2 Oct 22 03:23:23.160804 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b5bb09bb-307c-47f5-851d-28bf7e2f0176 req-4ebbb18a-50d1-4214-aebf-ac30fcdd68b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035095 Oct 22 03:23:23.162181 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2157/4362] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:23:23.306979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:23.315360 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11232ea6-2ac0-4f01-8084-245a7be5cc9f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1317 microversion: 2.1 time: 0.370745 Oct 22 03:23:23.315944 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2206/4363] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:22 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:23.573171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:23.573716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:23.592015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:23.592544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:23.592987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:23.602403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:23.603104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:23.603592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:23.704674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:23.705294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:23.716257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:23.717890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:23.718363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:23.719105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:23.728510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:23.730662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:24.420453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:24.437020 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d94330d2-12d2-4d4b-8d06-8faec4366651 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.881429 Oct 22 03:23:24.443823 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2158/4364] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:23 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:24.477851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:24.478473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:24.507106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:24.507614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:24.508062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:24.508814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:24.509273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:24.509712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:24.692765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:24.706080 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a3a9ca5-7c36-463b-9ec8-76bc2cc593ae tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 1.005258 Oct 22 03:23:24.719769 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2207/4365] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:23 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:24.720307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:24.727102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:24.745993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:24.746513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:24.746970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:24.747702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:24.752581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:24.753701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:25.155677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:25.168496 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ccb9ac2a-c4be-4226-bd2b-0ccbbaddc6db tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 200 len: 1504 microversion: 2.1 time: 0.459071 Oct 22 03:23:25.181074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2208/4366] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:24 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:25.201805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:25.204241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:25.224841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:25.225987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:25.228526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:25.231218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:25.234566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:25.235508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:25.446294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=56 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:25.966638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:25.975641 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27f1f256-d1b7-42d4-a307-b6c69c8d528e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 1.508748 Oct 22 03:23:25.977909 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2159/4367] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:24 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:25.990764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:25.991914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:26.004226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:26.008344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:26.009069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:26.010041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:26.010704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:26.011472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:26.579315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:26.588198 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5ffad701-ae23-4be7-bbfe-4dcef750b9a6 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.606554 Oct 22 03:23:26.594177 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2160/4368] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:25 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:26.604007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:26.607243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:26.608436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:26.615638 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3fd60d9f-9fc0-4df1-99c3-230508b7b6c4 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 200 len: 1317 microversion: 2.1 time: 1.425021 Oct 22 03:23:26.633174 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2209/4369] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:25 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 1317 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:26.641231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:26.644697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:26.645460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:26.650262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:26.650899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:26.651466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:26.653294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-768f8f70-ceaa-4855-9263-bb5cacb6f4ec req-f3e3813b-bc89-402e-a886-e5b851ecc45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5504fb6-a051-4033-bd18-3fbfd2857ab3", "name": "network-vif-plugged", "status": "completed", "tag": "7a351819-bbcd-4346-a745-38dbb9d18497"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:26.680313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-768f8f70-ceaa-4855-9263-bb5cacb6f4ec req-f3e3813b-bc89-402e-a886-e5b851ecc45c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:26.681027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-768f8f70-ceaa-4855-9263-bb5cacb6f4ec req-f3e3813b-bc89-402e-a886-e5b851ecc45c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:26.681634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-768f8f70-ceaa-4855-9263-bb5cacb6f4ec req-f3e3813b-bc89-402e-a886-e5b851ecc45c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:26.703477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-768f8f70-ceaa-4855-9263-bb5cacb6f4ec req-f3e3813b-bc89-402e-a886-e5b851ecc45c service nova] Creating event network-vif-plugged:7a351819-bbcd-4346-a745-38dbb9d18497 for instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 on n-h2-862416-2 Oct 22 03:23:26.712510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-768f8f70-ceaa-4855-9263-bb5cacb6f4ec req-f3e3813b-bc89-402e-a886-e5b851ecc45c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072273 Oct 22 03:23:26.713717 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2210/4370] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:27.015136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:27.015856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:27.025161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:27.025673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:27.026119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:27.026835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:27.027369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:27.027800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:27.391002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:27.410602 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-81d6328b-3885-42da-9f25-033c4a10917a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 0.809144 Oct 22 03:23:27.413232 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2161/4371] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:26 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:27.449065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:27.471064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13c00b5e-0935-403d-87bc-1c7c05617066 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.471610 Oct 22 03:23:27.474374 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2211/4372] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:26 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:27.618883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:27.619886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:27.626439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:27.627211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:27.627889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:27.633603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:27.634433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:27.635091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:27.647277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:27.648029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:27.657801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:27.677240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:27.681868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:27.685247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:27.685982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:27.689397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:27.987988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:28.001373 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-46ba641e-8bf8-4b6a-9824-5e854a67654b tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 200 len: 1317 microversion: 2.1 time: 0.357412 Oct 22 03:23:28.003301 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2212/4373] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:27 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:28.010977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a4d343b8-e976-4312-9fb5-720b83a1d85f req-b7ab56c5-82e1-4124-a534-e9b8261c8482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd9a2200-b7dd-4191-a5aa-43448b87663f", "tag": "90489716-e587-45b4-bcd9-1e021325ec0e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:28.027974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:28.030393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:28.045407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a4d343b8-e976-4312-9fb5-720b83a1d85f req-b7ab56c5-82e1-4124-a534-e9b8261c8482 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:28.046274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a4d343b8-e976-4312-9fb5-720b83a1d85f req-b7ab56c5-82e1-4124-a534-e9b8261c8482 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:28.047036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a4d343b8-e976-4312-9fb5-720b83a1d85f req-b7ab56c5-82e1-4124-a534-e9b8261c8482 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:28.073337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a4d343b8-e976-4312-9fb5-720b83a1d85f req-b7ab56c5-82e1-4124-a534-e9b8261c8482 service nova] Creating event network-changed:90489716-e587-45b4-bcd9-1e021325ec0e for instance cd9a2200-b7dd-4191-a5aa-43448b87663f on n-h2-862416-2 Oct 22 03:23:28.089667 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a4d343b8-e976-4312-9fb5-720b83a1d85f req-b7ab56c5-82e1-4124-a534-e9b8261c8482 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083483 Oct 22 03:23:28.090426 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2213/4374] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:28.148832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:28.165519 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c45efa04-737e-4ad8-ae76-b47cad9691b0 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.551901 Oct 22 03:23:28.167613 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2162/4375] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:27 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:28.443459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:28.451433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:28.460072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:28.461059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:28.461531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:28.462244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:28.462702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:28.463136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:28.499104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:28.499726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:28.507060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:28.507560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:28.512042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:28.517323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:28.518172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:28.518771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:28.694269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=15 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:28.745178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:28.766859 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fba23623-9978-49c9-948c-d7491fa84980 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 0.330585 Oct 22 03:23:28.779293 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2214/4376] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:28 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:28.804083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7f88f0bf-06a7-468d-8867-e79129dc07a7 req-47d1e482-7746-401b-a786-c4dddb43130f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03dd7ae-c54a-440e-b9de-0eb4b8b31359", "name": "network-vif-plugged", "status": "completed", "tag": "3f338ab8-c350-45e6-a43e-6e3d948e35ef"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:28.817811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7f88f0bf-06a7-468d-8867-e79129dc07a7 req-47d1e482-7746-401b-a786-c4dddb43130f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:28.818460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7f88f0bf-06a7-468d-8867-e79129dc07a7 req-47d1e482-7746-401b-a786-c4dddb43130f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:28.818895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7f88f0bf-06a7-468d-8867-e79129dc07a7 req-47d1e482-7746-401b-a786-c4dddb43130f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:28.846870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7f88f0bf-06a7-468d-8867-e79129dc07a7 req-47d1e482-7746-401b-a786-c4dddb43130f service nova] Creating event network-vif-plugged:3f338ab8-c350-45e6-a43e-6e3d948e35ef for instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 on n-h1-862416-2 Oct 22 03:23:28.853937 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7f88f0bf-06a7-468d-8867-e79129dc07a7 req-47d1e482-7746-401b-a786-c4dddb43130f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054345 Oct 22 03:23:28.860063 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2215/4377] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:23:28.900113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:28.908167 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c4cd0daf-870c-4430-bed0-844fbd6b499f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.413060 Oct 22 03:23:28.908993 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2163/4378] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:28 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:29.030778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:29.031873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:29.048650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:29.049551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:29.051083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:29.053277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:29.054142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:29.055110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:29.190501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:29.191286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:29.202965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:29.203665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:29.204505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:29.206023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:29.206674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:29.207474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:29.293402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:29.310281 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30a6068c-37ab-4d3c-af6d-57cd704ccf4d tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 200 len: 1317 microversion: 2.1 time: 0.285114 Oct 22 03:23:29.312639 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2216/4379] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:29 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:29.676324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:29.687974 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1b19829-53da-4ede-b265-04cfb5591d81 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.502767 Oct 22 03:23:29.689800 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2164/4380] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:29 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:29.793514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:29.794332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:29.815404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:29.818495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:29.818977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:29.819715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:29.821183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:29.823478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:29.935130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:29.936000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:29.943652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:29.944418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:29.945006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:29.945888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:29.946539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:29.947374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:30.341632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:30.349661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:30.364186 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ae5bd9d-e46f-4acf-b26e-541ed74a6e4e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1320 microversion: 2.1 time: 0.572164 Oct 22 03:23:30.368642 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1bc1b680-0741-4e84-b99f-1ae4a9a38b7d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.438680 Oct 22 03:23:30.373153 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2165/4381] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:29 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:30.376838 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2217/4382] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:29 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1320 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:30.387998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:30.391530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:30.415405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:30.415908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:30.419243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:30.421709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:30.424404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:30.425056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:30.685514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-255eb64f-dc86-4034-b5ac-7718ddd3b193 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1e4ac430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1210998469", "description": "tempest-description-216184347"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:30.760472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:30.773335 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-796610d3-d447-4a7f-9054-6872e67955c5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 200 len: 1317 microversion: 2.1 time: 0.397259 Oct 22 03:23:30.785934 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2166/4383] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:30 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:30.878484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9af9febe-2fd5-46af-9b43-b428ec4be041 tempest-ComputeTenantNetworksTest-693275623 tempest-ComputeTenantNetworksTest-693275623-project] Calling method '.version_select at 0x7f0d19636c10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:30.936089 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-255eb64f-dc86-4034-b5ac-7718ddd3b193 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.502889 Oct 22 03:23:30.937238 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2218/4384] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:23:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:23:30.942704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:30.944159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:30.956425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:30.956916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:30.957347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:30.959300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:30.959743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:30.961030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:31.166407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:31.197256 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-85ca7878-f09c-46c1-9150-a29eeb864957 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.257692 Oct 22 03:23:31.214521 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2219/4385] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:30 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:31.223056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-697af341-276a-4dee-8898-2681605fa769 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1e50f3a0>, body: {"security_group_rule": {"parent_group_id": "16236c5d-ca73-4a61-af82-8fc0e53d3e00", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:31.253667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9af9febe-2fd5-46af-9b43-b428ec4be041 tempest-ComputeTenantNetworksTest-693275623 tempest-ComputeTenantNetworksTest-693275623-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.478621 Oct 22 03:23:31.255124 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2167/4386] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:23:30 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:31.266803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0152c2df-302c-4fe0-873b-7697b6cef575 tempest-ComputeTenantNetworksTest-693275623 tempest-ComputeTenantNetworksTest-693275623-project] Calling method '.version_select at 0x7f0d1e4c65e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:31.436565 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0152c2df-302c-4fe0-873b-7697b6cef575 tempest-ComputeTenantNetworksTest-693275623 tempest-ComputeTenantNetworksTest-693275623-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/6f77faff-d87e-4eea-92c1-d7d2f75fc856" status: 200 len: 140 microversion: 2.1 time: 0.173745 Oct 22 03:23:31.437161 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2168/4387] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:23:31 2022] GET /compute/v2.1/os-tenant-networks/6f77faff-d87e-4eea-92c1-d7d2f75fc856 => generated 140 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:31.443831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:31.443831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:31.459043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:31.459916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:31.460687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:31.462177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:31.462874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:31.463500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:31.650054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-697af341-276a-4dee-8898-2681605fa769 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.433017 Oct 22 03:23:31.651027 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2220/4388] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:23:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:31.660370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:31.662256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:31.670235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:31.670980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:31.671647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:31.672982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:31.674773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:31.676908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:31.686757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:31.824788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:31.828234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:31.833442 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5e5c0b6-a4c8-420f-a8f0-95fe9c817e47 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1511 microversion: 2.1 time: 0.395202 Oct 22 03:23:31.834315 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2169/4389] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:31 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:31.839230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fba64e5a-cdfd-4de3-b03c-1c7ad8d019ba tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d19b1daf0>, body: {"security_group_rule": {"parent_group_id": "16236c5d-ca73-4a61-af82-8fc0e53d3e00", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:31.923454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:31.934200 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c306b90f-c539-4799-bd22-8e9632f06695 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.281110 Oct 22 03:23:31.946649 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2221/4390] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:31 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:31.958828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:31.959845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:31.968907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:31.970632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:31.971469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:31.972426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:31.973023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:31.973646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:32.132563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:32.141342 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5c2effdf-5e29-489c-ba5f-d96da41edc70 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 200 len: 1504 microversion: 2.1 time: 0.192692 Oct 22 03:23:32.141940 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2222/4391] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:31 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:32.148034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:32.149071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:32.156089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:32.157160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:32.157779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:32.158832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:32.160081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:32.160723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:32.271053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-fba64e5a-cdfd-4de3-b03c-1c7ad8d019ba tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] HTTP exception thrown: This rule already exists in group 16236c5d-ca73-4a61-af82-8fc0e53d3e00 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fba64e5a-cdfd-4de3-b03c-1c7ad8d019ba tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Request method failure captured: Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 138 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IyAm32hV4qC6ujBVu0r7ubXMrnspH50-MaFKgT1K8mqk72hkmiODoqL_hsZPlyTTaaoCcZPcEe60cc3EQ8qEqyEA1DPHzwnUXJWBzHltaJ0IO1a4Lf3rTlrn-M3wvdh1Kv-R64xTaTs9GEVlhZS15HAz4L5zExLZ1tDvsuRhkuO2s Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7029876926a04aa58309f88ef250f94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7029876926a04aa58309f88ef250f94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}] Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3e42ea1e4a6d435c8620727579696ce7 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: {"security_group_rule": {"parent_group_id": "16236c5d-ca73-4a61-af82-8fc0e53d3e00", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: exception: This rule already exists in group 16236c5d-ca73-4a61-af82-8fc0e53d3e00 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'security_group_rule': {'parent_group_id': '16236c5d-ca73-4a61-af82-8fc0e53d3e00', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 16236c5d-ca73-4a61-af82-8fc0e53d3e00 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 16236c5d-ca73-4a61-af82-8fc0e53d3e00 Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:32.273066 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:32.276307 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:32.276307 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:32.276307 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 16236c5d-ca73-4a61-af82-8fc0e53d3e00 Oct 22 03:23:32.276307 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:32.276307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fba64e5a-cdfd-4de3-b03c-1c7ad8d019ba tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Returning 400 to user: This rule already exists in group 16236c5d-ca73-4a61-af82-8fc0e53d3e00 {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:32.276307 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fba64e5a-cdfd-4de3-b03c-1c7ad8d019ba tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.438949 Oct 22 03:23:32.276307 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2170/4392] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:23:31 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 440 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:23:32.279989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:32.280514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:32.289060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:32.290861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:32.292525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:32.293637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:32.294385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:32.295656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:32.335507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:23:32.339296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:32.350941 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de8cea68-ac56-43c1-a098-1709015cb503 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1511 microversion: 2.1 time: 0.207743 Oct 22 03:23:32.362180 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2223/4393] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:32 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:32.376625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:32.377880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:32.394358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:32.396450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:32.397741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:32.398705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:32.399491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:32.400150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:32.504000 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92201381-e041-46ee-ac0f-e258328aacdc tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 204 len: 0 microversion: 2.1 time: 0.227085 Oct 22 03:23:32.505162 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2171/4394] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:23:32 2022] DELETE /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:23:32.512457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d3305d5-b2bd-4228-8d54-e3ef28ea0e91 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Calling method '.version_select at 0x7f0d1e4c6a60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:32.699871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:32.710239 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b1c0d986-81cc-4ae8-a8b8-606901383a11 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.346354 Oct 22 03:23:32.711127 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2224/4395] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:32 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:32.717413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:32.719614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:32.727345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:32.728334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:32.729231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:32.730407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:32.731097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:32.731948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.075450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:33.086391 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d286a79-1502-4609-b77c-1ea23b3b8b51 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 200 len: 1512 microversion: 2.1 time: 0.373617 Oct 22 03:23:33.088613 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2225/4396] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:32 2022] GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:33.101715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:33.106471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:33.117599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:33.119120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:33.119574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.120323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:33.120818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:33.121255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.149283 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d3305d5-b2bd-4228-8d54-e3ef28ea0e91 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/18acf941-1232-4b0e-925e-80c2091e08e9" status: 202 len: 0 microversion: 2.1 time: 0.642720 Oct 22 03:23:33.149876 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2172/4397] 10.222.0.25 () {58 vars in 1287 bytes} [Sat Oct 22 03:23:32 2022] DELETE /compute/v2.1/os-security-group-rules/18acf941-1232-4b0e-925e-80c2091e08e9 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:23:33.155897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7efd952d-d8d5-4cb7-ade6-2404b82b4177 req-015e0c63-5575-482c-a862-553e09813c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea1e556-a429-4dd4-9289-49eb3c33e828", "name": "network-vif-plugged", "status": "completed", "tag": "89827cb1-c8eb-4fdc-b1a9-dbc40ef291fb"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:33.171783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:23:33.197883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7efd952d-d8d5-4cb7-ade6-2404b82b4177 req-015e0c63-5575-482c-a862-553e09813c1c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:33.198399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7efd952d-d8d5-4cb7-ade6-2404b82b4177 req-015e0c63-5575-482c-a862-553e09813c1c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:33.198846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7efd952d-d8d5-4cb7-ade6-2404b82b4177 req-015e0c63-5575-482c-a862-553e09813c1c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.231689 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7efd952d-d8d5-4cb7-ade6-2404b82b4177 req-015e0c63-5575-482c-a862-553e09813c1c service nova] Creating event network-vif-plugged:89827cb1-c8eb-4fdc-b1a9-dbc40ef291fb for instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 on n-h2-862416-2 Oct 22 03:23:33.245452 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7efd952d-d8d5-4cb7-ade6-2404b82b4177 req-015e0c63-5575-482c-a862-553e09813c1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091802 Oct 22 03:23:33.248527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2173/4398] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:33.261669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:33.262927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:33.278366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:33.279653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:33.280269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.282280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:33.284296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:33.285800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.346922 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0dfa2eaf-ad8d-418a-a652-a8f08c1f2f04 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 204 len: 0 microversion: 2.1 time: 0.254230 Oct 22 03:23:33.351820 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2226/4399] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:23:33 2022] DELETE /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:23:33.357880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:33.365883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:33.366542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:33.381471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:33.382445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:33.382445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.383528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:33.384307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:33.384774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.541144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:33.686408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:33.697175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:33.700252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:33.701218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:33.735655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:33.750851 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-91443a64-3dc0-4cc1-9d0b-262620878d70 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.498720 Oct 22 03:23:33.751722 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2174/4400] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:33 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:33.761783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d111ea90-fb34-4788-9a29-cb488f73782f tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1e55f670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-814663587", "description": "tempest-description-730174753"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:34.065734 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d111ea90-fb34-4788-9a29-cb488f73782f tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.309286 Oct 22 03:23:34.067440 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2175/4401] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:23:33 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:34.073096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:34.074692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:34.091581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.095123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.095671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:34.096650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.100942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.102184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:34.205535 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13fd882b-8de2-4f02-be8c-ab9a090f6850 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.855247 Oct 22 03:23:34.206459 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2227/4402] 10.222.0.25 () {58 vars in 1167 bytes} [Sat Oct 22 03:23:33 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:34.211991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:34.213070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:34.224237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.232733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.234124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:34.238417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.240470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.245795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:34.488578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:34.497797 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-95fc7269-7c46-49fd-bbb3-3e96275644b3 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 200 len: 1510 microversion: 2.1 time: 0.428942 Oct 22 03:23:34.498382 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2176/4403] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:34 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:34.517254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-952ad09f-332f-4eea-88cc-171e515173e1 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d196700d0>, body: {"security_group_rule": {"parent_group_id": "e897cc82-beef-47d6-a797-cba77ae56a7f", "ip_protocol": "tcp", "from_port": 937362535, "to_port": 22}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:34.562409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:34.586136 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9f1bb67-cdda-45de-bbf0-dec7438b4d6c tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.378495 Oct 22 03:23:34.588017 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2228/4404] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:34 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:34.597025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:34.614481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:34.619559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1423212621', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:34.624729 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-952ad09f-332f-4eea-88cc-171e515173e1 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] HTTP exception thrown: Invalid port range 937362535:22. Former value cannot be greater than the later Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-952ad09f-332f-4eea-88cc-171e515173e1 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Request method failure captured: Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 145 Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IyAm32hV4qC6ujBVu0r7ubXMrnspH50-MaFKgT1K8mqk72hkmiODoqL_hsZPlyTTaaoCcZPcEe60cc3EQ8qEqyEA1DPHzwnUXJWBzHltaJ0IO1a4Lf3rTlrn-M3wvdh1Kv-R64xTaTs9GEVlhZS15HAz4L5zExLZ1tDvsuRhkuO2s Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7029876926a04aa58309f88ef250f94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7029876926a04aa58309f88ef250f94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}] Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3e42ea1e4a6d435c8620727579696ce7 Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: {"security_group_rule": {"parent_group_id": "e897cc82-beef-47d6-a797-cba77ae56a7f", "ip_protocol": "tcp", "from_port": 937362535, "to_port": 22}} Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid port range 937362535:22. Former value cannot be greater than the later Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e897cc82-beef-47d6-a797-cba77ae56a7f', 'ip_protocol': 'tcp', 'from_port': 937362535, 'to_port': 22}}} Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 937362535:22. Former value cannot be greater than the later Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 937362535:22. Former value cannot be greater than the later Oct 22 03:23:34.626631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 937362535:22. Former value cannot be greater than the later Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-952ad09f-332f-4eea-88cc-171e515173e1 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Returning 400 to user: Invalid port range 937362535:22. Former value cannot be greater than the later {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-952ad09f-332f-4eea-88cc-171e515173e1 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.128797 Oct 22 03:23:34.631449 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2177/4405] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:23:34 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:23:34.634666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.634666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.636300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:34.637495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.638264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.639118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:34.641623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-835d6ffc-9e8a-4c50-aa53-6fd4918e5bd0 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d196363a0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1750415367", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:34.645935 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-835d6ffc-9e8a-4c50-aa53-6fd4918e5bd0 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] HTTP exception thrown: Security group id should be uuid Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-835d6ffc-9e8a-4c50-aa53-6fd4918e5bd0 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Request method failure captured: Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 131 Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IyAm32hV4qC6ujBVu0r7ubXMrnspH50-MaFKgT1K8mqk72hkmiODoqL_hsZPlyTTaaoCcZPcEe60cc3EQ8qEqyEA1DPHzwnUXJWBzHltaJ0IO1a4Lf3rTlrn-M3wvdh1Kv-R64xTaTs9GEVlhZS15HAz4L5zExLZ1tDvsuRhkuO2s Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7029876926a04aa58309f88ef250f94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7029876926a04aa58309f88ef250f94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}] Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3e42ea1e4a6d435c8620727579696ce7 Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1750415367", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group id should be uuid Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1750415367', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:34.648263 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:34.652276 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 22 03:23:34.652276 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:34.652276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-835d6ffc-9e8a-4c50-aa53-6fd4918e5bd0 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Returning 400 to user: Security group id should be uuid {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:34.652276 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-835d6ffc-9e8a-4c50-aa53-6fd4918e5bd0 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.013659 Oct 22 03:23:34.652813 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2178/4406] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:23:34 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 22 03:23:34.670771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:34.674251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:34.694030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.694538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.694984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:34.695705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.696165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.710414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:34.766944 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59246837-201f-44ec-949b-e374bf52d8a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/ips" status: 200 len: 152 microversion: 2.20 time: 0.108126 Oct 22 03:23:34.767528 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2179/4407] 10.222.0.25 () {60 vars in 1289 bytes} [Sat Oct 22 03:23:34 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/ips => generated 152 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:23:34.782174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f1c9d80-eec0-4060-8af2-32e632f8f4a0 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d19670e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2139778226", "description": "tempest-description-740135481"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:34.796584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:34.929885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:34.939045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:34.939765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:34.940405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:35.334164 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ebff597a-634e-434d-a001-f64fd171ed11 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1423212621" status: 200 len: 1514 microversion: 2.1 time: 0.744628 Oct 22 03:23:35.349674 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2229/4408] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:23:34 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1423212621 => generated 1514 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:35.356767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:35.357794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:35.372722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:35.373502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:35.374710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:35.376014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:35.376862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:35.377825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:35.490734 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1f1c9d80-eec0-4060-8af2-32e632f8f4a0 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.718372 Oct 22 03:23:35.491835 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2180/4409] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:23:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:35.499795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:35.510361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:35.511399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:35.521652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:35.522209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:35.522697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:35.523636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:35.524164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:35.524759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:35.686081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:35.795316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:35.803804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:35.824881 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-59da2be9-13b9-411e-b4fa-a2018a7207f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1314 microversion: 2.1 time: 0.472423 Oct 22 03:23:35.830356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:35.830602 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2230/4410] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:35 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:35.833369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:35.838288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:35.852049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4e37b49-b053-499f-9083-22b5878f4b29 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1a23d700>, body: {"security_group_rule": {"parent_group_id": "d137e08d-b712-4fa2-9a5d-e0952b8dd492", "ip_protocol": "tempest-999-462125710", "from_port": 22, "to_port": 22}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:36.175496 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f4e37b49-b053-499f-9083-22b5878f4b29 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] HTTP exception thrown: Invalid IP protocol tempest-999-462125710. Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4e37b49-b053-499f-9083-22b5878f4b29 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Request method failure captured: Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 156 Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IyAm32hV4qC6ujBVu0r7ubXMrnspH50-MaFKgT1K8mqk72hkmiODoqL_hsZPlyTTaaoCcZPcEe60cc3EQ8qEqyEA1DPHzwnUXJWBzHltaJ0IO1a4Lf3rTlrn-M3wvdh1Kv-R64xTaTs9GEVlhZS15HAz4L5zExLZ1tDvsuRhkuO2s Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7029876926a04aa58309f88ef250f94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7029876926a04aa58309f88ef250f94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}] Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3e42ea1e4a6d435c8620727579696ce7 Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: {"security_group_rule": {"parent_group_id": "d137e08d-b712-4fa2-9a5d-e0952b8dd492", "ip_protocol": "tempest-999-462125710", "from_port": 22, "to_port": 22}} Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid IP protocol tempest-999-462125710. Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd137e08d-b712-4fa2-9a5d-e0952b8dd492', 'ip_protocol': 'tempest-999-462125710', 'from_port': 22, 'to_port': 22}}} Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-462125710. Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-462125710. Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:36.179050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:36.183057 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:36.183057 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:36.183057 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:36.183057 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:36.183057 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:36.183057 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:36.183057 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-462125710. Oct 22 03:23:36.183057 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:36.184298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4e37b49-b053-499f-9083-22b5878f4b29 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Returning 400 to user: Invalid IP protocol tempest-999-462125710. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:36.185323 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4e37b49-b053-499f-9083-22b5878f4b29 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.353605 Oct 22 03:23:36.193482 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2231/4411] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:23:35 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 362 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:23:36.198898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:36.207162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:36.220478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:36.227281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:36.228505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:36.229428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:36.230257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:36.230854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:36.468188 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-99051cd2-04e2-4ef4-b20b-0e03b460860b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.974760 Oct 22 03:23:36.469744 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2181/4412] 10.222.0.25 () {58 vars in 1173 bytes} [Sat Oct 22 03:23:35 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:36.500169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:36.504026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:36.527401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:36.535868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:36.536601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:36.537486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:36.543740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:36.544591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:36.745272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:36.758154 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-225d48ee-cf87-4a1d-acd1-cbadbea92274 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 200 len: 1510 microversion: 2.1 time: 0.563099 Oct 22 03:23:36.778225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2232/4413] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:36 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 1510 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:36.785885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9277ee1-e599-42da-9c5a-6532e3a1c2fc tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1a4bbee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1504221379", "description": "tempest-description-2091693121"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:37.142511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:37.161402 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e83a1e8c-7fa0-4f65-8274-8199b1fad96b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.690435 Oct 22 03:23:37.162006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2182/4414] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:36 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:37.166793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-068ab769-6b25-4650-9561-0ee4e2964c2a req-dcd10a3b-bf40-49b8-8f73-299eb0b95173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbfd3a3-2c95-4826-8aec-85abbd265bd9", "name": "network-vif-deleted", "tag": "c0b5c901-969c-4d38-a39e-297db0f29a5d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:37.195115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-068ab769-6b25-4650-9561-0ee4e2964c2a req-dcd10a3b-bf40-49b8-8f73-299eb0b95173 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.195829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-068ab769-6b25-4650-9561-0ee4e2964c2a req-dcd10a3b-bf40-49b8-8f73-299eb0b95173 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.196470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-068ab769-6b25-4650-9561-0ee4e2964c2a req-dcd10a3b-bf40-49b8-8f73-299eb0b95173 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.212239 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-068ab769-6b25-4650-9561-0ee4e2964c2a req-dcd10a3b-bf40-49b8-8f73-299eb0b95173 service nova] Creating event network-vif-deleted:c0b5c901-969c-4d38-a39e-297db0f29a5d for instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 on n-h1-862416-2 Oct 22 03:23:37.245013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-068ab769-6b25-4650-9561-0ee4e2964c2a req-dcd10a3b-bf40-49b8-8f73-299eb0b95173 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081552 Oct 22 03:23:37.251569 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2183/4415] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:37.258033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:37.267174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:37.274604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.compute.servers [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Removing options 'limit' from query {{(pid=120582) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 03:23:37.277526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:37.289373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.296811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.297771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.298821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.299491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.300495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.365054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:37.380509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.381006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.381757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.597747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28ca8c83-c5ec-45cf-afcc-b40994a555b9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.344524 Oct 22 03:23:37.601076 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2184/4416] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 03:23:37 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:37.623529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:37.624659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:37.637571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.638254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.640099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.646388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.647139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.650210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.841838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:37.849888 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d0d8a38-faf0-430c-9615-4590e7da7f5b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1501 microversion: 2.1 time: 0.247277 Oct 22 03:23:37.850560 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2185/4417] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:37 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1501 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:37.855748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6dd077f1-fd04-465c-ab57-048faf44620d req-719e12ae-991d-43ee-82d1-75af7d846234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03dd7ae-c54a-440e-b9de-0eb4b8b31359", "name": "network-vif-deleted", "tag": "3f338ab8-c350-45e6-a43e-6e3d948e35ef"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:37.862388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:37.872473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6dd077f1-fd04-465c-ab57-048faf44620d req-719e12ae-991d-43ee-82d1-75af7d846234 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.873204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6dd077f1-fd04-465c-ab57-048faf44620d req-719e12ae-991d-43ee-82d1-75af7d846234 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.873708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6dd077f1-fd04-465c-ab57-048faf44620d req-719e12ae-991d-43ee-82d1-75af7d846234 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.887074 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6dd077f1-fd04-465c-ab57-048faf44620d req-719e12ae-991d-43ee-82d1-75af7d846234 service nova] Creating event network-vif-deleted:3f338ab8-c350-45e6-a43e-6e3d948e35ef for instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 on n-h1-862416-2 Oct 22 03:23:37.892101 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6dd077f1-fd04-465c-ab57-048faf44620d req-719e12ae-991d-43ee-82d1-75af7d846234 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040090 Oct 22 03:23:37.893101 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2186/4418] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:37.899834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:37.904648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:37.905836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:37.911949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.912689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.913137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.913865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.914324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.914751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.947553 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9277ee1-e599-42da-9c5a-6532e3a1c2fc tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.167563 Oct 22 03:23:37.948246 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2233/4419] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:23:36 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:37.961539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:37.962398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:37.968651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.969328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.969932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:37.970793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:37.971401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:37.971979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.005477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.006863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.007312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.007773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lazy-loading 'fault' on Instance uuid c03dd7ae-c54a-440e-b9de-0eb4b8b31359 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:23:38.017757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:38.082717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9f00a0f4-3d7b-4b22-837e-9892541b9e2c tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.188292 Oct 22 03:23:38.083998 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2187/4420] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:23:37 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:38.088815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0feb52c-8028-4a71-b7ed-7bd19086122e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:38.095045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0feb52c-8028-4a71-b7ed-7bd19086122e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.095780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0feb52c-8028-4a71-b7ed-7bd19086122e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.096048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0feb52c-8028-4a71-b7ed-7bd19086122e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.107026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d479faa1f14d0ca72a1931b89aea08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baeef71a21d248e49eb2548a4a69bb2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:38.118238 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31db3fe2-27df-4cd6-b11c-7ed45bd8924f tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 200 len: 1307 microversion: 2.1 time: 0.160805 Oct 22 03:23:38.119592 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2234/4421] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:37 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:38.125404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e345fba3-92fd-4c4d-9315-bcebbdcab087 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1a1e1670>, body: {"security_group_rule": {"parent_group_id": "cef2573c-df35-4d10-87d1-b2df43ef2a84", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:38.127784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0feb52c-8028-4a71-b7ed-7bd19086122e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Going to try to stop instance {{(pid=120582) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:23:38.181103 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0feb52c-8028-4a71-b7ed-7bd19086122e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828/action" status: 202 len: 0 microversion: 2.1 time: 0.095812 Oct 22 03:23:38.182193 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2188/4422] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:23:38 2022] POST /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:23:38.188663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:38.194614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:38.195062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.compute.servers [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Removing options 'limit' from query {{(pid=120582) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 03:23:38.195805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:38.202225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.202813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.203323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.204523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.205139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.205780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.281286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:38.326895 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4132f09d-1014-4910-8b10-770d82643831 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.143376 Oct 22 03:23:38.335869 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2189/4423] 10.222.0.25 () {58 vars in 1150 bytes} [Sat Oct 22 03:23:38 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:38.341584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:38.342331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:38.352072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.352292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.352804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.353566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.354149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.354577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.462879 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e345fba3-92fd-4c4d-9315-bcebbdcab087 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e345fba3-92fd-4c4d-9315-bcebbdcab087 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Request method failure captured: Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 138 Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IyAm32hV4qC6ujBVu0r7ubXMrnspH50-MaFKgT1K8mqk72hkmiODoqL_hsZPlyTTaaoCcZPcEe60cc3EQ8qEqyEA1DPHzwnUXJWBzHltaJ0IO1a4Lf3rTlrn-M3wvdh1Kv-R64xTaTs9GEVlhZS15HAz4L5zExLZ1tDvsuRhkuO2s Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7029876926a04aa58309f88ef250f94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7029876926a04aa58309f88ef250f94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}] Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3e42ea1e4a6d435c8620727579696ce7 Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: {"security_group_rule": {"parent_group_id": "cef2573c-df35-4d10-87d1-b2df43ef2a84", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cef2573c-df35-4d10-87d1-b2df43ef2a84', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 03:23:38.469730 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 22 03:23:38.475705 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:38.479981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e345fba3-92fd-4c4d-9315-bcebbdcab087 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:38.484521 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e345fba3-92fd-4c4d-9315-bcebbdcab087 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.363251 Oct 22 03:23:38.486310 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2235/4424] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:23:38 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:23:38.497247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:38.500588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:38.517590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.518425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.519540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.521009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.522444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.523118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.685542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:38.718742 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac4eba08-88b2-42ff-a0a5-1e88df111133 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.381571 Oct 22 03:23:38.732706 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2190/4425] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:38 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:38.743232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:38.757851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:38.758305 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98797d71-96f4-4d06-9454-132e4de78014 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.268824 Oct 22 03:23:38.760564 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2236/4426] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:38 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:38.774569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:38.775593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:38.775918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:38.776929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:38.791216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.793168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.794312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.794993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.797504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.798190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.798438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.799238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.800664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.801655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:38.805588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:38.809503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:38.840360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:38.860008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:38.874706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:38.883720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lazy-loading 'flavor' on Instance uuid 52d2acf4-a7dd-46af-ae59-83a28eccaa4f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:23:38.913543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cb369996-66c4-4e1f-95d1-1475b28c4afc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.179222 Oct 22 03:23:38.914514 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2191/4427] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:23:38 2022] GET /compute/v2.1/servers => generated 1011 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:38.919524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41774da9-b7c3-4858-8e59-5922645c9881 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1e586ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-17068701", "description": "tempest-description-1938843991"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:39.269632 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c28695bc-99bf-4a20-9717-b51bab9c819b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/action" status: 202 len: 0 microversion: 2.20 time: 0.506413 Oct 22 03:23:39.273865 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2237/4428] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:23:38 2022] POST /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:23:39.284979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:39.302339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:39.303115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:39.350907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.351304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.351819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.352694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.353151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.353634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.384188 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41774da9-b7c3-4858-8e59-5922645c9881 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.467615 Oct 22 03:23:39.384188 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2192/4429] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:23:38 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:39.389071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:39.389678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: c03dd7ae-c54a-440e-b9de-0eb4b8b31359] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:39.403059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.407199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.407637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.415382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.415877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.416346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.438343 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] HTTP exception thrown: Instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 could not be found. Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Request method failure captured: Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 HTTP/1.1 Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Hum8DgzqqQIK4WEFdWlYPkD4bZiXtuNVUhRCMR-F1clTp65i-m88m6ro95O6IweGODrJEgCI0G9tleVST3ccPcqorbW-ts0LchaooSzk1e557LISp5_jo4eBqw_jmlWfRo09eOh2SghRGzNST3ysKquy4_Prz8ZUJZheyTkdb28Uc Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: baeef71a21d248e49eb2548a4a69bb2c Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-MultipleCreateTestJSON-457930395 Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_baeef71a21d248e49eb2548a4a69bb2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/baeef71a21d248e49eb2548a4a69bb2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/baeef71a21d248e49eb2548a4a69bb2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/baeef71a21d248e49eb2548a4a69bb2c"}]}] Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-MultipleCreateTestJSON-457930395 Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: baeef71a21d248e49eb2548a4a69bb2c Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-MultipleCreateTestJSON-457930395 Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-MultipleCreateTestJSON-457930395-project Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: a0d479faa1f14d0ca72a1931b89aea08 Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-MultipleCreateTestJSON-457930395-project Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 could not be found. Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'c03dd7ae-c54a-440e-b9de-0eb4b8b31359'} Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 could not be found. Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 could not be found. Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.450269 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 could not be found. Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Returning 404 to user: Instance c03dd7ae-c54a-440e-b9de-0eb4b8b31359 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d0402695-55db-41d5-97f2-d89129e33fc5 tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359" status: 404 len: 111 microversion: 2.1 time: 0.066580 Oct 22 03:23:39.454911 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2193/4430] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:39 2022] GET /compute/v2.1/servers/c03dd7ae-c54a-440e-b9de-0eb4b8b31359 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:39.468066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0853a457-497b-4413-8674-eba1cbe75632 req-bf5084fa-87db-4631-8632-9f8e14d3e2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9a2200-b7dd-4191-a5aa-43448b87663f", "name": "network-vif-plugged", "status": "completed", "tag": "90489716-e587-45b4-bcd9-1e021325ec0e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:39.478430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0853a457-497b-4413-8674-eba1cbe75632 req-bf5084fa-87db-4631-8632-9f8e14d3e2a2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.478430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0853a457-497b-4413-8674-eba1cbe75632 req-bf5084fa-87db-4631-8632-9f8e14d3e2a2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.478778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0853a457-497b-4413-8674-eba1cbe75632 req-bf5084fa-87db-4631-8632-9f8e14d3e2a2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.503779 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0853a457-497b-4413-8674-eba1cbe75632 req-bf5084fa-87db-4631-8632-9f8e14d3e2a2 service nova] Creating event network-vif-plugged:90489716-e587-45b4-bcd9-1e021325ec0e for instance cd9a2200-b7dd-4191-a5aa-43448b87663f on n-h2-862416-2 Oct 22 03:23:39.513489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0853a457-497b-4413-8674-eba1cbe75632 req-bf5084fa-87db-4631-8632-9f8e14d3e2a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059467 Oct 22 03:23:39.516770 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2194/4431] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:39.520942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:39.525917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:39.534641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:39.544662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.546785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.547680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.548604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.552791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.553411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.592682 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f62655f-41cf-49fc-b6fb-1bd0ca7b32eb tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.317074 Oct 22 03:23:39.605321 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2238/4432] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:23:39 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:39.605321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e31e87fb-137f-4273-bba8-c62c7423c40d tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1a1e1a60>, body: {"security_group_rule": {"parent_group_id": "c3f73c79-069b-40f7-b7c4-b2e1863bc2f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1938385285}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:39.716017 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e31e87fb-137f-4273-bba8-c62c7423c40d tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] HTTP exception thrown: Invalid port range 22:1938385285. Valid TCP ports should be between 1-65535 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e31e87fb-137f-4273-bba8-c62c7423c40d tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Request method failure captured: Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 146 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IyAm32hV4qC6ujBVu0r7ubXMrnspH50-MaFKgT1K8mqk72hkmiODoqL_hsZPlyTTaaoCcZPcEe60cc3EQ8qEqyEA1DPHzwnUXJWBzHltaJ0IO1a4Lf3rTlrn-M3wvdh1Kv-R64xTaTs9GEVlhZS15HAz4L5zExLZ1tDvsuRhkuO2s Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7029876926a04aa58309f88ef250f94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7029876926a04aa58309f88ef250f94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}] Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3e42ea1e4a6d435c8620727579696ce7 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: {"security_group_rule": {"parent_group_id": "c3f73c79-069b-40f7-b7c4-b2e1863bc2f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1938385285}} Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid port range 22:1938385285. Valid TCP ports should be between 1-65535 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c3f73c79-069b-40f7-b7c4-b2e1863bc2f5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1938385285}}} Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1938385285. Valid TCP ports should be between 1-65535 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1938385285. Valid TCP ports should be between 1-65535 Oct 22 03:23:39.718560 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1938385285. Valid TCP ports should be between 1-65535 Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e31e87fb-137f-4273-bba8-c62c7423c40d tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Returning 400 to user: Invalid port range 22:1938385285. Valid TCP ports should be between 1-65535 {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e31e87fb-137f-4273-bba8-c62c7423c40d tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.124389 Oct 22 03:23:39.721945 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2239/4433] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:23:39 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:23:39.726342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:39.734952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] [instance: ccbfd3a3-2c95-4826-8aec-85abbd265bd9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:39.757842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.758335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.758771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.759477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.759926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.760377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.799937 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] HTTP exception thrown: Instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 could not be found. Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Request method failure captured: Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 HTTP/1.1 Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Hum8DgzqqQIK4WEFdWlYPkD4bZiXtuNVUhRCMR-F1clTp65i-m88m6ro95O6IweGODrJEgCI0G9tleVST3ccPcqorbW-ts0LchaooSzk1e557LISp5_jo4eBqw_jmlWfRo09eOh2SghRGzNST3ysKquy4_Prz8ZUJZheyTkdb28Uc Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: baeef71a21d248e49eb2548a4a69bb2c Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-MultipleCreateTestJSON-457930395 Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_baeef71a21d248e49eb2548a4a69bb2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/baeef71a21d248e49eb2548a4a69bb2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/baeef71a21d248e49eb2548a4a69bb2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/baeef71a21d248e49eb2548a4a69bb2c"}]}] Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-MultipleCreateTestJSON-457930395 Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: baeef71a21d248e49eb2548a4a69bb2c Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-MultipleCreateTestJSON-457930395 Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-MultipleCreateTestJSON-457930395-project Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: a0d479faa1f14d0ca72a1931b89aea08 Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-MultipleCreateTestJSON-457930395-project Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 could not be found. Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ccbfd3a3-2c95-4826-8aec-85abbd265bd9'} Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 could not be found. Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 could not be found. Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.804074 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.807498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.807498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:39.807498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:39.807498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:39.807498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:39.807498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 could not be found. Oct 22 03:23:39.807498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.807498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] Returning 404 to user: Instance ccbfd3a3-2c95-4826-8aec-85abbd265bd9 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:39.807932 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c898155-651c-4bd1-889f-04aa50f0db1e tempest-MultipleCreateTestJSON-457930395 tempest-MultipleCreateTestJSON-457930395-project] 10.222.0.25 "GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9" status: 404 len: 111 microversion: 2.1 time: 0.086028 Oct 22 03:23:39.814030 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2240/4434] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:39 2022] GET /compute/v2.1/servers/ccbfd3a3-2c95-4826-8aec-85abbd265bd9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:39.819184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:39.824607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:39.825503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.compute.servers [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Removing options 'limit' from query {{(pid=120581) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 03:23:39.826287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:39.832793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.833618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.834363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.835200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.835760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:39.836317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:39.873639 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67ce7d09-28bb-411c-ae82-dcb9d6b58304 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.058344 Oct 22 03:23:39.874985 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2241/4435] 10.222.0.25 () {58 vars in 1140 bytes} [Sat Oct 22 03:23:39 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:39.881800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5799d89-2528-4c13-963b-c49590606179 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Action: 'create', calling method: .version_select at 0x7f0d1a1e1040>, body: {"security_group_rule": {"parent_group_id": "70ca981e-3373-4221-b403-6bed20e09672", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:39.961603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-a5799d89-2528-4c13-963b-c49590606179 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70ca981e-3373-4221-b403-6bed20e09672 does not exist", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:23:39.963988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.security_group_api [None req-a5799d89-2528-4c13-963b-c49590606179 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Neutron security group 70ca981e-3373-4221-b403-6bed20e09672 not found {{(pid=120581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:23:39.965821 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a5799d89-2528-4c13-963b-c49590606179 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] HTTP exception thrown: Security group 70ca981e-3373-4221-b403-6bed20e09672 does not exist Oct 22 03:23:39.965821 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-f7866caf-35ce-45f0-b002-fb175ef23d50'] Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5799d89-2528-4c13-963b-c49590606179 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Request method failure captured: Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 138 Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IyAm32hV4qC6ujBVu0r7ubXMrnspH50-MaFKgT1K8mqk72hkmiODoqL_hsZPlyTTaaoCcZPcEe60cc3EQ8qEqyEA1DPHzwnUXJWBzHltaJ0IO1a4Lf3rTlrn-M3wvdh1Kv-R64xTaTs9GEVlhZS15HAz4L5zExLZ1tDvsuRhkuO2s Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7029876926a04aa58309f88ef250f94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7029876926a04aa58309f88ef250f94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}] Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3e42ea1e4a6d435c8620727579696ce7 Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: {"security_group_rule": {"parent_group_id": "70ca981e-3373-4221-b403-6bed20e09672", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: exception: Security group 70ca981e-3373-4221-b403-6bed20e09672 does not exist Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-f7866caf-35ce-45f0-b002-fb175ef23d50'] Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'security_group_rule': {'parent_group_id': '70ca981e-3373-4221-b403-6bed20e09672', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:23:39.969780 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70ca981e-3373-4221-b403-6bed20e09672 does not exist Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7866caf-35ce-45f0-b002-fb175ef23d50'] Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70ca981e-3373-4221-b403-6bed20e09672 does not exist Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7866caf-35ce-45f0-b002-fb175ef23d50'] Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70ca981e-3373-4221-b403-6bed20e09672 does not exist Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7866caf-35ce-45f0-b002-fb175ef23d50'] Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70ca981e-3373-4221-b403-6bed20e09672 does not exist Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7866caf-35ce-45f0-b002-fb175ef23d50'] Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5799d89-2528-4c13-963b-c49590606179 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Returning 404 to user: Security group 70ca981e-3373-4221-b403-6bed20e09672 does not exist Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-f7866caf-35ce-45f0-b002-fb175ef23d50'] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:39.973925 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a5799d89-2528-4c13-963b-c49590606179 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.097032 Oct 22 03:23:39.982260 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2242/4436] 10.222.0.25 () {60 vars in 1195 bytes} [Sat Oct 22 03:23:39 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:39.990099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:39.990765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:39.999397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:39.999889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.000367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:40.001265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:40.002735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.003374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:40.329224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:40.350809 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da09031c-f81e-4c57-b37b-e894797e94f1 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.367043 Oct 22 03:23:40.356324 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2243/4437] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:39 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:40.370999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:40.375402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:40.387575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:40.388255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.388600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:40.389021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:40.391310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:40.392725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.393331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:40.402065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:40.403801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:40.405075 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a96ede8c-481e-48c4-af53-0308d2add0af tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.886997 Oct 22 03:23:40.405640 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2195/4438] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:39 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:40.420536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:40.425821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:40.426645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1423212621', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:40.432961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:40.433365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.434082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:40.434972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:40.435577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.436153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:40.570892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:40.632373 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d1e5360-6e6f-4b47-8981-e03bd153fa59 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1423212621" status: 200 len: 346 microversion: 2.1 time: 0.225619 Oct 22 03:23:40.632964 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2196/4439] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:23:40 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1423212621 => generated 346 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:40.641027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df925650-9178-4418-a9ef-d1681094a33a tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Calling method '.version_select at 0x7f0d1e5a0310>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:40.680637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-df925650-9178-4418-a9ef-d1681094a33a tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule bf11cac7-9292-4664-8368-92731ebd751d does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:23:40.681519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-df925650-9178-4418-a9ef-d1681094a33a tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Neutron security group rule bf11cac7-9292-4664-8368-92731ebd751d not found {{(pid=120582) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 22 03:23:40.682329 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-df925650-9178-4418-a9ef-d1681094a33a tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] HTTP exception thrown: Security group rule bf11cac7-9292-4664-8368-92731ebd751d does not exist Oct 22 03:23:40.682329 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-e6833e49-50d7-4e68-9d2b-6cd3601bdaff'] Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df925650-9178-4418-a9ef-d1681094a33a tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Request method failure captured: Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-security-group-rules/bf11cac7-9292-4664-8368-92731ebd751d HTTP/1.1 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IyAm32hV4qC6ujBVu0r7ubXMrnspH50-MaFKgT1K8mqk72hkmiODoqL_hsZPlyTTaaoCcZPcEe60cc3EQ8qEqyEA1DPHzwnUXJWBzHltaJ0IO1a4Lf3rTlrn-M3wvdh1Kv-R64xTaTs9GEVlhZS15HAz4L5zExLZ1tDvsuRhkuO2s Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7029876926a04aa58309f88ef250f94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7029876926a04aa58309f88ef250f94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7029876926a04aa58309f88ef250f94d"}]}] Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7029876926a04aa58309f88ef250f94d Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3e42ea1e4a6d435c8620727579696ce7 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group rule bf11cac7-9292-4664-8368-92731ebd751d does not exist Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-e6833e49-50d7-4e68-9d2b-6cd3601bdaff'] Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'bf11cac7-9292-4664-8368-92731ebd751d'} Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:23:40.686140 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule bf11cac7-9292-4664-8368-92731ebd751d does not exist Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6833e49-50d7-4e68-9d2b-6cd3601bdaff'] Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule bf11cac7-9292-4664-8368-92731ebd751d does not exist Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6833e49-50d7-4e68-9d2b-6cd3601bdaff'] Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule bf11cac7-9292-4664-8368-92731ebd751d does not exist Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6833e49-50d7-4e68-9d2b-6cd3601bdaff'] Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule bf11cac7-9292-4664-8368-92731ebd751d does not exist Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6833e49-50d7-4e68-9d2b-6cd3601bdaff'] Oct 22 03:23:40.689961 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:40.693746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df925650-9178-4418-a9ef-d1681094a33a tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Returning 404 to user: Security group rule bf11cac7-9292-4664-8368-92731ebd751d does not exist Oct 22 03:23:40.693746 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-e6833e49-50d7-4e68-9d2b-6cd3601bdaff'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:40.693746 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-df925650-9178-4418-a9ef-d1681094a33a tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/bf11cac7-9292-4664-8368-92731ebd751d" status: 404 len: 199 microversion: 2.1 time: 0.058096 Oct 22 03:23:40.694768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:40.695644 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2197/4440] 10.222.0.25 () {58 vars in 1287 bytes} [Sat Oct 22 03:23:40 2022] DELETE /compute/v2.1/os-security-group-rules/bf11cac7-9292-4664-8368-92731ebd751d => generated 199 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:40.706486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72219f6c-ca78-450f-b7dc-ca703b0d95c6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:40.709916 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-861b0044-0fa8-4dec-8335-e3798b159485 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.348259 Oct 22 03:23:40.710527 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2244/4441] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:40 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:40.716277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8967bad4-e097-44ae-a31c-ecedbfdd55cf tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Calling method '.version_select at 0x7f0d1993c3a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:40.728254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72219f6c-ca78-450f-b7dc-ca703b0d95c6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:40.728999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72219f6c-ca78-450f-b7dc-ca703b0d95c6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.729579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72219f6c-ca78-450f-b7dc-ca703b0d95c6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:40.755476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-72219f6c-ca78-450f-b7dc-ca703b0d95c6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Going to try to stop instance {{(pid=120582) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:23:40.810180 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72219f6c-ca78-450f-b7dc-ca703b0d95c6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "POST /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.112823 Oct 22 03:23:40.811373 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2198/4442] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:23:40 2022] POST /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:23:40.822956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:40.823660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:40.829924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:40.830802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.831396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:40.831396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:40.833554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:40.834415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:41.139337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8967bad4-e097-44ae-a31c-ecedbfdd55cf tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c3f73c79-069b-40f7-b7c4-b2e1863bc2f5" status: 202 len: 0 microversion: 2.1 time: 0.427562 Oct 22 03:23:41.141340 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2245/4443] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:23:40 2022] DELETE /compute/v2.1/os-security-groups/c3f73c79-069b-40f7-b7c4-b2e1863bc2f5 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:23:41.146033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:41.149621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cca8e7b2-7c05-4aac-921a-6cb650ebeff6 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Calling method '.version_select at 0x7f0d199ac160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:41.157357 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39fce88c-ab22-4cc7-bd0c-18a33b49baa1 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1521 microversion: 2.1 time: 0.338730 Oct 22 03:23:41.158497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2199/4444] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:40 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:41.377815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:41.378767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:41.387738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:41.388511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:41.389150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:41.391119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:41.391955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:41.392735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:41.714699 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cca8e7b2-7c05-4aac-921a-6cb650ebeff6 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cef2573c-df35-4d10-87d1-b2df43ef2a84" status: 202 len: 0 microversion: 2.1 time: 0.568704 Oct 22 03:23:41.717730 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2246/4445] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:23:41 2022] DELETE /compute/v2.1/os-security-groups/cef2573c-df35-4d10-87d1-b2df43ef2a84 => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:23:41.728842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:41.730576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:41.738354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:41.741022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:41.741685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:41.743430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:41.746102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:41.746960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:41.749171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:41.755521 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-24391f8b-5b12-42c7-85fe-501aea923424 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1313 microversion: 2.1 time: 0.382140 Oct 22 03:23:41.756171 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2200/4446] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:41 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:41.768654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dae1e5eb-8dff-4cca-a2fe-573dc646ad63 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Calling method '.version_select at 0x7f0d1a6a2550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:42.376770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:42.387424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:42.390517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:42.391758 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5dbd1edc-f345-41be-bbd9-fb4ef9cf2f93 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.672160 Oct 22 03:23:42.392525 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2247/4447] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:41 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:42.406172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:42.416553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:42.430313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:42.430987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:42.431594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:42.432503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:42.433694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:42.434294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:42.525984 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dae1e5eb-8dff-4cca-a2fe-573dc646ad63 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d137e08d-b712-4fa2-9a5d-e0952b8dd492" status: 202 len: 0 microversion: 2.1 time: 0.765173 Oct 22 03:23:42.527235 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2201/4448] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:23:41 2022] DELETE /compute/v2.1/os-security-groups/d137e08d-b712-4fa2-9a5d-e0952b8dd492 => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:23:42.539158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:42.539806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:42.548047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:42.551765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:42.551765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:42.561016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:42.563866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:42.566257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:42.821259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:42.839090 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7376da7-82c3-4d6b-8cdd-6f25b9db49be tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.437419 Oct 22 03:23:42.858541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2248/4449] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:42 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:42.870202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af297caa-c4fd-448d-a50a-ab2e55469e76 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Calling method '.version_select at 0x7f0d197728b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:43.208480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:43.217767 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b5739d7-56bb-4ca7-adc0-45e5d6c6cebf tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1521 microversion: 2.1 time: 0.689392 Oct 22 03:23:43.218349 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2202/4450] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:42 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:43.234224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:43.235085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:43.241983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:43.242727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:43.243326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:43.244194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:43.244821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:43.245424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:43.274083 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af297caa-c4fd-448d-a50a-ab2e55469e76 tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e897cc82-beef-47d6-a797-cba77ae56a7f" status: 202 len: 0 microversion: 2.1 time: 0.413869 Oct 22 03:23:43.275152 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2249/4451] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:23:42 2022] DELETE /compute/v2.1/os-security-groups/e897cc82-beef-47d6-a797-cba77ae56a7f => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:23:43.282572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e064a867-0456-433a-88fa-f6f97b52d5ff tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] Calling method '.version_select at 0x7f0d1993cdc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:43.605746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:43.625432 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d4d5fa53-f5c7-447d-a1cb-0c2d6eae4a65 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1498 microversion: 2.1 time: 0.395959 Oct 22 03:23:43.627012 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2203/4452] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:43 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1498 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:43.641423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:43.644893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:43.653835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:43.654594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:43.655264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:43.656187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:43.656870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:43.657504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:43.711774 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e064a867-0456-433a-88fa-f6f97b52d5ff tempest-SecurityGroupRulesNegativeTestJSON-1541562733 tempest-SecurityGroupRulesNegativeTestJSON-1541562733-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/16236c5d-ca73-4a61-af82-8fc0e53d3e00" status: 202 len: 0 microversion: 2.1 time: 0.432782 Oct 22 03:23:43.712899 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2250/4453] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:23:43 2022] DELETE /compute/v2.1/os-security-groups/16236c5d-ca73-4a61-af82-8fc0e53d3e00 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:23:43.720319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa420bfe-a2cc-41cc-932b-66344f4b7d63 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:43.766908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.compute.server_groups [None req-fa420bfe-a2cc-41cc-932b-66344f4b7d63 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Querying cell 8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) for 1 instances {{(pid=120581) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 03:23:43.768194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa420bfe-a2cc-41cc-932b-66344f4b7d63 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:43.769234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa420bfe-a2cc-41cc-932b-66344f4b7d63 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:43.772054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa420bfe-a2cc-41cc-932b-66344f4b7d63 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:43.794669 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa420bfe-a2cc-41cc-932b-66344f4b7d63 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/114a9260-3a48-4026-bfd9-5f45a7290e91" status: 200 len: 222 microversion: 2.1 time: 0.080104 Oct 22 03:23:43.797113 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2251/4454] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:23:43 2022] GET /compute/v2.1/os-server-groups/114a9260-3a48-4026-bfd9-5f45a7290e91 => generated 222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:43.818287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:43.818942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:43.827163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:43.827923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:43.828489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:43.850834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:43.852608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:43.857612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:43.976627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:23:44.170230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:44.191394 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da612c13-b0a1-4519-90f5-f3effd736242 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 204 len: 0 microversion: 2.1 time: 0.382117 Oct 22 03:23:44.195680 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2252/4455] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:23:43 2022] DELETE /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:23:44.203190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:44.203714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:44.204453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:44.210126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:44.213280 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c821a159-13eb-4757-a99f-176aa8426f71 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.585111 Oct 22 03:23:44.217198 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2204/4456] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:43 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:44.233685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:44.234605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:44.244551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:44.245202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:44.245750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:44.246566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:44.247131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:44.247683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:44.248469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:44.249142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:44.249914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:44.251099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:44.251818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:44.252449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:44.616392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:44.627128 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b29f677d-3f66-45a3-aa4b-1d24328d9b1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.433084 Oct 22 03:23:44.628813 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2253/4457] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:44 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:44.657785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:44.658401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:44.672436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:44.672929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:44.673370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:44.674082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:44.674541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:44.674971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:44.697121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:44.711262 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab03bd69-ba69-4079-b607-3ca8e6127144 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1504 microversion: 2.1 time: 0.490071 Oct 22 03:23:44.713653 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2205/4458] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:44 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:44.925786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:45.245386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:45.246388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:45.254874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:45.255730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:45.256434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:45.257411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:45.258083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:45.258734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:45.405930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:45.421928 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5404367b-4b12-46f4-9801-6b6ea8b930c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1521 microversion: 2.1 time: 0.773714 Oct 22 03:23:45.423298 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2254/4459] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:44 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1521 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:45.481338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:45.493962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:45.505229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:45.506474 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-11568bc5-2fe9-4e73-b828-e01db4800c04 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.265033 Oct 22 03:23:45.507049 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2206/4460] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:45 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:23:45.667743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:45.673768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:45.696971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:45.698667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:45.704140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:45.707724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:45.710265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:45.711558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:45.741354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:45.742069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:45.758338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:45.759057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:45.759646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:45.760652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:45.761278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:45.761866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:46.645508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:46.669096 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15373ee3-b352-4e0b-9698-768679d295af tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1504 microversion: 2.1 time: 0.925521 Oct 22 03:23:46.669899 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2207/4461] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:45 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1504 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:46.684369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:46.684369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:46.687331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:46.688129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:46.688659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:46.690238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:46.690713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:46.691143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:47.035520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:47.070305 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bb0a3481-2479-4f5a-b92e-29db87a473df tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1498 microversion: 2.1 time: 0.394279 Oct 22 03:23:47.071228 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2208/4462] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:46 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1498 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:47.076109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:47.079749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:47.109548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:47.110421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:47.110872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:47.111610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:47.112094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:47.126054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:47.167863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:47.182751 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6651e09-9d66-4bd1-8ad9-f1910bc0e8e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 1.532214 Oct 22 03:23:47.184755 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2255/4463] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:45 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:47.198797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:47.213507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:47.216083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:47.248039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:47.248720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:47.249172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:47.249992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:47.250479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:47.250907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:47.310794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:47.364955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:47.387860 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-507b38e7-908e-417e-a2c9-ca3e746c3cac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.200402 Oct 22 03:23:47.406525 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2256/4464] 10.222.0.25 () {58 vars in 1154 bytes} [Sat Oct 22 03:23:47 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:47.419700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc1bb9fe-bbce-4000-8067-8a3b59c531a5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:47.446667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1bb9fe-bbce-4000-8067-8a3b59c531a5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:47.447883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1bb9fe-bbce-4000-8067-8a3b59c531a5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:47.449050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc1bb9fe-bbce-4000-8067-8a3b59c531a5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:47.550276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:47.569826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc1bb9fe-bbce-4000-8067-8a3b59c531a5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Going to try to start instance {{(pid=120581) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 03:23:47.655512 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc1bb9fe-bbce-4000-8067-8a3b59c531a5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "POST /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.247090 Oct 22 03:23:47.661179 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2257/4465] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:23:47 2022] POST /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:23:47.670817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:47.671790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:47.684946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:47.687150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:47.688117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:47.689154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:47.690239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:47.691144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:48.018320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:48.033572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:48.038602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:48.041146 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fbcba58b-0e1f-4c21-856f-87e3b68f69ae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.967637 Oct 22 03:23:48.043136 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2209/4466] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:47 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:48.054018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:48.057056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:48.081331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:48.084230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:48.085695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:48.087782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:48.089951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:48.091181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:48.138348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:48.424536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:48.438709 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ece21d4-20e4-4418-adfa-b2a774cb325b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1507 microversion: 2.1 time: 0.773532 Oct 22 03:23:48.459317 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2258/4467] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:47 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1507 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:48.466783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:48.467404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:48.475828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:48.477221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:48.477884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:48.478957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:48.479649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:48.480516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:48.540910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:48.555519 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-adfb224b-f55b-45af-9e4f-407744ebda48 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1504 microversion: 2.1 time: 0.510694 Oct 22 03:23:48.558165 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2210/4468] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:48 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:49.072302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:49.073637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:49.081087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:49.081779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:49.082555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:49.084241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:49.091437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:49.092076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:49.151041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:49.170696 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-905dbc0a-7d74-4755-a3a3-11fdc3651349 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.710116 Oct 22 03:23:49.185114 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2259/4469] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:48 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:49.305382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-aa89e62e-60ce-4185-9c4f-c9c1a655cf81 req-a10e32b5-ce91-4a05-9f84-2cf24a2d087e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9a2200-b7dd-4191-a5aa-43448b87663f", "name": "network-vif-deleted", "tag": "90489716-e587-45b4-bcd9-1e021325ec0e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:49.323883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aa89e62e-60ce-4185-9c4f-c9c1a655cf81 req-a10e32b5-ce91-4a05-9f84-2cf24a2d087e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:49.324760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aa89e62e-60ce-4185-9c4f-c9c1a655cf81 req-a10e32b5-ce91-4a05-9f84-2cf24a2d087e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:49.326095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aa89e62e-60ce-4185-9c4f-c9c1a655cf81 req-a10e32b5-ce91-4a05-9f84-2cf24a2d087e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:49.350819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-aa89e62e-60ce-4185-9c4f-c9c1a655cf81 req-a10e32b5-ce91-4a05-9f84-2cf24a2d087e service nova] Creating event network-vif-deleted:90489716-e587-45b4-bcd9-1e021325ec0e for instance cd9a2200-b7dd-4191-a5aa-43448b87663f on n-h2-862416-2 Oct 22 03:23:49.376801 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-aa89e62e-60ce-4185-9c4f-c9c1a655cf81 req-a10e32b5-ce91-4a05-9f84-2cf24a2d087e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076061 Oct 22 03:23:49.378103 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2260/4470] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:23:49.470854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:49.472582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:49.499518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:49.501434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:49.502781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:49.522765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:49.524350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:49.525302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:49.796991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:49.811075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:49.822669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:49.825071 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9467f10-cee3-4a89-9d0a-4cca17a3c6dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.756701 Oct 22 03:23:49.830636 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2211/4471] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:49 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:23:49.839230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:49.840190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:49.855390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:49.856528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:49.858974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:49.865888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:49.877563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:49.878040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:49.968885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:49.969588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:49.970158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:49.970761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lazy-loading 'fault' on Instance uuid cd9a2200-b7dd-4191-a5aa-43448b87663f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:23:50.045708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5148f47860480084de17ba4e335f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b462df9f4734b6a9c1b7c588a8592f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:50.071276 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98d10002-b9ae-4170-aa18-e18bfda0f07a tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 200 len: 1303 microversion: 2.1 time: 0.238381 Oct 22 03:23:50.085198 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2212/4472] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:49 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:50.125763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:50.139642 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0316ff47-2577-47fd-96f3-111d622a3b77 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1507 microversion: 2.1 time: 0.675513 Oct 22 03:23:50.158055 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2261/4473] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:49 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:50.203014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:50.204939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:50.228794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:50.231256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:50.232481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:50.232924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:50.236384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:50.246672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:50.247359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:50.369129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-012cea34-3d46-4a97-a789-b8253079be4d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: .version_select at 0x7f0d1a77d430>, body: {"keypair": {"name": "tempest-keypair-80722569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3Se64UKbx8mAkoaNIBrjdPvUriZknCO0w8gPGPBlXockwfLGi2cZVDQsGf3/FMkonBFjhI0x8yeG7nGjnKABy16U/jrg8RM42fvK9pZg4Ey4CHHcEWeRzB4Rq4FHaMRQ=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:50.404644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-012cea34-3d46-4a97-a789-b8253079be4d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:50.414467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-012cea34-3d46-4a97-a789-b8253079be4d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for user 3ad9769823b74399aabb7395eeee44aa and project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:50.455304 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-012cea34-3d46-4a97-a789-b8253079be4d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.376798 Oct 22 03:23:50.464634 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2213/4474] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:23:50 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:50.763210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:50.774573 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef780522-0092-4b83-a073-c77c4c4c29b6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.578873 Oct 22 03:23:50.798442 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2262/4475] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:50 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:50.860430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:50.861383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:50.874271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:50.876514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:50.877320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:50.877971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:50.878901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:50.881611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:50.882266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.099293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.099910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:51.108034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.108813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.109544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.110255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.110714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.127130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.178134 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] HTTP exception thrown: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Request method failure captured: Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f HTTP/1.1 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IgoBtYqWpGIqKWamUYi34sa8bWG1tQg_YjHRrijQYWAunkvzS_B1tOpPIN2Jz2vl3P-Zz1kc_ryqifM9Xsi9YgD-QPtXmqN8IJQyB3pDY2uUXdo0ixJMwLAleacAi9dHY3UxKuMmpclKNe4s7L2lmt0LcmpU3uku3W425-mfn08ig Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}] Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: ef5148f47860480084de17ba4e335f14 Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'cd9a2200-b7dd-4191-a5aa-43448b87663f'} Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.184894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.189302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.189302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.189302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.189302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:51.189302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:51.189302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.189302 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.192030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Returning 404 to user: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:51.193875 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e53014fb-60b0-406e-826f-1875bac82dc2 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 404 len: 111 microversion: 2.1 time: 0.098693 Oct 22 03:23:51.196646 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2263/4476] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:51 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:51.203823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.204927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:51.213483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.214196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.214988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.216425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.217077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.217691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.287844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:51.302433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:51.304095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:51.305336 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86d9fded-4483-4566-91e3-63f54b129ad6 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.449232 Oct 22 03:23:51.305931 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2214/4477] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:50 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:51.330726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d7310cb-7447-402f-9654-3b999e14bb0b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.351218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.compute.server_groups [None req-5d7310cb-7447-402f-9654-3b999e14bb0b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Querying cell 8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) for 1 instances {{(pid=120582) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 03:23:51.352176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d7310cb-7447-402f-9654-3b999e14bb0b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.352843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d7310cb-7447-402f-9654-3b999e14bb0b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.356037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d7310cb-7447-402f-9654-3b999e14bb0b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.396682 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d7310cb-7447-402f-9654-3b999e14bb0b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.071608 Oct 22 03:23:51.400616 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2215/4478] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:23:51 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:51.419700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7df1daca-0e54-4535-add3-036658b54497 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.442458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.compute.server_groups [None req-7df1daca-0e54-4535-add3-036658b54497 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Querying cell 8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) for 1 instances {{(pid=120582) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 22 03:23:51.443415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7df1daca-0e54-4535-add3-036658b54497 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.446520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7df1daca-0e54-4535-add3-036658b54497 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.447307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7df1daca-0e54-4535-add3-036658b54497 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.481588 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7df1daca-0e54-4535-add3-036658b54497 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/114a9260-3a48-4026-bfd9-5f45a7290e91" status: 200 len: 184 microversion: 2.1 time: 0.072901 Oct 22 03:23:51.496263 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2216/4479] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:23:51 2022] GET /compute/v2.1/os-server-groups/114a9260-3a48-4026-bfd9-5f45a7290e91 => generated 184 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:51.508604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.509126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:51.515621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.516395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.516849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.517876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.518525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.519195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.536809 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] HTTP exception thrown: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Request method failure captured: Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f HTTP/1.1 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IgoBtYqWpGIqKWamUYi34sa8bWG1tQg_YjHRrijQYWAunkvzS_B1tOpPIN2Jz2vl3P-Zz1kc_ryqifM9Xsi9YgD-QPtXmqN8IJQyB3pDY2uUXdo0ixJMwLAleacAi9dHY3UxKuMmpclKNe4s7L2lmt0LcmpU3uku3W425-mfn08ig Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}] Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ef5148f47860480084de17ba4e335f14 Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'cd9a2200-b7dd-4191-a5aa-43448b87663f'} Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:51.539173 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.542685 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.544189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Returning 404 to user: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:51.545280 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49e9fb0a-1941-4483-87b2-08da23125d8b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 404 len: 111 microversion: 2.1 time: 0.047978 Oct 22 03:23:51.546199 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2217/4480] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:23:51 2022] DELETE /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:51.555350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.556240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] [instance: cd9a2200-b7dd-4191-a5aa-43448b87663f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:51.563272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.564109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.564931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.566118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.566732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.567190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.584440 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] HTTP exception thrown: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Request method failure captured: Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f HTTP/1.1 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IgoBtYqWpGIqKWamUYi34sa8bWG1tQg_YjHRrijQYWAunkvzS_B1tOpPIN2Jz2vl3P-Zz1kc_ryqifM9Xsi9YgD-QPtXmqN8IJQyB3pDY2uUXdo0ixJMwLAleacAi9dHY3UxKuMmpclKNe4s7L2lmt0LcmpU3uku3W425-mfn08ig Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}] Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ef5148f47860480084de17ba4e335f14 Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'cd9a2200-b7dd-4191-a5aa-43448b87663f'} Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.586548 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.590116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.590116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.590116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.590116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:51.590116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:51.590116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. Oct 22 03:23:51.590116 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.592336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Returning 404 to user: Instance cd9a2200-b7dd-4191-a5aa-43448b87663f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:51.593749 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6b7cae14-b4ea-43db-87bd-7abc4c9b4f56 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f" status: 404 len: 111 microversion: 2.1 time: 0.043240 Oct 22 03:23:51.598110 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2218/4481] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:51 2022] GET /compute/v2.1/servers/cd9a2200-b7dd-4191-a5aa-43448b87663f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:51.603633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e2573ce-71bd-43be-bff9-fff84f0bfe70 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.611110 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1e2573ce-71bd-43be-bff9-fff84f0bfe70 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] HTTP exception thrown: Instance group 67a69f27-8463-4621-b1ec-75c15f60e3b3 could not be found. Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e2573ce-71bd-43be-bff9-fff84f0bfe70 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Request method failure captured: Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-server-groups/67a69f27-8463-4621-b1ec-75c15f60e3b3 HTTP/1.1 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IgoBtYqWpGIqKWamUYi34sa8bWG1tQg_YjHRrijQYWAunkvzS_B1tOpPIN2Jz2vl3P-Zz1kc_ryqifM9Xsi9YgD-QPtXmqN8IJQyB3pDY2uUXdo0ixJMwLAleacAi9dHY3UxKuMmpclKNe4s7L2lmt0LcmpU3uku3W425-mfn08ig Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}] Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ef5148f47860480084de17ba4e335f14 Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance group 67a69f27-8463-4621-b1ec-75c15f60e3b3 could not be found. Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '67a69f27-8463-4621-b1ec-75c15f60e3b3'} Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 67a69f27-8463-4621-b1ec-75c15f60e3b3 could not be found. Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 67a69f27-8463-4621-b1ec-75c15f60e3b3 could not be found. Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.614775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.618580 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.618580 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.618580 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:51.618580 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:51.618580 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 67a69f27-8463-4621-b1ec-75c15f60e3b3 could not be found. Oct 22 03:23:51.618580 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.621122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e2573ce-71bd-43be-bff9-fff84f0bfe70 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Returning 404 to user: Instance group 67a69f27-8463-4621-b1ec-75c15f60e3b3 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:51.627562 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1e2573ce-71bd-43be-bff9-fff84f0bfe70 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/67a69f27-8463-4621-b1ec-75c15f60e3b3" status: 404 len: 117 microversion: 2.1 time: 0.028169 Oct 22 03:23:51.628353 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2219/4482] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:51 2022] DELETE /compute/v2.1/os-server-groups/67a69f27-8463-4621-b1ec-75c15f60e3b3 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:51.639995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d636392-4cc2-4340-9cf6-433c577caa3d tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.651471 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-0d636392-4cc2-4340-9cf6-433c577caa3d tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] HTTP exception thrown: Instance group 745c80b5-f055-4db1-b414-1a6baaad3c2f could not be found. Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d636392-4cc2-4340-9cf6-433c577caa3d tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Request method failure captured: Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-server-groups/745c80b5-f055-4db1-b414-1a6baaad3c2f HTTP/1.1 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IgoBtYqWpGIqKWamUYi34sa8bWG1tQg_YjHRrijQYWAunkvzS_B1tOpPIN2Jz2vl3P-Zz1kc_ryqifM9Xsi9YgD-QPtXmqN8IJQyB3pDY2uUXdo0ixJMwLAleacAi9dHY3UxKuMmpclKNe4s7L2lmt0LcmpU3uku3W425-mfn08ig Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}] Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ef5148f47860480084de17ba4e335f14 Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance group 745c80b5-f055-4db1-b414-1a6baaad3c2f could not be found. Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '745c80b5-f055-4db1-b414-1a6baaad3c2f'} Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 745c80b5-f055-4db1-b414-1a6baaad3c2f could not be found. Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 745c80b5-f055-4db1-b414-1a6baaad3c2f could not be found. Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.653762 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.657583 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.657583 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.657583 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:51.657583 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:51.657583 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 745c80b5-f055-4db1-b414-1a6baaad3c2f could not be found. Oct 22 03:23:51.657583 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.659922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d636392-4cc2-4340-9cf6-433c577caa3d tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Returning 404 to user: Instance group 745c80b5-f055-4db1-b414-1a6baaad3c2f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:51.661696 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d636392-4cc2-4340-9cf6-433c577caa3d tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/745c80b5-f055-4db1-b414-1a6baaad3c2f" status: 404 len: 117 microversion: 2.1 time: 0.028385 Oct 22 03:23:51.662668 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2220/4483] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:51 2022] DELETE /compute/v2.1/os-server-groups/745c80b5-f055-4db1-b414-1a6baaad3c2f => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:23:51.671052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55e3b524-5494-42f2-88ed-8a2c3cd86137 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.678795 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-55e3b524-5494-42f2-88ed-8a2c3cd86137 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] HTTP exception thrown: Instance group 4d148db2-763d-4139-a029-3cc1ec1ae4c6 could not be found. Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55e3b524-5494-42f2-88ed-8a2c3cd86137 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Request method failure captured: Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-server-groups/4d148db2-763d-4139-a029-3cc1ec1ae4c6 HTTP/1.1 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IgoBtYqWpGIqKWamUYi34sa8bWG1tQg_YjHRrijQYWAunkvzS_B1tOpPIN2Jz2vl3P-Zz1kc_ryqifM9Xsi9YgD-QPtXmqN8IJQyB3pDY2uUXdo0ixJMwLAleacAi9dHY3UxKuMmpclKNe4s7L2lmt0LcmpU3uku3W425-mfn08ig Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}] Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ef5148f47860480084de17ba4e335f14 Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance group 4d148db2-763d-4139-a029-3cc1ec1ae4c6 could not be found. Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '4d148db2-763d-4139-a029-3cc1ec1ae4c6'} Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4d148db2-763d-4139-a029-3cc1ec1ae4c6 could not be found. Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4d148db2-763d-4139-a029-3cc1ec1ae4c6 could not be found. Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.681349 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.685214 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.685214 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.685214 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:51.685214 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:51.685214 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4d148db2-763d-4139-a029-3cc1ec1ae4c6 could not be found. Oct 22 03:23:51.685214 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.688512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55e3b524-5494-42f2-88ed-8a2c3cd86137 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Returning 404 to user: Instance group 4d148db2-763d-4139-a029-3cc1ec1ae4c6 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:51.690025 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-55e3b524-5494-42f2-88ed-8a2c3cd86137 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/4d148db2-763d-4139-a029-3cc1ec1ae4c6" status: 404 len: 117 microversion: 2.1 time: 0.023373 Oct 22 03:23:51.691117 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2221/4484] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:51 2022] DELETE /compute/v2.1/os-server-groups/4d148db2-763d-4139-a029-3cc1ec1ae4c6 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:23:51.702912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f230b2b9-7a6a-4420-a31f-019679a82520 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.713510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-f230b2b9-7a6a-4420-a31f-019679a82520 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] HTTP exception thrown: Instance group 803c64bf-7019-4410-ad4c-3f4f42b9d01e could not be found. Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f230b2b9-7a6a-4420-a31f-019679a82520 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Request method failure captured: Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-server-groups/803c64bf-7019-4410-ad4c-3f4f42b9d01e HTTP/1.1 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2IgoBtYqWpGIqKWamUYi34sa8bWG1tQg_YjHRrijQYWAunkvzS_B1tOpPIN2Jz2vl3P-Zz1kc_ryqifM9Xsi9YgD-QPtXmqN8IJQyB3pDY2uUXdo0ixJMwLAleacAi9dHY3UxKuMmpclKNe4s7L2lmt0LcmpU3uku3W425-mfn08ig Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b462df9f4734b6a9c1b7c588a8592f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b462df9f4734b6a9c1b7c588a8592f7"}]}] Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 5b462df9f4734b6a9c1b7c588a8592f7 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerGroupTestJSON-848420902 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ef5148f47860480084de17ba4e335f14 Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerGroupTestJSON-848420902-project Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance group 803c64bf-7019-4410-ad4c-3f4f42b9d01e could not be found. Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '803c64bf-7019-4410-ad4c-3f4f42b9d01e'} Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 803c64bf-7019-4410-ad4c-3f4f42b9d01e could not be found. Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 803c64bf-7019-4410-ad4c-3f4f42b9d01e could not be found. Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.716782 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:51.721834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:51.721834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:51.721834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:51.721834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:51.721834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 803c64bf-7019-4410-ad4c-3f4f42b9d01e could not be found. Oct 22 03:23:51.721834 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:51.721834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f230b2b9-7a6a-4420-a31f-019679a82520 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Returning 404 to user: Instance group 803c64bf-7019-4410-ad4c-3f4f42b9d01e could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:51.723781 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f230b2b9-7a6a-4420-a31f-019679a82520 tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/803c64bf-7019-4410-ad4c-3f4f42b9d01e" status: 404 len: 117 microversion: 2.1 time: 0.025571 Oct 22 03:23:51.725008 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2222/4485] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:51 2022] DELETE /compute/v2.1/os-server-groups/803c64bf-7019-4410-ad4c-3f4f42b9d01e => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:23:51.736280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-438dc33d-364c-4ecf-b592-a52b08ad853b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.817589 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-438dc33d-364c-4ecf-b592-a52b08ad853b tempest-ServerGroupTestJSON-848420902 tempest-ServerGroupTestJSON-848420902-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/114a9260-3a48-4026-bfd9-5f45a7290e91" status: 204 len: 0 microversion: 2.1 time: 0.086535 Oct 22 03:23:51.818559 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2223/4486] 10.222.0.25 () {58 vars in 1266 bytes} [Sat Oct 22 03:23:51 2022] DELETE /compute/v2.1/os-server-groups/114a9260-3a48-4026-bfd9-5f45a7290e91 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:23:51.832821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:51.833373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:51.845606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.846102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.846778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:51.847606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:51.848802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:51.849237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:52.396989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:52.409555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3199505a-5008-4bbb-91ec-c928610719de tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1511 microversion: 2.1 time: 1.210046 Oct 22 03:23:52.435828 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2264/4487] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:51 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1511 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:52.442267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:52.443167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:52.451700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:52.452464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:52.453286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:52.454161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:52.456566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:52.457442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:52.652784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:52.667549 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-391b1835-9dca-42ad-b6f9-31fac1199bdc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.842869 Oct 22 03:23:52.668394 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2224/4488] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:51 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:52.675747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:52.682720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:52.683525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.compute.servers [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Removing options 'limit' from query {{(pid=120582) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 03:23:52.687285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:52.688683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:52.689592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:52.690252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:52.691343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:52.694308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:52.694971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:52.696683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fbccef61-0f04-4a3f-9b71-9aa52832e3cc tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.026957 Oct 22 03:23:52.698359 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2225/4489] 10.222.0.25 () {58 vars in 1140 bytes} [Sat Oct 22 03:23:52 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:23:52.725207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:52.725846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:52.738354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:52.739448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:52.740131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:52.741103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:52.741774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:52.742528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:52.939714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:52.965360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:52.969519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:52.974740 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9170a722-a0b4-4b10-bfa6-098ccae92e8a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.535136 Oct 22 03:23:52.975567 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2265/4490] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:52 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:52.986079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:53.004174 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b47fb04d-f08a-42ba-af21-453541ab42ca tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1511 microversion: 2.1 time: 0.290534 Oct 22 03:23:53.005790 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2226/4491] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:52 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:53.032444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:53.033444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:53.047177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:53.051447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:53.053822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:53.055756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:53.056888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:53.058061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:53.494179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:53.506865 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-688f9d49-a22f-42ab-a294-efdd6f0b2b07 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 200 len: 1512 microversion: 2.1 time: 0.479735 Oct 22 03:23:53.520750 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2266/4492] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:53 2022] GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:53.539758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:53.540827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:53.553215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:53.554304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:53.555560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:53.556841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:53.558355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:53.559295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:53.697361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:53.698270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:53.709383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:53.712109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:53.712805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:53.716808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:53.717600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:53.722640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:54.127831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:54.141683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:54.143856 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72380fad-8226-4498-9600-8af1f413ba59 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.456067 Oct 22 03:23:54.145759 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2267/4493] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:53 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:54.154923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:54.161517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:54.162349 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1a91d88-4377-4dde-aa08-88d347716c8a tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1511 microversion: 2.1 time: 0.633803 Oct 22 03:23:54.163252 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2227/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:53 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1511 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:54.193031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:54.210920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:54.211520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:54.212118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:54.212601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:54.213219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:54.213347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:54.213803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:54.214232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:54.458437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:54.459492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:54.460596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:54.461568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:54.462201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:54.462782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:54.646302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:54.667666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:54.669666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:54.671539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b091575f-6d4c-4e5d-b098-3b7650cffc34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.523536 Oct 22 03:23:54.672655 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2268/4495] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:54 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:54.677006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:54.789397 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-03ab1682-f042-4f08-97b6-b065be6a2730 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.601913 Oct 22 03:23:54.799734 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2228/4496] 10.222.0.25 () {58 vars in 1154 bytes} [Sat Oct 22 03:23:54 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:23:54.805572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:54.806406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:54.821235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:54.822000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:54.823696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:54.829012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:54.829490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:54.830037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:55.170797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:55.172799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:55.173792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:55.183025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:55.184036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:55.185943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:55.187035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:55.188686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:55.190658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:55.200078 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-02bf33fd-1f4b-4fdf-96b7-324a102f623b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1511 microversion: 2.1 time: 0.400414 Oct 22 03:23:55.201711 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2269/4497] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:54 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:55.225178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:55.225988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:55.233458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:55.234050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:55.234497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:55.235208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:55.252572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:55.253121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:55.664365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:55.675986 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aae80714-de64-4e47-9497-5ac8efb65501 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 200 len: 1512 microversion: 2.1 time: 0.454521 Oct 22 03:23:55.700079 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2270/4498] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:55 2022] GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 1512 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:23:55.713273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-651635895", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db13738c-9ec5-42b7-9de3-e09248983a6a"}], "security_groups": [{"name": "tempest-securitygroup--726561145"}], "key_name": "tempest-keypair-80722569", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:55.745931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:55.788164 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2c44dc8e-1376-44e6-96e5-570018d3de1a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.613321 Oct 22 03:23:55.792496 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2229/4499] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:55 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:55.811381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:55.820397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:55.835371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:55.837391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:55.837886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:55.838326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:55.839032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:55.845205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:55.845945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:56.040120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] validate_networks() for [('db13738c-9ec5-42b7-9de3-e09248983a6a', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:23:56.168985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:56.180574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:56.184125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:56.186577 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d67bf851-ad1f-421b-8a2f-e510947a6c84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.393055 Oct 22 03:23:56.195878 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2230/4500] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:55 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:56.213293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:56.214139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:56.221823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:56.222395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:56.223460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:56.224556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:56.225089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:56.225588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:56.404699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:56.414539 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a4c6695-1fde-4676-8c42-cb48df05f514 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1511 microversion: 2.1 time: 0.215552 Oct 22 03:23:56.415809 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2231/4501] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:56 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:56.773734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a57cd342-611a-420a-a141-fcddca7f7cb9 tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1393726689", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:56.778492 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-a57cd342-611a-420a-a141-fcddca7f7cb9 tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] HTTP exception thrown: min_count must be <= max_count Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a57cd342-611a-420a-a141-fcddca7f7cb9 tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Request method failure captured: Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 184 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JL0g6CKBz6JJCOAAct4YiWZVac22l8LioHzS2mjn5GgjRGqmJgyghHjgMFFThT1f2-Wk2AHfN5z7qr9_bK3zqxA1U-Du4i__cI1LAehnWZmWay3rskAWlX1n6KS80N5wrN_wbC-DcpdSuhpJVWPfzQ49Ryvi5BWSrotZV9AgX-kB8 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}] Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: cb175dc0f9af4cc68788cbcf02b8e0bf Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1393726689", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: exception: min_count must be <= max_count Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1393726689', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 22 03:23:56.780152 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:56.783846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a57cd342-611a-420a-a141-fcddca7f7cb9 tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Returning 400 to user: min_count must be <= max_count {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:56.783846 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a57cd342-611a-420a-a141-fcddca7f7cb9 tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.364601 Oct 22 03:23:56.787138 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2232/4502] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:56 2022] POST /compute/v2.1/servers => generated 74 bytes in 369 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 22 03:23:56.891800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1336739674", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": "none"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:56.970997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:23:56.971373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:23:56.971862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:23:56.972371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:23:56.973152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:23:56.984859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:56.985398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:56.986117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:56.987025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:56.987839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:56.988979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:57.010032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Getting quotas for project c04a7b6539774a3fb90f0a3f7f9c0ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:57.016530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Getting quotas for user 4c72a887b1ed4aa0867834238a080b6a and project c04a7b6539774a3fb90f0a3f7f9c0ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:57.031919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:23:57.034612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:23:57.098663 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f2518fb-2f58-4abd-8b4c-f85d217e61bd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.309692 Oct 22 03:23:57.106428 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2233/4503] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:23:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:23:57.110481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:57.123533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:57.124322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:57.152091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:57.152861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:57.153456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:57.154383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:57.161779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:57.162451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:57.200242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:23:57.201222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:23:57.202965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:23:57.203803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:23:57.204413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:23:57.226711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:57.227442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:57.228001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:57.228471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:57.229212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:57.229669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:57.230111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:57.280082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:23:57.291068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for user 3ad9769823b74399aabb7395eeee44aa and project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:23:57.292239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:57.307417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:23:57.311140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:23:57.318112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:57.320455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:57.321007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:57.387650 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8bedcb2-cef9-4704-ba42-c79d84df9156 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.686024 Oct 22 03:23:57.395917 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2271/4504] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:23:57.401822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:57.403246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:57.430983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:57.431490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:57.432044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:57.433265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:57.454080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:57.454771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:57.675375 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6af7715c-e4f6-4d2d-a39f-f348e5bb5d5e tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.573369 Oct 22 03:23:57.683593 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2234/4505] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:23:57 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:57.687221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ce0dfff-7d29-4e62-8c1e-59465bd8847f tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-544199902", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "max_count": 0}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ce0dfff-7d29-4e62-8c1e-59465bd8847f tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Request method failure captured: Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 167 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JL0g6CKBz6JJCOAAct4YiWZVac22l8LioHzS2mjn5GgjRGqmJgyghHjgMFFThT1f2-Wk2AHfN5z7qr9_bK3zqxA1U-Du4i__cI1LAehnWZmWay3rskAWlX1n6KS80N5wrN_wbC-DcpdSuhpJVWPfzQ49Ryvi5BWSrotZV9AgX-kB8 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}] Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: cb175dc0f9af4cc68788cbcf02b8e0bf Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-544199902", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "max_count": 0}} Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-544199902', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'max_count': 0}}} Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 0 Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:23:57.691995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:57.695832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ce0dfff-7d29-4e62-8c1e-59465bd8847f tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:57.698177 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9ce0dfff-7d29-4e62-8c1e-59465bd8847f tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021034 Oct 22 03:23:57.698780 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2235/4506] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:57 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:23:57.719675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-980b2bc6-350b-43d8-83f6-033e6f311cfe tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:57.723850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-980b2bc6-350b-43d8-83f6-033e6f311cfe tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:57.972350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-980b2bc6-350b-43d8-83f6-033e6f311cfe tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:57.985661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-980b2bc6-350b-43d8-83f6-033e6f311cfe tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:57.995784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-980b2bc6-350b-43d8-83f6-033e6f311cfe tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:58.002158 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-980b2bc6-350b-43d8-83f6-033e6f311cfe tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e" status: 200 len: 1281 microversion: 2.47 time: 0.302322 Oct 22 03:23:58.007120 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2236/4507] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:57 2022] GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e => generated 1281 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:58.013493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:58.021624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:58.023836 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-392258d6-de61-449c-90ed-da074e96b392 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.624529 Oct 22 03:23:58.025674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:58.033474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:58.033683 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2272/4508] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:57 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:58.034548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:58.040176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:58.044626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:58.046029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:58.053853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:58.061134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-041296dc-4e4f-4073-ae62-63232b92dc41 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:58.065483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-041296dc-4e4f-4073-ae62-63232b92dc41 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:58.170044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-041296dc-4e4f-4073-ae62-63232b92dc41 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:58.183441 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-041296dc-4e4f-4073-ae62-63232b92dc41 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1239 microversion: 2.1 time: 0.148019 Oct 22 03:23:58.189436 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2273/4509] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:58 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1239 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:58.199478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:58.214001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:58.215822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:58.489064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:58.489683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:58.490283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:58.491162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:58.491932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:58.492734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:58.563006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:58.582641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:58.602292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:58.603985 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-99fc810d-8454-4908-adfb-cc2bd4190c28 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1743 microversion: 2.20 time: 0.595580 Oct 22 03:23:58.604588 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2237/4510] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:58 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1743 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:58.611846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de4a114a-7f3c-4fc1-8a37-8c894d8e087e tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1936089907", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "max_count": 2.5}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de4a114a-7f3c-4fc1-8a37-8c894d8e087e tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Request method failure captured: Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 170 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JL0g6CKBz6JJCOAAct4YiWZVac22l8LioHzS2mjn5GgjRGqmJgyghHjgMFFThT1f2-Wk2AHfN5z7qr9_bK3zqxA1U-Du4i__cI1LAehnWZmWay3rskAWlX1n6KS80N5wrN_wbC-DcpdSuhpJVWPfzQ49Ryvi5BWSrotZV9AgX-kB8 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}] Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: cb175dc0f9af4cc68788cbcf02b8e0bf Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1936089907", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "max_count": 2.5}} Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1936089907', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'max_count': 2.5}}} Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 2.5 Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:23:58.623485 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 03:23:58.627283 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.630693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de4a114a-7f3c-4fc1-8a37-8c894d8e087e tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:58.631923 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-de4a114a-7f3c-4fc1-8a37-8c894d8e087e tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025802 Oct 22 03:23:58.632893 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2238/4511] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:23:58.654280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:58.751474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-354434b8-025f-4b60-a632-2887eecb2b6b tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1156215825", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 0}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-354434b8-025f-4b60-a632-2887eecb2b6b tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Request method failure captured: Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 168 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JL0g6CKBz6JJCOAAct4YiWZVac22l8LioHzS2mjn5GgjRGqmJgyghHjgMFFThT1f2-Wk2AHfN5z7qr9_bK3zqxA1U-Du4i__cI1LAehnWZmWay3rskAWlX1n6KS80N5wrN_wbC-DcpdSuhpJVWPfzQ49Ryvi5BWSrotZV9AgX-kB8 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}] Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: cb175dc0f9af4cc68788cbcf02b8e0bf Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1156215825", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 0}} Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1156215825', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'min_count': 0}}} Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi 0 Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:23:58.773572 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-354434b8-025f-4b60-a632-2887eecb2b6b tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:58.777206 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-354434b8-025f-4b60-a632-2887eecb2b6b tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028503 Oct 22 03:23:58.778617 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2239/4512] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:23:58.841700 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-977e8652-f521-4078-a4d1-03f06c530d19 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.646349 Oct 22 03:23:58.845291 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2274/4513] 10.222.0.25 () {58 vars in 1150 bytes} [Sat Oct 22 03:23:58 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:58.865010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:58.872094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:58.873014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:58.880039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:58.880652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:58.880791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eed87444-a2b9-4391-9533-717b38ceaf8f tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1821662037", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 2.5}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:23:58.881193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:58.882161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:58.882829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:58.883453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eed87444-a2b9-4391-9533-717b38ceaf8f tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Request method failure captured: Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 170 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JL0g6CKBz6JJCOAAct4YiWZVac22l8LioHzS2mjn5GgjRGqmJgyghHjgMFFThT1f2-Wk2AHfN5z7qr9_bK3zqxA1U-Du4i__cI1LAehnWZmWay3rskAWlX1n6KS80N5wrN_wbC-DcpdSuhpJVWPfzQ49Ryvi5BWSrotZV9AgX-kB8 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3342b31f8e34d80860be7c1a170c750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3342b31f8e34d80860be7c1a170c750"}]}] Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a3342b31f8e34d80860be7c1a170c750 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2144911839 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: cb175dc0f9af4cc68788cbcf02b8e0bf Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2144911839-project Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1821662037", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 2.5}} Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1821662037', 'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046', 'flavorRef': '452', 'min_count': 2.5}}} Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 2.5 Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:23:58.886222 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eed87444-a2b9-4391-9533-717b38ceaf8f tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:23:58.890728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eed87444-a2b9-4391-9533-717b38ceaf8f tempest-MultipleCreateNegativeTestJSON-2144911839 tempest-MultipleCreateNegativeTestJSON-2144911839-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013721 Oct 22 03:23:58.891833 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2275/4514] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:23:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:23:59.030891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:59.031506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:59.057420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.057950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.058405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.059715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.060466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.070377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.076136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:59.132050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:59.232017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:59.235295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:23:59.244144 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f07dfd67-4e71-435d-8af8-7ad3ee7a95db tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.384266 Oct 22 03:23:59.255442 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2240/4515] 10.222.0.25 () {58 vars in 1212 bytes} [Sat Oct 22 03:23:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:59.257483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:59.259160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:59.264031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:59.264295 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-78f16cf1-6348-47a1-b2b2-425a0308b22e tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e" status: 200 len: 1333 microversion: 2.47 time: 0.236877 Oct 22 03:23:59.276459 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2276/4516] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:59 2022] GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e => generated 1333 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:23:59.286636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:59.286636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:59.288274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:59.298225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.299641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.301906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.302230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.302742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.304997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.306859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.307423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.308147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.308756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.308960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.309533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.463865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:59.490813 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-823f9fc6-ad9d-49ad-b8b6-d9af55a25b5d tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1291 microversion: 2.1 time: 0.223644 Oct 22 03:23:59.493203 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2277/4517] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:59 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1291 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:59.501950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:59.521420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:59.523672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:59.538649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.539435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.540191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.541498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.544834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.545483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.683277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:23:59.837524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:59.868065 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92b6aa75-1ca4-44b3-8c29-926d534171a9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.611175 Oct 22 03:23:59.873795 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2241/4518] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:23:59 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:59.878963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:59.887940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:23:59.896681 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95c9e298-db00-4871-bc99-1de5dfebdd65 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.377174 Oct 22 03:23:59.898095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2278/4519] 10.222.0.25 () {58 vars in 1196 bytes} [Sat Oct 22 03:23:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:23:59.912970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:23:59.915754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.916544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.917208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.918141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.918809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.919457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.926159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:23:59.927291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'name': '1423212621', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:23:59.941135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.942773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.943281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:23:59.944634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:23:59.945279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:23:59.945737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:00.078299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:24:00.221989 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15cd7ebd-6774-477e-86e7-8bfe184f868b tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?name=1423212621" status: 200 len: 346 microversion: 2.1 time: 0.314929 Oct 22 03:24:00.222630 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2279/4520] 10.222.0.25 () {58 vars in 1156 bytes} [Sat Oct 22 03:23:59 2022] GET /compute/v2.1/servers?name=1423212621 => generated 346 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:24:00.236569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:00.241698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:00.242376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:24:00.275084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:00.276177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:00.276673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:00.277644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:00.277960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:00.278373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:00.523576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:00.538336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:00.543169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:00.544503 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-02c395f0-d51c-49d0-b060-faf4287d7bcd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1743 microversion: 2.20 time: 0.669351 Oct 22 03:24:00.549065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2242/4521] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:23:59 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1743 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:00.560712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:00.561902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:00.585975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:00.586527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:00.589668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:00.599538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:00.600353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:00.601068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:00.712301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:24:00.782282 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5bff25ac-b59e-4a3a-b867-781a19f41bac tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.550443 Oct 22 03:24:00.791478 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2280/4522] 10.222.0.25 () {58 vars in 1154 bytes} [Sat Oct 22 03:24:00 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:00.799630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:00.800368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:00.811344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:00.812168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:00.812785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:00.813742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:00.814324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:00.814922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:00.893038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:00.902752 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92bc1df0-544e-4818-aba8-c85f4fa7555a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1309 microversion: 2.1 time: 0.110015 Oct 22 03:24:00.903659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2281/4523] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:00 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:00.927550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:00.934116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:00.934931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-142321262', 'deleted': False, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:24:00.940954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:00.942250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:00.942904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:00.943726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:00.944290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:00.944820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.048240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:24:01.107568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:01.122865 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b9a87f2-14f0-418f-a127-d078dff36fe7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-142321262" status: 200 len: 346 microversion: 2.1 time: 0.202731 Oct 22 03:24:01.123020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:01.123114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:01.124262 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e389e7a2-d17b-4572-bf60-aab0f72ad5f7 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e" status: 200 len: 1339 microversion: 2.47 time: 0.573887 Oct 22 03:24:01.136763 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2282/4524] 10.222.0.25 () {58 vars in 1228 bytes} [Sat Oct 22 03:24:00 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-142321262 => generated 346 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:01.136955 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2243/4525] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:00 2022] GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e => generated 1339 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:01.140955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:01.147363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:01.154769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:01.157453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:01.163145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.163650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.164100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.164838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.165294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.165727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.167443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.168072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.168567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.169520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.170054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.170618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.221989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:24:01.436177 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a768d9c9-35bb-48b5-9d56-eaa7022203c9 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 204 len: 0 microversion: 2.1 time: 0.303941 Oct 22 03:24:01.438971 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2244/4526] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:24:01 2022] DELETE /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:24:01.458848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b7ff1e07-3905-42bd-95ae-26329ef04aab req-3c845d1c-47e3-468c-9034-eaa2e786bc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d2acf4-a7dd-46af-ae59-83a28eccaa4f", "name": "network-vif-plugged", "status": "completed", "tag": "01c4850c-25d7-4312-836a-b864a1ef4bed"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:01.460016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:01.471971 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6813e331-594d-4fae-8689-a30b900e7ea9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.341108 Oct 22 03:24:01.473503 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2283/4527] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:01 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:01.483640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:01.484471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:01.497423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b7ff1e07-3905-42bd-95ae-26329ef04aab req-3c845d1c-47e3-468c-9034-eaa2e786bc93 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.498727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b7ff1e07-3905-42bd-95ae-26329ef04aab req-3c845d1c-47e3-468c-9034-eaa2e786bc93 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.499409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b7ff1e07-3905-42bd-95ae-26329ef04aab req-3c845d1c-47e3-468c-9034-eaa2e786bc93 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.517942 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b7ff1e07-3905-42bd-95ae-26329ef04aab req-3c845d1c-47e3-468c-9034-eaa2e786bc93 service nova] Creating event network-vif-plugged:01c4850c-25d7-4312-836a-b864a1ef4bed for instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f on n-h2-862416-2 Oct 22 03:24:01.527683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.530248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.530855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.532002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.532683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.533685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.537169 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b7ff1e07-3905-42bd-95ae-26329ef04aab req-3c845d1c-47e3-468c-9034-eaa2e786bc93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090820 Oct 22 03:24:01.537846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2245/4528] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:01.582343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:01.583043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:01.607867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.608842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.609488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.610412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.611063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.611702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.735062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:01.746873 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efbdfa52-366e-41b1-87af-2dc13bed35a7 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1517 microversion: 2.1 time: 0.271818 Oct 22 03:24:01.748682 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2284/4529] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:01 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1517 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:01.935997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:01.940916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:01.951292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:01.958519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.960697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.961533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.961987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:01.962620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:01.963563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:01.964807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:01.966480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:01.972309 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f43c2a9-9017-4f77-ab35-964cbda69c07 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1743 microversion: 2.20 time: 0.393738 Oct 22 03:24:01.972309 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2246/4530] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:01 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1743 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:02.050225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:02.076326 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34fa3dd0-b8d4-446d-8762-f61b3cbe6e7f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1297 microversion: 2.1 time: 0.148639 Oct 22 03:24:02.077581 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2285/4531] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:01 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1297 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:02.153444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:02.154354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:02.162914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.163925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.165297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.166234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.166837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.167409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.301065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:02.336515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:02.342419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:02.343669 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ba45992-9955-47ef-a243-5e1226a82062 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e" status: 200 len: 1360 microversion: 2.47 time: 0.194230 Oct 22 03:24:02.344272 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2247/4532] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:02 2022] GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:02.376678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1505496601"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:02.381640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:02.402274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.404309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.406411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.407526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.408847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.411953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.498069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:02.498980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:02.513239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.514674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.517026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.517986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.518636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.521210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.826820 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-70f77ff7-ca53-4750-a314-4ae8303dc271 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "POST /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e/action" status: 202 len: 52 microversion: 2.47 time: 0.455110 Oct 22 03:24:02.828076 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2286/4533] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:24:02 2022] POST /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e/action => generated 52 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 22 03:24:02.860749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:02.866719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:02.884948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.887958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.889617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.891557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.895184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.895940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.918577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:02.935228 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19ff5701-5cc0-4fd6-bfc8-fb4a302ada2d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.439120 Oct 22 03:24:02.937220 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2248/4534] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:02 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:02.949827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:02.950951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:02.992657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:02.996329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:02.997020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:02.998179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:03.001044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:03.003730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:03.094695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:24:03.228702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:03.243368 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8ff2f888-9af7-418b-99a2-f9e25435b0f0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1517 microversion: 2.1 time: 0.394623 Oct 22 03:24:03.247291 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2287/4535] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:02 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1517 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:03.259706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:03.260587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:03.277823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:03.281327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:03.282088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:03.287188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:03.288298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:03.294970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:03.348771 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-621b60f4-ecc6-45a4-9782-c1cdebe94d51 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "DELETE /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e" status: 204 len: 0 microversion: 2.47 time: 0.401573 Oct 22 03:24:03.349789 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2249/4536] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:24:02 2022] DELETE /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:24:03.366885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:03.367600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:03.384689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:03.384689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:03.384689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:03.420301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:03.420804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:03.421259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:04.255550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:04.284578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:04.290497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:04.299076 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ec484b9-4ef2-4460-84fd-5347d0968733 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1743 microversion: 2.20 time: 1.047548 Oct 22 03:24:04.304451 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2288/4537] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:03 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1743 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:04.318589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:04.327040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:04.343373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:04.343873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:04.344360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:04.345084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:04.345542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:04.345970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:04.540018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:04.550043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:04.570003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:04.571246 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-db05d07a-fdb0-48f1-9d05-f5a347fbab6d tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e" status: 200 len: 1366 microversion: 2.47 time: 0.265241 Oct 22 03:24:04.584653 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2289/4538] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:04 2022] GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:04.596319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:04.596952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:04.604579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:04.605316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:04.605763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:04.606500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:04.607131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:04.607565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:04.800194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:04.820846 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13d2632f-9889-4dde-8445-5b330f2c5ee8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1364 microversion: 2.1 time: 1.469453 Oct 22 03:24:04.822418 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2250/4539] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:03 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1364 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:04.830885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:04.831499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:04.839782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:04.841133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:04.841805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:04.842662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:04.843267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:04.843835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:05.015900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:05.022990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:05.026412 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-66c732a2-1448-4bb4-9c8b-d4c47e1655ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.440641 Oct 22 03:24:05.033555 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2290/4540] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:04 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:05.073519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:05.082439 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd2f8d62-ad7e-4363-b9c7-c69cadb74e98 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 200 len: 1517 microversion: 2.1 time: 0.258202 Oct 22 03:24:05.082990 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2251/4541] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:04 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:05.091993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-74347900-06cb-442e-b8c1-293737a1a5bd tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d1e5a0310>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:05.220097 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-74347900-06cb-442e-b8c1-293737a1a5bd tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ee1f0794-c3df-4539-a04e-a431894ea566" status: 200 len: 348 microversion: 2.1 time: 0.136042 Oct 22 03:24:05.222023 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2252/4542] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:24:05 2022] GET /compute/v2.1/os-volumes/ee1f0794-c3df-4539-a04e-a431894ea566 => generated 348 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:05.328467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:05.329094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:05.342898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:05.344635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-997035993", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": "none"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:05.351855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:05.354881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:05.364504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:05.372880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:05.373592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:05.500271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:24:05.504253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:24:05.507071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:24:05.507687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:24:05.516550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:24:05.534074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:05.535291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:05.536337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:05.537613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:05.537896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:05.541774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:05.583339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=23 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:05.630243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Getting quotas for project 6ed1af3343a448ca9ce29caaeff286c6. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:05.650853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Getting quotas for user 1a31354f34dc49c8a251fb4921bf18ef and project 6ed1af3343a448ca9ce29caaeff286c6. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:05.692783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:24:05.708528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:24:05.896660 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9214248e-76a7-4160-91c2-596226255d44 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.858242 Oct 22 03:24:05.904770 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2291/4543] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:24:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:24:05.931500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:05.934388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:05.983460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:05.984326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:05.985390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:05.987266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:05.987942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:05.989271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:06.319333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.330460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.339631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c72a887b1ed4aa0867834238a080b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04a7b6539774a3fb90f0a3f7f9c0ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.342044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47b065bc-348e-40e8-b819-8a12f30cb7e8 tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e" status: 200 len: 1366 microversion: 2.47 time: 0.432818 Oct 22 03:24:06.366385 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2292/4544] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:05 2022] GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:06.376131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:06.377938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:06.386870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:06.387665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:06.388421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:06.389362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:06.390000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:06.390608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:06.499042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.514813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.517476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.524422 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d1e6d6bd-1bbc-4204-94d8-030c17d69a6b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 1.201852 Oct 22 03:24:06.526088 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2253/4545] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:05 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:06.540824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-304fc88c-af01-4f94-8f21-6471f25ca5df req-841778d0-d733-4117-9881-a2fe4a6ba75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5504fb6-a051-4033-bd18-3fbfd2857ab3", "name": "network-vif-deleted", "tag": "7a351819-bbcd-4346-a745-38dbb9d18497"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:06.559498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-304fc88c-af01-4f94-8f21-6471f25ca5df req-841778d0-d733-4117-9881-a2fe4a6ba75f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:06.560772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-304fc88c-af01-4f94-8f21-6471f25ca5df req-841778d0-d733-4117-9881-a2fe4a6ba75f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:06.566063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-304fc88c-af01-4f94-8f21-6471f25ca5df req-841778d0-d733-4117-9881-a2fe4a6ba75f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:06.596868 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-304fc88c-af01-4f94-8f21-6471f25ca5df req-841778d0-d733-4117-9881-a2fe4a6ba75f service nova] Creating event network-vif-deleted:7a351819-bbcd-4346-a745-38dbb9d18497 for instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 on n-h2-862416-2 Oct 22 03:24:06.610231 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-304fc88c-af01-4f94-8f21-6471f25ca5df req-841778d0-d733-4117-9881-a2fe4a6ba75f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082725 Oct 22 03:24:06.617003 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2254/4546] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:06.623709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b5541e7-4421-4ccf-b9de-91b08bbac46b tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:06.628634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6b5541e7-4421-4ccf-b9de-91b08bbac46b tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:06.786696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6b5541e7-4421-4ccf-b9de-91b08bbac46b tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.807067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6b5541e7-4421-4ccf-b9de-91b08bbac46b tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.810670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6b5541e7-4421-4ccf-b9de-91b08bbac46b tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:06.814816 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6b5541e7-4421-4ccf-b9de-91b08bbac46b tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 200 len: 1277 microversion: 2.47 time: 0.193284 Oct 22 03:24:06.816009 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2255/4547] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:06 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:06.829379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:06.838151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:06.873779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:06.892174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:06.897272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:06.900476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:06.908710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:06.909241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:07.485487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:07.506697 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eafe5da3-b3f7-4b32-a447-4190fc0aac73 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1364 microversion: 2.1 time: 1.138383 Oct 22 03:24:07.528637 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2293/4548] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:06 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1364 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:07.555683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:07.557877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: e5504fb6-a051-4033-bd18-3fbfd2857ab3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:07.576736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:07.578988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:07.580137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:07.582751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:07.583680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:07.584338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:07.622130 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] HTTP exception thrown: Instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 could not be found. Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Request method failure captured: Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 HTTP/1.1 Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IPU8oE7z5Fv37SNwvIIVMTPnVJhPzjv2GCMq1IdFNXkMA-JMRDTpYf6eRUKDIk_aGAP9P-wRZWMFFnM89nko8C7-pF7oXXI3N2mBxGIkGkFIsedqgbM8FKg0jlmwSf0Ycydjb54p-8TRZKzNYKg14XCk_FgxA4nLeYdCCTyA0nHoE Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a8fafd6eb6c4ed99ea6584eaa795c8c Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}] Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a8fafd6eb6c4ed99ea6584eaa795c8c Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListServerFiltersTestJSON-402942885-project Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3e822e3631634aa083e0996b7d99737c Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListServerFiltersTestJSON-402942885-project Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 could not be found. Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e5504fb6-a051-4033-bd18-3fbfd2857ab3'} Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 could not be found. Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 could not be found. Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:07.623921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 could not be found. Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Returning 404 to user: Instance e5504fb6-a051-4033-bd18-3fbfd2857ab3 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:24:07.627611 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5668ddef-449f-4e27-8195-7c55ad4f9ad4 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3" status: 404 len: 111 microversion: 2.1 time: 0.095439 Oct 22 03:24:07.628134 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2294/4549] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:07 2022] GET /compute/v2.1/servers/e5504fb6-a051-4033-bd18-3fbfd2857ab3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:24:07.659365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-903094051", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": "none"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:07.786275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:24:07.786705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:24:07.787184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:24:07.787594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:24:07.788009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:24:07.829738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:07.830305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:07.839590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:07.842730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:07.843300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:07.843850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:07.921124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Getting quotas for project 6ed1af3343a448ca9ce29caaeff286c6. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:07.923575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:07.927597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Getting quotas for user 1a31354f34dc49c8a251fb4921bf18ef and project 6ed1af3343a448ca9ce29caaeff286c6. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:07.954146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:07.975513 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ddd1ba8-b3ad-438a-bb43-73e061c3cdcf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 1.154624 Oct 22 03:24:07.998328 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2256/4550] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:06 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:08.019871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-3125de0a-bd81-4a12-bdc2-a2b083e64c5f req-cc7ff595-7525-4153-830b-9af8546ad536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfd6354-0b31-4bcf-8abb-a408e84093d8", "tag": "60dbd2f2-720d-4a18-adf1-f5dd30000fce"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:08.068184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:24:08.079577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:24:08.089049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3125de0a-bd81-4a12-bdc2-a2b083e64c5f req-cc7ff595-7525-4153-830b-9af8546ad536 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:08.096621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3125de0a-bd81-4a12-bdc2-a2b083e64c5f req-cc7ff595-7525-4153-830b-9af8546ad536 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:08.119338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3125de0a-bd81-4a12-bdc2-a2b083e64c5f req-cc7ff595-7525-4153-830b-9af8546ad536 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:08.162028 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-3125de0a-bd81-4a12-bdc2-a2b083e64c5f req-cc7ff595-7525-4153-830b-9af8546ad536 service nova] Creating event network-changed:60dbd2f2-720d-4a18-adf1-f5dd30000fce for instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 on n-h1-862416-2 Oct 22 03:24:08.169015 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-3125de0a-bd81-4a12-bdc2-a2b083e64c5f req-cc7ff595-7525-4153-830b-9af8546ad536 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168863 Oct 22 03:24:08.170242 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2257/4551] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:08.177791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:08.179108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] [instance: 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:08.187186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:08.187891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:08.188543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:08.189851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:08.190541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:08.191819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:08.200666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:08.217758 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] HTTP exception thrown: Instance 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e could not be found. Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Request method failure captured: Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e HTTP/1.1 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JMP7RtmESYKNe4MYBxCNDRnUvt2sNg7DnxsPyK8aP7RJVqAInj_bnW7MsNC9S8nkIyu4_2LxGCFwBdCkKUWqCJ8_Nn0usTr9Sb5iA3gxLGw00zWog7DSSI-Y9zBs3U16A8EfAQrX2yeT9RFJ-QlD1KHFj456C2YFKUiN4amj1PTf8 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.47 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c04a7b6539774a3fb90f0a3f7f9c0ef4 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersAaction247Test-1901814171 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c04a7b6539774a3fb90f0a3f7f9c0ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c04a7b6539774a3fb90f0a3f7f9c0ef4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c04a7b6539774a3fb90f0a3f7f9c0ef4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c04a7b6539774a3fb90f0a3f7f9c0ef4"}]}] Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersAaction247Test-1901814171 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c04a7b6539774a3fb90f0a3f7f9c0ef4 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersAaction247Test-1901814171 Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersAaction247Test-1901814171-project Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4c72a887b1ed4aa0867834238a080b6a Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersAaction247Test-1901814171-project Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e could not be found. Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '63338e6c-c7e7-4ce2-af73-2a03bf8ee33e'} Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e could not be found. Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e could not be found. Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:08.220661 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:08.225605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:08.225605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:08.225605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:08.225605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:08.225605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:24:08.225605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:24:08.225605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e could not be found. Oct 22 03:24:08.225605 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:08.227309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] Returning 404 to user: Instance 63338e6c-c7e7-4ce2-af73-2a03bf8ee33e could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:24:08.228434 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-848fed10-600b-4d48-b5e9-f729eae062fd tempest-ServersAaction247Test-1901814171 tempest-ServersAaction247Test-1901814171-project] 10.222.0.25 "GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e" status: 404 len: 111 microversion: 2.47 time: 0.056617 Oct 22 03:24:08.229993 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2258/4552] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:08 2022] GET /compute/v2.1/servers/63338e6c-c7e7-4ce2-af73-2a03bf8ee33e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:24:08.246735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:08.247861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:08.260425 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1462b1b4-7e07-4fea-bbf0-1b9dacb546d6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.621917 Oct 22 03:24:08.271225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2295/4553] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:24:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:24:08.272864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:08.276810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:08.280802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:08.281780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:08.285271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:08.285949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:08.292004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:08.302439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:08.359591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:08.360670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:08.364735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:08.374625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:08.375708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:08.379608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:08.574304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:24:08.973629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:08.979237 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfcf6470-28a5-4fae-b6c4-d3b89544ff8d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "DELETE /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 204 len: 0 microversion: 2.1 time: 0.704472 Oct 22 03:24:08.988652 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2296/4554] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:24:08 2022] DELETE /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 0 bytes in 717 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:24:09.021885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dffd1239-2c73-4eec-9318-63a22db0f063 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:09.038203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dffd1239-2c73-4eec-9318-63a22db0f063 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:09.241423 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dffd1239-2c73-4eec-9318-63a22db0f063 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "PUT /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 991 microversion: 2.47 time: 0.251290 Oct 22 03:24:09.245905 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2297/4555] 10.222.0.25 () {62 vars in 1297 bytes} [Sat Oct 22 03:24:08 2022] PUT /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 991 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:24:09.252788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.268511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:09.270157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:09.271026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.276244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.281543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4fcf2f6a-f29b-42ec-9cd0-79bff38fadc2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 1.049939 Oct 22 03:24:09.284849 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2259/4556] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:08 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:09.296543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:09.302166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:09.306762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:09.307545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:09.308154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:09.309077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:09.309698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:09.310292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:09.311337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:09.314047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:09.314764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:09.317660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:09.320406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:09.320926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:09.623171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.633408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.634454 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-09bcd73b-50d5-4217-8fb4-147874729a29 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 200 len: 1518 microversion: 2.1 time: 0.346563 Oct 22 03:24:09.636827 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2260/4557] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:09 2022] GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 1518 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:09.641972 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e8070f4-8e6f-494d-bc01-cde7519064f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1364 microversion: 2.1 time: 0.378796 Oct 22 03:24:09.642569 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2298/4558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:09 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1364 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:09.656099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:09.657151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:09.669926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:09.670804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:09.670926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:09.671490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:09.671972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:09.672821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:09.680284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:09.681071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:09.686740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:09.687872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:09.687872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:09.694308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:09.694821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:09.695276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:09.877039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.886692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.892039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.894908 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28364c1a-b780-45d6-b5c8-ca615c00f20d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1281 microversion: 2.47 time: 0.231250 Oct 22 03:24:09.897745 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2299/4559] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:09 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:09.903013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8d4d744-0dc5-4123-ae84-4b607a31f6d5 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d1a4ce430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:09.914152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:09.924800 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4dfeacc5-dcad-4468-b800-e67a1a220049 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.281039 Oct 22 03:24:09.938290 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2261/4560] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:09 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:10.010829 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8d4d744-0dc5-4123-ae84-4b607a31f6d5 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed6d2685-87aa-43f9-b8ca-6b0d9fb3730c" status: 200 len: 351 microversion: 2.1 time: 0.111716 Oct 22 03:24:10.011643 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2300/4561] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:24:09 2022] GET /compute/v2.1/os-volumes/ed6d2685-87aa-43f9-b8ca-6b0d9fb3730c => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:10.250909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1cba249d-95aa-405f-af5d-2a9eb809f849 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Calling method '.version_select at 0x7f0d1a45ab80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:10.310184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:10.310862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:10.321318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:10.321836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:10.322294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:10.332143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:10.333171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:10.333844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:10.384939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-1cba249d-95aa-405f-af5d-2a9eb809f849 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6e253b3-c1a2-4242-a529-a52418fdae66 does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:24:10.385886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-1cba249d-95aa-405f-af5d-2a9eb809f849 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Neutron security group c6e253b3-c1a2-4242-a529-a52418fdae66 not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:24:10.386657 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1cba249d-95aa-405f-af5d-2a9eb809f849 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] HTTP exception thrown: Security group c6e253b3-c1a2-4242-a529-a52418fdae66 does not exist Oct 22 03:24:10.386657 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-93512842-86c8-4f8a-a57b-62cd75deac85'] Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1cba249d-95aa-405f-af5d-2a9eb809f849 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Request method failure captured: Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-security-groups/c6e253b3-c1a2-4242-a529-a52418fdae66 HTTP/1.1 Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JZ9YwqV69guZfIJBWmsuOYqmW1UfAr60uOQ_nFviRQiSpKGOtq4E96G5qrwQvUOvjOs3L0sRowsYluwLOHUtHOwx_8V-a2cJSxOCzsJRPmAK9Y2ntGDpP-CPsWvo9syiRrUZL15nNtFhf8mf30Ntej9P9eVM9Pp89HAXG5bmYwa-A Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a8d83f238c094234b9f6b88717fedaed Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d83f238c094234b9f6b88717fedaed"}]}] Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a8d83f238c094234b9f6b88717fedaed Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsNegativeTestJSON-1904941475-project Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 142d3eb7724341e186720a0900a84bda Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475-project Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group c6e253b3-c1a2-4242-a529-a52418fdae66 does not exist Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-93512842-86c8-4f8a-a57b-62cd75deac85'] Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'c6e253b3-c1a2-4242-a529-a52418fdae66'} Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:24:10.389651 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6e253b3-c1a2-4242-a529-a52418fdae66 does not exist Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93512842-86c8-4f8a-a57b-62cd75deac85'] Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6e253b3-c1a2-4242-a529-a52418fdae66 does not exist Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93512842-86c8-4f8a-a57b-62cd75deac85'] Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6e253b3-c1a2-4242-a529-a52418fdae66 does not exist Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93512842-86c8-4f8a-a57b-62cd75deac85'] Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6e253b3-c1a2-4242-a529-a52418fdae66 does not exist Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93512842-86c8-4f8a-a57b-62cd75deac85'] Oct 22 03:24:10.394068 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:10.402756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1cba249d-95aa-405f-af5d-2a9eb809f849 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Returning 404 to user: Security group c6e253b3-c1a2-4242-a529-a52418fdae66 does not exist Oct 22 03:24:10.402756 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-93512842-86c8-4f8a-a57b-62cd75deac85'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:24:10.403963 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1cba249d-95aa-405f-af5d-2a9eb809f849 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c6e253b3-c1a2-4242-a529-a52418fdae66" status: 404 len: 194 microversion: 2.1 time: 0.463772 Oct 22 03:24:10.404794 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2262/4562] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:24:09 2022] DELETE /compute/v2.1/os-security-groups/c6e253b3-c1a2-4242-a529-a52418fdae66 => generated 194 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:24:10.416854 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-961baa7e-f4a8-4ba3-91a0-b28000b48d04 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005399 Oct 22 03:24:10.418125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2263/4563] 10.222.0.25 () {58 vars in 1164 bytes} [Sat Oct 22 03:24:10 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 03:24:10.445645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19917189-145e-49e9-a5e2-a10904b1c4e2 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Calling method '.version_select at 0x7f0d1e53df70>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:10.793925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:10.806634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:10.808540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:10.809947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b6be9b2-81e9-4aef-bf53-5d4e15c5427b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.503908 Oct 22 03:24:10.811785 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2301/4564] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:10 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:10.819113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:10.820052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:10.827359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:10.828105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:10.828810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:10.829844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:10.831183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:10.832674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:11.080993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:11.102159 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-284fbf8b-b71c-476a-92a3-88761d20cc01 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 200 len: 1518 microversion: 2.1 time: 0.288516 Oct 22 03:24:11.103256 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2302/4565] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:10 2022] GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 1518 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:11.124613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:11.125483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:11.140331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:11.143229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:11.143960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:11.147632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:11.153590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:11.154934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:11.210512 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19917189-145e-49e9-a5e2-a10904b1c4e2 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.786809 Oct 22 03:24:11.216660 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2264/4566] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 03:24:10 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:11.224157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:11.224953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:11.232744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:11.234471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:11.235264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:11.237103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:11.238980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:11.239749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:11.401565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:11.431066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:11.433763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:11.436025 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9cd161f-a78d-451b-b4a5-e82e8b7561ba tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1329 microversion: 2.47 time: 0.218252 Oct 22 03:24:11.441152 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2265/4567] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:11 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1329 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:11.451641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:11.452810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:11.473688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:11.475059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:11.476769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:11.478447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:11.479440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:11.483753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:11.539090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:11.562270 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5a96e6f-0ceb-4415-95d6-fa3e170e7192 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1364 microversion: 2.1 time: 0.454971 Oct 22 03:24:11.564879 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2303/4568] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:11 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1364 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:11.583000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2eb9018-b250-408a-bfac-404ff59efa7c tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Calling method '.version_select at 0x7f0d1a291f70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:11.781626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-e2eb9018-b250-408a-bfac-404ff59efa7c tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:24:11.782530 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e2eb9018-b250-408a-bfac-404ff59efa7c tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 22 03:24:11.782530 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-8baa8b1a-8ecd-410a-952a-f5df0bdee627'] Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2eb9018-b250-408a-bfac-404ff59efa7c tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Request method failure captured: Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-security-groups/347b110a-99a9-4fd1-b6da-6b388a375187 HTTP/1.1 Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JZ9YwqV69guZfIJBWmsuOYqmW1UfAr60uOQ_nFviRQiSpKGOtq4E96G5qrwQvUOvjOs3L0sRowsYluwLOHUtHOwx_8V-a2cJSxOCzsJRPmAK9Y2ntGDpP-CPsWvo9syiRrUZL15nNtFhf8mf30Ntej9P9eVM9Pp89HAXG5bmYwa-A Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a8d83f238c094234b9f6b88717fedaed Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d83f238c094234b9f6b88717fedaed"}]}] Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a8d83f238c094234b9f6b88717fedaed Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupsNegativeTestJSON-1904941475-project Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 142d3eb7724341e186720a0900a84bda Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475-project Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: exception: Insufficient rights for removing default security group. Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-8baa8b1a-8ecd-410a-952a-f5df0bdee627'] Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '347b110a-99a9-4fd1-b6da-6b388a375187'} Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:24:11.785452 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8baa8b1a-8ecd-410a-952a-f5df0bdee627'] Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8baa8b1a-8ecd-410a-952a-f5df0bdee627'] Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8baa8b1a-8ecd-410a-952a-f5df0bdee627'] Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8baa8b1a-8ecd-410a-952a-f5df0bdee627'] Oct 22 03:24:11.789379 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.793059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2eb9018-b250-408a-bfac-404ff59efa7c tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 22 03:24:11.793059 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-8baa8b1a-8ecd-410a-952a-f5df0bdee627'] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:24:11.795042 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e2eb9018-b250-408a-bfac-404ff59efa7c tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/347b110a-99a9-4fd1-b6da-6b388a375187" status: 400 len: 182 microversion: 2.1 time: 0.228305 Oct 22 03:24:11.796776 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2304/4569] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:24:11 2022] DELETE /compute/v2.1/os-security-groups/347b110a-99a9-4fd1-b6da-6b388a375187 => generated 182 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:24:11.810907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f673d4b2-96c7-412d-bcdc-c3a87a7ccd37 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Calling method '.version_select at 0x7f0d1a4ceee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:11.855637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:11.856855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG neutronclient.v2_0.client [None req-f673d4b2-96c7-412d-bcdc-c3a87a7ccd37 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 does not exist", "detail": ""}} {{(pid=120581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:24:11.857749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.security_group_api [None req-f673d4b2-96c7-412d-bcdc-c3a87a7ccd37 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Neutron security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 not found {{(pid=120581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:24:11.858649 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f673d4b2-96c7-412d-bcdc-c3a87a7ccd37 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] HTTP exception thrown: Security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 does not exist Oct 22 03:24:11.858649 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-4c6e2bfa-b8e1-4b76-88d1-139571094b71'] Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f673d4b2-96c7-412d-bcdc-c3a87a7ccd37 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Request method failure captured: Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-security-groups/d81d55a5-284c-4b8c-9a11-5950ffd3add0 HTTP/1.1 Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JZ9YwqV69guZfIJBWmsuOYqmW1UfAr60uOQ_nFviRQiSpKGOtq4E96G5qrwQvUOvjOs3L0sRowsYluwLOHUtHOwx_8V-a2cJSxOCzsJRPmAK9Y2ntGDpP-CPsWvo9syiRrUZL15nNtFhf8mf30Ntej9P9eVM9Pp89HAXG5bmYwa-A Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a8d83f238c094234b9f6b88717fedaed Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d83f238c094234b9f6b88717fedaed"}]}] Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a8d83f238c094234b9f6b88717fedaed Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-SecurityGroupsNegativeTestJSON-1904941475-project Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 142d3eb7724341e186720a0900a84bda Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475-project Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: exception: Security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 does not exist Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-4c6e2bfa-b8e1-4b76-88d1-139571094b71'] Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd81d55a5-284c-4b8c-9a11-5950ffd3add0'} Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:24:11.860748 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 does not exist Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c6e2bfa-b8e1-4b76-88d1-139571094b71'] Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 does not exist Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c6e2bfa-b8e1-4b76-88d1-139571094b71'] Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 does not exist Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c6e2bfa-b8e1-4b76-88d1-139571094b71'] Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 does not exist Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c6e2bfa-b8e1-4b76-88d1-139571094b71'] Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f673d4b2-96c7-412d-bcdc-c3a87a7ccd37 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Returning 404 to user: Security group d81d55a5-284c-4b8c-9a11-5950ffd3add0 does not exist Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: Neutron server returns request_ids: ['req-4c6e2bfa-b8e1-4b76-88d1-139571094b71'] {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:24:11.865687 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f673d4b2-96c7-412d-bcdc-c3a87a7ccd37 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/d81d55a5-284c-4b8c-9a11-5950ffd3add0" status: 404 len: 194 microversion: 2.1 time: 0.057746 Oct 22 03:24:11.876311 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2305/4570] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:24:11 2022] GET /compute/v2.1/os-security-groups/d81d55a5-284c-4b8c-9a11-5950ffd3add0 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:24:11.878594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:11.879735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:11.887841 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a4ea2bb-a10c-4344-93a5-9d2b26cbf6ac tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.442376 Oct 22 03:24:11.896366 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2266/4571] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:11 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:11.904957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-790bb305-e04c-4c09-84d1-8cef379b84f1 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Action: 'update', calling method: .version_select at 0x7f0d19af6820>, body: {"security_group": {"name": "tempest-sg-1465666673", "description": "tempest-description-1888526486"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:11.918204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:11.919003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:11.924791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:11.926356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:11.926857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:11.929435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:12.046707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG neutronclient.v2_0.client [None req-790bb305-e04c-4c09-84d1-8cef379b84f1 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db does not exist", "detail": ""}} {{(pid=120582) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 22 03:24:12.047689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.security_group_api [None req-790bb305-e04c-4c09-84d1-8cef379b84f1 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Neutron security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db not found {{(pid=120582) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 22 03:24:12.048656 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-790bb305-e04c-4c09-84d1-8cef379b84f1 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] HTTP exception thrown: Security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db does not exist Oct 22 03:24:12.048656 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-23c6e657-7149-48e1-b195-523cd95b9dcd'] Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-790bb305-e04c-4c09-84d1-8cef379b84f1 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Request method failure captured: Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/os-security-groups/4919a1fe-d13e-4be1-8877-4aa3bbb020db HTTP/1.1 Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 102 Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JZ9YwqV69guZfIJBWmsuOYqmW1UfAr60uOQ_nFviRQiSpKGOtq4E96G5qrwQvUOvjOs3L0sRowsYluwLOHUtHOwx_8V-a2cJSxOCzsJRPmAK9Y2ntGDpP-CPsWvo9syiRrUZL15nNtFhf8mf30Ntej9P9eVM9Pp89HAXG5bmYwa-A Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a8d83f238c094234b9f6b88717fedaed Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d83f238c094234b9f6b88717fedaed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d83f238c094234b9f6b88717fedaed"}]}] Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a8d83f238c094234b9f6b88717fedaed Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475 Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-SecurityGroupsNegativeTestJSON-1904941475-project Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 142d3eb7724341e186720a0900a84bda Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1904941475-project Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: {"security_group": {"name": "tempest-sg-1465666673", "description": "tempest-description-1888526486"}} Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: exception: Security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db does not exist Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-23c6e657-7149-48e1-b195-523cd95b9dcd'] Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '4919a1fe-d13e-4be1-8877-4aa3bbb020db', 'body': {'security_group': {'name': 'tempest-sg-1465666673', 'description': 'tempest-description-1888526486'}}} Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 22 03:24:12.052227 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db does not exist Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23c6e657-7149-48e1-b195-523cd95b9dcd'] Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db does not exist Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23c6e657-7149-48e1-b195-523cd95b9dcd'] Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db does not exist Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23c6e657-7149-48e1-b195-523cd95b9dcd'] Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db does not exist Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23c6e657-7149-48e1-b195-523cd95b9dcd'] Oct 22 03:24:12.055759 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:24:12.059119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-790bb305-e04c-4c09-84d1-8cef379b84f1 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] Returning 404 to user: Security group 4919a1fe-d13e-4be1-8877-4aa3bbb020db does not exist Oct 22 03:24:12.059119 n-d-862416-2 devstack@n-api.service[120582]: Neutron server returns request_ids: ['req-23c6e657-7149-48e1-b195-523cd95b9dcd'] {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:24:12.061197 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-790bb305-e04c-4c09-84d1-8cef379b84f1 tempest-SecurityGroupsNegativeTestJSON-1904941475 tempest-SecurityGroupsNegativeTestJSON-1904941475-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/4919a1fe-d13e-4be1-8877-4aa3bbb020db" status: 404 len: 194 microversion: 2.1 time: 0.162103 Oct 22 03:24:12.062436 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2267/4572] 10.222.0.25 () {60 vars in 1290 bytes} [Sat Oct 22 03:24:11 2022] PUT /compute/v2.1/os-security-groups/4919a1fe-d13e-4be1-8877-4aa3bbb020db => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:24:12.127826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:12.130619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:12.152506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:12.154642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:12.158432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:12.166290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:12.167610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:12.168820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:12.322523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:12.336328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:12.338247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:12.339906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-70260dc3-9e94-4785-afcb-4006401901dc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.471004 Oct 22 03:24:12.340972 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2306/4573] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:11 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:12.473816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:12.475593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:12.486561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:12.489280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:12.491609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:12.492640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:12.508430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:12.511815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:12.678826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:12.692870 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7036871a-6ca1-43d4-94e7-388043257902 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 200 len: 1518 microversion: 2.1 time: 0.569867 Oct 22 03:24:12.694446 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2268/4574] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:12 2022] GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 1518 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:12.711703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:12.712725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:12.715432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:12.726542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:12.729221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:12.729839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:12.731764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:12.734382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:12.734537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:12.735034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:12.747593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:12.753343 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f55274aa-f054-4be1-95eb-23a7bd82d727 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1335 microversion: 2.47 time: 0.282615 Oct 22 03:24:12.756337 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2307/4575] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:12 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1335 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:12.917786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:12.950839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:12.992194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:12.992836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:12.993301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:13.000503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:13.000987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:13.001460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:13.367227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:13.378054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3a4acd3-0e89-4961-ac2c-3a50ce3f20f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1511 microversion: 2.1 time: 0.468317 Oct 22 03:24:13.384494 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2308/4576] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:12 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:13.395878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:13.409588 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb6db205-a2e1-49ad-9b31-1d08871778b0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1364 microversion: 2.1 time: 0.713772 Oct 22 03:24:13.410986 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2269/4577] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:12 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1364 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:13.413974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:13.414863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:13.421577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:13.422246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:13.422858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:13.423994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:13.424796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:13.425525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:13.674516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:13.697032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:13.699341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:13.707699 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bf76a989-bf36-447d-9c71-74c6215cd37d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.305141 Oct 22 03:24:13.709927 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2309/4578] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:13 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:13.745721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:13.746498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:13.767774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:13.768317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:13.768769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:13.774201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:13.774719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:13.775174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:13.783083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:13.783798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:13.792958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:13.795454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:13.796260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:13.797127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:13.815302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:13.824841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:14.054548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:14.076854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:14.082971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:14.090530 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16e56380-fc44-4afe-b82a-66a9a0f369c9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1335 microversion: 2.47 time: 0.311444 Oct 22 03:24:14.093877 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2310/4579] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:13 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1335 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:14.106886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b704893-6079-474e-a5c4-e20a32674e46 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d19772040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:14.270866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b704893-6079-474e-a5c4-e20a32674e46 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1f25bcd0-4df9-4fc9-98a4-07338bf0b446" status: 200 len: 349 microversion: 2.1 time: 0.175613 Oct 22 03:24:14.271499 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2311/4580] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:24:14 2022] GET /compute/v2.1/os-volumes/1f25bcd0-4df9-4fc9-98a4-07338bf0b446 => generated 349 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:14.288664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69815e71-c610-4e90-a2bd-49dacce53e98 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d1afb9820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:14.442164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:14.461921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-70e0ad4e-aa72-4ced-9ee0-a3af93216ad8 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 200 len: 1518 microversion: 2.1 time: 0.731373 Oct 22 03:24:14.465746 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2270/4581] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:13 2022] GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 1518 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:14.485500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:14.489968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:14.503885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:14.504963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:14.505565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:14.506630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:14.507374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:14.508198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:14.619225 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69815e71-c610-4e90-a2bd-49dacce53e98 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.336699 Oct 22 03:24:14.620149 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2312/4582] 10.222.0.25 () {58 vars in 1134 bytes} [Sat Oct 22 03:24:14 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:14.629532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:14.630488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:14.655830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:14.660840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:14.662228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:14.663007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:14.666015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:14.671168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:15.161390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:15.163748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:15.220491 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1bbedc5d-817b-4e12-bfbd-2e8c41ac423b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1364 microversion: 2.1 time: 0.596848 Oct 22 03:24:15.221468 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2313/4583] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:14 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1364 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:15.239304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a27811df-8b23-4d57-af7a-4087eb7bd087 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d197721f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:15.433103 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a27811df-8b23-4d57-af7a-4087eb7bd087 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.210538 Oct 22 03:24:15.434797 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2314/4584] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:24:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:15.457442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-300abc18-3529-4e71-8408-ca62facb819e req-e596f411-296c-437a-8bd0-66e0ec4e0520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34099294-0ec2-494a-a13d-7d2e2ae9effd", "name": "network-vif-deleted", "tag": "472b9d3d-b211-49c2-92e5-0f393163b9f8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:15.497320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-300abc18-3529-4e71-8408-ca62facb819e req-e596f411-296c-437a-8bd0-66e0ec4e0520 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:15.499173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-300abc18-3529-4e71-8408-ca62facb819e req-e596f411-296c-437a-8bd0-66e0ec4e0520 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:15.501184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-300abc18-3529-4e71-8408-ca62facb819e req-e596f411-296c-437a-8bd0-66e0ec4e0520 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:15.533258 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-300abc18-3529-4e71-8408-ca62facb819e req-e596f411-296c-437a-8bd0-66e0ec4e0520 service nova] Creating event network-vif-deleted:472b9d3d-b211-49c2-92e5-0f393163b9f8 for instance 34099294-0ec2-494a-a13d-7d2e2ae9effd on n-h2-862416-2 Oct 22 03:24:15.547913 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-300abc18-3529-4e71-8408-ca62facb819e req-e596f411-296c-437a-8bd0-66e0ec4e0520 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110526 Oct 22 03:24:15.552368 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2315/4585] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:15.566607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:15.570263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:15.583930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:15.586278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:15.588768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:15.589813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:15.592664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:15.593482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:15.887794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:15.902502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:15.904002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:15.906164 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a428fff-ab3e-4159-a0f2-454624aa73b5 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.348443 Oct 22 03:24:15.906958 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2316/4586] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:15 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:15.931569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:15.932563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:15.939447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:15.940318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:15.941038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:15.942267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:15.942925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:15.943554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.028179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:16.044543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9969b7a-b800-4e95-93ab-b5f73098f157 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1488 microversion: 2.1 time: 1.577522 Oct 22 03:24:16.045149 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2271/4587] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:14 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1488 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:16.056330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ded900cd-8cb7-40e3-83b2-860883a30aeb tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d1a0430d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:16.083195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:16.116325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:16.121411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:16.123908 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5199335d-a9ae-43fc-80af-9f6dbc3cd2a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1356 microversion: 2.47 time: 0.196318 Oct 22 03:24:16.126480 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2317/4588] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:15 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:16.141717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:16.143487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 34099294-0ec2-494a-a13d-7d2e2ae9effd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:16.160383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.163616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.164872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.167161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.167904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.169704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.209051 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] HTTP exception thrown: Instance 34099294-0ec2-494a-a13d-7d2e2ae9effd could not be found. Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Request method failure captured: Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd HTTP/1.1 Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IPU8oE7z5Fv37SNwvIIVMTPnVJhPzjv2GCMq1IdFNXkMA-JMRDTpYf6eRUKDIk_aGAP9P-wRZWMFFnM89nko8C7-pF7oXXI3N2mBxGIkGkFIsedqgbM8FKg0jlmwSf0Ycydjb54p-8TRZKzNYKg14XCk_FgxA4nLeYdCCTyA0nHoE Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a8fafd6eb6c4ed99ea6584eaa795c8c Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}] Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a8fafd6eb6c4ed99ea6584eaa795c8c Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListServerFiltersTestJSON-402942885-project Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3e822e3631634aa083e0996b7d99737c Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListServerFiltersTestJSON-402942885-project Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 34099294-0ec2-494a-a13d-7d2e2ae9effd could not be found. Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '34099294-0ec2-494a-a13d-7d2e2ae9effd'} Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34099294-0ec2-494a-a13d-7d2e2ae9effd could not be found. Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34099294-0ec2-494a-a13d-7d2e2ae9effd could not be found. Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:16.217433 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34099294-0ec2-494a-a13d-7d2e2ae9effd could not be found. Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Returning 404 to user: Instance 34099294-0ec2-494a-a13d-7d2e2ae9effd could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:24:16.221234 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be0a00b0-bf0b-48e0-94e8-96939c8086a6 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd" status: 404 len: 111 microversion: 2.1 time: 0.091171 Oct 22 03:24:16.225050 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2318/4589] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:16 2022] GET /compute/v2.1/servers/34099294-0ec2-494a-a13d-7d2e2ae9effd => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:24:16.240447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-63c9a905-b0b0-481b-a1eb-5bce56002416 req-0533d2bd-3c4d-49ec-83aa-adf5caa5884c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfd6354-0b31-4bcf-8abb-a408e84093d8", "name": "network-vif-plugged", "status": "completed", "tag": "60dbd2f2-720d-4a18-adf1-f5dd30000fce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:16.264823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-63c9a905-b0b0-481b-a1eb-5bce56002416 req-0533d2bd-3c4d-49ec-83aa-adf5caa5884c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.265518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-63c9a905-b0b0-481b-a1eb-5bce56002416 req-0533d2bd-3c4d-49ec-83aa-adf5caa5884c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.267740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-63c9a905-b0b0-481b-a1eb-5bce56002416 req-0533d2bd-3c4d-49ec-83aa-adf5caa5884c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.284115 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ded900cd-8cb7-40e3-83b2-860883a30aeb tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.237075 Oct 22 03:24:16.285926 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2272/4590] 10.222.0.25 () {58 vars in 1134 bytes} [Sat Oct 22 03:24:16 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:16.291040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:16.291728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-63c9a905-b0b0-481b-a1eb-5bce56002416 req-0533d2bd-3c4d-49ec-83aa-adf5caa5884c service nova] Creating event network-vif-plugged:60dbd2f2-720d-4a18-adf1-f5dd30000fce for instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 on n-h1-862416-2 Oct 22 03:24:16.299217 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-63c9a905-b0b0-481b-a1eb-5bce56002416 req-0533d2bd-3c4d-49ec-83aa-adf5caa5884c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073411 Oct 22 03:24:16.299705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:16.300310 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2319/4591] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:16.307999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:16.312091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:16.319956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.320489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.320987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.321379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.322413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.323016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.323897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.324551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.325631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.335268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.337323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.337989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.454553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:24:16.454899 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-819a7831-96bb-4e59-a475-5d6f4c3377f5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 200 len: 122 microversion: 2.1 time: 0.167602 Oct 22 03:24:16.455429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:24:16.455974 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2273/4592] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:16 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 122 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:16.456276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:24:16.457515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:24:16.458348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:24:16.464001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:16.465222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:16.482302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:16.488627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.489696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.490156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.490899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.494122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.495748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.597649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:24:16.598547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:16.606310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.606856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.607555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.608668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.609256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.609787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.690733 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8f092f1-5c0b-4d84-8f83-7f6c1a1e7e4d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "POST /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5/action" status: 202 len: 1078 microversion: 2.47 time: 0.388582 Oct 22 03:24:16.691478 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2320/4593] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:24:16 2022] POST /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5/action => generated 1078 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 03:24:16.696314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:16.696935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:16.704871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.705475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.706531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.707597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:16.708355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:16.708795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:16.787042 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39d1ee2a-38b4-4b1e-b02a-c642b8b793ec tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "DELETE /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 204 len: 0 microversion: 2.1 time: 0.328915 Oct 22 03:24:16.787658 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2274/4594] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:24:16 2022] DELETE /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:24:16.805581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d244b48-94c3-4d8f-8c89-c37f697085cc tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d1e3ff700>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:16.841404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=16 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:17.016941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d244b48-94c3-4d8f-8c89-c37f697085cc tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.216367 Oct 22 03:24:17.018185 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2275/4595] 10.222.0.25 () {58 vars in 1167 bytes} [Sat Oct 22 03:24:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:17.031289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:17.034753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:17.059347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.060167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.062560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.063695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.066885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.070314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.099412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.119040 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2598215f-819a-494f-8f82-a54d9a5e00bc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1364 microversion: 2.1 time: 0.424826 Oct 22 03:24:17.122702 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2321/4596] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:16 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1364 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:17.138911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:17.140805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:17.164458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.165693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.166147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.166878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.167723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.168096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.300513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.309641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.311124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.312356 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7714967-873a-400e-9cca-77a4b5b11f98 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.188489 Oct 22 03:24:17.312921 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2322/4597] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:17 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:17.322981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:17.323823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:17.330374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.331100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.332141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.332887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.333542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.333978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.524793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.537892 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-52c72686-02ae-4a1f-93d8-a55c3201b4d0 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1517 microversion: 2.1 time: 0.223917 Oct 22 03:24:17.538775 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2323/4598] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:17 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1517 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:17.568180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:17.569144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:17.582940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.583701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.584316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.585165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.585767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.586341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.630462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.639134 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f4ddd5d6-facb-4971-847c-f4ed66c674e1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.619719 Oct 22 03:24:17.639724 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2276/4599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:17 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:17.654937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13319e83-7ea9-4139-90b2-626693a47227 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d1a073ee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:17.854101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.865177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.866948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:17.868737 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-263de211-f70d-4d5e-aca1-88e4da5ccfae tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.311936 Oct 22 03:24:17.869661 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2324/4600] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:17 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:17.874744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:17.875617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:17.879593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:17.884314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.885246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.885857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13319e83-7ea9-4139-90b2-626693a47227 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.240370 Oct 22 03:24:17.886101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.888608 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2277/4601] 10.222.0.25 () {58 vars in 1170 bytes} [Sat Oct 22 03:24:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:17.892104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:17.892821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:17.893466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:17.905544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db847efd-e26d-433e-8d69-8351950a1c0f tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d19af6f70>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:18.012419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=20 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:18.127256 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db847efd-e26d-433e-8d69-8351950a1c0f tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.226811 Oct 22 03:24:18.130480 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2278/4602] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:24:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:18.145724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b7464be-5597-4c3d-8049-3619ae8d18e9 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d1e548f70>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:18.170525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:18.181031 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-26066dae-d333-4c3c-a275-30fb486d2b20 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.310000 Oct 22 03:24:18.182112 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2325/4603] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:17 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:18.193456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:18.194421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:18.201828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.202610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.203513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.204525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.205215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.206097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.390587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:18.412108 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87f21eae-f59d-4f06-af7b-a253b82baeb1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1364 microversion: 2.1 time: 0.228701 Oct 22 03:24:18.416550 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2326/4604] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:18 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:18.426791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:18.428098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:18.441441 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b7464be-5597-4c3d-8049-3619ae8d18e9 tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.301190 Oct 22 03:24:18.442333 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2279/4605] 10.222.0.25 () {58 vars in 1188 bytes} [Sat Oct 22 03:24:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:24:18.447931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:18.448761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:18.452366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.453078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.453623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.454612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.455198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.456502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.472880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.490632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.491336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.492494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.493119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.493704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.651806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:18.664239 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-242f3abe-cf62-46d6-8e6a-7f20492d6e1c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.246305 Oct 22 03:24:18.677930 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2327/4606] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:18 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:18.693815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a51b0b6-734a-42a3-abf5-989322914e1f tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] Calling method '.version_select at 0x7f0d1a23de50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:18.713402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:18.726980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:18.731727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:18.732973 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-561b0e7c-bb55-4a15-8200-3e661fb48ff0 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.289553 Oct 22 03:24:18.750916 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2280/4607] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:18 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:18.750916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:18.750916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:18.767092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.767092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.767092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.767092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.767092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.767092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.840690 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0a51b0b6-734a-42a3-abf5-989322914e1f tempest-VolumesTestJSON-203660397 tempest-VolumesTestJSON-203660397-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.155149 Oct 22 03:24:18.841282 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2328/4608] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:24:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:18.846571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:18.847780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:18.866854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.867367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.867819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:18.868582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:18.869050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:18.869491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:19.221678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:19.254888 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-047084db-7a2c-44fc-a510-95a093ec46c5 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1517 microversion: 2.1 time: 0.515063 Oct 22 03:24:19.257181 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2281/4609] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:18 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1517 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:19.271631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:19.272674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:19.292327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:19.301307 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f4954b2-1494-4bb4-9057-8f5d1ae75fea tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.458963 Oct 22 03:24:19.308879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:19.311589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:19.312586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:19.322935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:19.323638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:19.327073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:19.349055 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2329/4610] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:18 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:19.441345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:19.442860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:19.466069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:19.466597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:19.467046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:19.474595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:19.475332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:19.476629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:19.639515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:19.651042 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abe24129-c5da-437f-bd14-65c08ac0f4a0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1555 microversion: 2.1 time: 0.213777 Oct 22 03:24:19.664728 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2330/4611] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:19 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:19.682560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:19.683080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:19.690082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:19.690578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:19.691716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:19.692492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:19.692959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:19.693395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:19.803826 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f4efa29-4818-44dd-a030-32e26e548204 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130431 Oct 22 03:24:19.804661 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2331/4612] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:24:19 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:19.818546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-898987422", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "316c23c4-6eda-4626-bced-03168617187b"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:19.929976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] validate_networks() for [('316c23c4-6eda-4626-bced-03168617187b', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:24:20.905899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:20.922330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:20.937167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:20.942413 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be182057-5457-4741-92b9-df01ab164de0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 1.678811 Oct 22 03:24:20.944907 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2282/4613] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:19 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:20.954994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:20.959199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:20.981630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:20.982363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:20.983014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:20.984447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:20.985128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:20.989488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:21.046775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:21.243255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:21.251967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:21.258316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:21.260258 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59a25e3f-1835-4a19-94e0-5ca15fc26d80 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.310952 Oct 22 03:24:21.266125 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2283/4614] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:20 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:21.272707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:21.277101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:21.298062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:21.298917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:21.299564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:21.300565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:21.301914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:21.302525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:21.434550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:24:21.435099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:24:21.435470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:24:21.435884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:24:21.437454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:24:21.454494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:21.454981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:21.455415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:21.462861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:21.463449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:21.463874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:21.530823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:21.558261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for user f89d04db39be473097b885f7465115a2 and project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:21.580159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:24:21.584120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:24:21.757766 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eea23c63-b97e-4929-9007-8b0299517ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.923928 Oct 22 03:24:21.759827 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2332/4615] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:24:21.796675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a4eb1c6-937e-4605-bcdf-73c21e3cdca4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:21.801112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a4eb1c6-937e-4605-bcdf-73c21e3cdca4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:21.824328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:21.904119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:21.927245 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e3b12cc-00c2-4566-96d2-8b01b6a67751 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1517 microversion: 2.1 time: 0.659495 Oct 22 03:24:21.930398 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2284/4616] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:21 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1517 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:21.978025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:21.979054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:22.007658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:22.008540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:22.009227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:22.011170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:22.012894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:22.013714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:22.671426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5a4eb1c6-937e-4605-bcdf-73c21e3cdca4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:22.689741 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a4eb1c6-937e-4605-bcdf-73c21e3cdca4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1214 microversion: 2.1 time: 0.918265 Oct 22 03:24:22.691838 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2333/4617] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:21 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1214 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:22.717000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:22.719567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:22.743673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:22.746437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:22.753218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:22.755171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:22.757244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:22.759474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:22.812828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:23.255162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:23.274809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:23.285987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:23.295096 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e10a3cd5-59b6-404a-b81f-cd391f9a949d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.595149 Oct 22 03:24:23.325796 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2334/4618] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:22 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:23.330895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:23.332128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:23.385727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:23.389068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:23.389796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:23.392640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:23.393360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:23.401010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:23.421216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:23.431045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:23.442019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:23.443340 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b10c2cd3-80f8-4c39-b639-314ad2b3e636 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 1.472039 Oct 22 03:24:23.443931 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2285/4619] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:21 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:23.478830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-ea1e9349-1e85-4087-bc34-c20cf1919fa1 req-781547b5-4af9-4ae8-85cf-771b378a1021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451170a5-0891-4542-a8e8-119f7fbc6c6d", "name": "network-vif-deleted", "tag": "2b10c880-6807-4afc-860e-4b8209440b56"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:23.512800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ea1e9349-1e85-4087-bc34-c20cf1919fa1 req-781547b5-4af9-4ae8-85cf-771b378a1021 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:23.514050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ea1e9349-1e85-4087-bc34-c20cf1919fa1 req-781547b5-4af9-4ae8-85cf-771b378a1021 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:23.516630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ea1e9349-1e85-4087-bc34-c20cf1919fa1 req-781547b5-4af9-4ae8-85cf-771b378a1021 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:23.550030 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-ea1e9349-1e85-4087-bc34-c20cf1919fa1 req-781547b5-4af9-4ae8-85cf-771b378a1021 service nova] Creating event network-vif-deleted:2b10c880-6807-4afc-860e-4b8209440b56 for instance 451170a5-0891-4542-a8e8-119f7fbc6c6d on n-h1-862416-2 Oct 22 03:24:23.574791 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-ea1e9349-1e85-4087-bc34-c20cf1919fa1 req-781547b5-4af9-4ae8-85cf-771b378a1021 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100326 Oct 22 03:24:23.576668 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2286/4620] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:23.718004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:23.719452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:23.739353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:23.739866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:23.745432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:23.746544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:23.749422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:23.752924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:23.896447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e822e3631634aa083e0996b7d99737c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8fafd6eb6c4ed99ea6584eaa795c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:23.906833 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87feed9b-d04e-4abf-b7fc-a33ebc756422 tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 200 len: 1306 microversion: 2.1 time: 0.579784 Oct 22 03:24:23.907444 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2335/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:23 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 1306 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:23.972852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b90d58df-e1e0-4cd4-b611-d4434669c968 req-67a70730-ee06-4c97-92ed-c1f3beb7d6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfd6354-0b31-4bcf-8abb-a408e84093d8", "tag": "60dbd2f2-720d-4a18-adf1-f5dd30000fce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:23.995745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b90d58df-e1e0-4cd4-b611-d4434669c968 req-67a70730-ee06-4c97-92ed-c1f3beb7d6b2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:23.996162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b90d58df-e1e0-4cd4-b611-d4434669c968 req-67a70730-ee06-4c97-92ed-c1f3beb7d6b2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:23.996628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b90d58df-e1e0-4cd4-b611-d4434669c968 req-67a70730-ee06-4c97-92ed-c1f3beb7d6b2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:24.044139 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b90d58df-e1e0-4cd4-b611-d4434669c968 req-67a70730-ee06-4c97-92ed-c1f3beb7d6b2 service nova] Creating event network-changed:60dbd2f2-720d-4a18-adf1-f5dd30000fce for instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 on n-h1-862416-2 Oct 22 03:24:24.058990 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b90d58df-e1e0-4cd4-b611-d4434669c968 req-67a70730-ee06-4c97-92ed-c1f3beb7d6b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093640 Oct 22 03:24:24.059608 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2336/4622] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:24:24.182481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:24.191724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c90065dc-2ba8-42c5-9772-dc6aff5e1755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1266 microversion: 2.1 time: 0.479189 Oct 22 03:24:24.212233 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2287/4623] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:23 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1266 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:24.332367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:24.333187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:24.367574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:24.368095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:24.368568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:24.380356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:24.382308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:24.384074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:24.482040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:24.482783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:24.514073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:24.522585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:24.523231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:24.524180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:24.524810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:24.525352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:24.850249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:24.873076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:24.879010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:24.883727 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b5d4f390-7757-4520-85d4-9da85786c794 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.556535 Oct 22 03:24:24.889377 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2337/4624] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:24 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:24.931950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:24.933427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] [instance: 451170a5-0891-4542-a8e8-119f7fbc6c6d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:24.943059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:24.952400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:24.957035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:24.958201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:24.958945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:24.959637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:24.997589 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] HTTP exception thrown: Instance 451170a5-0891-4542-a8e8-119f7fbc6c6d could not be found. Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Request method failure captured: Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d HTTP/1.1 Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2IPU8oE7z5Fv37SNwvIIVMTPnVJhPzjv2GCMq1IdFNXkMA-JMRDTpYf6eRUKDIk_aGAP9P-wRZWMFFnM89nko8C7-pF7oXXI3N2mBxGIkGkFIsedqgbM8FKg0jlmwSf0Ycydjb54p-8TRZKzNYKg14XCk_FgxA4nLeYdCCTyA0nHoE Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1a8fafd6eb6c4ed99ea6584eaa795c8c Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8fafd6eb6c4ed99ea6584eaa795c8c"}]}] Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1a8fafd6eb6c4ed99ea6584eaa795c8c Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-402942885 Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListServerFiltersTestJSON-402942885-project Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3e822e3631634aa083e0996b7d99737c Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListServerFiltersTestJSON-402942885-project Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 451170a5-0891-4542-a8e8-119f7fbc6c6d could not be found. Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '451170a5-0891-4542-a8e8-119f7fbc6c6d'} Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 451170a5-0891-4542-a8e8-119f7fbc6c6d could not be found. Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451170a5-0891-4542-a8e8-119f7fbc6c6d could not be found. Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:24:25.015090 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:25.019747 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:24:25.019747 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:24:25.019747 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:24:25.019747 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:24:25.019747 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:24:25.019747 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451170a5-0891-4542-a8e8-119f7fbc6c6d could not be found. Oct 22 03:24:25.019747 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:24:25.025212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] Returning 404 to user: Instance 451170a5-0891-4542-a8e8-119f7fbc6c6d could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:24:25.032346 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7059d005-e2a1-487c-8c69-39ed0160bb1d tempest-ListServerFiltersTestJSON-402942885 tempest-ListServerFiltersTestJSON-402942885-project] 10.222.0.25 "GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d" status: 404 len: 111 microversion: 2.1 time: 0.104721 Oct 22 03:24:25.033398 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2338/4625] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:24 2022] GET /compute/v2.1/servers/451170a5-0891-4542-a8e8-119f7fbc6c6d => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:24:25.224407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:25.225193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:25.236938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:25.239615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:25.241437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:25.242476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:25.251114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:25.251732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:25.654028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:25.664534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90fea648-58fa-43b6-88d9-047cda389c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1272 microversion: 2.1 time: 0.444338 Oct 22 03:24:25.665131 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2339/4626] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:25 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1272 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:25.863387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:25.895807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:25.902637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:25.903994 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93e437e9-d1f6-45b5-8876-896a18c34f2b tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 1.428126 Oct 22 03:24:25.912274 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2288/4627] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:24 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:25.915309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:25.916120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:25.926663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:25.932039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:25.933524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:25.938046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:25.938837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:25.943272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:26.095371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:26.106754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:26.115434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:26.117116 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-249281f4-0100-40f8-ad56-cf86b387f634 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.206083 Oct 22 03:24:26.117913 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2340/4628] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:25 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:26.693536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:26.695723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:26.710100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:26.710902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:26.711526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:26.713064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:26.718228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:26.718905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:26.949321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:26.952160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:26.973858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:26.978658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:26.979124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:26.979892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:26.980394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:26.980837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:27.138903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:27.157692 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-22da2b8d-33ec-46d3-b7c7-c7f05774610b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1272 microversion: 2.1 time: 0.465821 Oct 22 03:24:27.158376 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2289/4629] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:26 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1272 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:27.168029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:27.198695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:27.213275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:27.215188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:27.216692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:27.217552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:27.219195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:27.222505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:27.489553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:27.504000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:27.515400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:27.517195 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc00ebdd-1dd7-49db-bbb4-2eb9b9547850 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.577300 Oct 22 03:24:27.521514 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2341/4630] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:26 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:27.535857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:27.559967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:27.572589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:27.575063 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9569284c-6314-40b1-9c48-2d4b82d69ed7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.415488 Oct 22 03:24:27.607727 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2290/4631] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:27 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:28.184311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:28.185692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:28.205441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:28.211011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:28.212510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:28.221231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:28.224097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:28.225680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:28.557419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:28.558785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:28.584061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:28.587693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:28.591534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:28.595551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:28.597238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:28.600151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:28.956064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:28.967379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:28.970194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:28.971722 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01a29f71-dc02-4611-9563-1baaddaa53a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.418650 Oct 22 03:24:28.991080 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2291/4632] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:28 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:28.991080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:28.991080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:28.991080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:28.991724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:28.992449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:28.998271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:28.999046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:28.999796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:29.112707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:29.124138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:29.127423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:29.128353 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d320fcb6-63cd-4b30-912c-a36cc141e316 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.154026 Oct 22 03:24:29.129385 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2292/4633] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:28 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:29.498196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:29.510098 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac03ad80-4ec5-4978-8108-1e97e3aba89f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 1.330050 Oct 22 03:24:29.526318 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2342/4634] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:28 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:29.999182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:29.999838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:30.021074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:30.023351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:30.025314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:30.026186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:30.029303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:30.029893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:30.157396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:30.157926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:30.164990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:30.165495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:30.165936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:30.177040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:30.177543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:30.177992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:30.376334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:30.389716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:30.391818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:30.400423 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6023cc28-07df-41e4-9da3-d8ea6ffea7fb tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.400267 Oct 22 03:24:30.402153 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2293/4635] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:29 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:30.495520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:30.505840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:30.507308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:30.525231 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6fa6e000-47de-4fe8-86f2-07f13010289d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.355772 Oct 22 03:24:30.525904 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2343/4636] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:30 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:30.552150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:30.552810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:30.576349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:30.576845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:30.577303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:30.578031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:30.578471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:30.578905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:31.174404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:31.187686 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-61a3cfdc-82b4-4be3-bfea-e604345244d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.640990 Oct 22 03:24:31.204768 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2294/4637] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:30 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:31.433004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:31.433862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:31.454021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:31.455052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:31.455758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:31.457212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:31.463728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:31.464529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:31.511299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:31.554438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:31.555123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:31.571096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:31.571594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:31.572032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:31.572792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:31.573261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:31.573683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:31.829470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:31.838679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:31.849587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:31.851040 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08f0ac2a-1fb7-4d78-9c42-46ee8a76d7da tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.301143 Oct 22 03:24:31.864697 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2295/4638] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:31 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:32.214469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:32.215157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:32.228342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:32.230037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:32.230552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:32.232443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:32.234536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:32.236127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:32.656103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:32.676512 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1041d40e-39ac-47bd-9c36-42e8733dcb85 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.463305 Oct 22 03:24:32.676995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:32.677450 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2296/4639] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:32 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:32.697597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4747b1a9-a942-4300-bfcc-0fbf7236678f req-567215ae-9d39-4dd9-a6f6-d20021f6d8dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f126728-86e7-4959-a830-cb548f164e0c", "tag": "fe0e1ee2-4811-473e-9504-0bc33fad5b32"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:32.786052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4747b1a9-a942-4300-bfcc-0fbf7236678f req-567215ae-9d39-4dd9-a6f6-d20021f6d8dd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:32.786586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4747b1a9-a942-4300-bfcc-0fbf7236678f req-567215ae-9d39-4dd9-a6f6-d20021f6d8dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:32.793797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4747b1a9-a942-4300-bfcc-0fbf7236678f req-567215ae-9d39-4dd9-a6f6-d20021f6d8dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:32.824684 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4747b1a9-a942-4300-bfcc-0fbf7236678f req-567215ae-9d39-4dd9-a6f6-d20021f6d8dd service nova] Creating event network-changed:fe0e1ee2-4811-473e-9504-0bc33fad5b32 for instance 6f126728-86e7-4959-a830-cb548f164e0c on n-h2-862416-2 Oct 22 03:24:32.845358 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4747b1a9-a942-4300-bfcc-0fbf7236678f req-567215ae-9d39-4dd9-a6f6-d20021f6d8dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164683 Oct 22 03:24:32.846994 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2297/4640] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:32.879244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:32.880761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:32.892271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:32.895209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:32.895719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:32.896531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:32.899767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:32.900637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:32.982195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:33.005570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:33.007197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:33.015141 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c692788-35ad-482e-ab2d-b6f1a5c2c15d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 1.579712 Oct 22 03:24:33.017367 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2344/4641] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:31 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:33.189772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:33.210837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:33.220156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:33.225042 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1755cf79-51f3-4366-af8e-a1986825ddee tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.350745 Oct 22 03:24:33.257332 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2298/4642] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:32 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:33.717620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:33.718168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:33.753862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:33.765995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:33.766560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:33.767320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:33.767793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:33.768235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:34.048695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:34.049312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:34.068716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:34.069221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:34.069657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:34.072921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:34.073728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:34.074491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:34.760831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:34.771288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:34.772820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:34.774023 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0be0472-d87e-4b14-8744-00c3e41d3df3 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.730982 Oct 22 03:24:34.774597 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2299/4643] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:34 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:34.817979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:34.818819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:34.841448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:34.841980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:34.842448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:34.853271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:34.853773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:34.859863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:35.124839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:35.134661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:35.149821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:35.151171 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ada1fd5-0cf6-42bb-84a0-5d89d0ddc2c4 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.353210 Oct 22 03:24:35.164622 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2300/4644] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:34 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:35.231095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:35.249102 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73f66d65-0bda-42d0-8c46-eafa038dc814 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 1.548595 Oct 22 03:24:35.272363 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2345/4645] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:33 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:35.803331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:35.803923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:35.811199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:35.817655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:35.818318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:35.819252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:35.819867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:35.820481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:35.873994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:36.181717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:36.182743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:36.204527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:36.205028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:36.205474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:36.208052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:36.208560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:36.208998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:36.355497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:36.379414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:36.385581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:36.387198 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1fbc1d4f-f210-4c00-95ac-e367dafd9c6f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 0.588657 Oct 22 03:24:36.388393 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2301/4646] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:35 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:36.393877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:36.399035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:36.421525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:36.422027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:36.422466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:36.423486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:36.423967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:36.424493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:36.567980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:36.584330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:36.586022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:36.592948 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90e9984a-d49c-4902-9076-958e82338b25 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.415283 Oct 22 03:24:36.596229 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2346/4647] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:36 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:36.701361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:36.721248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-44772925-4ced-4a22-88f0-d7f80729176b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.331566 Oct 22 03:24:36.744222 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2302/4648] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:36 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:37.417759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:37.418590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:37.431431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:37.431935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:37.434429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:37.437108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:37.437870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:37.442845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:37.918195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-994076762", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:37.995527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] validate_networks() for [('652a1419-ed91-4f06-81f3-e3091d650d7d', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:24:38.559207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:24:38.561129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:24:38.563364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:24:38.564009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:24:38.566677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:24:38.578813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:38.579511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:38.580157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:38.582393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:38.583130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:38.584325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:38.611620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Getting quotas for project fc3de0ae4c844bfa92316a20a1974e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:38.621649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:38.637387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:38.643005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Getting quotas for user 76fb02af67184c1ca83c5b55c381f195 and project fc3de0ae4c844bfa92316a20a1974e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:38.643441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:38.647524 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e908fd03-8c41-4842-a4f8-1344d6a9a537 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1738 microversion: 2.20 time: 1.234871 Oct 22 03:24:38.650344 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2303/4649] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:37 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1738 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:38.663961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:38.664872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:38.675559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:24:38.677774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:38.681070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:38.681681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:38.683994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:38.684731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:24:38.685339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:38.686355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:38.772196 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-545dff7d-72e4-4dec-911b-a7987f4ba244 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.455062 Oct 22 03:24:38.782345 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2347/4650] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:24:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:24:38.794888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:38.795977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:38.808163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:38.809136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:38.809951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:38.811152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:38.811913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:38.821859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:39.079592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:39.090385 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11cc4047-449d-4956-8608-882066b576fd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.306039 Oct 22 03:24:39.106369 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2348/4651] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:38 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:39.114701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-842299a5-ae73-4f08-ba46-4d3c320b4907 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:39.115917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-842299a5-ae73-4f08-ba46-4d3c320b4907 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:39.178869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:39.188411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:39.198570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:39.200114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4adf90f8-8246-44d7-aedf-c2ac2a1ba605 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.547747 Oct 22 03:24:39.201061 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2304/4652] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:38 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:39.221313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-842299a5-ae73-4f08-ba46-4d3c320b4907 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:39.231461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-842299a5-ae73-4f08-ba46-4d3c320b4907 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1221 microversion: 2.1 time: 0.123074 Oct 22 03:24:39.232330 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2349/4653] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:39 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:39.436055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-328514286", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:39.552952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] validate_networks() for [('652a1419-ed91-4f06-81f3-e3091d650d7d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:24:39.689917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:39.690787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:39.710571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:39.711154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:39.711610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:39.712357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:39.712821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:39.713277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:40.019434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:40.038878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:40.042581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:40.047453 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e169866-df62-4097-b596-1bf851d4d7b8 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1720 microversion: 2.20 time: 0.361865 Oct 22 03:24:40.079147 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2350/4654] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:39 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1720 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:40.125713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:40.127063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:40.136056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:40.136778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:40.137411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:40.138321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:40.138995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:40.139622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:40.384616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:40.400364 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0799b083-2345-4f76-9b82-0f35050225b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.283274 Oct 22 03:24:40.402338 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2351/4655] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:40 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:40.408824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:40.410324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:40.417962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:40.418979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:40.419657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:40.421048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:40.423250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:40.423924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:40.513534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:40.526210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:40.528094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:40.529532 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a00a27d-0ee4-4698-8c0b-cd0418959031 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.125954 Oct 22 03:24:40.530539 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2352/4656] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:40 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:41.087440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:41.088544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:41.102958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:41.103861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:41.104337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:41.105067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:41.107966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:41.109510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:41.352548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:41.364511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:41.366628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:41.368529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65567b60-844d-41e7-958a-f7a69bd0789c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1720 microversion: 2.20 time: 0.293417 Oct 22 03:24:41.369561 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2353/4657] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:41 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:41.437755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:41.438842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:41.495447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:41.496020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:41.496500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:41.498074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:41.498548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:41.500474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:41.520502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:41.744182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:41.753265 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0fa9444-dd8a-4259-a2da-35798e0710d9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.328490 Oct 22 03:24:41.765447 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2354/4658] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:41 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:41.770583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:41.771467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:41.788657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:41.789394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:41.790930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:41.791529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:41.791998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:41.792481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:41.941869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:41.962836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:41.964458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:41.965697 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2abd5410-1ae4-454b-b94f-89dadb6ea55f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.199870 Oct 22 03:24:41.981352 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2355/4659] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:41 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:42.397179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:42.398551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:42.412314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:42.415227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:42.415936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:42.417097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:42.417926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:42.418574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:42.509180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:24:42.509749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:24:42.510434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:24:42.511002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:24:42.511568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:24:42.526347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:42.530058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:42.530762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:42.531734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:42.532738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:42.535873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:42.588487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Getting quotas for project fc3de0ae4c844bfa92316a20a1974e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:42.605788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Getting quotas for user 76fb02af67184c1ca83c5b55c381f195 and project fc3de0ae4c844bfa92316a20a1974e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:42.642360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:24:42.645356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:24:42.730701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:42.753586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:42.755678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:42.760780 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a9764aa-eb4e-4df5-932c-0a12cad54bdc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1720 microversion: 2.20 time: 0.370028 Oct 22 03:24:42.762234 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2356/4660] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:42 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1720 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:42.781816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:42.785964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:42.786662 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c6b583f5-ed15-412d-9ec1-9bf733c34bcf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.354890 Oct 22 03:24:42.788572 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2305/4661] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:24:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:24:42.798620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:42.799465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:42.800809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0d2e0df-260b-45e4-8f55-5a1afd82920f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:42.801091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:42.801498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0d2e0df-260b-45e4-8f55-5a1afd82920f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:42.802241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:42.802914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:42.803557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:43.026313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0d2e0df-260b-45e4-8f55-5a1afd82920f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:43.045924 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0d2e0df-260b-45e4-8f55-5a1afd82920f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1221 microversion: 2.1 time: 0.248498 Oct 22 03:24:43.048583 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2306/4662] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:42 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1221 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:43.067159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:43.069207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:43.079065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:43.080043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:43.080895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:43.082421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:43.086369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:43.090308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:43.349503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:43.366110 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c4ccc9c1-45fa-4f43-a155-ba11b7aac46a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.588072 Oct 22 03:24:43.366737 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2357/4663] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:42 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:43.580534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:43.590683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:43.599737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:43.601126 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62e94872-8190-410f-92fd-36dcff4e50e5 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.550530 Oct 22 03:24:43.602282 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2307/4664] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:43 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:43.712429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7a09a580-63e7-460c-a468-72ee9ae58ae6 req-18d10d14-de3a-4bdf-a044-b866f7322f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f126728-86e7-4959-a830-cb548f164e0c", "name": "network-vif-plugged", "status": "completed", "tag": "fe0e1ee2-4811-473e-9504-0bc33fad5b32"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:43.736297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7a09a580-63e7-460c-a468-72ee9ae58ae6 req-18d10d14-de3a-4bdf-a044-b866f7322f4d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:43.737145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7a09a580-63e7-460c-a468-72ee9ae58ae6 req-18d10d14-de3a-4bdf-a044-b866f7322f4d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:43.737865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7a09a580-63e7-460c-a468-72ee9ae58ae6 req-18d10d14-de3a-4bdf-a044-b866f7322f4d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:43.776894 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7a09a580-63e7-460c-a468-72ee9ae58ae6 req-18d10d14-de3a-4bdf-a044-b866f7322f4d service nova] Creating event network-vif-plugged:fe0e1ee2-4811-473e-9504-0bc33fad5b32 for instance 6f126728-86e7-4959-a830-cb548f164e0c on n-h2-862416-2 Oct 22 03:24:43.786485 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7a09a580-63e7-460c-a468-72ee9ae58ae6 req-18d10d14-de3a-4bdf-a044-b866f7322f4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080496 Oct 22 03:24:43.787690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2358/4665] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:43.791559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:43.792245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:43.807734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:43.808391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:43.808706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:43.810049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:43.810049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:43.810290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:44.075664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:44.076402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:44.115708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:44.122843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:44.125187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:44.130208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:44.133467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:44.135662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:44.334003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:44.344659 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a2d606c-c096-401e-a1c5-783b35b2de8d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1217 microversion: 2.1 time: 0.272933 Oct 22 03:24:44.349020 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2359/4666] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:44 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1217 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:44.411980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:44.416695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:44.441598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:44.444425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:44.445882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:44.446662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:44.448927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:44.450493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:44.748328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:44.761570 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35fe556b-7111-4b11-8ff7-052b5151d8f0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.373016 Oct 22 03:24:44.778417 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2360/4667] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:44 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:44.785227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:44.788674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:44.812470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:44.813190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:44.813897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:44.814770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:44.815608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:44.817293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:44.918065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:44.928905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:44.930480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:44.931909 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11177db8-c266-4e19-a438-9cabdaf3fbdd tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.152012 Oct 22 03:24:44.933559 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2361/4668] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:44 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:45.171261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:45.182519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:45.184706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:45.185986 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bc57e340-de94-4099-8389-a5e59205fc1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1723 microversion: 2.20 time: 1.398568 Oct 22 03:24:45.186788 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2308/4669] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:43 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1723 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:45.216108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f591f97-a6fc-4b22-8372-f1830874864c"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:45.219128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:45.226780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:45.227651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:45.228315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:45.229186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:45.229998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:45.230590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:45.375234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:45.376624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:45.384464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:45.385164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:45.385999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:45.387118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:45.388522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:45.390330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:45.545398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:45.560566 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b34414f7-67b5-4692-9840-bb4aa49c74c3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1279 microversion: 2.1 time: 0.193226 Oct 22 03:24:45.561714 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2309/4670] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:45 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:45.633593 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ba8adb3-d8dc-442d-9875-fa7a5879f71f tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.422129 Oct 22 03:24:45.635085 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2362/4671] 10.222.0.25 () {62 vars in 1364 bytes} [Sat Oct 22 03:24:45 2022] POST /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/os-volume_attachments => generated 188 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:24:45.782814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:45.783392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:45.787432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:45.788116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:45.791273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:45.792777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:45.793736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:45.795148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:45.795760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:45.796247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:45.796565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:45.796743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:45.797172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:45.798233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:45.799029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:45.801269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.102620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:46.112714 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e97eaa0-cd0e-4e63-b1f5-0ecd3be50c79 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1314 microversion: 2.1 time: 0.329733 Oct 22 03:24:46.113619 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2363/4672] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:45 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:46.139913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e3bff82d-e08d-40b8-a85c-ffeebd296183 req-11019190-2d8d-4483-9218-5b1cb03c7a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d2acf4-a7dd-46af-ae59-83a28eccaa4f", "name": "network-vif-unplugged", "status": "completed", "tag": "01c4850c-25d7-4312-836a-b864a1ef4bed"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:46.153747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e3bff82d-e08d-40b8-a85c-ffeebd296183 req-11019190-2d8d-4483-9218-5b1cb03c7a90 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.154468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e3bff82d-e08d-40b8-a85c-ffeebd296183 req-11019190-2d8d-4483-9218-5b1cb03c7a90 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.155099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e3bff82d-e08d-40b8-a85c-ffeebd296183 req-11019190-2d8d-4483-9218-5b1cb03c7a90 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.178319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.compute.server_external_events [req-e3bff82d-e08d-40b8-a85c-ffeebd296183 req-11019190-2d8d-4483-9218-5b1cb03c7a90 service nova] Unable to find a host for instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f. Dropping event network-vif-unplugged {{(pid=120581) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 03:24:46.179616 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e3bff82d-e08d-40b8-a85c-ffeebd296183 req-11019190-2d8d-4483-9218-5b1cb03c7a90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053148 Oct 22 03:24:46.181442 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2364/4673] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 22 03:24:46.193360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:46.194380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:46.203272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.205117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.205922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.206921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.207644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.209077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.276626 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-992008e1-ddf1-4470-8b77-4977eddcceb4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/os-volume_attachments/4f591f97-a6fc-4b22-8372-f1830874864c" status: 202 len: 0 microversion: 2.20 time: 0.498274 Oct 22 03:24:46.278356 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2310/4674] 10.222.0.25 () {60 vars in 1457 bytes} [Sat Oct 22 03:24:45 2022] DELETE /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/os-volume_attachments/4f591f97-a6fc-4b22-8372-f1830874864c => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:24:46.306357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:46.319285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:46.321161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:46.323355 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b0fad4e-1b64-4637-8b45-7af73036d6a8 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.140670 Oct 22 03:24:46.324302 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2365/4675] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:46 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:46.454481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:46.455260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:46.486390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.488373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.491002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.491757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.492247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.493808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.591476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:46.593141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:46.598920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:46.608091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.610704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.611635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120582) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 03:24:46.615859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.617072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.619489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.622045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.772275 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0252fc32-450f-4f1a-9f31-4b64dd4d9e19 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "POST /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/action" status: 202 len: 0 microversion: 2.20 time: 0.333265 Oct 22 03:24:46.776484 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2311/4676] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Oct 22 03:24:46 2022] POST /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:24:46.785858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:46.790451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:46.820612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:46.832693 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b276fac-5de4-4103-8a1c-c813335318f7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1279 microversion: 2.1 time: 0.244685 Oct 22 03:24:46.833332 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2366/4677] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:46 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:24:46.838216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.838976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.839282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:46.840067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:46.844664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:46.845161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:47.139884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:47.140526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:47.155853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:47.156386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:47.157516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:47.158829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:47.160061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:47.160840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:47.334784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:47.352669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:47.354573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:47.355971 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ace431d-8242-49a4-aeb9-067d691c5468 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1671 microversion: 2.20 time: 0.578179 Oct 22 03:24:47.356761 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2312/4678] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:46 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1671 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:47.361872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:47.370446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:47.385459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:47.386262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:47.386857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:47.387718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:47.388394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:47.389009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:47.426806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:47.444058 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0f99c5e-f162-4841-a927-bcd795c924fc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1502 microversion: 2.1 time: 0.308263 Oct 22 03:24:47.452945 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2367/4679] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:47 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:47.478310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:47.482231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:47.492621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:47.495729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:47.496379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:47.497475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:47.499707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:47.500472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:47.511000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:47.533229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:47.537968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:47.541926 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93cf3ad1-ae88-4cdc-a883-ddbbb5008935 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.183892 Oct 22 03:24:47.552468 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2313/4680] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:47 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:47.602646 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-120a368d-d1a5-4a3f-b28d-4226a6f14416 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action" status: 200 len: 14 microversion: 2.1 time: 0.128281 Oct 22 03:24:47.608895 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2368/4681] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:47 2022] POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:24:47.859908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:47.860682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:47.882027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:47.886392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:47.886965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:47.891164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:47.891685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:47.892064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:48.228860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe213321-ef88-443d-8e8a-d457d3228ae4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Action: 'create', calling method: .version_select at 0x7f0d1e5db040>, body: {"keypair": {"name": "tempest-keypair-367865601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4SLlAoBW+Wr5L+x/BF3lhNdbzIUkchlETLl84ch/bdv8+BButt3yLvf8UqABNPEgN736YJePU56HST0cGe6Sbc/VGvbl+zo96E3bbFKzOb239/WaJzP+lgfABCpcEGXA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:48.293547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fe213321-ef88-443d-8e8a-d457d3228ae4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Getting quotas for project 155c2a3bf2a24d92959c82e15c7645bd. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:48.305395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fe213321-ef88-443d-8e8a-d457d3228ae4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Getting quotas for user d98deb80919941558e8fb09e1b4fcc9c and project 155c2a3bf2a24d92959c82e15c7645bd. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:48.369490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:48.395971 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe213321-ef88-443d-8e8a-d457d3228ae4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.391529 Oct 22 03:24:48.398655 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2369/4682] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:24:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:48.412098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:48.414301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:48.432195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:48.433449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:48.435396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:48.436345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:48.438689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:48.439800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:48.595310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:48.968998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:48.981207 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6b2ffe0-8917-42ae-bb33-a53e8318534d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 1.125978 Oct 22 03:24:48.983881 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2314/4683] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:47 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:48.996182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:48.998026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:49.014019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:49.014876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:49.016759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:49.018657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:49.020706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:49.021411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:49.161593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:49.164815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:49.178847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:49.179708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:49.184920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:49.187876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:49.189328 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-02dd1e9e-7059-4acb-b100-5235bb0d32a0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1671 microversion: 2.20 time: 0.789349 Oct 22 03:24:49.192376 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2370/4684] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:48 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1671 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:49.195069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:49.198835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:49.232117 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ed35c262-c9ab-45d7-9763-cf389d967b38 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1365 microversion: 2.47 time: 0.246273 Oct 22 03:24:49.232869 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2315/4685] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:48 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:49.244548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:49.257454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:49.277465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:49.279624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:49.280124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:49.282734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:49.283225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:49.288140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:49.410508 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0bce7f0-c05d-4ee2-ba56-a5e888f86c8e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action" status: 200 len: 14 microversion: 2.1 time: 0.214600 Oct 22 03:24:49.413018 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2371/4686] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:49 2022] POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:24:49.851354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d461dd7e-23d3-4413-a4f3-817c338dd568 req-7066ad3d-bc39-4ee7-8204-8da5c17afe5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97055cc-112a-4d01-9d20-bfa7f95d9886", "tag": "a63a763d-2107-4dfb-abd1-11f0810c08e1"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:49.903219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d461dd7e-23d3-4413-a4f3-817c338dd568 req-7066ad3d-bc39-4ee7-8204-8da5c17afe5e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:49.904916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d461dd7e-23d3-4413-a4f3-817c338dd568 req-7066ad3d-bc39-4ee7-8204-8da5c17afe5e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:49.910906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d461dd7e-23d3-4413-a4f3-817c338dd568 req-7066ad3d-bc39-4ee7-8204-8da5c17afe5e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:49.974216 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d461dd7e-23d3-4413-a4f3-817c338dd568 req-7066ad3d-bc39-4ee7-8204-8da5c17afe5e service nova] Creating event network-changed:a63a763d-2107-4dfb-abd1-11f0810c08e1 for instance a97055cc-112a-4d01-9d20-bfa7f95d9886 on n-h1-862416-2 Oct 22 03:24:49.998208 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d461dd7e-23d3-4413-a4f3-817c338dd568 req-7066ad3d-bc39-4ee7-8204-8da5c17afe5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147375 Oct 22 03:24:50.000907 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2316/4687] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:50.008703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:50.009499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:50.039909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:50.042651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:50.043991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:50.046222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:50.048489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:50.049119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:50.228533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:50.229392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:50.242613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:50.243111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:50.243544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:50.244287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:50.244753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:50.245192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:50.861836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:50.874601 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6138e4fd-e6bb-48a6-83fb-bffd6f52df5b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 0.871204 Oct 22 03:24:50.875197 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2372/4688] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:50 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:50.922980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:50.923761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:50.944535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:50.944856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:50.951077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:50.951916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:50.952451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:50.953080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:51.054010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:51.079472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:51.085359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:51.088059 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e5bd8260-ab04-449b-b3a1-1d46082e864a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1371 microversion: 2.47 time: 0.171237 Oct 22 03:24:51.093187 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2373/4689] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:50 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:51.103864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:51.106128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:51.109254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:51.133170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:51.136983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:51.137641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:51.140142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:51.140663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:51.141614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:51.144649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:51.147778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:51.149225 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7efefdd9-1a5c-449c-bc44-cef2fbe3295e tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.926532 Oct 22 03:24:51.150327 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2317/4690] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:50 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:51.211558 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c9729035-d108-40ba-86b8-a1fe885c0f98 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action" status: 200 len: 14 microversion: 2.1 time: 0.116710 Oct 22 03:24:51.225152 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2374/4691] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:51 2022] POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:24:51.906354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:51.907218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:51.920083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:51.922494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:51.923181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:51.924120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:51.927594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:51.928857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:52.309722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-54890166", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "4d4bbebb-53d3-400e-9efe-9451479ff082"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:52.468954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] validate_networks() for [('4d4bbebb-53d3-400e-9efe-9451479ff082', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:24:52.497699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:52.516304 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-34ac9428-e805-4a14-a370-008b1bdd3ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 0.616107 Oct 22 03:24:52.520349 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2318/4692] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:51 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:52.536820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:52.537800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:52.547307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:52.550581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:52.551408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:52.552411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:52.554025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:52.554985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:52.555846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:52.739585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:52.762175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:52.764568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:52.768890 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f30801b3-9a65-4ca7-9245-338fef42cf35 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1371 microversion: 2.47 time: 0.242385 Oct 22 03:24:52.770780 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2319/4693] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:52 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:52.784796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:52.785731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:52.813081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:52.814005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:52.816858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:52.818333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:52.821891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:52.837469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:53.036028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:53.244654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:53.259816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:53.264327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:53.272927 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6cbdf32-d814-4a87-9b22-aa85e4987c4d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.496187 Oct 22 03:24:53.288594 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2320/4694] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:52 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:53.309212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:53.318741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:53.334444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:53.335162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:53.335758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:53.336862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:53.338330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:53.338974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:53.391025 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37de53dd-a15a-4c81-a8c8-6b2b3069a0e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action" status: 200 len: 14 microversion: 2.1 time: 0.096751 Oct 22 03:24:53.392131 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2321/4695] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:53 2022] POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:24:53.550761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:53.550761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:53.568538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:53.570143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:53.573433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:53.574530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:53.577311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:53.578193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.192766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:24:54.193262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:24:54.193713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:24:54.194151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:24:54.194689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:24:54.228934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.231549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.232020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.236722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.237493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.238124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.261879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:54.274410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73c77ab6-bd5b-4fcd-8b7b-71640ef1ca9d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 0.733180 Oct 22 03:24:54.275574 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2322/4696] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:53 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:54.305046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-3d8c7610-3594-443f-bcd2-3925558d6ac2 req-79d7303e-88df-4279-ada6-18c84f7d9b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d097da5a-0301-425a-8004-5bfbdfc3ebe8", "tag": "16b99da1-2d29-4542-9dda-0b8a68a38adb"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:54.310325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Getting quotas for project 1b67a14bf5e4423e9b811630a3ca66e3. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:54.334623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Getting quotas for user 68b228c872894aefadd62b339880e93f and project 1b67a14bf5e4423e9b811630a3ca66e3. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:54.334906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3d8c7610-3594-443f-bcd2-3925558d6ac2 req-79d7303e-88df-4279-ada6-18c84f7d9b96 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.338692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3d8c7610-3594-443f-bcd2-3925558d6ac2 req-79d7303e-88df-4279-ada6-18c84f7d9b96 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.341370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3d8c7610-3594-443f-bcd2-3925558d6ac2 req-79d7303e-88df-4279-ada6-18c84f7d9b96 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.374000 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-3d8c7610-3594-443f-bcd2-3925558d6ac2 req-79d7303e-88df-4279-ada6-18c84f7d9b96 service nova] Creating event network-changed:16b99da1-2d29-4542-9dda-0b8a68a38adb for instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 on n-h1-862416-2 Oct 22 03:24:54.387713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:24:54.392853 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-3d8c7610-3594-443f-bcd2-3925558d6ac2 req-79d7303e-88df-4279-ada6-18c84f7d9b96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115552 Oct 22 03:24:54.394113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:24:54.399545 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2323/4697] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:54.418203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:54.421708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:54.439962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.446883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.447363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.448115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.448930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.449692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.552228 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-983e1923-96fb-4f2b-a5cc-316aeac35b8f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.536641 Oct 22 03:24:54.552927 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2375/4698] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:24:54.564297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:54.586915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:54.599129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.599129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.599129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.599129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.600735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.600735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.636835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:54.653665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:54.660473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:54.662024 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97182f79-5833-47b9-b897-8e8b607db01d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1356 microversion: 2.47 time: 0.259509 Oct 22 03:24:54.665553 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2324/4699] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:54 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1356 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:54.703165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:54.711042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:54.738702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.739251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.739696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.743849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:54.744464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:54.753497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:54.858767 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e894268-709a-44aa-a416-870613aa5558 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action" status: 200 len: 14 microversion: 2.1 time: 0.191200 Oct 22 03:24:54.873922 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2325/4700] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:54 2022] POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:24:54.895530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bca9bd77-3831-4a47-bab6-37549979c4ee tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:54.896289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bca9bd77-3831-4a47-bab6-37549979c4ee tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:54.988035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:54.996992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:55.003034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:55.008519 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e66328c-2ebc-4e12-8bf6-da6d9f2a102a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.453811 Oct 22 03:24:55.026380 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2376/4701] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:54 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:55.035323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:55.056031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:55.057396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Searching by: {'deleted': False, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:24:55.064437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:55.065737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:55.066380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:55.067452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:55.068176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:55.068869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:55.083645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bca9bd77-3831-4a47-bab6-37549979c4ee tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:55.091957 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bca9bd77-3831-4a47-bab6-37549979c4ee tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1223 microversion: 2.1 time: 0.216601 Oct 22 03:24:55.105251 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2326/4702] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:54 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1223 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:55.131256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1786842245", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "266a2985-0fd7-4da4-b59a-d02f99a70423"}], "security_groups": [{"name": "tempest-securitygroup--159338294"}], "key_name": "tempest-keypair-367865601", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:55.392338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:24:55.507314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:55.528742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:55.529465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:55.530129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:55.543314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:55.545182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:55.570678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] validate_networks() for [('266a2985-0fd7-4da4-b59a-d02f99a70423', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:24:55.655597 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c70eb513-1ba6-420a-bd63-8828cd9b4189 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.627754 Oct 22 03:24:55.656863 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2377/4703] 10.222.0.25 () {60 vars in 1187 bytes} [Sat Oct 22 03:24:55 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:55.663044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:55.665292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:55.681684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:55.684613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:55.685294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:55.694668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:55.697058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:55.699135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.045209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:56.060950 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-78a5c141-bdca-4852-96a9-5fbc0bf66315 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 0.402128 Oct 22 03:24:56.062255 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2378/4704] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:55 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:56.082692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:56.087929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:56.095606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.097993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.098901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.099887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.100609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.101261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.140233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:24:56.348824 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f93af79-aaf6-41b1-8d50-6759b442a3b6 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 204 len: 0 microversion: 2.47 time: 0.282691 Oct 22 03:24:56.350252 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2379/4705] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:24:56 2022] DELETE /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:24:56.363584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:56.366957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:56.374784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.376876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.378777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.380490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.381556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.382406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.459773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Getting quotas for project 155c2a3bf2a24d92959c82e15c7645bd. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:56.488533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Getting quotas for user d98deb80919941558e8fb09e1b4fcc9c and project 155c2a3bf2a24d92959c82e15c7645bd. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:56.517642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:24:56.538431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:24:56.539345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:24:56.539831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:24:56.540610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:24:56.567953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.568515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.570368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.572707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.573459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.574447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.627549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Getting quotas for project 155c2a3bf2a24d92959c82e15c7645bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:24:56.639392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Getting quotas for user d98deb80919941558e8fb09e1b4fcc9c and project 155c2a3bf2a24d92959c82e15c7645bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:24:56.645327 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d1d2d5dd-6033-48be-91cd-09bb6a7af755 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action" status: 200 len: 14 microversion: 2.1 time: 0.287808 Oct 22 03:24:56.649335 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2380/4706] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:56 2022] POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action => generated 14 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:24:56.661159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:56.669867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:56.687791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.688325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.689519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.691321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.692028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.693327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.698796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:24:56.703785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:24:56.792772 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7cac198-1ff8-4b21-9a59-3140eedb33da tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.676421 Oct 22 03:24:56.795234 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2327/4707] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:24:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:24:56.849397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:56.850174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:56.897393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.897905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.898352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.904855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:56.905351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:56.905796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:56.991869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:57.001706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:57.005709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:57.011215 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-980fd315-49ba-46b7-ab28-a7803f342776 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.355381 Oct 22 03:24:57.016544 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2381/4708] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:56 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:57.023880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:57.039269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:57.057102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:57.057594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:57.058042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:57.059322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:57.065664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:57.065664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:57.117363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:57.134110 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-de025fe4-9acb-4625-b90c-dff5c7be3cea tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1275 microversion: 2.1 time: 0.332125 Oct 22 03:24:57.136603 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2328/4709] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:56 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1275 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:57.148009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a05a638f-61ce-4531-b768-0b128bea02dc tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:57.148975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a05a638f-61ce-4531-b768-0b128bea02dc tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:57.277698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:57.291627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:57.293197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a05a638f-61ce-4531-b768-0b128bea02dc tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:57.297787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:57.300567 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48cf7548-a6c6-455c-acdd-26e131481a3d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1362 microversion: 2.47 time: 0.282950 Oct 22 03:24:57.301361 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2382/4710] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:57 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:57.307213 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a05a638f-61ce-4531-b768-0b128bea02dc tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1269 microversion: 2.1 time: 0.169453 Oct 22 03:24:57.311141 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2329/4711] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:57 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:57.322751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:57.325361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:57.326293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:57.336067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:57.357046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:57.358438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:57.362519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:57.364130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:57.366301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:57.367280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:57.370217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:57.371280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:57.372803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:57.375298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:57.378932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:57.390824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:57.544967 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2077fc0a-d20d-42fc-b513-0399c0e86410 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/ips" status: 200 len: 151 microversion: 2.1 time: 0.227155 Oct 22 03:24:57.551562 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2383/4712] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:24:57 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/ips => generated 151 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:24:57.657009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:57.666025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:57.709475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:57.710093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:57.710560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:57.711336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:57.711805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:57.712288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:57.836402 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eadf06aa-50fd-4b48-b546-a956da55303b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action" status: 200 len: 14 microversion: 2.1 time: 0.171216 Oct 22 03:24:57.840909 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2384/4713] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:57 2022] POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 03:24:58.042933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:58.043653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:58.061197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:58.061768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:58.080838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:58.084356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:58.084899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:58.085349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:58.679254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:58.700574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:58.705785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:58.709656 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-31ec363b-25ef-465f-8d00-1718ef5bed1a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.671257 Oct 22 03:24:58.710907 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2385/4714] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:58 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:24:58.724085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:58.725098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:58.744809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:58.745700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:58.746922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:58.748594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:58.752360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:58.754463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:58.885820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:58.899453 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8bffef23-70a2-4ef9-a826-411f0ed1205b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 1.585074 Oct 22 03:24:58.901439 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2330/4715] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:57 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:58.910580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:58.921866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8543da25-dc5f-4524-aa07-247e392d4df9 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1281 microversion: 2.1 time: 0.209512 Oct 22 03:24:58.936737 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2386/4716] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:58 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:58.944009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:58.953326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:58.958104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:58.960751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:58.974471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:58.977892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:58.978452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:58.979141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:58.979905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:58.980412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:58.980969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:58.981581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:58.982444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:58.985900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:58.989605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:58.991613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:59.047109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:24:59.210256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:59.212398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:59.223066 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39f2d8ef-e258-419d-9780-61afc9be582a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1265 microversion: 2.1 time: 0.284973 Oct 22 03:24:59.223662 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2387/4717] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:24:58 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:59.232299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:59.235718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:59.239952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:24:59.241429 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90d75709-8cb2-4de0-9a8a-fe07d3c24c2f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1362 microversion: 2.47 time: 0.302656 Oct 22 03:24:59.241598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:59.248579 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2331/4718] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:58 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:24:59.265548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:59.266060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:59.266507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:59.269447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:59.271248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:59.271708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:59.739560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:24:59.740427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:24:59.760892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:59.767241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:59.768233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:59.771415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:59.772117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:59.772770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:24:59.882894 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-612fe5ad-bbc4-43d2-a969-dd61cb0cc351 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action" status: 200 len: 8204 microversion: 2.1 time: 0.653347 Oct 22 03:24:59.883554 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2388/4719] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:24:59 2022] POST /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c/action => generated 8204 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:24:59.888809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ad4fc518-599d-4936-a3b9-5eae7c9dd71b req-3a3113eb-2437-45d8-a420-9061b7c1107a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97055cc-112a-4d01-9d20-bfa7f95d9886", "name": "network-vif-plugged", "status": "completed", "tag": "a63a763d-2107-4dfb-abd1-11f0810c08e1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:24:59.938855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ad4fc518-599d-4936-a3b9-5eae7c9dd71b req-3a3113eb-2437-45d8-a420-9061b7c1107a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:24:59.942480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ad4fc518-599d-4936-a3b9-5eae7c9dd71b req-3a3113eb-2437-45d8-a420-9061b7c1107a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:24:59.947690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ad4fc518-599d-4936-a3b9-5eae7c9dd71b req-3a3113eb-2437-45d8-a420-9061b7c1107a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:00.014757 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ad4fc518-599d-4936-a3b9-5eae7c9dd71b req-3a3113eb-2437-45d8-a420-9061b7c1107a service nova] Creating event network-vif-plugged:a63a763d-2107-4dfb-abd1-11f0810c08e1 for instance a97055cc-112a-4d01-9d20-bfa7f95d9886 on n-h1-862416-2 Oct 22 03:25:00.038722 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ad4fc518-599d-4936-a3b9-5eae7c9dd71b req-3a3113eb-2437-45d8-a420-9061b7c1107a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153666 Oct 22 03:25:00.044023 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2389/4720] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:00.049648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:00.061246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:00.092390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:00.099184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:00.101646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:00.105026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:00.105736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:00.107608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:00.281821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:00.296325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:00.302235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:00.307870 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-afba1bff-73a1-4af7-8829-caf8e5c4b7b7 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.573047 Oct 22 03:25:00.320836 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2332/4721] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:24:59 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:25:00.366396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:00.367544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:00.426349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:00.431680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:00.432531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:00.463853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:00.464873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:00.479988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.082909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:01.093621 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf8024cc-79d3-46ac-a6e6-9c6d1ab5cdce tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 1.048151 Oct 22 03:25:01.095438 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2390/4722] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:00 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:01.101685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:01.102729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:01.110784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.111907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.112626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.113556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.114269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.132120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.226861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:01.247281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49ef1629-70e7-4318-b1ea-19437a893106 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 0.924958 Oct 22 03:25:01.272413 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2333/4723] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:00 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:01.286363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:01.301732 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b82dfa8-49d5-45ab-811b-94089e93782d tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1281 microversion: 2.1 time: 0.204540 Oct 22 03:25:01.302698 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2391/4724] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:01 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:01.308258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:01.309583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:01.313757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:01.314942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:01.327298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.328160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.328546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.329045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.329333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.329477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.330574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.331437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.332102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.344588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.345244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.348975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.387181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.388127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.389560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.390348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lazy-loading 'fault' on Instance uuid 7da085b5-8cfb-41e2-bbd8-f486887845a5 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:25:01.489069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:01.516898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:01.521413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:01.524706 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9cac1590-7f57-44de-8750-cbe6bfdafd48 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 200 len: 1367 microversion: 2.47 time: 0.220250 Oct 22 03:25:01.528401 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2392/4725] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:01 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:01.544989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:01.545199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:01.568682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.571641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.573421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.578377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.582804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.584724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.649424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:01.666116 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-36dee1aa-253b-460e-bbde-90feec9ac9e3 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1321 microversion: 2.1 time: 0.389296 Oct 22 03:25:01.666703 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2334/4726] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:01 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:01.698555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:01.699951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:01.722456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.723198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.723830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.726080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:01.726766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:01.728739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:01.924011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:01.946037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d6b4650-c62f-43bf-931f-7dafbc517616 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.404799 Oct 22 03:25:01.949315 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2393/4727] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:01 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:01.999635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36e11573-a221-4619-b8ad-4fdebd9ab307"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:02.003734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:02.027063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:02.027191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:02.031189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:02.031887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:02.032408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:02.037801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:02.038848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:02.040054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:02.045404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:02.046648 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-974d8875-cadd-4a56-a1e9-e3a3ff7064fc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.378991 Oct 22 03:25:02.047556 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2335/4728] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:01 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:02.058341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:02.061916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:02.083177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:02.083927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:02.084581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:02.086033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:02.086836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:02.087413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:02.544319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:02.557721 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c98522c-bcab-44e9-8410-6c59e6a03f3e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.505727 Oct 22 03:25:02.558994 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2336/4729] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:02 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:02.569175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:02.574139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:02.582001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:02.582788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:02.583457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:02.584413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:02.585068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:02.585947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:02.592497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:02.739414 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f3927db-331d-404e-8f24-94f4920781eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757674 Oct 22 03:25:02.760361 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2394/4730] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:25:01 2022] POST /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:02.816506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:02.819188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:02.854168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:02.854673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:02.855121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:02.855958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:02.876449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:02.877224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:02.987655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:03.010419 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c49a075-e4e2-4ef8-8418-fb32275caed4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 0.439452 Oct 22 03:25:03.012966 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2337/4731] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:02 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:03.023465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:03.029457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7da085b5-8cfb-41e2-bbd8-f486887845a5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:03.041294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:03.045114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:03.045876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:03.048118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:03.052349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:03.053335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:03.074667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] HTTP exception thrown: Instance 7da085b5-8cfb-41e2-bbd8-f486887845a5 could not be found. Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Request method failure captured: Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 HTTP/1.1 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JU1honJmbieCnhgt5yCxUQ7X948lqJysr4GUOkBHALXdki3GZlnN1mWTxmDWX0DnCiLNO2Zt6Q5LohCVVZqkh37IVoFRTkSkn6JlV4C6mPltrnQYB4etOT-H0HBOrryNAP_j3O6en-TPMJLYJcZz7RkCRKtuQFmWU3zj2wj_Y7pkM Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.47 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 6ed1af3343a448ca9ce29caaeff286c6 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerShowV247Test-310452514 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ed1af3343a448ca9ce29caaeff286c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ed1af3343a448ca9ce29caaeff286c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ed1af3343a448ca9ce29caaeff286c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ed1af3343a448ca9ce29caaeff286c6"}]}] Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerShowV247Test-310452514 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 6ed1af3343a448ca9ce29caaeff286c6 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerShowV247Test-310452514 Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerShowV247Test-310452514-project Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 1a31354f34dc49c8a251fb4921bf18ef Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerShowV247Test-310452514-project Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 7da085b5-8cfb-41e2-bbd8-f486887845a5 could not be found. Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '7da085b5-8cfb-41e2-bbd8-f486887845a5'} Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da085b5-8cfb-41e2-bbd8-f486887845a5 could not be found. Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da085b5-8cfb-41e2-bbd8-f486887845a5 could not be found. Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:03.079061 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:03.086934 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:03.086934 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:03.086934 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:03.086934 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:25:03.086934 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:25:03.086934 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da085b5-8cfb-41e2-bbd8-f486887845a5 could not be found. Oct 22 03:25:03.086934 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:03.089532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Returning 404 to user: Instance 7da085b5-8cfb-41e2-bbd8-f486887845a5 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:25:03.090644 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-960737a3-3756-4b80-8a49-790b4b6957d9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5" status: 404 len: 111 microversion: 2.47 time: 0.076564 Oct 22 03:25:03.091715 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2338/4732] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:03 2022] GET /compute/v2.1/servers/7da085b5-8cfb-41e2-bbd8-f486887845a5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:25:03.243154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:03.255444 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e11ad8f-6b44-45d6-a8a1-b768d4335bef tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.486834 Oct 22 03:25:03.284330 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2395/4733] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:02 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:03.293568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:03.297370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:03.316148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:03.317414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:03.319284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:03.320534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:03.323463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:03.326083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:03.495396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:03.511843 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fdc292d7-12bd-4ada-aa03-1fea9895fa63 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1321 microversion: 2.1 time: 0.225863 Oct 22 03:25:03.514994 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2396/4734] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:03 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:03.526942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:03.530104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:03.544862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:03.547354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:03.548026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:03.549016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:03.551135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:03.553678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:03.881896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:03.882524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:03.896364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:03.896849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:03.897294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:03.898020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:03.898489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:03.898922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:03.931408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:03.943985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:03.964174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:03.966753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-403679ee-bf94-47dc-ab72-bc7ab10c2151 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.450435 Oct 22 03:25:03.968360 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2397/4735] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:03 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:03.975373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:03.981532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:04.006806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:04.007296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:04.011664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:04.013128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:04.014923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:04.016999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:04.117292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:25:04.309749 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d9ca45ee-59e5-4eb9-a479-16d4967b53a9 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 204 len: 0 microversion: 2.47 time: 0.338423 Oct 22 03:25:04.321272 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2398/4736] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:25:03 2022] DELETE /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:25:04.334142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-26d08eb2-acfb-47c1-82ba-6401cf314092 req-00a0fd3f-6f02-4580-ad19-43e15f9b9ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097da5a-0301-425a-8004-5bfbdfc3ebe8", "name": "network-vif-plugged", "status": "completed", "tag": "16b99da1-2d29-4542-9dda-0b8a68a38adb"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:04.353055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-26d08eb2-acfb-47c1-82ba-6401cf314092 req-00a0fd3f-6f02-4580-ad19-43e15f9b9ebc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:04.353972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-26d08eb2-acfb-47c1-82ba-6401cf314092 req-00a0fd3f-6f02-4580-ad19-43e15f9b9ebc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:04.354936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-26d08eb2-acfb-47c1-82ba-6401cf314092 req-00a0fd3f-6f02-4580-ad19-43e15f9b9ebc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:04.371814 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-26d08eb2-acfb-47c1-82ba-6401cf314092 req-00a0fd3f-6f02-4580-ad19-43e15f9b9ebc service nova] Creating event network-vif-plugged:16b99da1-2d29-4542-9dda-0b8a68a38adb for instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 on n-h1-862416-2 Oct 22 03:25:04.380784 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-26d08eb2-acfb-47c1-82ba-6401cf314092 req-00a0fd3f-6f02-4580-ad19-43e15f9b9ebc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053715 Oct 22 03:25:04.386941 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2399/4737] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:04.394564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:04.395788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:04.403775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:04.404719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:04.405487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:04.406533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:04.407218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:04.408010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:04.732143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:04.746545 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-942e56d2-cac0-4b22-8a8e-6c2beec06f74 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 0.357856 Oct 22 03:25:04.747146 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2400/4738] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:04 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:04.756170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:04.757429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:04.765618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:04.766393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:04.767200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:04.768655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:04.769256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:04.769617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:05.144307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:05.501344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:05.503814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=20 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:05.529350 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-796a851d-2f7b-4048-96cb-ce240a22f175 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 2.436181 Oct 22 03:25:05.530027 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2339/4739] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:03 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:05.535358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:05.535974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:05.561859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:05.562507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:05.563113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:05.563877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:05.568595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:05.569222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:05.985794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:06.001044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:06.003847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:06.009612 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d416a4e8-b04e-49e3-98e7-3d19c025452a tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 200 len: 1362 microversion: 2.47 time: 0.476011 Oct 22 03:25:06.028825 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2340/4740] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:05 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:06.039680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:06.040951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:06.050670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.051505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.052174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.053130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.053790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.054437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.226845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:06.261082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d157136d-3c1b-4d8a-94e5-b7f1af1767d5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 1.512796 Oct 22 03:25:06.277461 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2401/4741] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:04 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:06.282799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:06.283668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:06.291582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.292334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.292942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.293816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.295862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.296509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.335450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:06.575456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:06.585805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:06.587359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:06.590028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:06.591629 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e284f9d-d8f6-4b6b-9ee9-4d73bf453e05 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.312874 Oct 22 03:25:06.596992 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2402/4742] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:06 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:06.603925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:06.604753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:06.614027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:06.615206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.616249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.616992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.620492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.621824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.622492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.631206 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7656cc52-a573-40ff-b7be-05234d8bcad7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1327 microversion: 2.1 time: 0.598501 Oct 22 03:25:06.632006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2341/4743] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:06 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1327 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:06.646099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:06.649907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:06.670432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.671903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.673837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.675900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.680030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.682565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.683639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Locking {{(pid=120581) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 22 03:25:06.802904 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18630d24-703b-4a14-8477-45a26078ecbc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.203284 Oct 22 03:25:06.808168 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2403/4744] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:06 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:25:06.815786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:06.816569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:06.819700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:06.830910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.833442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.834068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:06.834907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:06.835742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:06.836454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.062325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.075357 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c17959ba-ed96-4c80-90fc-f89f22461fb1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1321 microversion: 2.1 time: 0.441615 Oct 22 03:25:07.077164 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2342/4745] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:06 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:07.103969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:07.104592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:07.122580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.123358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.125323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.126850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.129119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.129763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.130353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.137733 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa253202-945f-4173-8560-496cc874d2d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.327925 Oct 22 03:25:07.138564 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2404/4746] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:06 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:07.164288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0fb0d7ca-74d4-4319-a40d-1903c1b73028 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:07.178516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fb0d7ca-74d4-4319-a40d-1903c1b73028 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.179035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fb0d7ca-74d4-4319-a40d-1903c1b73028 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.179483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fb0d7ca-74d4-4319-a40d-1903c1b73028 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.242151 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-0fb0d7ca-74d4-4319-a40d-1903c1b73028 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] HTTP exception thrown: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 is locked Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0fb0d7ca-74d4-4319-a40d-1903c1b73028 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Request method failure captured: Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action HTTP/1.1 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 15 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Fh1zrAV3t3KXx01cQXblz7hWmYKt-76cC8cmSebtHYnQKQ6-07LBdAlhscB-G6tA0KBEWmhguTVHXtHC-mZ051ajv54b_mHfqK5USw7BTbJtryaehovUtJ4vhB5F5cy2WfuByiSOyHd4j6nJIMUTEwGhnCO-2AV7v1DgpBUt1eVag Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 76599914af404f118b425b41a2432291 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76599914af404f118b425b41a2432291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76599914af404f118b425b41a2432291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}] Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 76599914af404f118b425b41a2432291 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f89d04db39be473097b885f7465115a2 Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: {"os-stop": {}} Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 is locked Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f6b5a94d-290e-4f62-91e9-2dbd0af49e80', 'body': {'os-stop': {}}} Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 is locked Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 is locked Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 is locked Oct 22 03:25:07.246262 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:07.253771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0fb0d7ca-74d4-4319-a40d-1903c1b73028 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Returning 409 to user: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 is locked {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:25:07.255237 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0fb0d7ca-74d4-4319-a40d-1903c1b73028 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 409 len: 107 microversion: 2.1 time: 0.096683 Oct 22 03:25:07.257036 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2405/4747] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:07 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 107 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:25:07.267445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:07.269490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:07.269633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.279657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.280409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.280866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.281606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.282074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.282764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.289914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.291580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.292942 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-634fd21a-c940-4198-b117-bd504714594f tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 200 len: 1362 microversion: 2.47 time: 0.194693 Oct 22 03:25:07.294258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2343/4748] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:07 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:07.304227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:07.317332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:07.323277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=14 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:07.325755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.326488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.327082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.328035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.328669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.334580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.367222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Unlocking {{(pid=120581) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 22 03:25:07.467195 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-24a698c5-a92a-403d-8581-7f9c653bf7b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.203379 Oct 22 03:25:07.470960 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2406/4749] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:07 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:25:07.477962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e4928ca6-c520-4d14-baea-4e73716f07cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:07.491323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4928ca6-c520-4d14-baea-4e73716f07cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.492279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4928ca6-c520-4d14-baea-4e73716f07cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.492969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4928ca6-c520-4d14-baea-4e73716f07cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.532594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e4928ca6-c520-4d14-baea-4e73716f07cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Going to try to stop instance {{(pid=120581) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:25:07.613691 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e4928ca6-c520-4d14-baea-4e73716f07cc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.139729 Oct 22 03:25:07.616683 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2407/4750] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:07 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:25:07.622952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:07.623964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:07.631011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.632132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.632867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.633996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.634678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.635324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.866614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.885997 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9287bde-d478-4e57-b23f-9b805c60f623 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.584027 Oct 22 03:25:07.888525 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2344/4751] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:07 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:07.925352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:07.927875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:07.939366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.941304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:07.948796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.948987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.950108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.950314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:07.951495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a68f6a6b-3cce-436c-9f99-725330e94ffc tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.333132 Oct 22 03:25:07.960374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.962295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.962989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.963675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.965154 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2408/4752] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:07 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:07.970223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:07.970822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:07.994488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.994982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.995422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:07.996146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:07.996619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:07.997049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.220905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:08.230885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c1a1f6a-9eeb-4211-9754-0237a58b7847 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.264522 Oct 22 03:25:08.246195 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2409/4753] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:07 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:08.248445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:08.254077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-666340d2-5cf3-4bae-97e4-21f95d790140 req-a14887eb-ba14-4dc3-a25e-a0ebfdca9cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb00ca77-eb2b-4caf-afb5-31e93205ba00", "tag": "274d3275-2157-4b78-9870-dc2189202df4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:08.256816 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01c02bac-940d-4f5b-9d17-edaca2600d78 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.366385 Oct 22 03:25:08.257432 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2345/4754] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:07 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:08.262059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:08.262674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:08.272459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-666340d2-5cf3-4bae-97e4-21f95d790140 req-a14887eb-ba14-4dc3-a25e-a0ebfdca9cc0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.273068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-666340d2-5cf3-4bae-97e4-21f95d790140 req-a14887eb-ba14-4dc3-a25e-a0ebfdca9cc0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.273728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-666340d2-5cf3-4bae-97e4-21f95d790140 req-a14887eb-ba14-4dc3-a25e-a0ebfdca9cc0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.280755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.281258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.281704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.282483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.282947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.284028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.291929 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-666340d2-5cf3-4bae-97e4-21f95d790140 req-a14887eb-ba14-4dc3-a25e-a0ebfdca9cc0 service nova] Creating event network-changed:274d3275-2157-4b78-9870-dc2189202df4 for instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 on n-h2-862416-2 Oct 22 03:25:08.297045 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-666340d2-5cf3-4bae-97e4-21f95d790140 req-a14887eb-ba14-4dc3-a25e-a0ebfdca9cc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048439 Oct 22 03:25:08.298208 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2410/4755] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:08.323060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:08.324059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:08.331554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.332282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.332885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.333941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.334412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.334970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.421542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:08.431271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:08.432926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:08.434280 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8fa423f3-2304-403f-8059-f3b8ad20224d tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 200 len: 1362 microversion: 2.47 time: 0.115706 Oct 22 03:25:08.448290 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2411/4756] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:08 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 1362 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:08.482425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:08.491404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e85ce791-24b3-4c1e-ae9b-860a2d1aec3b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1516 microversion: 2.1 time: 0.232990 Oct 22 03:25:08.492247 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2346/4757] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:08 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:08.513954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:08.516247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:08.523268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.523763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.524295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.525014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.525478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.525909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.557691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lazy-loading 'flavor' on Instance uuid d097da5a-0301-425a-8004-5bfbdfc3ebe8 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:25:08.609345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=5,nova_cell1:UPDATE=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:08.647186 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e3fcfd7b-6dbd-4aa7-8007-51229704bd3d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8/action" status: 200 len: 32 microversion: 2.1 time: 0.136656 Oct 22 03:25:08.648068 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2412/4758] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:08 2022] POST /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:25:08.660028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:08.661100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:08.681911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.682436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.682862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.686399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.687819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.688659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.884232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:08.894940 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fea7bddf-e808-4259-9607-f5482856d849 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.239660 Oct 22 03:25:08.900110 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2347/4759] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:08 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:08.920675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:08.921380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:08.928743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.929467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.930076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.930963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.931587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:08.932174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:08.987989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:08.988993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:08.997408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:08.999913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.000409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.001144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.001610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.002049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.198172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.206952 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a37fba3-f0b5-45b2-a42c-58f2a4b67f6f tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.290500 Oct 22 03:25:09.208261 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2413/4760] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:08 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:09.246068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.255247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.257226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.258424 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b3570a95-5826-4a60-9ba4-7e00c050e0bd tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.276437 Oct 22 03:25:09.259467 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2348/4761] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:08 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:09.261715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:09.263910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:09.271366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.272274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.272938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.273884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.274712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.275360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.286591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:09.287639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:09.294546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.295372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.296007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.296934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.297710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.299017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.451888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.465323 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18e94484-3daf-469c-8efa-45af598cd08f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.208019 Oct 22 03:25:09.466375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2414/4762] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:09 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:09.487383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:09.488544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:09.497264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.498112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.500019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.501395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.502843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.503920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.585575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.602368 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8d3ff577-fac5-4b60-99d9-d673223eb56c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.322963 Oct 22 03:25:09.616327 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2349/4763] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:09 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:09.616679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.617081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.621355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:09.621355 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-648cb2f9-9813-4a6c-9ce4-eb27e31ffb57 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 200 len: 1362 microversion: 2.47 time: 0.152058 Oct 22 03:25:09.621355 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2415/4764] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:09 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:09.925859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:09.927110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:09.934748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.935367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.935880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:09.936896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:09.937647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:09.938171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.237441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:10.238653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:10.247659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.248707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.249451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.250433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.251325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.251924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.388744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.401363 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9963bbc9-b9db-4b3d-a892-2e0b4504c4df tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.480928 Oct 22 03:25:10.402822 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2350/4765] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:09 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:10.409689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:10.410570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:10.417093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.418050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.419229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.420564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.421558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.422352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.475639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.486325 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d7c05c04-94f2-406d-bda8-df92fd86a54e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.255738 Oct 22 03:25:10.500895 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2416/4766] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:10 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:10.509048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:10.509986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:10.516841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.517648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.518842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.519794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.520503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.521315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.623907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.637876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.643851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.646417 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1970db0-b568-4b27-91a0-593b9b3c4b34 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.241859 Oct 22 03:25:10.648074 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2351/4767] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:10 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:10.653720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:10.654630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:10.663107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.664069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.664735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.665681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.666500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.667145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.704369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.714359 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-358a63d5-1c76-4a3b-8e10-6e56ab9033b7 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.211813 Oct 22 03:25:10.715403 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2417/4768] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:10 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:10.729987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:10.732896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:10.742268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.742973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.743450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.744175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:10.744714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:10.745146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:10.824577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.839133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.841134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.842523 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b4576455-0b42-4ad1-8230-dcae0fb37086 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 200 len: 1362 microversion: 2.47 time: 0.125618 Oct 22 03:25:10.843561 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2418/4769] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:10 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 1362 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:10.863602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:10.873015 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4cfeb66-f147-4a20-9454-95d684f6b26a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.223562 Oct 22 03:25:10.873595 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2352/4770] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:10 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:11.428385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:11.429217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:11.437626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.438349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.439041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.441466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.441925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.443048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.514357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:11.515105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:11.526127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.526617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.528084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.528835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.529295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.530141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.605773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:11.617288 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b9e0562-e61c-45ba-ab66-418c045c8d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.193600 Oct 22 03:25:11.617922 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2419/4771] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:11 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:11.677547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:11.678202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:11.684775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.685794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.686256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.687130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.687592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.688659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.844869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:11.855545 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9a4d749-89d7-4d21-a413-70541f90632e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.345758 Oct 22 03:25:11.869310 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2353/4772] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:11 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:11.893503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:11.893503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:11.900446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.901128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.901724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.903088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.903689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.904294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.915476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:11.928129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:11.929153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:11.931753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:11.933287 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-84ae2262-8115-4bd0-87d8-328565912ea0 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.260031 Oct 22 03:25:11.944730 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2420/4773] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:11 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:11.954444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:11.955056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:11.962044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.962765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.963723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:11.964642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:11.965264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:11.965689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.007831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.008587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.009175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.009778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lazy-loading 'fault' on Instance uuid 7e502e81-8992-43ff-99c4-b387c55350af {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:25:12.066634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:12.075700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:12.077180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:12.078592 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-857d91d6-26f6-44af-85ef-a5f66b1ad0a7 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 200 len: 1367 microversion: 2.47 time: 0.132725 Oct 22 03:25:12.079156 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2421/4774] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:11 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 1367 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:12.084686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:12.085473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:12.092241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.097637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.098093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.098859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.099373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.099752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.131394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:12.140044 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1bd3fa72-2202-4f6b-92ad-11d58d65e3c0 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.269603 Oct 22 03:25:12.140660 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2354/4775] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:11 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:12.189609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d8bce0e4-54f2-4c6e-8a9d-5089968d927b req-a6b59fe3-0c8e-49b9-9d64-3f47d953e5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56532615-7ea4-4368-9039-4e52cd63c4bd", "tag": "0b989957-1d60-4fe9-a53e-9104e05ee137"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:12.199774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d8bce0e4-54f2-4c6e-8a9d-5089968d927b req-a6b59fe3-0c8e-49b9-9d64-3f47d953e5b5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.200725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d8bce0e4-54f2-4c6e-8a9d-5089968d927b req-a6b59fe3-0c8e-49b9-9d64-3f47d953e5b5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.201339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d8bce0e4-54f2-4c6e-8a9d-5089968d927b req-a6b59fe3-0c8e-49b9-9d64-3f47d953e5b5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.217629 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d8bce0e4-54f2-4c6e-8a9d-5089968d927b req-a6b59fe3-0c8e-49b9-9d64-3f47d953e5b5 service nova] Creating event network-changed:0b989957-1d60-4fe9-a53e-9104e05ee137 for instance 56532615-7ea4-4368-9039-4e52cd63c4bd on n-h2-862416-2 Oct 22 03:25:12.225407 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d8bce0e4-54f2-4c6e-8a9d-5089968d927b req-a6b59fe3-0c8e-49b9-9d64-3f47d953e5b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039428 Oct 22 03:25:12.226239 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2355/4776] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:25:12.280621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:12.289542 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abfc374a-3943-4dfc-97e9-1120be5a9f1d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.209222 Oct 22 03:25:12.295730 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2422/4777] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:12 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:12.643979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:12.644712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:12.650736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.651214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.651646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.652356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.652811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.653240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.791365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:12.799684 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8093ed8c-0478-4766-871e-255772ea628f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.160457 Oct 22 03:25:12.812128 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2356/4778] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:12 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:12.885982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:12.886597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:12.893432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.894041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.894489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.895194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.895653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.896094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.977280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:12.977975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:12.984547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.985100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.985620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:12.987093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:12.987834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:12.988129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.069287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.078921 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-94a268e5-7251-4d66-9dab-31a97986d932 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.196563 Oct 22 03:25:13.079524 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2423/4779] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:12 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:13.107595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:13.108532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:13.115429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.115921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.116401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.117111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.117575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.118009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.141177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.150317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.151776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.153070 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-143fcf97-07e4-4baa-b7d2-f94e7f46c960 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.190828 Oct 22 03:25:13.153625 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2357/4780] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:12 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:13.158162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.159505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.160080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.160628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lazy-loading 'fault' on Instance uuid 7e502e81-8992-43ff-99c4-b387c55350af {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:25:13.168201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:13.168949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:13.175592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.176356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.176902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.177708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.178259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.178762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.210137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.218932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.220468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a31354f34dc49c8a251fb4921bf18ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed1af3343a448ca9ce29caaeff286c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.222046 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a50bdbe6-026f-41b1-a2d6-9b78a8dc3f84 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 200 len: 1367 microversion: 2.47 time: 0.118348 Oct 22 03:25:13.222628 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2424/4781] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:13 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 1367 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:25:13.313298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:13.313917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:13.320135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.320658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.321099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.321808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.322204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.322351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.322688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.329950 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6595efc4-5394-4396-bd84-d11c99258c79 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.170697 Oct 22 03:25:13.338904 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2358/4782] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:13 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:13.464751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.479419 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-06bc094a-6ceb-49b6-8271-58ce4cf0e8ec tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.169951 Oct 22 03:25:13.480005 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2425/4783] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:13 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:13.823474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:13.824152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:13.831886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.832407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.832878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.833592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:13.834051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:13.834519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:13.970366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:13.978745 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13a1e8b9-9e55-4ce7-bd97-740e4f0eaa15 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.158961 Oct 22 03:25:14.005972 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2359/4784] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:13 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:14.103557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:14.105225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:14.112984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.113727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.114519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.115440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.116237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.116823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.181956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:14.182915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:14.194271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.195702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.196493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.197433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.198299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.199088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.280862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:14.290291 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9edc1feb-4264-42be-81e0-55987d179476 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.190510 Oct 22 03:25:14.290937 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2426/4785] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:14 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:14.296567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:14.297387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] [instance: 7e502e81-8992-43ff-99c4-b387c55350af] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:14.305829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.306587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.307218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.307936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.308446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.308926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.324555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] HTTP exception thrown: Instance 7e502e81-8992-43ff-99c4-b387c55350af could not be found. Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Request method failure captured: Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af HTTP/1.1 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JU1honJmbieCnhgt5yCxUQ7X948lqJysr4GUOkBHALXdki3GZlnN1mWTxmDWX0DnCiLNO2Zt6Q5LohCVVZqkh37IVoFRTkSkn6JlV4C6mPltrnQYB4etOT-H0HBOrryNAP_j3O6en-TPMJLYJcZz7RkCRKtuQFmWU3zj2wj_Y7pkM Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.47 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 6ed1af3343a448ca9ce29caaeff286c6 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerShowV247Test-310452514 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ed1af3343a448ca9ce29caaeff286c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ed1af3343a448ca9ce29caaeff286c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ed1af3343a448ca9ce29caaeff286c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ed1af3343a448ca9ce29caaeff286c6"}]}] Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerShowV247Test-310452514 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 6ed1af3343a448ca9ce29caaeff286c6 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerShowV247Test-310452514 Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerShowV247Test-310452514-project Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 1a31354f34dc49c8a251fb4921bf18ef Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerShowV247Test-310452514-project Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 7e502e81-8992-43ff-99c4-b387c55350af could not be found. Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '7e502e81-8992-43ff-99c4-b387c55350af'} Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e502e81-8992-43ff-99c4-b387c55350af could not be found. Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e502e81-8992-43ff-99c4-b387c55350af could not be found. Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:14.326230 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e502e81-8992-43ff-99c4-b387c55350af could not be found. Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] Returning 404 to user: Instance 7e502e81-8992-43ff-99c4-b387c55350af could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-662fe8bf-af4d-4328-b210-0fed5ecdb166 tempest-ServerShowV247Test-310452514 tempest-ServerShowV247Test-310452514-project] 10.222.0.25 "GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af" status: 404 len: 111 microversion: 2.47 time: 0.035448 Oct 22 03:25:14.331467 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2427/4786] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:14 2022] GET /compute/v2.1/servers/7e502e81-8992-43ff-99c4-b387c55350af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:25:14.354557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:14.355264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:14.362358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.363106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.363760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.365929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.366465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.366981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.540246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:14.545062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:14.551980 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-979ef056-b543-4ffd-84d4-a7da9c59b9ef tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.201159 Oct 22 03:25:14.564231 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2428/4787] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:14 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:14.564231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:14.564231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:14.568538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.569307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.570015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.570944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:14.571654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:14.572719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:14.606428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:14.625369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:14.626816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:14.629101 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a99f2827-8c73-45cb-8fc6-6c3b0dce2dce tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.452028 Oct 22 03:25:14.629687 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2360/4788] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:14 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:25:14.748021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:14.782049 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dbc5f1e8-57d9-497a-be52-af9789188fe2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.227073 Oct 22 03:25:14.782661 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2429/4789] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:14 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:15.011045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:15.012620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:15.027688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.028450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.029865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.030581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.031055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.031469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.206759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:15.216830 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47fa4f53-d3a3-4298-8dee-0abd0f5f263a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.213728 Oct 22 03:25:15.232235 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2361/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:15 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:15.320944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:15.325773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:15.335502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.335993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.336457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.337173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.337627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.338056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.569364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:15.577076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:15.577966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:15.585082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0fa12e2-3647-416c-9c0e-56fc83a5a0e5 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.274078 Oct 22 03:25:15.585898 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2430/4791] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:15 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:15.586260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.586869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.587316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.588033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.588519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.588953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.656110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:15.657120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:15.663611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.664528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.665151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.666024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.667243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.667835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.769068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:15.778124 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a04875d-beed-46c5-b05b-5614d018ac1d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.204802 Oct 22 03:25:15.778712 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2362/4792] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:15 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:15.808100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:15.809075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:15.816025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.816554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.816993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.817699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:15.818152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:15.818577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:15.906611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:15.917092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:15.918925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:15.920528 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1ee5608a-13d3-4e1e-8bd6-6ca40401f1f9 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.269339 Oct 22 03:25:15.921619 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2431/4793] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:15 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:25:16.059373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:16.068794 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90072395-9d66-4394-b733-189db8a7ad82 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.265443 Oct 22 03:25:16.069369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2363/4794] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:15 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:16.245904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:16.246510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:16.252753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:16.253251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:16.253701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:16.254415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:16.254877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:16.255308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:16.434606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:16.458384 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c0bb4be-b28d-40d6-ba11-02526c86de89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.216215 Oct 22 03:25:16.458982 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2432/4795] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:16 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:16.618699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:16.619321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:16.625747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:16.630032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:16.630032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:16.630032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:16.630032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:16.630032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:16.774119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:16.782110 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2b21c56-1afe-44cf-b8be-e23840e7c4d2 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.168816 Oct 22 03:25:16.782998 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2364/4796] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:16 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:16.802886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:16.803510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:16.809836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:16.810327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:16.810771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:16.811475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:16.811937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:16.812475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:16.947456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:16.948067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:16.954222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:16.955028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:16.955690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:16.956626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:16.957241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:16.957880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:16.964262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:16.976047 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3866228e-355e-4c49-b50c-c5bde3599af1 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.177706 Oct 22 03:25:16.977143 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2433/4797] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:16 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:17.094092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:17.094882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:17.102055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:17.102755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:17.103353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:17.104235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:17.104848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:17.105447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:17.134991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:17.146049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:17.148814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:17.150229 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b15d82e9-3257-44c5-aa36-e1e8c69eab72 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.206676 Oct 22 03:25:17.151191 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2365/4798] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:16 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:17.333958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:17.344523 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe0e94b3-acde-4587-a0a0-dc8c3d8ff948 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.255206 Oct 22 03:25:17.346589 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2434/4799] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:17 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:17.421361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad6ae307-caf9-4b8e-9074-b252ba3be791 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: .version_select at 0x7f0d1986b3a0>, body: {"keypair": {"name": "tempest-keypair-1045829975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjv8aGPr9t2HLg7NywlHeEz7fVCHW7C/OP+Y/BkVSSIBiMsOmX4uxHOtoFxyPdX3h+6SCkWhQa4GYfQ/Mlkv1hSdJ5ptWX0V5E9sssq+WZi/d9jv4FCKw37pkzmW6FyBw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:17.457293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ad6ae307-caf9-4b8e-9074-b252ba3be791 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:25:17.467433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ad6ae307-caf9-4b8e-9074-b252ba3be791 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for user 3ad9769823b74399aabb7395eeee44aa and project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:25:17.489219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:17.489835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:17.496911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:17.497412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:17.498787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:17.499853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:17.501834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:17.503795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:17.522499 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad6ae307-caf9-4b8e-9074-b252ba3be791 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105452 Oct 22 03:25:17.523283 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2366/4800] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:25:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:17.636863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7fae041d-8729-417b-aef0-1505c988764e req-d7b5c7fd-1e0e-4b9d-84da-20752f1deb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d2acf4-a7dd-46af-ae59-83a28eccaa4f", "name": "network-vif-plugged", "status": "completed", "tag": "01c4850c-25d7-4312-836a-b864a1ef4bed"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:17.659951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7fae041d-8729-417b-aef0-1505c988764e req-d7b5c7fd-1e0e-4b9d-84da-20752f1deb95 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:17.661573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7fae041d-8729-417b-aef0-1505c988764e req-d7b5c7fd-1e0e-4b9d-84da-20752f1deb95 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:17.664169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7fae041d-8729-417b-aef0-1505c988764e req-d7b5c7fd-1e0e-4b9d-84da-20752f1deb95 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:17.680499 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7fae041d-8729-417b-aef0-1505c988764e req-d7b5c7fd-1e0e-4b9d-84da-20752f1deb95 service nova] Creating event network-vif-plugged:01c4850c-25d7-4312-836a-b864a1ef4bed for instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f on n-h2-862416-2 Oct 22 03:25:17.690600 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7fae041d-8729-417b-aef0-1505c988764e req-d7b5c7fd-1e0e-4b9d-84da-20752f1deb95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057768 Oct 22 03:25:17.693687 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2367/4801] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:25:17.812990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:17.820969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:17.825900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:17.837816 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ff68e316-b7df-4d1f-9b70-82aa97f0eb61 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.352496 Oct 22 03:25:17.850916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:17.852760 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2435/4802] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:17 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:17.854058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:17.857832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:17.863619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:17.864137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:17.867517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.001722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:18.003392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:18.012949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.016475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.017112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.019691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.020377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.022333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.230991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:18.231573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:18.240314 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20e8123e-ab42-439a-be20-8b216593f882 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.434537 Oct 22 03:25:18.240662 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-09e9abb1-7920-4008-851d-6ee14cb99042 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.243578 Oct 22 03:25:18.241638 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2436/4803] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:17 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:18.244481 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2368/4804] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:17 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:18.265367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:18.267491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:18.283057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.284702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.285793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.286667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.287208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.287679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.371081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:18.372026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:18.383701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.384789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.385441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.386564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.387937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.388640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.546969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:18.558895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:18.569510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:18.573322 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6f9a843-6ba9-4822-926e-9ad234a706a2 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.329325 Oct 22 03:25:18.577628 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2437/4805] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:18 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:18.601484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:18.614303 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39a86205-8978-40a9-8d56-d154a20fbc93 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1654 microversion: 2.1 time: 0.248356 Oct 22 03:25:18.615816 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2369/4806] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:18 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1654 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:18.637985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a072dde-4fda-45e9-be0e-face4a3b1a12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:18.645565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a072dde-4fda-45e9-be0e-face4a3b1a12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.646047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a072dde-4fda-45e9-be0e-face4a3b1a12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.646702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a072dde-4fda-45e9-be0e-face4a3b1a12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.686373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a072dde-4fda-45e9-be0e-face4a3b1a12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Going to try to start instance {{(pid=120581) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 03:25:18.743335 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a072dde-4fda-45e9-be0e-face4a3b1a12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.109203 Oct 22 03:25:18.744153 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2438/4807] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:18 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:25:18.754410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:18.755026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:18.765997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.766716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.767303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.769113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.770353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.771024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.867463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:18.868718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:18.877654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.878669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.883173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:18.885383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:18.886168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:18.887582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:19.048162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:19.060985 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ec1682f-b23f-419d-8265-1f5556f4da42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1663 microversion: 2.1 time: 0.310498 Oct 22 03:25:19.062853 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2370/4808] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:18 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1663 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:19.186667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:19.202388 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50e939c2-2572-47a1-a98c-80bbd54fdab7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.340869 Oct 22 03:25:19.206916 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2439/4809] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:18 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:19.283693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:19.285459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:19.286134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:19.287094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:19.299288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:19.300135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:19.300864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:19.303056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:19.303274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:19.303882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:19.304256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:19.305183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:19.305785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:19.308888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:19.309711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:19.310407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:19.712252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:19.728413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b934723b-c8c1-4cf0-b5bd-1c5bf64c8424 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.447227 Oct 22 03:25:19.730783 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2440/4810] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:19 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:19.745309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:19.747923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:19.762941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:19.763445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:19.763923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:19.766514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:19.769438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:19.771547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:19.854658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:19.867282 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa30d6b6-e538-4b9a-a538-5cd59a332b5a tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.589129 Oct 22 03:25:19.868704 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2371/4811] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:19 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:20.044258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:20.060194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:20.061721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:20.062962 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-469a1efd-175d-4874-9b22-e87d17422090 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.330490 Oct 22 03:25:20.063530 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2441/4812] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:19 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:20.094126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:20.094738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:20.112930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:20.113719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:20.114732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:20.115630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:20.116314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:20.117056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:20.235183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:20.237435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:20.245859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:20.246588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:20.247101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:20.247836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:20.248595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:20.253263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:20.312506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:20.322994 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4cb704c8-8d89-4e24-bc14-cfbbab32551d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1663 microversion: 2.1 time: 0.237667 Oct 22 03:25:20.326027 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2372/4813] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:20 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1663 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:20.401403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1618289214", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db13738c-9ec5-42b7-9de3-e09248983a6a"}], "security_groups": [{"name": "tempest-securitygroup--1765997193"}], "key_name": "tempest-keypair-1045829975", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:20.490708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:20.499793 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-85d12d58-4f95-4b61-a880-71706549626c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.268706 Oct 22 03:25:20.500838 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2442/4814] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:20 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:20.617800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] validate_networks() for [('db13738c-9ec5-42b7-9de3-e09248983a6a', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:25:20.758573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:20.759830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:20.775692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:20.776322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:20.776959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:20.777820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:20.778622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:20.779256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.016312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:21.026562 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d61a4932-5d86-4717-951f-a5c4eb9840f8 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.275151 Oct 22 03:25:21.027848 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2443/4815] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:20 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:21.039454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:21.040311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:21.048344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.049597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.050285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.051208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.051893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.052652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.072397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:21.184547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:25:21.185178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:25:21.185991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:25:21.187800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:25:21.188479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:25:21.198889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.199647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.200395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.201295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.201912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.202524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.234414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:25:21.244331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for user 3ad9769823b74399aabb7395eeee44aa and project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:25:21.262965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:25:21.273433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:25:21.277067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:21.290301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-02fca283-f8a1-4124-a37b-dbffade09e9d tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.260685 Oct 22 03:25:21.291998 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2444/4816] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:21 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:21.299866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:21.301116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:21.311390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.313868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.315161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.316176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.317463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.319151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.375297 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6f22e9cb-8809-4798-9802-6160d015207c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.978771 Oct 22 03:25:21.384420 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2373/4817] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:25:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:25:21.389431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:21.390707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:21.401975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.403589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.405977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.406868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.407690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.408435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.439119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:21.596554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:21.611943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:21.614015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:21.615253 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-71361a32-f0f6-4ec7-a2c9-e0f80c5c9063 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.321201 Oct 22 03:25:21.619275 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2445/4818] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:21 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:21.633340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-51771b50-f0bc-4e31-ba3f-948a32ad0457 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:21.634186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-51771b50-f0bc-4e31-ba3f-948a32ad0457 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:21.717556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:21.728435 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-94909d8d-58b5-4f1a-a095-1cbca49a99b2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.342710 Oct 22 03:25:21.740306 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2374/4819] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:21 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:21.759801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-51771b50-f0bc-4e31-ba3f-948a32ad0457 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:21.768257 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-51771b50-f0bc-4e31-ba3f-948a32ad0457 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1242 microversion: 2.1 time: 0.145174 Oct 22 03:25:21.773835 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2446/4820] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:21 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:21.786263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:21.787219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:21.793656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.794459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.795140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.796254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:21.796950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:21.797577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:21.995742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1fcc93d2-b382-4f10-9a65-fae31574c6e9 req-fdd5cc54-d2bc-48e2-8d9f-90634498585b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb00ca77-eb2b-4caf-afb5-31e93205ba00", "name": "network-vif-plugged", "status": "completed", "tag": "274d3275-2157-4b78-9870-dc2189202df4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:22.030854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1fcc93d2-b382-4f10-9a65-fae31574c6e9 req-fdd5cc54-d2bc-48e2-8d9f-90634498585b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.035638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1fcc93d2-b382-4f10-9a65-fae31574c6e9 req-fdd5cc54-d2bc-48e2-8d9f-90634498585b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.036188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1fcc93d2-b382-4f10-9a65-fae31574c6e9 req-fdd5cc54-d2bc-48e2-8d9f-90634498585b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.059881 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1fcc93d2-b382-4f10-9a65-fae31574c6e9 req-fdd5cc54-d2bc-48e2-8d9f-90634498585b service nova] Creating event network-vif-plugged:274d3275-2157-4b78-9870-dc2189202df4 for instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 on n-h2-862416-2 Oct 22 03:25:22.067781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:22.089776 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c91c17a9-e727-4d4c-b332-0cf5ff09649b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.314051 Oct 22 03:25:22.090930 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2447/4821] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:21 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:22.107281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1fcc93d2-b382-4f10-9a65-fae31574c6e9 req-fdd5cc54-d2bc-48e2-8d9f-90634498585b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375841 Oct 22 03:25:22.110939 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2375/4822] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:22.112493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:22.126762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:22.145167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:22.145881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:22.159314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.161732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.162187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.162931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.170301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.170301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.176974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.177478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.177921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.178647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.183577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.190093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.432022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:22.441791 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8c7d31f-5521-42bf-a091-75576c4bfdb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.347018 Oct 22 03:25:22.457332 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2448/4823] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:22 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:22.463297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:22.463910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:22.465170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:22.474401 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ee19852-6999-4c9a-ad76-9457b9794c85 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.358624 Oct 22 03:25:22.481270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.481270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.481270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.481270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.481270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.481270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.485055 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2376/4824] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:22 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:22.495050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:22.495536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:22.511963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.512481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.513278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.514348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.515767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.519031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.570079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Unlocking {{(pid=120582) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 22 03:25:22.638782 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e0cf197-9091-4ccc-b556-21856b1d6c0b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.152309 Oct 22 03:25:22.647389 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2377/4825] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:22 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:25:22.656412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:22.657332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:22.673033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.673531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.674297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.675020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.675484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.675912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.737177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:22.753922 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-977d0b17-2e7c-4936-9b5a-bdb670b70246 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.295463 Oct 22 03:25:22.755803 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2449/4826] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:22 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:22.765742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:22.766364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:22.785384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.785895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.786346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.787649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:22.788117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:22.793007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:22.963423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:22.975324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:22.977133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:22.978406 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-94b69b9a-1a7f-4641-9348-5fbd3b1fa552 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1729 microversion: 2.20 time: 0.332669 Oct 22 03:25:22.980102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2378/4827] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:22 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1729 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:23.005492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:23.006374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:23.022094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.022682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.023741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.024664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.025128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.025778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.135974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:23.155290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:23.161188 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2c8e2374-9b36-4bb0-97cd-e3f812e19b78 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1294 microversion: 2.1 time: 0.178471 Oct 22 03:25:23.162844 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2379/4828] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:22 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1294 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:23.167256 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30c95367-6ba9-4537-802f-853a39b9dc4f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.408277 Oct 22 03:25:23.169375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2450/4829] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:22 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:23.173415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:23.176920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:23.184972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.186121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.186894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.187925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.188878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.190207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.195330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:23.196636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:23.203010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:23.204830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.206918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.207837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.208743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.209413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.210017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.508095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:23.511868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:23.524604 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b1c3d5f7-ac7f-4cf0-93bc-678da831cb12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.331892 Oct 22 03:25:23.527736 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-07b44a6f-430e-48a7-8519-81b50feb18ab tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.363011 Oct 22 03:25:23.528243 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2451/4830] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:23 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:23.540375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:23.541404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:23.545600 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2380/4831] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:23 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:23.553786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.554719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.555364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.556281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.556866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:23.557065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.557471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:23.557848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.573266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.573760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.574189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.581689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.582210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.582698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.835828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:23.847494 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-75bfbfac-9aa4-44c4-9bf9-132cb564f2e6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.294689 Oct 22 03:25:23.850450 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2381/4832] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:23 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:23.868864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:23.869683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:23.873489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:23.881334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.881829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.882265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.883000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.883454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.883880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.931920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:23.944333 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca10b945-a1a4-4c73-ab9a-4ce3c88a7a6c tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1323 microversion: 2.1 time: 0.414953 Oct 22 03:25:23.946538 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2452/4833] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:23 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1323 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:23.966471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:23.967245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:23.974449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.978731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.979187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:23.979917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:23.980445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:23.980881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.071870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-350ce147-8d60-4973-b549-25aed83d574a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.123151 Oct 22 03:25:24.072913 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2453/4834] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:23 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:25:24.080422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:24.081663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:24.089725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.090528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.091208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.092127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.093031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.093456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.212642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:24.220317 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4952eb46-f0ba-425c-aae9-adb580cff798 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.365540 Oct 22 03:25:24.224680 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2382/4835] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:23 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:24.229614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:24.230225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:24.250726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.251233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.251693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.252750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.253212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.253656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.364973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:24.393826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:24.397157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:24.404485 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a02da01d-2246-4742-abe4-596d64a99d84 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1716 microversion: 2.20 time: 0.329913 Oct 22 03:25:24.405829 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2454/4836] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:25:24 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1716 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:25:24.411685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0be43360-eba8-497d-80b5-50e034995c1d req-abee0632-a105-4492-9f56-0de739833af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56532615-7ea4-4368-9039-4e52cd63c4bd", "name": "network-vif-plugged", "status": "completed", "tag": "0b989957-1d60-4fe9-a53e-9104e05ee137"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:24.421626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0be43360-eba8-497d-80b5-50e034995c1d req-abee0632-a105-4492-9f56-0de739833af7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.422342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0be43360-eba8-497d-80b5-50e034995c1d req-abee0632-a105-4492-9f56-0de739833af7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.423242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0be43360-eba8-497d-80b5-50e034995c1d req-abee0632-a105-4492-9f56-0de739833af7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.437580 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0be43360-eba8-497d-80b5-50e034995c1d req-abee0632-a105-4492-9f56-0de739833af7 service nova] Creating event network-vif-plugged:0b989957-1d60-4fe9-a53e-9104e05ee137 for instance 56532615-7ea4-4368-9039-4e52cd63c4bd on n-h2-862416-2 Oct 22 03:25:24.454715 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0be43360-eba8-497d-80b5-50e034995c1d req-abee0632-a105-4492-9f56-0de739833af7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046898 Oct 22 03:25:24.456645 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2455/4837] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:24.465220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:24.466292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:24.492565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.493449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.494370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.495320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.509281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.510543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:24.511321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.523415 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7f78c50f-9e5b-42a3-bbaf-2a01df6eb728 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1672 microversion: 2.1 time: 0.297456 Oct 22 03:25:24.525900 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2383/4838] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:24 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1672 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:24.552982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:24.553986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:24.562545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.564912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.570246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.571317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.571958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.574046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.597056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:24.607134 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9368bfd-360d-45db-bbd5-4ecbefbda2e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1300 microversion: 2.1 time: 0.147284 Oct 22 03:25:24.608024 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2456/4839] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:24 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:24.890025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:24.898314 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6fc47037-3a3d-4552-a621-7f635ff5f3f1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.349700 Oct 22 03:25:24.914409 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2384/4840] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:24 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:24.975410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:24.976115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:24.984164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.984680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.985647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:24.985785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:24.986564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:24.986926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.226627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:25.235465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-88fdd77d-3eaa-4b83-8c45-ca311dd6e1ce tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1521 microversion: 2.1 time: 0.265173 Oct 22 03:25:25.238859 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2457/4841] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:24 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:25.245249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:25.246078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:25.254257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.254977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.255936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.256985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.257594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.258339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.268499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:25.269179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:25.281809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.282545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.283243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.284297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.285050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.285834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.344901 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] HTTP exception thrown: Instance is not a member of specified network Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Request method failure captured: Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00/ips/invalid HTTP/1.1 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2KDc9GEEbRaKRaeEiVJeQWdxrxBz9CqED3RJdbWg2ILL4LiMJTH_o73no3iMVWklBOHEV-GD0YYG4Ch7zv44apw_iKyIBoNOFm2uzO4c-C4HNp6tRe1PzhrA95eOXpLYcl-gy-UKEAVKSGHIN96_KeLRQmhrJVLFRlGRSGhi88y0vM Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1b67a14bf5e4423e9b811630a3ca66e3 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b67a14bf5e4423e9b811630a3ca66e3"}]}] Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1b67a14bf5e4423e9b811630a3ca66e3 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerAddressesNegativeTestJSON-319709271-project Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 68b228c872894aefadd62b339880e93f Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-319709271-project Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance is not a member of specified network Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': 'bb00ca77-eb2b-4caf-afb5-31e93205ba00', 'id': 'invalid'} Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 22 03:25:25.353700 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:25.358612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:25:25.361735 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d1c61dc2-a827-4b01-b1a4-362f253fcd63 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.099592 Oct 22 03:25:25.363925 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2458/4842] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:25:25 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00/ips/invalid => generated 91 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:25:25.375087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6871dc22-65c9-451b-91f8-19da57e6a943 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:25.377711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6871dc22-65c9-451b-91f8-19da57e6a943 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Failed to fetch instance by id 999 {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 22 03:25:25.379589 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6871dc22-65c9-451b-91f8-19da57e6a943 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] HTTP exception thrown: Instance 999 could not be found. Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6871dc22-65c9-451b-91f8-19da57e6a943 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Request method failure captured: Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2KDc9GEEbRaKRaeEiVJeQWdxrxBz9CqED3RJdbWg2ILL4LiMJTH_o73no3iMVWklBOHEV-GD0YYG4Ch7zv44apw_iKyIBoNOFm2uzO4c-C4HNp6tRe1PzhrA95eOXpLYcl-gy-UKEAVKSGHIN96_KeLRQmhrJVLFRlGRSGhi88y0vM Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1b67a14bf5e4423e9b811630a3ca66e3 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b67a14bf5e4423e9b811630a3ca66e3"}]}] Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1b67a14bf5e4423e9b811630a3ca66e3 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerAddressesNegativeTestJSON-319709271-project Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 68b228c872894aefadd62b339880e93f Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-319709271-project Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 999 could not be found. Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': '999'} Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 22 03:25:25.383576 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:25.390511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6871dc22-65c9-451b-91f8-19da57e6a943 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:25:25.395929 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6871dc22-65c9-451b-91f8-19da57e6a943 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020463 Oct 22 03:25:25.396653 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2459/4843] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Oct 22 03:25:25 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 22 03:25:25.407910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:25.408967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:25.416921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.417625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.418240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.418953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.419416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.419857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.459232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:25:25.553342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:25.562093 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8a2ea65-553b-4c8c-baef-a58c97201fb9 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.320676 Oct 22 03:25:25.562709 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2385/4844] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:25 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:25.572399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:25.573232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:25.580079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-56281a5a-68f0-420f-a7c9-08d6d4b03f1b tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 204 len: 0 microversion: 2.1 time: 0.176142 Oct 22 03:25:25.583063 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2460/4845] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:25:25 2022] DELETE /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:25:25.592643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:25.593347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:25.593898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.594400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.594840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.596087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.598557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.599010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.602117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.602616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.603115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.603840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.604338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.604824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.634117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:25.792236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:25.804758 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c24c2000-fe26-42e4-85aa-cecb02da0af1 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1527 microversion: 2.1 time: 0.217272 Oct 22 03:25:25.806648 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2461/4846] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:25 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1527 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:25.813239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:25.814091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:25.822500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.823252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.823929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.824756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:25.825285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:25.826069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:25.958719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:25.970744 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47729b58-7ca6-434a-a2f1-0af3ca0e930a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1652 microversion: 2.1 time: 0.402459 Oct 22 03:25:25.987076 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2386/4847] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:25 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1652 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:25.995582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:25.999476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:26.013874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.020070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.020552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.021397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.021761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.022193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.033988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:26.043760 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2ad9ea0-22ac-4f54-b18d-11b69599cf61 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1368 microversion: 2.1 time: 0.235879 Oct 22 03:25:26.044901 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2462/4848] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:25 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:26.050389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:26.051208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:26.058737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.060274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.061521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.063748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.065081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.065707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.169866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cdcaea67-9c1a-45d4-b17d-1b60923428cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.122947 Oct 22 03:25:26.171457 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2463/4849] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:26 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:25:26.181846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:26.182749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:26.192104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.192928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.193945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.194905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.196137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.196692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.328453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:26.342248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-51c6252f-3b3d-41cd-b708-179a8a823ae0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.353953 Oct 22 03:25:26.342849 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2387/4850] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:25 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:26.389253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:26.403284 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-afb9ab6c-a8f7-45cb-9341-8e0057cbea46 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1659 microversion: 2.1 time: 0.227267 Oct 22 03:25:26.405105 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2464/4851] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:26 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1659 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:26.590847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:26.591753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:26.599604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.600427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.601072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.602008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.602666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.603295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.715809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a88ed964-c569-4a50-bc0a-aa3ad1cf7dba req-55f08e61-9868-4a6e-ba50-4c62cde6da7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c0147bb-0dba-4e7b-8a85-5816ab10aa14", "tag": "28027494-dcb5-471d-978d-93fa35b232ed"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:26.733542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a88ed964-c569-4a50-bc0a-aa3ad1cf7dba req-55f08e61-9868-4a6e-ba50-4c62cde6da7e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.734864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a88ed964-c569-4a50-bc0a-aa3ad1cf7dba req-55f08e61-9868-4a6e-ba50-4c62cde6da7e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.735460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a88ed964-c569-4a50-bc0a-aa3ad1cf7dba req-55f08e61-9868-4a6e-ba50-4c62cde6da7e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.752428 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a88ed964-c569-4a50-bc0a-aa3ad1cf7dba req-55f08e61-9868-4a6e-ba50-4c62cde6da7e service nova] Creating event network-changed:28027494-dcb5-471d-978d-93fa35b232ed for instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 on n-h1-862416-2 Oct 22 03:25:26.760090 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a88ed964-c569-4a50-bc0a-aa3ad1cf7dba req-55f08e61-9868-4a6e-ba50-4c62cde6da7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402399 Oct 22 03:25:26.762183 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2388/4852] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:26.764197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:26.774814 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb4b442b-197b-4b44-b7ea-b49933d0523e tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1394 microversion: 2.1 time: 0.187743 Oct 22 03:25:26.790997 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2465/4853] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:26 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1394 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:26.831271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:26.832039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:26.839633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.840132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.840601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:26.841363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:26.841831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:26.842445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.038041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:27.041215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:27.048119 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f05c47eb-5f58-4796-9227-eb2092e8ad4e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1527 microversion: 2.1 time: 0.221503 Oct 22 03:25:27.050099 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2389/4854] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:26 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1527 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:27.071002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:27.072221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:27.078567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.079057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.079492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.080296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.080930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.081419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.233056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:27.242469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a9079c1d-0f41-4fd1-9fc0-436b5a597fb2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1368 microversion: 2.1 time: 0.175242 Oct 22 03:25:27.243228 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2466/4855] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:27 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:27.369113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:27.369777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:27.391138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.391670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.392242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.393172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.393734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.394436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.434172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:27.435268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:27.442840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.444475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.447466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.452523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.453560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.454032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.661445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:27.669386 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efc12111-9085-47eb-9b1e-3e637123057a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.242280 Oct 22 03:25:27.670266 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2467/4856] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:27 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:27.695047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:27.695934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:27.696546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:27.706034 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72baff4a-a42e-43b5-8a3e-749fd4d7f7b6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.340707 Oct 22 03:25:27.706753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.707501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.708162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.709119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.709802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.710459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.721564 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2390/4857] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:27 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:27.803418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:27.804531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:27.816032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.817007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.818387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.819428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.821557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.824053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.881643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:27.889815 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a11bb1cd-8e96-4e4e-900f-32a783085f42 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.199978 Oct 22 03:25:27.890392 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2468/4858] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:27 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:27.922127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:27.922744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:27.929169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.929656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.930312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:27.931215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:27.931871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:27.932620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.198684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:28.228722 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9945408-f3da-4fbd-9722-87ee3d601b3f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.310272 Oct 22 03:25:28.230419 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2469/4859] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:27 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:28.242802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:28.243789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:28.265785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.267330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.270636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.272476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.275594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.279223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.311631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:28.320769 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-253d473d-1df1-4d74-b2f5-aff62468ee61 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1576 microversion: 2.1 time: 0.523537 Oct 22 03:25:28.344394 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2391/4860] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:27 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1576 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:28.348493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:28.349358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:28.358139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.361920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.362657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.363566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.369794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.370465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.487301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b228c872894aefadd62b339880e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b67a14bf5e4423e9b811630a3ca66e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:28.503081 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-02781d13-338a-414e-960b-e7e9cf00983e tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 200 len: 1308 microversion: 2.1 time: 0.265263 Oct 22 03:25:28.520923 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2470/4861] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:28 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:28.520923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:28.520923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:28.529600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.531885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.532375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.534850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.535352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.535794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.716534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:28.730993 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d217766a-094d-4468-a74a-0682bcb80945 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.398838 Oct 22 03:25:28.731745 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2392/4862] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:28 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:28.737537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:28.738222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:28.754246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.754739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.755198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.756186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.756836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.759340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.769744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:28.780759 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0bdbcaff-7d5a-4505-8a26-b195e66fefdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1368 microversion: 2.1 time: 0.275355 Oct 22 03:25:28.781627 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2471/4863] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:28 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:28.811240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:28.812146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:28.820245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.820768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.821203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.821909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.822425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.822844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.884674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0fefb498-095b-4a06-bff9-3f3458bbb12b tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151602 Oct 22 03:25:28.885433 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2393/4864] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:25:28 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:28.891102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:28.891888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:28.899141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.899875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.900581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:28.901512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:28.902184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:28.902849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:29.146681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:29.155445 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c81cc6fc-08b6-4494-b969-9bc333eb6961 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.353718 Oct 22 03:25:29.159384 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2472/4865] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:28 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:29.180155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-65a78b12-e505-4008-b9a8-e55d41e2afe0 req-13f4b295-882b-45ec-8b8d-0edf527f1002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb00ca77-eb2b-4caf-afb5-31e93205ba00", "name": "network-vif-deleted", "tag": "274d3275-2157-4b78-9870-dc2189202df4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:29.197626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-65a78b12-e505-4008-b9a8-e55d41e2afe0 req-13f4b295-882b-45ec-8b8d-0edf527f1002 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:29.198122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-65a78b12-e505-4008-b9a8-e55d41e2afe0 req-13f4b295-882b-45ec-8b8d-0edf527f1002 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:29.198547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-65a78b12-e505-4008-b9a8-e55d41e2afe0 req-13f4b295-882b-45ec-8b8d-0edf527f1002 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:29.226898 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-65a78b12-e505-4008-b9a8-e55d41e2afe0 req-13f4b295-882b-45ec-8b8d-0edf527f1002 service nova] Creating event network-vif-deleted:274d3275-2157-4b78-9870-dc2189202df4 for instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 on n-h2-862416-2 Oct 22 03:25:29.242748 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-65a78b12-e505-4008-b9a8-e55d41e2afe0 req-13f4b295-882b-45ec-8b8d-0edf527f1002 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080180 Oct 22 03:25:29.266509 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2473/4866] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:29.528648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:29.529740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] [instance: bb00ca77-eb2b-4caf-afb5-31e93205ba00] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:29.536882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:29.537737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:29.538394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:29.539390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:29.540074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:29.540743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:29.555230 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] HTTP exception thrown: Instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 could not be found. Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Request method failure captured: Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 HTTP/1.1 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2KDc9GEEbRaKRaeEiVJeQWdxrxBz9CqED3RJdbWg2ILL4LiMJTH_o73no3iMVWklBOHEV-GD0YYG4Ch7zv44apw_iKyIBoNOFm2uzO4c-C4HNp6tRe1PzhrA95eOXpLYcl-gy-UKEAVKSGHIN96_KeLRQmhrJVLFRlGRSGhi88y0vM Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 1b67a14bf5e4423e9b811630a3ca66e3 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b67a14bf5e4423e9b811630a3ca66e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b67a14bf5e4423e9b811630a3ca66e3"}]}] Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 1b67a14bf5e4423e9b811630a3ca66e3 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-319709271 Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerAddressesNegativeTestJSON-319709271-project Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 68b228c872894aefadd62b339880e93f Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-319709271-project Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 could not be found. Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'bb00ca77-eb2b-4caf-afb5-31e93205ba00'} Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 could not be found. Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 could not be found. Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:29.557386 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:29.561109 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:29.561109 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:29.561109 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:29.561109 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:29.561109 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:25:29.561109 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:25:29.561109 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 could not be found. Oct 22 03:25:29.561109 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:29.563675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] Returning 404 to user: Instance bb00ca77-eb2b-4caf-afb5-31e93205ba00 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:25:29.565777 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6981a81f-6a61-44df-a2b8-919417cf4ea0 tempest-ServerAddressesNegativeTestJSON-319709271 tempest-ServerAddressesNegativeTestJSON-319709271-project] 10.222.0.25 "GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00" status: 404 len: 111 microversion: 2.1 time: 0.042729 Oct 22 03:25:29.570938 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2474/4867] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:29 2022] GET /compute/v2.1/servers/bb00ca77-eb2b-4caf-afb5-31e93205ba00 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:25:29.646492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:29.654435 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c28db77b-8bcf-45bd-b781-a8cf52ed7ad6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.767799 Oct 22 03:25:29.655021 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2394/4868] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:28 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:29.678912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:29.679520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:29.688735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:29.692153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:29.693145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:29.694122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:29.694735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:29.695375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:29.805605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:29.806930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:29.815324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:29.817519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:29.818011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:29.818734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:29.819200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:29.819640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:30.037786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:30.047703 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb3c7d3d-c1ad-41ae-98a1-2472cc9c4a99 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1368 microversion: 2.1 time: 0.245989 Oct 22 03:25:30.049035 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2395/4869] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:29 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:30.182855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:30.183732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:30.190882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:30.191560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:30.192287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:30.193353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:30.193876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:30.195114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:30.384929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:30.398444 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c1d7c6a4-2703-4684-b86e-9adf520a1028 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.219912 Oct 22 03:25:30.401249 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2396/4870] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:30 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:30.551058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:30.565052 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d19cf4d4-c7a0-4587-a791-5c7807d62029 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.890723 Oct 22 03:25:30.577019 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2475/4871] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:29 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:31.070968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:31.072189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:31.090933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:31.091749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:31.099434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:31.099853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:31.102969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:31.103462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:31.103903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:31.104650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:31.105254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:31.106205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:31.106661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:31.107401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:31.110333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:31.111739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:31.216013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:31.252769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:31.336745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:31.347298 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28086c52-c670-48aa-a654-fafb26ab9c44 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1368 microversion: 2.1 time: 0.280091 Oct 22 03:25:31.361905 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2397/4872] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:31 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:31.371329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2d4c301d-2f29-497d-8737-a2412fe4cd05 req-5c77eb81-c17b-4237-bf12-d4d1b75a5c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56532615-7ea4-4368-9039-4e52cd63c4bd", "tag": "0b989957-1d60-4fe9-a53e-9104e05ee137"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:31.385086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d4c301d-2f29-497d-8737-a2412fe4cd05 req-5c77eb81-c17b-4237-bf12-d4d1b75a5c10 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:31.385867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d4c301d-2f29-497d-8737-a2412fe4cd05 req-5c77eb81-c17b-4237-bf12-d4d1b75a5c10 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:31.386520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d4c301d-2f29-497d-8737-a2412fe4cd05 req-5c77eb81-c17b-4237-bf12-d4d1b75a5c10 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:31.402679 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2d4c301d-2f29-497d-8737-a2412fe4cd05 req-5c77eb81-c17b-4237-bf12-d4d1b75a5c10 service nova] Creating event network-changed:0b989957-1d60-4fe9-a53e-9104e05ee137 for instance 56532615-7ea4-4368-9039-4e52cd63c4bd on n-h2-862416-2 Oct 22 03:25:31.408473 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2d4c301d-2f29-497d-8737-a2412fe4cd05 req-5c77eb81-c17b-4237-bf12-d4d1b75a5c10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044730 Oct 22 03:25:31.410178 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2398/4873] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:31.427244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:31.428610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:31.436609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:31.437376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:31.437996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:31.438919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:31.439866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:31.440507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:31.442212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:31.455770 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb2577f0-e088-424d-a7ee-c03f5f7b33f2 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1576 microversion: 2.1 time: 0.363940 Oct 22 03:25:31.456520 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2476/4874] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:31 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1576 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:31.547878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-975f082b-7aa0-4250-ad70-453f740eada0 req-3465d2b9-b284-4cf2-b4b7-2429032fb4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0147bb-0dba-4e7b-8a85-5816ab10aa14", "name": "network-vif-plugged", "status": "completed", "tag": "28027494-dcb5-471d-978d-93fa35b232ed"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:31.572951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-975f082b-7aa0-4250-ad70-453f740eada0 req-3465d2b9-b284-4cf2-b4b7-2429032fb4d2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:31.577498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-975f082b-7aa0-4250-ad70-453f740eada0 req-3465d2b9-b284-4cf2-b4b7-2429032fb4d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:31.580116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-975f082b-7aa0-4250-ad70-453f740eada0 req-3465d2b9-b284-4cf2-b4b7-2429032fb4d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:31.622354 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-975f082b-7aa0-4250-ad70-453f740eada0 req-3465d2b9-b284-4cf2-b4b7-2429032fb4d2 service nova] Creating event network-vif-plugged:28027494-dcb5-471d-978d-93fa35b232ed for instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 on n-h1-862416-2 Oct 22 03:25:31.638684 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-975f082b-7aa0-4250-ad70-453f740eada0 req-3465d2b9-b284-4cf2-b4b7-2429032fb4d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094645 Oct 22 03:25:31.639646 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2477/4875] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:25:31.870901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:31.884353 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2a1da8a7-8f65-4724-b45e-aeb45ebee7c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.463087 Oct 22 03:25:31.885325 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2399/4876] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:31 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:32.372661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:32.382700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:32.383897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:32.394233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:32.395044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:32.396120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:32.397156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:32.398114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:32.398885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:32.800955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:32.815599 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-12a810c0-24f4-4367-9a0a-3e8fd5fddd2c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1368 microversion: 2.1 time: 0.445018 Oct 22 03:25:32.818778 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2478/4877] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:32 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:32.911535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:32.911535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:32.926883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:32.928672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:32.930495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:32.931516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:32.933244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:32.934449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:33.192491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:33.202316 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d92aac2a-fda6-4856-8e86-1b4fe9b756ff tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.297887 Oct 22 03:25:33.218303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2400/4878] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:32 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:33.844939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:33.846664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:33.858253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:33.859303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:33.859742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:33.860626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:33.861968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:33.862514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:33.898697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:34.228616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:34.229831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:34.246923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:34.248712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:34.266145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:34.268167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:34.274510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:34.275992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:34.562108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:34.577521 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e945f444-bb16-482a-b6ea-ed6a801f3982 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1558 microversion: 2.1 time: 0.736566 Oct 22 03:25:34.596788 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2479/4879] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:33 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1558 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:34.604360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:34.606324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:34.614127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:34.614868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:34.615762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:34.617495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:34.618911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:34.619558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:34.654766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:34.663650 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e497218f-0408-45d3-9d1a-e4e34c49111e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.439400 Oct 22 03:25:34.667336 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2401/4880] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:34 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:34.790923 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac046a7f-ca51-4e3a-aa11-9d8701e31ba9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191553 Oct 22 03:25:34.793069 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2480/4881] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:25:34 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:25:35.707275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:35.708864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:35.738496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:35.740694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:35.742391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:35.745633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:35.747177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:35.748592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:36.222612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:36.245095 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f258bb3d-2f00-4253-a0ad-2c0b13d65d72 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.553477 Oct 22 03:25:36.245727 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2402/4882] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:35 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:36.557689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3e72a53a-23e2-4fab-9a8d-4bed00b0ffa7 req-d80ad6be-6a11-4db8-a51a-175c59446863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c0147bb-0dba-4e7b-8a85-5816ab10aa14", "tag": "28027494-dcb5-471d-978d-93fa35b232ed"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:36.573685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e72a53a-23e2-4fab-9a8d-4bed00b0ffa7 req-d80ad6be-6a11-4db8-a51a-175c59446863 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:36.574193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e72a53a-23e2-4fab-9a8d-4bed00b0ffa7 req-d80ad6be-6a11-4db8-a51a-175c59446863 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:36.574687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e72a53a-23e2-4fab-9a8d-4bed00b0ffa7 req-d80ad6be-6a11-4db8-a51a-175c59446863 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:36.601160 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3e72a53a-23e2-4fab-9a8d-4bed00b0ffa7 req-d80ad6be-6a11-4db8-a51a-175c59446863 service nova] Creating event network-changed:28027494-dcb5-471d-978d-93fa35b232ed for instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 on n-h1-862416-2 Oct 22 03:25:36.606919 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3e72a53a-23e2-4fab-9a8d-4bed00b0ffa7 req-d80ad6be-6a11-4db8-a51a-175c59446863 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054846 Oct 22 03:25:36.609150 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2481/4883] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:37.270983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:37.271744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:37.280418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:37.280990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:37.287313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:37.288098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:37.288641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:37.289158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:37.500482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:37.510222 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9d836477-a74a-4137-8434-4951b72b1fb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.243780 Oct 22 03:25:37.514506 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2403/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:37 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:38.541340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:38.542027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:38.553363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:38.554129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:38.554797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:38.555754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:38.556445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:38.557088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:38.725900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:38.736424 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1bb7b38b-d96e-4f69-985b-9239193a637b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.200724 Oct 22 03:25:38.738124 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2482/4885] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:38 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:39.761248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:39.762163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:39.777201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:39.777768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:39.778506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:39.779641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:39.780453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:39.781077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:40.150120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:40.164806 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90202a4d-136e-45b6-afdc-50cec5272c95 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.407824 Oct 22 03:25:40.168842 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2404/4886] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:39 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:41.200263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:41.200944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:41.224092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:41.224636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:41.227898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:41.229139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:41.229802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:41.230556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:41.422119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:41.430729 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35017d1d-7e4e-4d24-98f6-1b25f4be1d34 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.243912 Oct 22 03:25:41.444237 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2483/4887] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:41 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:42.454392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:42.456158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:42.470012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:42.471064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:42.471712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:42.472740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:42.477690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:42.478364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:42.911058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:42.925504 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4adc87a-37b3-443b-9e6c-d802f963c2c7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1522 microversion: 2.1 time: 0.470496 Oct 22 03:25:42.925504 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2405/4888] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:42 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:43.948881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:43.949631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:43.961871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:43.963677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:43.966495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:43.967675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:43.972907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:43.973479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:44.146138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:44.155314 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b72574b4-c8fb-4a87-b1d3-048f6959b99c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1502 microversion: 2.1 time: 0.212520 Oct 22 03:25:44.155899 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2484/4889] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:43 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:44.179022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:44.179639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:44.186726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:44.187990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:44.189172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:44.190775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:44.191248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:44.191686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:44.378961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:44.389032 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5191a49-b8f2-4470-a23e-904b84da9c3e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1515 microversion: 2.1 time: 0.213670 Oct 22 03:25:44.400446 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2406/4890] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:44 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:44.417744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1814d0ec-1fd4-4895-844f-508fe0f1ce37 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:44.422003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1814d0ec-1fd4-4895-844f-508fe0f1ce37 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: aaf39874-0e1b-418e-ad54-7276aed6df38] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:44.432699 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1814d0ec-1fd4-4895-844f-508fe0f1ce37 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Instance aaf39874-0e1b-418e-ad54-7276aed6df38 could not be found. Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1814d0ec-1fd4-4895-844f-508fe0f1ce37 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/aaf39874-0e1b-418e-ad54-7276aed6df38/action HTTP/1.1 Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 14 Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: {"rescue": {}} Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance aaf39874-0e1b-418e-ad54-7276aed6df38 could not be found. Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'aaf39874-0e1b-418e-ad54-7276aed6df38', 'body': {'rescue': {}}} Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf39874-0e1b-418e-ad54-7276aed6df38 could not be found. Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf39874-0e1b-418e-ad54-7276aed6df38 could not be found. Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:44.448847 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:44.453794 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:44.453794 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:44.453794 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:25:44.453794 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:25:44.453794 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf39874-0e1b-418e-ad54-7276aed6df38 could not be found. Oct 22 03:25:44.453794 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:25:44.453794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1814d0ec-1fd4-4895-844f-508fe0f1ce37 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 404 to user: Instance aaf39874-0e1b-418e-ad54-7276aed6df38 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:25:44.453794 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1814d0ec-1fd4-4895-844f-508fe0f1ce37 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf39874-0e1b-418e-ad54-7276aed6df38/action" status: 404 len: 111 microversion: 2.1 time: 0.040457 Oct 22 03:25:44.455931 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2485/4891] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:44 2022] POST /compute/v2.1/servers/aaf39874-0e1b-418e-ad54-7276aed6df38/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:25:44.465279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:44.466031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:44.475403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:44.476697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:44.476697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:44.477457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:44.478172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:44.479301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:44.498230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:44.573259 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d8691541-a785-4a7a-b4eb-565c156905ce tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action" status: 202 len: 0 microversion: 2.1 time: 0.112492 Oct 22 03:25:44.588897 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2407/4892] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:44 2022] POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:25:44.597100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:44.598131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:44.612681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:44.613372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:44.614024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:44.614915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:44.615522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:44.616133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:44.791502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:44.802898 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-774426af-fce2-4178-8faa-1487de0d0eda tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1520 microversion: 2.1 time: 0.212109 Oct 22 03:25:44.803487 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2408/4893] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:44 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:44.849964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1635790902", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:44.919272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] validate_networks() for [('11b56ed7-7fde-4624-af01-50f065e67c82', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:25:45.402247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:25:45.403480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:25:45.404383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:25:45.405074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:25:45.405619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:25:45.416384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:45.417135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:45.417671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:45.418416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:45.418874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:45.419303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:45.446834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Getting quotas for project 6f53f096c8dc49e9be1aae9ecb4e6e61. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:25:45.452751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Getting quotas for user 4812c4e486404d0c8dfdf417d0c4dc46 and project 6f53f096c8dc49e9be1aae9ecb4e6e61. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:25:45.466290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:25:45.469052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:25:45.534835 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f2b414d-6422-4bfd-88b2-77f9dca3c1f2 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.038647 Oct 22 03:25:45.538339 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2486/4894] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:25:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:25:45.552527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13005734-d48a-437b-ac12-17e4ba3f2f9d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:45.553695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13005734-d48a-437b-ac12-17e4ba3f2f9d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:45.653693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-13005734-d48a-437b-ac12-17e4ba3f2f9d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:45.664565 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13005734-d48a-437b-ac12-17e4ba3f2f9d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1223 microversion: 2.1 time: 0.119200 Oct 22 03:25:45.681529 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2409/4895] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:45 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:45.834316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:45.835315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:45.848628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:45.849816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:45.857909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:45.871804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:45.873114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:45.874577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.223428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:46.232552 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ddcbc2e-a904-4287-bd49-89bd2bdfa0c6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1500 microversion: 2.1 time: 0.409114 Oct 22 03:25:46.234044 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2487/4896] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:45 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1500 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:46.259576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:46.263025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:46.280316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:46.280814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:46.281260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.281978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:46.282440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:46.283076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.350975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lazy-loading 'flavor' on Instance uuid a97055cc-112a-4d01-9d20-bfa7f95d9886 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:25:46.373310 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Cannot 'rescue' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state paused Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action HTTP/1.1 Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 14 Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: {"rescue": {}} Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot 'rescue' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state paused Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'a97055cc-112a-4d01-9d20-bfa7f95d9886', 'body': {'rescue': {}}} Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a97055cc-112a-4d01-9d20-bfa7f95d9886 in vm_state paused. Cannot rescue while the instance is in this state. Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state paused Oct 22 03:25:46.375237 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state paused Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:25:46.382378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 409 to user: Cannot 'rescue' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state paused {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:25:46.384691 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01010286-e05c-42f2-b292-deea17e360da tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action" status: 409 len: 144 microversion: 2.1 time: 0.122903 Oct 22 03:25:46.391376 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2410/4897] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:46 2022] POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action => generated 144 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:25:46.399582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:46.401148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:46.410425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:46.413040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:46.413896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.415029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:46.415766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:46.416808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.594841 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e64f68d-87b2-4b2c-bff4-03697fa7a8a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action" status: 202 len: 0 microversion: 2.1 time: 0.200070 Oct 22 03:25:46.597412 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2488/4898] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:46 2022] POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:25:46.614680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:46.615507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:46.647520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:46.649507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:46.650980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.652846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:46.654249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:46.658531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.698248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:46.700333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:46.715038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:46.717575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:46.718555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.721094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:46.722525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:46.724370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:46.898152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:46.906494 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-536d1917-d2dc-407d-96fc-1873213c1613 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1275 microversion: 2.1 time: 0.214673 Oct 22 03:25:46.913388 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2489/4899] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:46 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:46.928616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:46.937946 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19fd214f-b2c8-4909-98e5-10a7d7108e16 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1507 microversion: 2.1 time: 0.335297 Oct 22 03:25:46.939222 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2411/4900] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:46 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:47.935250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:47.935879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:47.948083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:47.949954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:47.952597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:47.953372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:47.955889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:47.959519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:47.962453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:47.963152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:47.978925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:47.984626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:47.984626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:47.985291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:47.985806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:47.986232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:48.071577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:48.083476 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab588abe-afd5-403d-9438-40fd87e631dd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1281 microversion: 2.1 time: 0.151373 Oct 22 03:25:48.085488 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2490/4901] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:47 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:48.387336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:48.399673 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1cfe869-9ff8-4534-9a2a-630a54575a8f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1515 microversion: 2.1 time: 0.439182 Oct 22 03:25:48.404559 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2412/4902] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:47 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1515 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:49.109962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:49.111570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:49.128103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:49.129101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:49.130968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:49.133894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:49.134453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:49.134841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:49.430425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:49.443535 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6812cf2-953a-4be2-9ba3-fc4bcf4e89a6 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1323 microversion: 2.1 time: 0.336858 Oct 22 03:25:49.444528 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2491/4903] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:49 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:50.139346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-12d51eef-9e27-4ff2-93d9-ddba9c231302 req-420e2a6f-21ed-4163-8e2d-ca4d37fb4d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34bd18f-8662-46f8-9741-7b88afc61bea", "tag": "c189b125-f4a2-465b-9e66-5b851a5f074f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:50.163824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-12d51eef-9e27-4ff2-93d9-ddba9c231302 req-420e2a6f-21ed-4163-8e2d-ca4d37fb4d60 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:50.173558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-12d51eef-9e27-4ff2-93d9-ddba9c231302 req-420e2a6f-21ed-4163-8e2d-ca4d37fb4d60 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:50.174291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-12d51eef-9e27-4ff2-93d9-ddba9c231302 req-420e2a6f-21ed-4163-8e2d-ca4d37fb4d60 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:50.207860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-12d51eef-9e27-4ff2-93d9-ddba9c231302 req-420e2a6f-21ed-4163-8e2d-ca4d37fb4d60 service nova] Creating event network-changed:c189b125-f4a2-465b-9e66-5b851a5f074f for instance e34bd18f-8662-46f8-9741-7b88afc61bea on n-h2-862416-2 Oct 22 03:25:50.238564 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-12d51eef-9e27-4ff2-93d9-ddba9c231302 req-420e2a6f-21ed-4163-8e2d-ca4d37fb4d60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099113 Oct 22 03:25:50.239844 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2413/4904] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:25:50.467973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:50.469198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:50.473030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:50.481250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:50.482130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:50.482804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:50.483681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:50.484494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:50.485361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:50.664007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:50.673786 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-54c21c95-425a-4859-a93f-6814d7b199d8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1323 microversion: 2.1 time: 0.209997 Oct 22 03:25:50.684840 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2492/4905] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:50 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:51.137977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:51.140609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:51.147708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:51.148197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:51.148674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:51.149385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:51.149843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:51.150273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:51.175937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lazy-loading 'flavor' on Instance uuid a97055cc-112a-4d01-9d20-bfa7f95d9886 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:25:51.254761 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bfb945bb-c765-4644-96ca-caff51cc87d4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action" status: 200 len: 32 microversion: 2.1 time: 0.121453 Oct 22 03:25:51.261121 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2414/4906] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:51 2022] POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:25:51.266334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:51.267529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:51.275106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:51.275873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:51.276535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:51.277931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:51.278739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:51.279579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:51.484793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:51.496517 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01d06cdf-5fea-4135-9893-918f3c2a7702 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.233580 Oct 22 03:25:51.497753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2493/4907] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:51 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:51.701136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:51.702606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:51.712071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:51.713062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:51.713735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:51.714587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:51.715237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:51.715893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:51.936123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:51.947414 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ca9fe50-6548-4f3c-ab4b-88c50b442fe8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1323 microversion: 2.1 time: 0.252749 Oct 22 03:25:51.964519 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2415/4908] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:51 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:52.524742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:52.527108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:52.534596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:52.535225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:52.535769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:52.536613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:52.537191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:52.537757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:52.701791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:52.712418 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-37ae83da-fb47-47ee-8ab5-6b67117be71d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.195421 Oct 22 03:25:52.727247 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2494/4909] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:52 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:52.973511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:52.974074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:52.984899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:52.986351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:52.987068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:52.988365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:52.989076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:52.989571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:53.149029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:53.158904 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39db032e-7973-49c1-9b8f-c6bab5ac3793 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1323 microversion: 2.1 time: 0.191172 Oct 22 03:25:53.159497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2416/4910] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:52 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:53.737421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:53.738909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:53.747044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:53.747728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:53.748535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:53.749405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:53.750036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:53.750789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:53.912245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:53.921293 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25062f63-21d6-47e1-acee-04937653ed08 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.190247 Oct 22 03:25:53.924249 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2495/4911] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:53 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:54.185102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:54.186808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:54.196059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=71 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:54.199065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:54.199598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:54.200072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:54.203258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:54.203725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:54.204187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:54.796569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:54.807110 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a55d2215-0d83-432b-ada1-56a0bddaeb9e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1323 microversion: 2.1 time: 0.628964 Oct 22 03:25:54.808256 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2417/4912] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:54 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1323 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:54.945596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:54.947558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:54.957654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:54.958180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:54.958591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:54.959303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:54.959754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:54.960177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:55.121097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:55.133353 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab387b0c-5320-4589-b1d9-4d2d8780f8f6 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.191844 Oct 22 03:25:55.134039 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2496/4913] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:54 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:55.830671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:55.831205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:55.837448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:55.839386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:55.839840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:55.840260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:55.841124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:55.841792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:55.842425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:56.046136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:56.055458 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-94682a14-dd3a-44bc-b342-d91c75cf745d tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1323 microversion: 2.1 time: 0.228942 Oct 22 03:25:56.056126 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2418/4914] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:55 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1323 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:56.158855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:56.159543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:56.161858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:56.162712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:56.170204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:56.170832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:56.171306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:56.172077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:56.172758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:56.173855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:56.190304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:56.336242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:56.345966 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-969130a4-c3d0-4634-8219-1dfa9a02e8e7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.192575 Oct 22 03:25:56.347566 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2497/4915] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:56 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:57.081259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:57.081888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:57.088863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:57.089373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:57.090057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:57.090975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:57.091637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:57.092199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:57.240649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:57.248796 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-67c96d91-d963-427b-bbb5-b58f0e206573 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1323 microversion: 2.1 time: 0.172549 Oct 22 03:25:57.249486 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2419/4916] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:57 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:57.371207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:57.371823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:57.379756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:57.380471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:57.381092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:57.382027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:57.382634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:57.383411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:57.523409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-ab1e99b0-2f73-4a61-bb8c-9794f40f425b req-b50b04ca-ac49-44c9-b6c0-574f01e8f070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34bd18f-8662-46f8-9741-7b88afc61bea", "name": "network-vif-plugged", "status": "completed", "tag": "c189b125-f4a2-465b-9e66-5b851a5f074f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:57.539056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ab1e99b0-2f73-4a61-bb8c-9794f40f425b req-b50b04ca-ac49-44c9-b6c0-574f01e8f070 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:57.539748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ab1e99b0-2f73-4a61-bb8c-9794f40f425b req-b50b04ca-ac49-44c9-b6c0-574f01e8f070 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:57.540803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ab1e99b0-2f73-4a61-bb8c-9794f40f425b req-b50b04ca-ac49-44c9-b6c0-574f01e8f070 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:57.551813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:57.556412 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-ab1e99b0-2f73-4a61-bb8c-9794f40f425b req-b50b04ca-ac49-44c9-b6c0-574f01e8f070 service nova] Creating event network-vif-plugged:c189b125-f4a2-465b-9e66-5b851a5f074f for instance e34bd18f-8662-46f8-9741-7b88afc61bea on n-h2-862416-2 Oct 22 03:25:57.561513 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5d25950b-2854-4bd3-8ccf-84d2e44ebc82 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.194176 Oct 22 03:25:57.562500 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-ab1e99b0-2f73-4a61-bb8c-9794f40f425b req-b50b04ca-ac49-44c9-b6c0-574f01e8f070 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045393 Oct 22 03:25:57.564446 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2498/4917] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:57 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:57.569542 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2420/4918] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:25:58.273027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:58.274013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:58.281299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:58.281799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:58.282294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:58.283029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:58.283769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:58.284440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:58.441493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:58.453420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5ff5721-4656-4800-98b0-6777a4154328 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1323 microversion: 2.1 time: 0.184904 Oct 22 03:25:58.454819 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2499/4919] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:58 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:58.587784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:58.589071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:58.596133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:58.596636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:58.597086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:58.597795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:58.598248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:58.598851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:58.747860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:58.760241 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b79c453-0d51-4e24-8118-4ca7ca49d98a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.174873 Oct 22 03:25:58.767776 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2421/4920] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:58 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:25:59.477257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:59.477908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:59.484971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:59.486196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:59.486887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:59.487607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:59.488060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:59.488515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:59.629013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:25:59.637287 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-68d67e30-2197-47b4-89b6-973a80f75c89 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1516 microversion: 2.1 time: 0.163823 Oct 22 03:25:59.637871 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2500/4921] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:59 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:25:59.661181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:25:59.663270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:59.670212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:59.670688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:59.671307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:59.672008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:59.672474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:59.673225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:59.699242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lazy-loading 'flavor' on Instance uuid e34bd18f-8662-46f8-9741-7b88afc61bea {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:25:59.725726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:25:59.781354 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d608c7ba-9cec-43ec-a5f4-6f406e182df1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action" status: 200 len: 32 microversion: 2.1 time: 0.124905 Oct 22 03:25:59.782004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:59.782177 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2422/4922] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:25:59 2022] POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action => generated 32 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:25:59.782772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:59.789789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:59.790292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:59.790734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:59.791588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:59.792241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:59.792869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:59.796705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:25:59.797426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:25:59.811306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:59.814571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:59.815228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:25:59.815997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:25:59.816840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:25:59.817690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:00.047542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:00.058089 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb0cc2f3-6bca-4925-b955-3b0a48a04de5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.281786 Oct 22 03:26:00.059094 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2501/4923] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:59 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:00.122233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:00.130915 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-23c600c5-fbc7-4325-a669-f8be5501e1db tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.342469 Oct 22 03:26:00.131656 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2423/4924] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:25:59 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:01.083345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:01.083884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:01.093566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:01.094189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:01.094528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:01.095820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:01.096328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:01.096743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:01.155004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:01.155602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:01.166190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:01.166190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:01.166190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:01.166190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:01.166190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:01.166649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:01.265075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:01.274002 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1da84fc4-3331-43d0-89c4-8bc7a34006bb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.195524 Oct 22 03:26:01.274810 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2502/4925] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:01 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:01.304313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:01.307474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:01.314435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:01.314937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:01.315370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:01.316091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:01.316576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:01.317007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:01.323608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:01.332842 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ec51efb3-a758-405a-84e7-7bd7ba0a4451 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.182112 Oct 22 03:26:01.333745 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2424/4926] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:01 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:01.409084 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aba202e9-370a-4387-be2a-9e452309b131 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.116654 Oct 22 03:26:01.412431 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2503/4927] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:26:01 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:26:01.418378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:01.419453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:01.425505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:01.426210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:01.426807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:01.427697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:01.428335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:01.428767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:01.679882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:01.691633 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-608dce27-e3a8-40ad-bec6-d0fc4111ad03 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1669 microversion: 2.1 time: 0.275988 Oct 22 03:26:01.693260 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2425/4928] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:01 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1669 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:02.310275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:02.310979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:02.318502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:02.318945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:02.319384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:02.320183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:02.320564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:02.320992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:02.357451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:02.357981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:02.366451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:02.366939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:02.367370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:02.368290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:02.368907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:02.369520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:02.507883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:02.520052 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc6b4bc8-7737-4c82-861a-fde035788f5c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.214888 Oct 22 03:26:02.532288 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2504/4929] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:02 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:02.553577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:02.563264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-64abfca2-f6f0-46d1-bcf0-0a5a74c8ad96 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.209340 Oct 22 03:26:02.564721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2426/4930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:02 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:02.715557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:02.716325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:02.722987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:02.723477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:02.723911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:02.724641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:02.725092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:02.725514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:02.877487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:02.886167 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6916afa-18bf-43fc-a93b-6817245faba5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1674 microversion: 2.1 time: 0.174570 Oct 22 03:26:02.886886 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2505/4931] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:02 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:03.544435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:03.545076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:03.551920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:03.552445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:03.552887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:03.553620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:03.554075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:03.554483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:03.589202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:03.590510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:03.598551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:03.599366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:03.600069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:03.601028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:03.601719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:03.602415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:03.727615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:03.739966 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e5ebd66-5315-468c-9256-875abea444f2 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.199157 Oct 22 03:26:03.754584 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2427/4932] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:03 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:03.778237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:03.788119 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d9198dd-a90a-4cb4-9948-9f2d0e7931fd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.203064 Oct 22 03:26:03.788741 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2506/4933] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:03 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:03.911394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:03.912509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:03.919643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:03.921124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:03.921751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:03.922793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:03.924712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:03.930589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:04.091315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:04.101300 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-54c88a06-be43-4435-9271-a83a48dbf375 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.194293 Oct 22 03:26:04.101936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2428/4934] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:03 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:04.762982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:04.763614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:04.771240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:04.771726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:04.772163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:04.772884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:04.773395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:04.773823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:04.810755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:04.811360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:04.819470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:04.820236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:04.820946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:04.821879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:04.822554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:04.823039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:04.936405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:04.944357 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d067c146-fc8e-4f68-a70f-816e49ad1293 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.185172 Oct 22 03:26:04.957128 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2507/4935] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:04 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:04.996575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:05.005688 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27e5ec01-d93d-419a-8ecb-a9322afa8293 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.198614 Oct 22 03:26:05.006528 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2429/4936] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:04 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:05.967452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:05.968058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:05.974965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:05.975446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:05.975879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:05.976612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:05.977062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:05.977484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.031171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:06.031886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:06.039339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:06.039829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:06.040294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.041035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:06.041491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:06.041917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.121754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:06.129864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c793f36a-9a42-481d-90a9-45a90fbf1269 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1501 microversion: 2.1 time: 0.166240 Oct 22 03:26:06.130458 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2508/4937] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:05 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:06.153228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afd2700a-09df-4686-8fc7-4266dfe79c83"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:06.155713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:06.162779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:06.163248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:06.163734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.164466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:06.164926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:06.165358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.187120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:06.189555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Cannot 'attach_volume' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state rescued Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/os-volume_attachments HTTP/1.1 Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 74 Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: {"volumeAttachment": {"volumeId": "afd2700a-09df-4686-8fc7-4266dfe79c83"}} Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: exception: Cannot 'attach_volume' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state rescued Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': 'a97055cc-112a-4d01-9d20-bfa7f95d9886', 'body': {'volumeAttachment': {'volumeId': 'afd2700a-09df-4686-8fc7-4266dfe79c83'}}} Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a97055cc-112a-4d01-9d20-bfa7f95d9886 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 22 03:26:06.192820 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state rescued Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state rescued Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 409 to user: Cannot 'attach_volume' instance a97055cc-112a-4d01-9d20-bfa7f95d9886 while it is in vm_state rescued {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0532dc48-52d8-4406-8cde-4be8584e82ef tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045325 Oct 22 03:26:06.197369 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2509/4938] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:26:06 2022] POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:26:06.199992 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c662092-3e7c-4eb9-b485-74293a0d31f1 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.169008 Oct 22 03:26:06.204059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:06.204820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:06.211306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:06.211797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:06.212249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.213176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:06.213590 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2430/4939] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:06 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:06.213851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:06.214284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.283684 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f4fb775-b213-48eb-b767-0d73996d03d3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action" status: 202 len: 0 microversion: 2.1 time: 0.083876 Oct 22 03:26:06.284423 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2510/4940] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:26:06 2022] POST /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:26:06.293740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:06.294356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:06.302928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:06.303413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:06.304119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.304855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:06.305309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:06.305732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:06.587396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:06.595501 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c4bab2d-9614-45d8-b573-75309a5bf6b9 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1509 microversion: 2.1 time: 0.306885 Oct 22 03:26:06.596088 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2431/4941] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:06 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:07.225109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:07.225644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:07.233138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:07.233704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:07.234598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:07.235816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:07.236323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:07.236752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:07.371259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:07.379245 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7a4f618-64ce-47ba-be46-ea9a4d1b3a07 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.161442 Oct 22 03:26:07.380016 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2511/4942] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:07 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:07.626013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:07.626825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:07.633520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:07.634264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:07.634774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:07.635548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:07.636943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:07.637461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:07.781551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:07.790070 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af5331a5-d268-466a-b5a7-a2051ed69650 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1509 microversion: 2.1 time: 0.168601 Oct 22 03:26:07.790651 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2432/4943] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:07 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:08.404314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:08.405968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:08.413880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:08.414369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:08.414809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:08.415508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:08.415966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:08.416449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:08.432250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:08.560816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:08.569380 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b269ec1a-c511-4cf0-a2d7-eb46a373f102 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.169203 Oct 22 03:26:08.569956 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2512/4944] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:08 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:08.813752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:08.814378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:08.821355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:08.821833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:08.822297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:08.822987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:08.823436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:08.823859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:08.961965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:08.970846 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-437351c1-c0c0-49a3-a950-84c92f7e7004 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1509 microversion: 2.1 time: 0.161246 Oct 22 03:26:08.984792 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2433/4945] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:08 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:09.592819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:09.593422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:09.600511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:09.600996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:09.601430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:09.602126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:09.602575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:09.603006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:09.742178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:09.750673 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fcf4cb30-0d22-4b8f-893e-b14ba32b9556 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.161799 Oct 22 03:26:09.751861 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2513/4946] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:09 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:09.996981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:09.997808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:10.005960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:10.006608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:10.007045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:10.007781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:10.008258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:10.008678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:10.191681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:10.201248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b15f482e-a7e0-4fbc-8b29-f0f214891837 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1515 microversion: 2.1 time: 0.208012 Oct 22 03:26:10.201980 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2434/4947] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:09 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:10.775368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:10.776127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:10.784167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:10.784725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:10.785212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:10.785998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:10.786787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:10.787225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:10.962734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:10.978350 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6445ab32-f27c-49eb-9f79-fe3d809508b3 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.206922 Oct 22 03:26:10.984383 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2514/4948] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:10 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:11.634205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-94c54fc3-9dd1-4d97-8d9d-d2d4bb00e56d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'create', calling method: .version_select at 0x7f0d196e2dc0>, body: {"keypair": {"name": "tempest-keypair-859723391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUtIrK0I4x1j9pv7Nz77tlx/bS0PuvHQP4TJbf1L4M83K2xUzaH+Wg9W9DtOCsjOCI24+K32nS+mcVAtfuAhKzYsfXvxdnXNEtjG3sQb4P10PzujfjDpKkwdtP0jmxKFw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:11.653554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-94c54fc3-9dd1-4d97-8d9d-d2d4bb00e56d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Getting quotas for project fc3de0ae4c844bfa92316a20a1974e0f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:26:11.659216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-94c54fc3-9dd1-4d97-8d9d-d2d4bb00e56d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Getting quotas for user 76fb02af67184c1ca83c5b55c381f195 and project fc3de0ae4c844bfa92316a20a1974e0f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:26:11.685247 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-94c54fc3-9dd1-4d97-8d9d-d2d4bb00e56d tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055473 Oct 22 03:26:11.685887 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2435/4949] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:26:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:12.008397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:12.009009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:12.019050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:12.020067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:12.020879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:12.021889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:12.022827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:12.023679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:12.269275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:12.277693 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c53b3203-338e-4aa3-86f4-19cd328e0d57 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.273797 Oct 22 03:26:12.278684 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2515/4950] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:12 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:13.018509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:13.019123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:13.027361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.028241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.028839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.029705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.030360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.031132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.059218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c050071f-d285-4834-b6e0-44fa16e9adc0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14/ips" status: 200 len: 150 microversion: 2.1 time: 0.045147 Oct 22 03:26:13.064975 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2436/4951] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:26:13 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:13.081533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36e11573-a221-4619-b8ad-4fdebd9ab307"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:13.085016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:13.103919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.104582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.105596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.106665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.107309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.107951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.159784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-752756204", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "652a1419-ed91-4f06-81f3-e3091d650d7d"}], "security_groups": [{"name": "tempest-securitygroup--471380593"}], "key_name": "tempest-keypair-859723391", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:13.232283 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Invalid volume: volume 36e11573-a221-4619-b8ad-4fdebd9ab307 is already attached to instances: bbfd6354-0b31-4bcf-8abb-a408e84093d8 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14/os-volume_attachments HTTP/1.1 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 74 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: {"volumeAttachment": {"volumeId": "36e11573-a221-4619-b8ad-4fdebd9ab307"}} Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid volume: volume 36e11573-a221-4619-b8ad-4fdebd9ab307 is already attached to instances: bbfd6354-0b31-4bcf-8abb-a408e84093d8 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': '1c0147bb-0dba-4e7b-8a85-5816ab10aa14', 'body': {'volumeAttachment': {'volumeId': '36e11573-a221-4619-b8ad-4fdebd9ab307'}}} Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 36e11573-a221-4619-b8ad-4fdebd9ab307 is already attached to instances: bbfd6354-0b31-4bcf-8abb-a408e84093d8 Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:26:13.234652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 36e11573-a221-4619-b8ad-4fdebd9ab307 is already attached to instances: bbfd6354-0b31-4bcf-8abb-a408e84093d8 Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 36e11573-a221-4619-b8ad-4fdebd9ab307 is already attached to instances: bbfd6354-0b31-4bcf-8abb-a408e84093d8 Oct 22 03:26:13.239394 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:13.242141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 400 to user: Invalid volume: volume 36e11573-a221-4619-b8ad-4fdebd9ab307 is already attached to instances: bbfd6354-0b31-4bcf-8abb-a408e84093d8 {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:26:13.243196 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8585138a-b773-4639-8c79-7cfa50865a66 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170442 Oct 22 03:26:13.244289 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2516/4952] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:26:13 2022] POST /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14/os-volume_attachments => generated 174 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:26:13.252562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:13.253184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:13.260024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.260771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.261331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.262138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.262700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.263231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.293253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:26:13.332439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] validate_networks() for [('652a1419-ed91-4f06-81f3-e3091d650d7d', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:26:13.445904 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4cee6cd-7b3e-4add-a53c-8895f3185fad tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 204 len: 0 microversion: 2.1 time: 0.197252 Oct 22 03:26:13.446773 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2517/4953] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:26:13 2022] DELETE /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:26:13.456732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:13.457577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:13.464723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.465308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.465830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.466604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.467129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.467762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.611085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:13.619183 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b68277c6-ceda-4907-8008-55c60dc9ec27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.170958 Oct 22 03:26:13.619779 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2518/4954] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:13 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:13.633123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:13.634067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:13.642983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.643682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.644353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.645166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:13.645707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:13.646247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:13.794313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:13.805373 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-456533e4-5b93-4873-9f14-3b2c32539faa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1683 microversion: 2.1 time: 0.176242 Oct 22 03:26:13.805989 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2519/4955] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:13 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:14.376952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:26:14.377915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:26:14.378878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:26:14.379524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:26:14.380413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:26:14.395028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:14.395512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:14.396309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:14.397273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:14.397983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:14.398630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:14.423529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Getting quotas for project fc3de0ae4c844bfa92316a20a1974e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:26:14.429372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Getting quotas for user 76fb02af67184c1ca83c5b55c381f195 and project fc3de0ae4c844bfa92316a20a1974e0f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:26:14.449806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:26:14.452578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:26:14.506047 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2c1fb616-0b54-4972-82b5-1f5b3d165537 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.351151 Oct 22 03:26:14.508564 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2437/4956] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:26:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:26:14.518118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fe3ccf5-48ac-4889-a009-b25ac21d20d8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:14.518817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2fe3ccf5-48ac-4889-a009-b25ac21d20d8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:14.608338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2fe3ccf5-48ac-4889-a009-b25ac21d20d8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:14.619149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2fe3ccf5-48ac-4889-a009-b25ac21d20d8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1244 microversion: 2.1 time: 0.104139 Oct 22 03:26:14.633457 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2520/4957] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:14 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:14.644834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:14.645510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:14.654383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:14.655151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:14.655918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:14.657006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:14.658329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:14.659015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:14.833431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:14.834591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:14.848244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:14.873594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:14.874377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:14.874831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:14.875311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:14.882855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:14.895599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:14.909488 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee3337d4-61a5-421d-b2c1-5649723a4a4a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.269671 Oct 22 03:26:14.910460 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2438/4958] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:14 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:15.148110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:15.156617 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67cc2d4d-e1e3-40a8-9ef8-44043eebdab8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1683 microversion: 2.1 time: 0.329331 Oct 22 03:26:15.158177 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2521/4959] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:14 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1683 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:15.645262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:15.646502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:15.654750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:15.655480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:15.656082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:15.656995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:15.658088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:15.658773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:15.933947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:15.934559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:15.950298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:15.950967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:15.953258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:15.954181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:15.961177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:15.962424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:16.116183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:16.124073 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-420fff5f-e822-46e4-a170-07f7afa517b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1296 microversion: 2.1 time: 0.484349 Oct 22 03:26:16.128307 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2439/4960] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:15 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1296 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:16.181812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:16.182000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:16.198647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:16.199149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:16.199593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:16.200338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:16.209150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:16.211504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:16.222997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:16.398544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:16.410341 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a683342-116f-4c80-81b9-7eca8e2f2638 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.479949 Oct 22 03:26:16.428576 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2522/4961] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:15 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:16.478118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:16.504011 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9df6ca9-411b-4fab-ab69-91090290d45c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1615 microversion: 2.1 time: 0.323018 Oct 22 03:26:16.505949 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2440/4962] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:16 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1615 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:17.152544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:17.153687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:17.161310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:17.162111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:17.162718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:17.163636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:17.164298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:17.165814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:17.191332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e8eef07e-ac27-4f31-a47c-cf42f49307f3 req-2d058696-5ed9-4ebe-97cd-04e9b19efd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0147bb-0dba-4e7b-8a85-5816ab10aa14", "name": "network-vif-deleted", "tag": "28027494-dcb5-471d-978d-93fa35b232ed"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:17.234957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e8eef07e-ac27-4f31-a47c-cf42f49307f3 req-2d058696-5ed9-4ebe-97cd-04e9b19efd77 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:17.236313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e8eef07e-ac27-4f31-a47c-cf42f49307f3 req-2d058696-5ed9-4ebe-97cd-04e9b19efd77 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:17.238159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e8eef07e-ac27-4f31-a47c-cf42f49307f3 req-2d058696-5ed9-4ebe-97cd-04e9b19efd77 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:17.253995 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e8eef07e-ac27-4f31-a47c-cf42f49307f3 req-2d058696-5ed9-4ebe-97cd-04e9b19efd77 service nova] Creating event network-vif-deleted:28027494-dcb5-471d-978d-93fa35b232ed for instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 on n-h1-862416-2 Oct 22 03:26:17.259740 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e8eef07e-ac27-4f31-a47c-cf42f49307f3 req-2d058696-5ed9-4ebe-97cd-04e9b19efd77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073880 Oct 22 03:26:17.260610 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2441/4963] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:26:17.274370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:17.291783 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c71e5b2-80e2-4248-a7df-9c892e937048 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1302 microversion: 2.1 time: 0.143057 Oct 22 03:26:17.293708 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2523/4964] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:17 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1302 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:17.451503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:17.451503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:17.461812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:17.463001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:17.464817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:17.465569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:17.466034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:17.466533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:17.537258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:17.538011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:17.554727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:17.555732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:17.556451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:17.557703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:17.559053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:17.559785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:17.624088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:17.625575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:17.626953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:17.627715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lazy-loading 'fault' on Instance uuid 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:26:17.734449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:17.742812 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9e78b8f1-a4c5-46f0-b088-ae5db40c1e53 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.305262 Oct 22 03:26:17.743401 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2442/4965] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:17 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:17.752665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:17.761039 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0bc57c4-1577-4198-bd90-a21ba2ae0115 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 200 len: 1332 microversion: 2.1 time: 0.231930 Oct 22 03:26:17.765072 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2524/4966] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:17 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 1332 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:18.316191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:18.316839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:18.324649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:18.325146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:18.325838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:18.326800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:18.327476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:18.328128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:18.578872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:18.588584 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c50ebc6c-c887-43ce-be7f-05e4197eac21 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1369 microversion: 2.1 time: 0.276268 Oct 22 03:26:18.589763 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2443/4967] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:18 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:18.771804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:18.773044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:18.780150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:18.780887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:18.781615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:18.783623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:18.788896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:18.789268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:18.789812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:18.792187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:18.803346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:18.803843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:18.804319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:18.805043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:18.805507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:18.805938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:18.838649 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 HTTP/1.1 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1c0147bb-0dba-4e7b-8a85-5816ab10aa14'} Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:18.840629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:26:18.846113 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c9b6675-64fd-4f5d-b0be-0cda38941aeb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 404 len: 111 microversion: 2.1 time: 0.058393 Oct 22 03:26:18.850067 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2444/4968] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:18 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:26:18.854879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08bf099c-9736-4c60-bf65-3750ca2d00d5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '.version_select at 0x7f0d1a03a790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:18.883659 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08bf099c-9736-4c60-bf65-3750ca2d00d5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045829975" status: 202 len: 0 microversion: 2.1 time: 0.032367 Oct 22 03:26:18.884562 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2445/4969] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:26:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045829975 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:26:19.008501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:19.021660 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dd47604a-e041-4ccf-a4d3-d7fd71e283cb tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.253848 Oct 22 03:26:19.022858 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2525/4970] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:18 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:19.481278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-3075d9bb-a2dc-44bc-b83a-13b4842c598b req-310ad91c-9605-4c93-a4d9-ad28b7f1a488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b96077-d04d-4bb7-b33b-632d27cebe25", "tag": "d3202c78-639a-4940-ab07-4ab3beeea85f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:19.494254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3075d9bb-a2dc-44bc-b83a-13b4842c598b req-310ad91c-9605-4c93-a4d9-ad28b7f1a488 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:19.494830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3075d9bb-a2dc-44bc-b83a-13b4842c598b req-310ad91c-9605-4c93-a4d9-ad28b7f1a488 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:19.495457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3075d9bb-a2dc-44bc-b83a-13b4842c598b req-310ad91c-9605-4c93-a4d9-ad28b7f1a488 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:19.507239 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-3075d9bb-a2dc-44bc-b83a-13b4842c598b req-310ad91c-9605-4c93-a4d9-ad28b7f1a488 service nova] Creating event network-changed:d3202c78-639a-4940-ab07-4ab3beeea85f for instance 41b96077-d04d-4bb7-b33b-632d27cebe25 on n-h2-862416-2 Oct 22 03:26:19.512409 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-3075d9bb-a2dc-44bc-b83a-13b4842c598b req-310ad91c-9605-4c93-a4d9-ad28b7f1a488 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035466 Oct 22 03:26:19.513307 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2446/4971] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:19.618583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:19.619537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:19.628562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:19.629736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:19.630611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:19.631862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:19.633109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:19.633997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:19.893055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:19.901888 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e429f906-0773-443b-9e65-522df91494cd tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1369 microversion: 2.1 time: 0.289492 Oct 22 03:26:19.902467 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2526/4972] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:19 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1369 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:20.050458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:20.051459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:20.057600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:20.058087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:20.058551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:20.059235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:20.059690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:20.060776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:20.171387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:20.171880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:20.178660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:20.179146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:20.179774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:20.180502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:20.180963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:20.181389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:20.267461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lazy-loading 'services' on Instance uuid bbfd6354-0b31-4bcf-8abb-a408e84093d8 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:26:20.271569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:20.294559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:20.304941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c6ceec7-2eb4-4670-8b68-90f9b18c5b90 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.259578 Oct 22 03:26:20.305614 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2447/4973] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:20 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:20.345313 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3c2658da-1fe2-43e8-bec6-7c53073e273e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments/36e11573-a221-4619-b8ad-4fdebd9ab307" status: 202 len: 0 microversion: 2.1 time: 0.177767 Oct 22 03:26:20.346097 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2527/4974] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:26:20 2022] DELETE /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments/36e11573-a221-4619-b8ad-4fdebd9ab307 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:26:20.362805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:20.365110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:20.371177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:20.371667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:20.372109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:20.372842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:20.373298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:20.373729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:20.406396 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77187023-f6b9-420d-a18a-37e7e738db45 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048086 Oct 22 03:26:20.406997 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2448/4975] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:26:20 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:20.928930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:20.929721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:20.933185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:20.941875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:20.943995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:20.944542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:20.945348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:20.946074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:20.946589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:21.213030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:21.224383 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c1033649-4c13-4f11-ab8c-153c149e813b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1369 microversion: 2.1 time: 0.299191 Oct 22 03:26:21.225736 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2528/4976] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:20 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1369 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:21.330105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:21.330746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:21.338088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:21.338592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:21.339097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:21.339888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:21.340444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:21.340932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:21.421557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:21.425920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:21.439378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:21.440301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:21.440931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:21.441842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:21.442658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:21.443277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:21.493605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:21.494756 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5efa4d88-64dd-49e3-87e2-20864d9660eb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078348 Oct 22 03:26:21.495814 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2529/4977] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:26:21 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:21.502488 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef5a5b05-9216-4565-9943-e3d922d1fa3f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.176565 Oct 22 03:26:21.503086 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2449/4978] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:21 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:22.248319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:22.249051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:22.255931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:22.257274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:22.258152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:22.259102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:22.260723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:22.261291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:22.425410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:22.434628 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f698708c-c087-47c7-8841-93f664b85287 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1369 microversion: 2.1 time: 0.188840 Oct 22 03:26:22.434628 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2530/4979] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:22 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1369 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:22.510219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:22.514049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:22.525914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:22.527191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:22.528144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:22.528435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:22.529310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:22.529429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:22.530129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:22.530807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:22.536766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:22.537397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:22.537917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:22.538710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:22.539235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:22.539888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:22.583960 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d12a020-5a55-4a34-9662-08b67eff1c0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080101 Oct 22 03:26:22.593496 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2450/4980] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:26:22 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:22.718426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:22.728856 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-baef988d-76b4-4bc7-9883-986f27177515 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.206290 Oct 22 03:26:22.736251 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2531/4981] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:22 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:23.459090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:23.460055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:23.466993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:23.475753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:23.476530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:23.478117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:23.478763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:23.479362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:23.606580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:23.611931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:23.620513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:23.621387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:23.622251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:23.623546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:23.624335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:23.625054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:23.669487 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b33059fa-8e02-4c2e-85c9-55410199db10 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067436 Oct 22 03:26:23.670338 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2532/4982] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:26:23 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:23.687695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:23.700074 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38329377-3212-4264-82ac-63a14ea9059c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1369 microversion: 2.1 time: 0.244981 Oct 22 03:26:23.706722 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2451/4983] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:23 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:23.753396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:23.754218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:23.762158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:23.762889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:23.763648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:23.764934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:23.765557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:23.766150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:23.938295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:23.946858 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-89c0a43e-2762-46ae-bbde-eefd47fd561b tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.198002 Oct 22 03:26:23.948151 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2533/4984] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:23 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:24.683106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:24.685521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:24.687684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:24.688398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:24.690678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:24.697046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:24.697541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:24.697974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:24.698687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:24.699134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:24.699612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:24.722080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:24.728355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:24.729400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:24.737888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:24.738639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:24.739252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:24.739844 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3fc9f6cb-dabd-4ee3-afb4-b9a7ccafa409 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060649 Oct 22 03:26:24.740353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:24.740973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:24.741592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:24.744487 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2452/4985] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:26:24 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:24.888799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:24.898708 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-41fa1e47-52e5-4ce5-ad36-775d7a023cb4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1369 microversion: 2.1 time: 0.178649 Oct 22 03:26:24.899285 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2534/4986] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:24 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:24.971388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:24.972374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:24.979597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:24.980140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:24.980821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:24.981596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:24.982139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:24.982637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:25.217533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:25.227262 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4852359-e162-4675-8110-4bd679e6d8e7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.259760 Oct 22 03:26:25.228527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2453/4987] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:24 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:25.596066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-25adba7a-5d6d-4840-b852-28344e123fa7 req-f4df87ba-eeaf-4d5a-b4c6-42449d05dc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b96077-d04d-4bb7-b33b-632d27cebe25", "name": "network-vif-plugged", "status": "completed", "tag": "d3202c78-639a-4940-ab07-4ab3beeea85f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:25.607317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-25adba7a-5d6d-4840-b852-28344e123fa7 req-f4df87ba-eeaf-4d5a-b4c6-42449d05dc8f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:25.607892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-25adba7a-5d6d-4840-b852-28344e123fa7 req-f4df87ba-eeaf-4d5a-b4c6-42449d05dc8f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:25.608427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-25adba7a-5d6d-4840-b852-28344e123fa7 req-f4df87ba-eeaf-4d5a-b4c6-42449d05dc8f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:25.620388 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-25adba7a-5d6d-4840-b852-28344e123fa7 req-f4df87ba-eeaf-4d5a-b4c6-42449d05dc8f service nova] Creating event network-vif-plugged:d3202c78-639a-4940-ab07-4ab3beeea85f for instance 41b96077-d04d-4bb7-b33b-632d27cebe25 on n-h2-862416-2 Oct 22 03:26:25.625728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-25adba7a-5d6d-4840-b852-28344e123fa7 req-f4df87ba-eeaf-4d5a-b4c6-42449d05dc8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038051 Oct 22 03:26:25.627302 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2535/4988] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:25.754788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:25.758008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:25.765873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:25.767696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:25.768926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:25.769657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:25.770275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:25.771132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:25.802908 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1b5687a8-1239-469f-98a4-6aa4e29c079f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054280 Oct 22 03:26:25.803487 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2454/4989] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:26:25 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:26:25.869944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:25.870508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:25.878420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:25.878904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:25.879338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:25.880036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:25.880519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:25.880944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:25.909319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:26:25.927948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:25.928708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:25.935415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:25.936202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:25.936899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:25.938001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:25.939330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:25.940104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:25.996671 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-207e44b9-1941-4ad4-8729-6f7b44ed9afa tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 204 len: 0 microversion: 2.1 time: 0.130457 Oct 22 03:26:25.997300 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2536/4990] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:26:25 2022] DELETE /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:26:26.008834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:26.009558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:26.015685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:26.016166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:26.016692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:26.017398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:26.017855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:26.018483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:26.086469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:26.095860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6199430a-c6e4-4ce0-a1f1-0caeee542827 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1369 microversion: 2.1 time: 0.176610 Oct 22 03:26:26.096567 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2455/4991] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:25 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:26.220229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:26.228251 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9d61c6d-8646-4767-8235-87fc3cfd5617 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1680 microversion: 2.1 time: 0.223989 Oct 22 03:26:26.228838 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2537/4992] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:26 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:26.251904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:26.252552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:26.258665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:26.259159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:26.259601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:26.260338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:26.260797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:26.261227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:26.392189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:26.400169 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9dca9c39-e044-4efd-927f-a7e94a5afa61 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.153013 Oct 22 03:26:26.400777 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2456/4993] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:26 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:27.118981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:27.120128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:27.127278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:27.127773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:27.128454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:27.129168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:27.129625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:27.130053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:27.254922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:27.255557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:27.263884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:27.264407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:27.265371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:27.266085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:27.268145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:27.268919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:27.364767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:27.378825 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca0af8ce-3e68-4685-bb44-aa9ac0cb9452 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1369 microversion: 2.1 time: 0.262669 Oct 22 03:26:27.379947 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2538/4994] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:27 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:27.426539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:27.427408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:27.439879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:27.440715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:27.441350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:27.442250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:27.442863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:27.444747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:27.493432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:27.503240 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-882e3b30-1b88-44e1-8083-78903115a6b1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1680 microversion: 2.1 time: 0.253320 Oct 22 03:26:27.504270 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2457/4995] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:27 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:27.718050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:27.727713 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a884c199-e5a5-4b8c-833b-49a7e286ba27 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.305574 Oct 22 03:26:27.728486 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2539/4996] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:27 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:28.403482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:28.404130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:28.421143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:28.430469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:28.431850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:28.432651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:28.433121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:28.433556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:28.533777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:28.535400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:28.544938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:28.545751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:28.546413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:28.547341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:28.548642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:28.549699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:28.655456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:28.668134 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fddf1b0d-dc50-4141-a112-5316ecb08f28 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1613 microversion: 2.1 time: 0.143804 Oct 22 03:26:28.669645 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2540/4997] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:28 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1613 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:28.680059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:28.695280 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6521ba00-1d69-4b31-bbe0-ffe0a951e299 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1563 microversion: 2.1 time: 0.296463 Oct 22 03:26:28.697870 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2458/4998] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:28 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1563 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:28.724465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:28.725554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:28.732844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:28.733438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:28.733891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:28.734863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:28.735636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:28.736255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:28.755679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:28.756852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:28.768250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:28.768870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:28.770004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:28.771723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:28.774518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:28.775063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:28.990044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c19ec957-f9f2-4a85-9709-0dd8135a43dc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.273535 Oct 22 03:26:28.998511 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2541/4999] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:26:28 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-interface => generated 284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:29.003974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9f728353-f19b-422c-b659-213a99c24a12 req-b87e3ac3-1a92-440f-a1af-9a2b68487992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfd6354-0b31-4bcf-8abb-a408e84093d8", "name": "network-vif-deleted", "tag": "60dbd2f2-720d-4a18-adf1-f5dd30000fce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:29.030656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9f728353-f19b-422c-b659-213a99c24a12 req-b87e3ac3-1a92-440f-a1af-9a2b68487992 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:29.031146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9f728353-f19b-422c-b659-213a99c24a12 req-b87e3ac3-1a92-440f-a1af-9a2b68487992 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:29.032715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9f728353-f19b-422c-b659-213a99c24a12 req-b87e3ac3-1a92-440f-a1af-9a2b68487992 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:29.062753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9f728353-f19b-422c-b659-213a99c24a12 req-b87e3ac3-1a92-440f-a1af-9a2b68487992 service nova] Creating event network-vif-deleted:60dbd2f2-720d-4a18-adf1-f5dd30000fce for instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 on n-h1-862416-2 Oct 22 03:26:29.092798 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9f728353-f19b-422c-b659-213a99c24a12 req-b87e3ac3-1a92-440f-a1af-9a2b68487992 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092883 Oct 22 03:26:29.096576 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2542/5000] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:29.319034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:29.338015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:29.343246 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f25c6c0e-991b-4a33-8fbd-e71ebdbf258c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.594497 Oct 22 03:26:29.343823 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2459/5001] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:28 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:29.698828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:29.699436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:29.713418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:29.714595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:29.715338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:29.717063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:29.717833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:29.718465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:29.802430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:29.805177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:29.805858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:29.806539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lazy-loading 'fault' on Instance uuid bbfd6354-0b31-4bcf-8abb-a408e84093d8 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:26:29.923523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:29.927973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:29.936528 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-660c5b31-c0f5-4199-941e-e5676ea6af80 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 200 len: 1329 microversion: 2.1 time: 0.247737 Oct 22 03:26:29.937862 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2543/5002] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:29 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 1329 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:30.372407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:30.373091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:30.387413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:30.389592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:30.390313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:30.391055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:30.392070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:30.392533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:30.651125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:30.660815 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f148635-fc72-4049-bbac-ab4e3591cadf tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.293004 Oct 22 03:26:30.661732 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2460/5003] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:30 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:30.964359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:30.965223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:30.985376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:30.986100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:30.986660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:30.987505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:30.988090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:30.988640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:31.005964 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 HTTP/1.1 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'bbfd6354-0b31-4bcf-8abb-a408e84093d8'} Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:31.007785 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:31.011809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:31.011809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:31.011809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:31.011809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:26:31.011809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:26:31.011809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:26:31.011809 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:31.014053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:26:31.015174 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9860a470-719a-4d20-b77e-1f6d48485a60 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 404 len: 111 microversion: 2.1 time: 0.055467 Oct 22 03:26:31.015957 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2544/5004] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:30 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:26:31.024663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c39b565a-352f-4975-b71e-86c23d8712ab tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '.version_select at 0x7f0d1a8a1a60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:31.054320 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c39b565a-352f-4975-b71e-86c23d8712ab tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-80722569" status: 202 len: 0 microversion: 2.1 time: 0.033350 Oct 22 03:26:31.055572 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2461/5005] 10.222.0.25 () {58 vars in 1215 bytes} [Sat Oct 22 03:26:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-80722569 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:26:31.142629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c90f541d-17ab-45e8-8a16-763723b007b1 req-02be8d1f-4985-4d4f-9d47-53561d2f3f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b96077-d04d-4bb7-b33b-632d27cebe25", "tag": "d3202c78-639a-4940-ab07-4ab3beeea85f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:31.171103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c90f541d-17ab-45e8-8a16-763723b007b1 req-02be8d1f-4985-4d4f-9d47-53561d2f3f44 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:31.172442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c90f541d-17ab-45e8-8a16-763723b007b1 req-02be8d1f-4985-4d4f-9d47-53561d2f3f44 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:31.179310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c90f541d-17ab-45e8-8a16-763723b007b1 req-02be8d1f-4985-4d4f-9d47-53561d2f3f44 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:31.215249 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c90f541d-17ab-45e8-8a16-763723b007b1 req-02be8d1f-4985-4d4f-9d47-53561d2f3f44 service nova] Creating event network-changed:d3202c78-639a-4940-ab07-4ab3beeea85f for instance 41b96077-d04d-4bb7-b33b-632d27cebe25 on n-h2-862416-2 Oct 22 03:26:31.227005 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c90f541d-17ab-45e8-8a16-763723b007b1 req-02be8d1f-4985-4d4f-9d47-53561d2f3f44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088976 Oct 22 03:26:31.227945 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2545/5006] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:31.687628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:31.688877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:31.698202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:31.699067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:31.699713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:31.700745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:31.701950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:31.702628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:32.260004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:32.268778 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-00c96d11-2436-492b-a9f1-a93a9817c207 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.586838 Oct 22 03:26:32.269371 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2462/5007] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:31 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:32.648694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9b30fe9-688d-4823-b56e-f954fdba1fca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: .version_select at 0x7f0d199a9790>, body: {"keypair": {"name": "tempest-keypair-435146675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPH6n9+2stpw4oJHJ9YxTZ5+xivRef/TGBEA9/mCbHmDl5ahmVmJriQAFtBgGwuNIK1Go2MGxbs9c0gXgSy8Y3bu3tAfVKVlrIPkIZTcXn2ru+d41EvWHcikj3z76Vmtg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:32.666880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b9b30fe9-688d-4823-b56e-f954fdba1fca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:26:32.673481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b9b30fe9-688d-4823-b56e-f954fdba1fca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for user 3ad9769823b74399aabb7395eeee44aa and project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:26:32.700504 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9b30fe9-688d-4823-b56e-f954fdba1fca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055951 Oct 22 03:26:32.701932 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2546/5008] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:26:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:33.294513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:33.295119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:33.302949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:33.303465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:33.304054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:33.304973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:33.306224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:33.306224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:33.577561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:33.604920 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-44e26ab9-28c1-43f5-b150-d4b1316e313a tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.315273 Oct 22 03:26:33.605835 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2463/5009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:33 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:34.361702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1464704464", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db13738c-9ec5-42b7-9de3-e09248983a6a"}], "security_groups": [{"name": "tempest-securitygroup--1759542092"}], "key_name": "tempest-keypair-435146675", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:34.632003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:34.633659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:34.640986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:34.642361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:34.642877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:34.643661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:34.644363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:34.644917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:34.781416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] validate_networks() for [('db13738c-9ec5-42b7-9de3-e09248983a6a', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:26:34.795550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:34.803974 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d9b6fdf-398b-477c-a17d-ca0703d1b7ec tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.177007 Oct 22 03:26:34.816257 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2464/5010] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:34 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:35.430005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:26:35.430723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:26:35.430881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:26:35.431529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:26:35.432095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:26:35.442841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:35.443325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:35.443751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:35.453975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:35.455824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:35.456541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:35.486765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:26:35.493376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for user 3ad9769823b74399aabb7395eeee44aa and project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:26:35.509035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:26:35.511690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:26:35.567321 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b5054e26-cfe2-4c13-84d3-345ae7dacc17 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.212049 Oct 22 03:26:35.568340 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2547/5011] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:26:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:26:35.579358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6976f396-c73b-4a81-b209-aac5dec858d6 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:35.579973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6976f396-c73b-4a81-b209-aac5dec858d6 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:35.667542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6976f396-c73b-4a81-b209-aac5dec858d6 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:35.674871 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6976f396-c73b-4a81-b209-aac5dec858d6 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1241 microversion: 2.1 time: 0.099110 Oct 22 03:26:35.675606 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2465/5012] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:35 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:35.828147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:35.830306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:35.839109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:35.839929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:35.840644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:35.841580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:35.842223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:35.842888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:36.042631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:36.062751 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5fb92a2c-4256-4a09-bf63-3424acacf791 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.237664 Oct 22 03:26:36.063425 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2548/5013] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:35 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:36.698470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:36.699759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:36.710429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:36.710924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:36.711369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:36.712089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:36.712581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:36.713009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:36.798772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:36.823726 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9c9e200-8547-4f33-9a8a-c424df3d30c2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1293 microversion: 2.1 time: 0.127372 Oct 22 03:26:36.824706 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2466/5014] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:36 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:37.086047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:37.086651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:37.096877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:37.097744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:37.098349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:37.099221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:37.099828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:37.100433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:37.378027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:37.387696 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69d5fecb-2e54-4965-a31c-95bf7e4c5236 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1522 microversion: 2.1 time: 0.305605 Oct 22 03:26:37.390243 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2549/5015] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:37 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:37.848187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:37.848851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:37.856015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:37.856544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:37.856988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:37.857704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:37.858163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:37.858630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:37.946511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:37.956625 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2f795c40-3dcf-4eea-a00f-3031f23b50c3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1299 microversion: 2.1 time: 0.112918 Oct 22 03:26:37.957697 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2467/5016] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:37 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:38.414895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:38.415957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:38.426227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:38.426782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:38.427492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:38.428344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:38.428722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:38.429155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:38.589950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:38.600972 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aac2200a-0c58-4724-8efe-36c493c5b5d7 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1502 microversion: 2.1 time: 0.190675 Oct 22 03:26:38.610064 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2550/5017] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:38 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:38.626735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-941ec5dd-4240-4030-8c25-d67ca28eab05 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Action: 'create', calling method: .version_select at 0x7f0d192f0040>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1748218515", "description": "tempest-description-551007924"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:38.982292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:38.983890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:38.990957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:38.991701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:38.992144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:38.993698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:38.994324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:38.994916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:39.020090 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-941ec5dd-4240-4030-8c25-d67ca28eab05 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.398246 Oct 22 03:26:39.021069 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2468/5018] 10.222.0.25 () {60 vars in 1180 bytes} [Sat Oct 22 03:26:38 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:39.034926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1748218515"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:39.035636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:39.048927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:39.051562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:39.052101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:39.053904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:39.055076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:39.056004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:39.374290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.network.security_group_api [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Adding security group 72ad6235-c692-4be3-98bc-9932e6c9f7bb to port c189b125-f4a2-465b-9e66-5b851a5f074f Oct 22 03:26:39.700997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:39.713273 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e725e52f-5938-4409-be47-e77668fbf31b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1367 microversion: 2.1 time: 0.734881 Oct 22 03:26:39.714571 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2551/5019] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:38 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1367 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:39.726510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:39.730064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:39.741775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:39.742566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:39.743383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:39.744419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:39.745136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:39.745783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:40.128590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:40.137274 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e58a8675-160b-4e1b-bfe4-e0c80e0fc502 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.418944 Oct 22 03:26:40.137866 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2552/5020] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:39 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:40.164078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:40.164743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:40.177871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:40.178795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:40.179644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:40.180941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:40.181602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:40.182189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:40.295553 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-544feca1-6803-47ea-a9d4-10618c0435b5 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action" status: 202 len: 0 microversion: 2.1 time: 1.264617 Oct 22 03:26:40.296868 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2469/5021] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:26:39 2022] POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action => generated 0 bytes in 1268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:26:40.322715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1748218515"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:40.325662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:40.348366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:40.348962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:40.350166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:40.351266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:40.351828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:40.352804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:40.523399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:40.537220 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0de481ab-d490-45c6-ab0a-9bfce2c90b6b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.377078 Oct 22 03:26:40.537952 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2553/5022] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:40 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:40.554465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-bfae56af-f312-4d59-8c45-5e90799ee65d req-28c79005-1675-47a6-a8b8-9386b839e2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34bd18f-8662-46f8-9741-7b88afc61bea", "tag": "c189b125-f4a2-465b-9e66-5b851a5f074f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:40.569306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bfae56af-f312-4d59-8c45-5e90799ee65d req-28c79005-1675-47a6-a8b8-9386b839e2f7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:40.569794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bfae56af-f312-4d59-8c45-5e90799ee65d req-28c79005-1675-47a6-a8b8-9386b839e2f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:40.570236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bfae56af-f312-4d59-8c45-5e90799ee65d req-28c79005-1675-47a6-a8b8-9386b839e2f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:40.603688 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-bfae56af-f312-4d59-8c45-5e90799ee65d req-28c79005-1675-47a6-a8b8-9386b839e2f7 service nova] Creating event network-changed:c189b125-f4a2-465b-9e66-5b851a5f074f for instance e34bd18f-8662-46f8-9741-7b88afc61bea on n-h2-862416-2 Oct 22 03:26:40.605071 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-bfae56af-f312-4d59-8c45-5e90799ee65d req-28c79005-1675-47a6-a8b8-9386b839e2f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065245 Oct 22 03:26:40.605975 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2554/5023] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:40.615331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:40.617650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:40.642830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:40.649378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:40.650111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:40.654953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:40.655717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:40.656435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:40.911307 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.network.security_group_api [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Removing security group 72ad6235-c692-4be3-98bc-9932e6c9f7bb from port c189b125-f4a2-465b-9e66-5b851a5f074f Oct 22 03:26:40.960844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:40.974511 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c22724c5-97ec-46e1-871b-799096bc7092 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.367137 Oct 22 03:26:40.986654 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2555/5024] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:40 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:40.992308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:40.993332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:41.002613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:41.003360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:41.003813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:41.004571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:41.005505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:41.006127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:41.230489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:41.242219 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2539eae-ec6b-45c6-87ee-529199a22e0a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1367 microversion: 2.1 time: 0.261067 Oct 22 03:26:41.244642 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2556/5025] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:40 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:41.254913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:41.255800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:41.268241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:41.268725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:41.269163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:41.269883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:41.270306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:41.270733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:41.506544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:41.518388 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98f9c31b-0a48-4dc1-ab24-1584adde970a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.272091 Oct 22 03:26:41.521271 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2557/5026] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:41 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:41.662811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-596019857", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "316c23c4-6eda-4626-bced-03168617187b"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:41.723967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] validate_networks() for [('316c23c4-6eda-4626-bced-03168617187b', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:26:42.028836 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-30eb36b5-62a6-45ec-a873-09b8eac0542f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action" status: 202 len: 0 microversion: 2.1 time: 1.727622 Oct 22 03:26:42.030064 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2470/5027] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:26:40 2022] POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action => generated 0 bytes in 1730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:26:42.039881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15de2c60-128b-4b83-b0d4-9ec211522770 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Action: 'create', calling method: .version_select at 0x7f0d1986bf70>, body: {"pool": null} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:43.110801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:26:43.111972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:26:43.112739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:26:43.113345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:26:43.114001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:26:43.124598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.125083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.125572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:43.126288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.127014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.127451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:43.147384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:26:43.153167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:43.154691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for user f89d04db39be473097b885f7465115a2 and project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:26:43.171942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:26:43.175739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:26:43.239448 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5bb33edd-b9d7-4e0b-b2c1-fae29d7a0852 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580281 Oct 22 03:26:43.247078 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2558/5028] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:26:43.254849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:43.258258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:43.267754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.268438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.269099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:43.270068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.270634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.271290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:43.316353 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7e0a5d5-54b0-4f00-8147-77fde455530d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.073828 Oct 22 03:26:43.323061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2559/5029] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Oct 22 03:26:43 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:43.328143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:43.330025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:43.336519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.337243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.338560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:43.339927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.340639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.341321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:43.816151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:43.827182 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c80fa89b-7579-408b-9557-e4e12dabd23a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1367 microversion: 2.1 time: 0.502275 Oct 22 03:26:43.841332 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2560/5030] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:43 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1367 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:43.867135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-71c28f32-e305-4326-ba0d-52bb69bfd291 req-e52421ad-5b60-47bb-adff-f6e692c3ead8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13cb759-d1e1-43a4-a3e4-5f778581559f", "tag": "87ad47fe-3221-4711-b326-39b4dc50d735"}, {"name": "network-changed", "server_uuid": "e34bd18f-8662-46f8-9741-7b88afc61bea", "tag": "c189b125-f4a2-465b-9e66-5b851a5f074f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:43.897326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-71c28f32-e305-4326-ba0d-52bb69bfd291 req-e52421ad-5b60-47bb-adff-f6e692c3ead8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.898677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-71c28f32-e305-4326-ba0d-52bb69bfd291 req-e52421ad-5b60-47bb-adff-f6e692c3ead8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.899494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-71c28f32-e305-4326-ba0d-52bb69bfd291 req-e52421ad-5b60-47bb-adff-f6e692c3ead8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:43.917373 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-71c28f32-e305-4326-ba0d-52bb69bfd291 req-e52421ad-5b60-47bb-adff-f6e692c3ead8 service nova] Creating event network-changed:87ad47fe-3221-4711-b326-39b4dc50d735 for instance d13cb759-d1e1-43a4-a3e4-5f778581559f on n-h1-862416-2 Oct 22 03:26:43.918761 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-71c28f32-e305-4326-ba0d-52bb69bfd291 req-e52421ad-5b60-47bb-adff-f6e692c3ead8 service nova] Creating event network-changed:c189b125-f4a2-465b-9e66-5b851a5f074f for instance e34bd18f-8662-46f8-9741-7b88afc61bea on n-h2-862416-2 Oct 22 03:26:43.929341 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-71c28f32-e305-4326-ba0d-52bb69bfd291 req-e52421ad-5b60-47bb-adff-f6e692c3ead8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085230 Oct 22 03:26:43.930359 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2561/5031] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:43.936955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:43.937967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:43.946417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.947214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.947881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:43.949266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:43.950055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:43.950970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:44.091935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:44.107162 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b3cdf43-f366-46aa-a3b6-fe3219fb916d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1218 microversion: 2.1 time: 0.175299 Oct 22 03:26:44.108053 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2562/5032] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:43 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:44.117283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:44.117899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:44.126088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:44.127214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:44.127689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:44.128464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:44.128912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:44.129409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:44.131802 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15de2c60-128b-4b83-b0d4-9ec211522770 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.095868 Oct 22 03:26:44.133516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2471/5033] 10.222.0.25 () {60 vars in 1170 bytes} [Sat Oct 22 03:26:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:26:44.148069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.140"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:44.153785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:44.171468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:44.173003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:44.174459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:44.175449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:44.176135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:44.176797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:44.185841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:26:44.226831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "refresh_cache-e34bd18f-8662-46f8-9741-7b88afc61bea" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:26:44.227231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquired lock "refresh_cache-e34bd18f-8662-46f8-9741-7b88afc61bea" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:26:44.269372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:44.310550 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4cb7702d-20ca-4329-9421-31b4792e8fee tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 204 len: 0 microversion: 2.20 time: 0.198506 Oct 22 03:26:44.312152 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2563/5034] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:26:44 2022] DELETE /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:26:44.325135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:44.326437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:44.335725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:44.337846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:44.339039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:44.340369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:44.341321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:44.342057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:45.079530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:45.091215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:45.092889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:45.094864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b468e50-78d9-43d8-a273-b74bef792404 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.777449 Oct 22 03:26:45.102579 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2564/5035] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:26:44 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:26:45.102579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:45.102579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:45.109523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:45.110324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:45.111381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:45.112452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:45.113187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:45.114713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:45.439456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:45.455486 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c48c0a74-3dd4-4ac3-8626-f3a331562186 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1367 microversion: 2.1 time: 0.358840 Oct 22 03:26:45.460056 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2565/5036] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:45 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:45.477197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:45.485800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:45.494767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:45.495629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:45.496396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:45.500227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:45.501299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:45.501954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:45.672759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:45.673363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:45.690279 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8058f78-4f8b-4674-a9d3-359369be4b9f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1266 microversion: 2.1 time: 0.228556 Oct 22 03:26:45.691290 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2566/5037] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:45 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:46.123797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:46.124497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:46.131770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:46.132310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:46.132780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:46.133522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:46.134137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:46.134591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:46.498701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:46.520376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:46.521950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:46.523939 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6396c29e-6e7c-4b04-97a6-7cd21533e3a4 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.403984 Oct 22 03:26:46.523939 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2567/5038] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:26:46 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:26:46.536086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:46.538652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:46.549873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:46.550613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:46.551270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:46.552840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:46.553468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:46.554061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:46.711358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Building network info cache for instance {{(pid=120582) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:26:46.900085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:46.915429 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-04cb4b13-9c8c-4ebe-8edc-ec36c7a37bd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1367 microversion: 2.1 time: 0.386114 Oct 22 03:26:46.917554 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2568/5039] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:46 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:46.927717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:46.928865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:46.937087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:46.938919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:46.940578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:46.942111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:46.942976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:46.943616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:47.088336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:47.109030 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4d4c46a-0b7d-452f-a9da-696eb851f58a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1272 microversion: 2.1 time: 0.188830 Oct 22 03:26:47.111669 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2569/5040] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:46 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:47.120552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-fc22bbb1-a650-4f62-9f78-f545b2f55286 req-de4316c8-4ef1-4677-8c8f-d807342015b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34bd18f-8662-46f8-9741-7b88afc61bea", "tag": "c189b125-f4a2-465b-9e66-5b851a5f074f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:47.136391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fc22bbb1-a650-4f62-9f78-f545b2f55286 req-de4316c8-4ef1-4677-8c8f-d807342015b5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:47.137300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fc22bbb1-a650-4f62-9f78-f545b2f55286 req-de4316c8-4ef1-4677-8c8f-d807342015b5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:47.138087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fc22bbb1-a650-4f62-9f78-f545b2f55286 req-de4316c8-4ef1-4677-8c8f-d807342015b5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:47.154868 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-fc22bbb1-a650-4f62-9f78-f545b2f55286 req-de4316c8-4ef1-4677-8c8f-d807342015b5 service nova] Creating event network-changed:c189b125-f4a2-465b-9e66-5b851a5f074f for instance e34bd18f-8662-46f8-9741-7b88afc61bea on n-h2-862416-2 Oct 22 03:26:47.165223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-fc22bbb1-a650-4f62-9f78-f545b2f55286 req-de4316c8-4ef1-4677-8c8f-d807342015b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051582 Oct 22 03:26:47.167780 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2570/5041] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:47.576962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:47.577677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:47.589659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:47.596810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:47.598989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:47.601671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:47.602937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:47.603486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:48.089151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:48.111719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:48.113293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:48.114491 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e91ea039-e31f-4f85-8b87-2248cbead483 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1722 microversion: 2.20 time: 0.561902 Oct 22 03:26:48.115064 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2571/5042] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:26:47 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1722 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:26:48.129972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a6e8bb04-1cab-42b2-8c8c-47d1b3ac1494 req-3d01525f-2f93-4059-868b-85854d031384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13cb759-d1e1-43a4-a3e4-5f778581559f", "name": "network-vif-plugged", "status": "completed", "tag": "87ad47fe-3221-4711-b326-39b4dc50d735"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:48.159825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a6e8bb04-1cab-42b2-8c8c-47d1b3ac1494 req-3d01525f-2f93-4059-868b-85854d031384 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:48.160451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a6e8bb04-1cab-42b2-8c8c-47d1b3ac1494 req-3d01525f-2f93-4059-868b-85854d031384 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:48.162406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a6e8bb04-1cab-42b2-8c8c-47d1b3ac1494 req-3d01525f-2f93-4059-868b-85854d031384 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:48.190769 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a6e8bb04-1cab-42b2-8c8c-47d1b3ac1494 req-3d01525f-2f93-4059-868b-85854d031384 service nova] Creating event network-vif-plugged:87ad47fe-3221-4711-b326-39b4dc50d735 for instance d13cb759-d1e1-43a4-a3e4-5f778581559f on n-h1-862416-2 Oct 22 03:26:48.204755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a6e8bb04-1cab-42b2-8c8c-47d1b3ac1494 req-3d01525f-2f93-4059-868b-85854d031384 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082187 Oct 22 03:26:48.205480 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2572/5043] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:48.216413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:48.220638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:48.241440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:48.244356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:48.245103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:48.245888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:48.247282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:48.257572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:48.720265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:48.727956 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-adb431e9-34c3-476d-a3a4-ae55ba992d38 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1367 microversion: 2.1 time: 0.521248 Oct 22 03:26:48.728955 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2573/5044] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:48 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1367 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:48.735147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:48.735733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:48.742492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:48.743654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:48.744348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:48.745845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:48.746371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:48.746862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:48.962443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:48.972387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8622491b-fd51-4a50-85ee-793451372315 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1314 microversion: 2.1 time: 0.242156 Oct 22 03:26:48.973210 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2574/5045] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:48 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:49.143627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:49.144658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:49.151172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:49.151944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:49.152600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:49.153711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:49.154339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:49.155753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:49.254067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:49.262439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:49.263886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:49.265079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f93d4d7-fc8b-42fb-89e7-1945838c5b78 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1654 microversion: 2.20 time: 0.126074 Oct 22 03:26:49.266864 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2575/5046] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:26:49 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1654 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:26:49.307554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-136ff884-8770-4f3f-91be-f28de40cec08 req-826ca3b4-7bdd-4a07-b3de-91b37558ab6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f2223f-8133-453b-bc3a-20cea20c541b", "tag": "9724dee3-4baf-4aad-b861-fa173e22dc22"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:49.355056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-136ff884-8770-4f3f-91be-f28de40cec08 req-826ca3b4-7bdd-4a07-b3de-91b37558ab6c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:49.355544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-136ff884-8770-4f3f-91be-f28de40cec08 req-826ca3b4-7bdd-4a07-b3de-91b37558ab6c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:49.356230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-136ff884-8770-4f3f-91be-f28de40cec08 req-826ca3b4-7bdd-4a07-b3de-91b37558ab6c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:49.380583 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-136ff884-8770-4f3f-91be-f28de40cec08 req-826ca3b4-7bdd-4a07-b3de-91b37558ab6c service nova] Creating event network-changed:9724dee3-4baf-4aad-b861-fa173e22dc22 for instance c2f2223f-8133-453b-bc3a-20cea20c541b on n-h2-862416-2 Oct 22 03:26:49.391475 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-136ff884-8770-4f3f-91be-f28de40cec08 req-826ca3b4-7bdd-4a07-b3de-91b37558ab6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086644 Oct 22 03:26:49.393778 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2576/5047] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:26:49.501661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Updating instance_info_cache with network_info: [{"id": "c189b125-f4a2-465b-9e66-5b851a5f074f", "address": "fa:16:3e:ae:69:4e", "network": {"id": "11b56ed7-7fde-4624-af01-50f065e67c82", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-83706930-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6f53f096c8dc49e9be1aae9ecb4e6e61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc189b125-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:26:49.518913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Releasing lock "refresh_cache-e34bd18f-8662-46f8-9741-7b88afc61bea" {{(pid=120582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:26:49.523438 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92ef07ed-1f73-4dfd-9fde-b4ec06e3d230 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action" status: 202 len: 0 microversion: 2.1 time: 5.380430 Oct 22 03:26:49.524651 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2472/5048] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:26:44 2022] POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action => generated 0 bytes in 5383 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 03:26:49.539962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.140"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:49.755607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:49.756587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:49.770495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:49.772323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:49.774113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:49.776429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:49.777978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:49.778646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:49.799489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:49.811373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:49.812695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:49.814170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:49.815171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:49.815856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:49.816581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:50.196029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "refresh_cache-e34bd18f-8662-46f8-9741-7b88afc61bea" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 22 03:26:50.196971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquired lock "refresh_cache-e34bd18f-8662-46f8-9741-7b88afc61bea" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 22 03:26:50.261121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:50.276098 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-96ba8713-be07-4480-ab8f-b8e30739a1b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1367 microversion: 2.1 time: 0.526883 Oct 22 03:26:50.287045 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2473/5049] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:49 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1367 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:50.292966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:50.293851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:50.304079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:50.304998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:50.305677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:50.306846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:50.307954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:50.308682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:50.639336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:50.647633 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9c0acf3-c429-4d53-8eb0-e607ca7c1ca2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1314 microversion: 2.1 time: 0.359098 Oct 22 03:26:50.648655 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2474/5050] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:50 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:50.653542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f7c78916-6cc6-4a84-9657-320d5a9ed33d req-758fbc5d-9f8a-42d4-bbdc-796df345f233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d2acf4-a7dd-46af-ae59-83a28eccaa4f", "name": "network-vif-deleted", "tag": "01c4850c-25d7-4312-836a-b864a1ef4bed"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:50.664411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f7c78916-6cc6-4a84-9657-320d5a9ed33d req-758fbc5d-9f8a-42d4-bbdc-796df345f233 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:50.665180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f7c78916-6cc6-4a84-9657-320d5a9ed33d req-758fbc5d-9f8a-42d4-bbdc-796df345f233 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:50.666017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f7c78916-6cc6-4a84-9657-320d5a9ed33d req-758fbc5d-9f8a-42d4-bbdc-796df345f233 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:50.678928 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f7c78916-6cc6-4a84-9657-320d5a9ed33d req-758fbc5d-9f8a-42d4-bbdc-796df345f233 service nova] Creating event network-vif-deleted:01c4850c-25d7-4312-836a-b864a1ef4bed for instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f on n-h2-862416-2 Oct 22 03:26:50.684486 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f7c78916-6cc6-4a84-9657-320d5a9ed33d req-758fbc5d-9f8a-42d4-bbdc-796df345f233 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034251 Oct 22 03:26:50.685680 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2475/5051] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:50.692887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:50.693836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:50.700988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:50.701766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:50.702413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:50.703837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:50.704645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:50.705656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:50.808231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:50.825184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:50.834925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:50.838602 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-326ded08-dfdb-4555-9ecb-297936d3d20c tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1654 microversion: 2.20 time: 0.149007 Oct 22 03:26:50.842892 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2476/5052] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:26:50 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:26:51.085371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Building network info cache for instance {{(pid=120581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 22 03:26:51.305599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:51.306431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:51.315309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:51.316088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:51.316987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:51.318442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:51.319413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:51.320148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:51.614295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:51.630291 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-87a5bbee-d168-4a8d-a357-44618c9d210f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1558 microversion: 2.1 time: 0.331985 Oct 22 03:26:51.630911 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2477/5053] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:51 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1558 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:51.638730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6666eb59-fbbb-4741-8ba8-aa16e7c21846 req-1f432b11-ba25-4a10-bb35-748e2eac1a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34bd18f-8662-46f8-9741-7b88afc61bea", "tag": "c189b125-f4a2-465b-9e66-5b851a5f074f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:51.664558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6666eb59-fbbb-4741-8ba8-aa16e7c21846 req-1f432b11-ba25-4a10-bb35-748e2eac1a1c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:51.665769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6666eb59-fbbb-4741-8ba8-aa16e7c21846 req-1f432b11-ba25-4a10-bb35-748e2eac1a1c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:51.666378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6666eb59-fbbb-4741-8ba8-aa16e7c21846 req-1f432b11-ba25-4a10-bb35-748e2eac1a1c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:51.690495 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6666eb59-fbbb-4741-8ba8-aa16e7c21846 req-1f432b11-ba25-4a10-bb35-748e2eac1a1c service nova] Creating event network-changed:c189b125-f4a2-465b-9e66-5b851a5f074f for instance e34bd18f-8662-46f8-9741-7b88afc61bea on n-h2-862416-2 Oct 22 03:26:51.705931 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6666eb59-fbbb-4741-8ba8-aa16e7c21846 req-1f432b11-ba25-4a10-bb35-748e2eac1a1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073771 Oct 22 03:26:51.707433 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2478/5054] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:51.715164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:51.715988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:51.723628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:51.724427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:51.725805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:51.726722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:51.727350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:51.727938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:51.764877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Updating instance_info_cache with network_info: [{"id": "c189b125-f4a2-465b-9e66-5b851a5f074f", "address": "fa:16:3e:ae:69:4e", "network": {"id": "11b56ed7-7fde-4624-af01-50f065e67c82", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-83706930-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6f53f096c8dc49e9be1aae9ecb4e6e61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc189b125-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:26:51.783813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Releasing lock "refresh_cache-e34bd18f-8662-46f8-9741-7b88afc61bea" {{(pid=120581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 22 03:26:51.801511 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b83caae5-75ea-4e92-ab7b-ced92195992f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action" status: 202 len: 0 microversion: 2.1 time: 2.271565 Oct 22 03:26:51.807028 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2577/5055] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:26:49 2022] POST /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea/action => generated 0 bytes in 2278 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 22 03:26:51.812845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:51.813930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:51.820777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:51.821493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:51.822120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:51.823040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:51.823523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:51.824014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:51.923291 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-78991288-1d26-477b-afd7-c19308aec75f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214123 Oct 22 03:26:51.923917 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2479/5056] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:26:51 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-interface => generated 285 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:51.931320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b3e54813-dcb3-4caf-b2ca-9c3210dee20c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '.version_select at 0x7f0d1a073f70>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:52.455702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:52.476942 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df8351f8-7ace-4591-b486-68d0b743f7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1314 microversion: 2.1 time: 0.668621 Oct 22 03:26:52.477781 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2578/5057] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:51 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:52.483066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:52.483969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:52.492843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:52.493709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:52.494317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:52.495226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:52.497791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:52.498445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:52.617326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:52.630081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:52.633066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '538f74faf48e4343b1794378636552d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acbea2993cb4d1d81f171c1b7f07443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:52.636040 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-807c469d-1863-466f-9c93-641d047e1603 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 200 len: 1654 microversion: 2.20 time: 0.157048 Oct 22 03:26:52.649278 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2579/5058] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:26:52 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:26:53.512452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:53.517218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:53.529576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:53.532184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=16 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:53.535948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:53.541857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:53.548589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:53.549299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:53.549779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:53.551914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:54.005815 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b3e54813-dcb3-4caf-b2ca-9c3210dee20c tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/f15c30a4-31d2-4bae-9f12-48c6f8bf4ebd" status: 202 len: 0 microversion: 2.1 time: 2.080662 Oct 22 03:26:54.007354 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2480/5059] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 03:26:51 2022] DELETE /compute/v2.1/os-floating-ips/f15c30a4-31d2-4bae-9f12-48c6f8bf4ebd => generated 0 bytes in 2083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:26:54.014480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:54.015353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:54.038735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:54.039486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:54.040174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:54.041143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:54.041820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:54.042718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:54.059133 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] HTTP exception thrown: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Request method failure captured: Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f HTTP/1.1 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Cpx_sDdPCAh6PeAQtXSy8eGyMbbevw5OzVqWm_rxfHyK_1Z2XeW7erChZ3omCqTOng5mfBnAcsuSZPgp0oSF1a6s_zI0oimF0FfNrXocc71yxDoHCHm8XMd4PVnJ-LFl_2M2yMTAm-HWAePu438dQWgA3WyVhvYGa2vMtxZRxmzeg Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}] Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 538f74faf48e4343b1794378636552d2 Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '52d2acf4-a7dd-46af-ae59-83a28eccaa4f'} Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:54.061209 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:54.066447 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:54.066447 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:54.066447 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:54.066447 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:54.066447 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:26:54.066447 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:26:54.066447 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:54.066447 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:54.068687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Returning 404 to user: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:26:54.070033 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-259c7ed0-0eab-4b8f-8507-518b9ae15617 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 404 len: 111 microversion: 2.20 time: 0.061188 Oct 22 03:26:54.071147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2481/5060] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:26:54 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:26:54.076094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9804879-97b7-4711-876f-049d1eae8448 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '.version_select at 0x7f0d1a073e50>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:54.122273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:54.133615 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e2b944ce-1f48-4928-95be-343a2105591b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1314 microversion: 2.1 time: 0.629763 Oct 22 03:26:54.134777 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2580/5061] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:53 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:54.140540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d30a968c-2261-4cc1-b6bb-6a6aeb0f1f46 req-f44ffe75-6514-4f1f-b849-cf4d7b250c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13cb759-d1e1-43a4-a3e4-5f778581559f", "tag": "87ad47fe-3221-4711-b326-39b4dc50d735"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:54.151919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d30a968c-2261-4cc1-b6bb-6a6aeb0f1f46 req-f44ffe75-6514-4f1f-b849-cf4d7b250c1b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:54.152716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d30a968c-2261-4cc1-b6bb-6a6aeb0f1f46 req-f44ffe75-6514-4f1f-b849-cf4d7b250c1b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:54.154026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d30a968c-2261-4cc1-b6bb-6a6aeb0f1f46 req-f44ffe75-6514-4f1f-b849-cf4d7b250c1b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:54.170425 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d30a968c-2261-4cc1-b6bb-6a6aeb0f1f46 req-f44ffe75-6514-4f1f-b849-cf4d7b250c1b service nova] Creating event network-changed:87ad47fe-3221-4711-b326-39b4dc50d735 for instance d13cb759-d1e1-43a4-a3e4-5f778581559f on n-h1-862416-2 Oct 22 03:26:54.176471 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d30a968c-2261-4cc1-b6bb-6a6aeb0f1f46 req-f44ffe75-6514-4f1f-b849-cf4d7b250c1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040209 Oct 22 03:26:54.177227 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2581/5062] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:54.182419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a80e28ef-7c0b-4725-9f14-81c258a2d772 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '.version_select at 0x7f0d18e56f70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:54.207783 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a80e28ef-7c0b-4725-9f14-81c258a2d772 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-25466774" status: 204 len: 0 microversion: 2.20 time: 0.029153 Oct 22 03:26:54.208974 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2582/5063] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:26:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-25466774 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:26:55.139824 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9804879-97b7-4711-876f-049d1eae8448 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/72ad6235-c692-4be3-98bc-9932e6c9f7bb" status: 202 len: 0 microversion: 2.1 time: 1.067292 Oct 22 03:26:55.145257 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2482/5064] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 03:26:54 2022] DELETE /compute/v2.1/os-security-groups/72ad6235-c692-4be3-98bc-9932e6c9f7bb => generated 0 bytes in 1071 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:26:55.151981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:55.152640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:55.163993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:55.164800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:55.168117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:55.168983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:55.169443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:55.169863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:55.170691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:55.171131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:55.171592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:55.177551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:55.178269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:55.178873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:55.179782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:55.180423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:55.184953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:55.188703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:55.269046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:26:55.421422 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b6d4a74-1b2f-4c1f-b09e-40a5ae851be8 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 204 len: 0 microversion: 2.1 time: 0.273709 Oct 22 03:26:55.427095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2583/5065] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:26:55 2022] DELETE /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:26:55.435352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:55.436252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:55.443382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:55.444566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:55.445277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:55.446243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:55.448043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:55.450029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:55.743097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:55.753698 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6bce92dc-62e7-4096-8be7-05519f4977c9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1314 microversion: 2.1 time: 0.594769 Oct 22 03:26:55.772587 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2483/5066] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:55 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:55.786788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:55.812475 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f002ca72-7184-4049-9ab9-6dab91f7d67f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1508 microversion: 2.1 time: 0.383507 Oct 22 03:26:55.826590 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2584/5067] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:55 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1508 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:56.017297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-306e9736-4eee-4fb3-b39d-7528fa5aa5f3 req-aee0313b-9568-4fd7-8312-b6d9292306fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f2223f-8133-453b-bc3a-20cea20c541b", "name": "network-vif-plugged", "status": "completed", "tag": "9724dee3-4baf-4aad-b861-fa173e22dc22"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:56.039894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-306e9736-4eee-4fb3-b39d-7528fa5aa5f3 req-aee0313b-9568-4fd7-8312-b6d9292306fd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:56.040447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-306e9736-4eee-4fb3-b39d-7528fa5aa5f3 req-aee0313b-9568-4fd7-8312-b6d9292306fd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:56.040889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-306e9736-4eee-4fb3-b39d-7528fa5aa5f3 req-aee0313b-9568-4fd7-8312-b6d9292306fd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:56.067554 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-306e9736-4eee-4fb3-b39d-7528fa5aa5f3 req-aee0313b-9568-4fd7-8312-b6d9292306fd service nova] Creating event network-vif-plugged:9724dee3-4baf-4aad-b861-fa173e22dc22 for instance c2f2223f-8133-453b-bc3a-20cea20c541b on n-h2-862416-2 Oct 22 03:26:56.077271 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-306e9736-4eee-4fb3-b39d-7528fa5aa5f3 req-aee0313b-9568-4fd7-8312-b6d9292306fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064757 Oct 22 03:26:56.084434 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2484/5068] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:56.776702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:56.778495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:56.787574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:56.788843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:56.789462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:56.790432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:56.791043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:56.791787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:56.836677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:56.838080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:56.845538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:56.846286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:56.846933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:56.847822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:56.848477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:56.849215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:56.874236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:26:57.065132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:57.077261 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c83ead2-0643-412e-a74e-4641c6c91cae tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1508 microversion: 2.1 time: 0.244043 Oct 22 03:26:57.078771 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2485/5069] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:56 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:57.186729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:57.205878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c79433a8-904c-44dd-b560-b96323dd2eff tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1314 microversion: 2.1 time: 0.433141 Oct 22 03:26:57.207251 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2585/5070] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:56 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:58.101578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:58.102195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:58.113294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:58.114916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:58.116065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:58.117400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:58.118190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:58.118639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:58.233104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:58.235333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:58.242766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:58.243553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:58.244227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:58.245321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:58.245990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:58.246628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:58.365959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:58.375626 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5911c8b2-b27a-42e4-b3a9-f6a0d62f5d79 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1508 microversion: 2.1 time: 0.278556 Oct 22 03:26:58.392236 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2486/5071] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:58 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:58.492481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:58.502269 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6df1c74b-dc86-4748-b8a9-8314585a51f8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1314 microversion: 2.1 time: 0.274846 Oct 22 03:26:58.506850 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2586/5072] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:58 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:58.856475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:58.857386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:58.864786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:58.865490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:58.866108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:58.866997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:58.867616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:58.868222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:58.886630 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] HTTP exception thrown: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Request method failure captured: Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f HTTP/1.1 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Cpx_sDdPCAh6PeAQtXSy8eGyMbbevw5OzVqWm_rxfHyK_1Z2XeW7erChZ3omCqTOng5mfBnAcsuSZPgp0oSF1a6s_zI0oimF0FfNrXocc71yxDoHCHm8XMd4PVnJ-LFl_2M2yMTAm-HWAePu438dQWgA3WyVhvYGa2vMtxZRxmzeg Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}] Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 538f74faf48e4343b1794378636552d2 Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '52d2acf4-a7dd-46af-ae59-83a28eccaa4f'} Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:26:58.889161 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.894320 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.896052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Returning 404 to user: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:26:58.897631 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0dde67a-3ac7-4fe5-8895-a65bd6e9c037 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 404 len: 111 microversion: 2.20 time: 0.045089 Oct 22 03:26:58.902566 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2487/5073] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:26:58 2022] DELETE /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:26:58.908198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:58.910192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: 52d2acf4-a7dd-46af-ae59-83a28eccaa4f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:58.918142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:58.922551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:58.923280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:58.924290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:58.924970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:58.925638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:58.940923 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] HTTP exception thrown: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Request method failure captured: Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f HTTP/1.1 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Cpx_sDdPCAh6PeAQtXSy8eGyMbbevw5OzVqWm_rxfHyK_1Z2XeW7erChZ3omCqTOng5mfBnAcsuSZPgp0oSF1a6s_zI0oimF0FfNrXocc71yxDoHCHm8XMd4PVnJ-LFl_2M2yMTAm-HWAePu438dQWgA3WyVhvYGa2vMtxZRxmzeg Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}] Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 538f74faf48e4343b1794378636552d2 Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '52d2acf4-a7dd-46af-ae59-83a28eccaa4f'} Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.943079 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:26:58.946996 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.946996 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:26:58.946996 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:26:58.946996 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:26:58.946996 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:26:58.946996 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:26:58.946996 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. Oct 22 03:26:58.946996 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:26:58.949037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Returning 404 to user: Instance 52d2acf4-a7dd-46af-ae59-83a28eccaa4f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:26:58.950290 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f8c67134-ac8d-45ac-858b-f20a258f6137 tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f" status: 404 len: 111 microversion: 2.20 time: 0.046614 Oct 22 03:26:58.951391 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2587/5074] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:26:58 2022] GET /compute/v2.1/servers/52d2acf4-a7dd-46af-ae59-83a28eccaa4f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:26:59.230037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:59.247505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:59.248441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Searching by: {'deleted': False, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:26:59.254199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.254776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.255285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.256335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.259698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.260309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.299986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:26:59.374479 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-002c7d41-1332-47c4-9a06-880553028e43 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.149136 Oct 22 03:26:59.376059 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2488/5075] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:26:59 2022] GET /compute/v2.1/servers => generated 334 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:59.391357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:59.401590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:59.402513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Searching by: {'deleted': False, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:26:59.405136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:59.405883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:59.416945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.420505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.421011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.421455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.422023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.422505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.423277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.423907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.424383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.429163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.429649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.430091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.479371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:26:59.559998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:59.570121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.570608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.571048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.734088 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fcfa78d6-1ed6-4971-af0e-8b8b4e4dbb10 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.348074 Oct 22 03:26:59.735919 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2588/5076] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:26:59 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:26:59.740757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:59.741366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:59.749914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.750518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.751046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.751748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.752229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.752656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.911689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:59.920714 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fa34a7bb-4ee4-464d-9958-2c65e8c9a58e tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1508 microversion: 2.1 time: 0.522949 Oct 22 03:26:59.933257 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2489/5077] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:59 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1508 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:59.941235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:26:59.944583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68e25160-ed76-478a-afdd-1880ca5fe7ae tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:26:59.955194 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68e25160-ed76-478a-afdd-1880ca5fe7ae tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020558 Oct 22 03:26:59.956911 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2490/5078] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:26:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:26:59.961614 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e03090b4-2c27-4b21-b397-a9f2e6dc0afd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1502 microversion: 2.1 time: 0.222434 Oct 22 03:26:59.963294 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2589/5079] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:26:59 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:26:59.990365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:26:59.991162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:26:59.997885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:26:59.998468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:26:59.998994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:26:59.999782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.000386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:00.000908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:00.041634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c99fb4dd-2319-41d4-aaea-5866fb072d84 req-b5136f87-13e3-49b9-a133-51a29887a4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34bd18f-8662-46f8-9741-7b88afc61bea", "name": "network-vif-deleted", "tag": "c189b125-f4a2-465b-9e66-5b851a5f074f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:00.062380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c99fb4dd-2319-41d4-aaea-5866fb072d84 req-b5136f87-13e3-49b9-a133-51a29887a4fd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.063175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c99fb4dd-2319-41d4-aaea-5866fb072d84 req-b5136f87-13e3-49b9-a133-51a29887a4fd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:00.063838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c99fb4dd-2319-41d4-aaea-5866fb072d84 req-b5136f87-13e3-49b9-a133-51a29887a4fd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:00.092317 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c99fb4dd-2319-41d4-aaea-5866fb072d84 req-b5136f87-13e3-49b9-a133-51a29887a4fd service nova] Creating event network-vif-deleted:c189b125-f4a2-465b-9e66-5b851a5f074f for instance e34bd18f-8662-46f8-9741-7b88afc61bea on n-h2-862416-2 Oct 22 03:27:00.099184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c99fb4dd-2319-41d4-aaea-5866fb072d84 req-b5136f87-13e3-49b9-a133-51a29887a4fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063087 Oct 22 03:27:00.100836 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2590/5080] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:00.279395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:00.279973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:00.291991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.292528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:00.292966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:00.293670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.294121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:00.294545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:00.352078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:27:00.365932 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.network.security_group_api [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Removing security group f91e2c65-311c-40f9-837f-6dced18c394b from port 9724dee3-4baf-4aad-b861-fa173e22dc22 Oct 22 03:27:00.539696 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c20fcfdc-b438-4ca0-b208-348e498f6d57 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "DELETE /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 204 len: 0 microversion: 2.1 time: 0.264055 Oct 22 03:27:00.540287 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2591/5081] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:27:00 2022] DELETE /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:27:00.552692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:00.553957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:00.562930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.563801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:00.564543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:00.566097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.566816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:00.567459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:00.792997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:00.804111 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0b5d7e05-838d-4a4e-b2fc-89d1df559c13 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1701 microversion: 2.1 time: 0.258726 Oct 22 03:27:00.805173 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2592/5082] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:00 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1701 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:00.949064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:00.949682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:00.957199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:00.958683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.959390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:00.959679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:00.960413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.960866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:00.961299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:00.999319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:00.999806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:01.000550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:01.001429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lazy-loading 'fault' on Instance uuid e34bd18f-8662-46f8-9741-7b88afc61bea {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:27:01.064802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:01.075514 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-842a825e-dec9-441a-b360-b73fda380be9 tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1313 microversion: 2.1 time: 0.130274 Oct 22 03:27:01.076536 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2593/5083] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:00 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1313 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:01.127851 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4a18c4f8-3221-4720-8577-f05e9fa896fe tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b/action" status: 202 len: 0 microversion: 2.1 time: 1.141957 Oct 22 03:27:01.128499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2491/5084] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:26:59 2022] POST /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b/action => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:27:01.138775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:01.138775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:01.146531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:01.147023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:01.148860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:01.149681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:01.150153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:01.150589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:01.309952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:01.324988 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bed4ec36-c136-4f0f-9d8b-79b59f984c48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1460 microversion: 2.1 time: 0.191738 Oct 22 03:27:01.338095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2594/5085] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:01 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1460 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:01.352268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:01.353194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:01.361384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:01.362110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:01.362709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:01.363589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:01.364194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:01.364834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:01.828358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:01.829701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:01.836885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:01.837506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:01.838043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:01.838987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:01.839566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:01.840063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:01.961889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:01.971829 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-271ccf19-2a38-4c5c-acf0-f729e55e3231 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.625192 Oct 22 03:27:01.972801 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2492/5086] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:01 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:01.999526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:02.000481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:02.007601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.008354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.008954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.010101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.010722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.011328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.047322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:02.060730 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-310bc82b-e9ea-43cf-9c6f-ed460dbdc97c tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1701 microversion: 2.1 time: 0.236189 Oct 22 03:27:02.066837 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2595/5087] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:01 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1701 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:02.103504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:02.105209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:02.121946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.122670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.123355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.124338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.125001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.125865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.190029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.192551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.193262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.193957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lazy-loading 'fault' on Instance uuid e34bd18f-8662-46f8-9741-7b88afc61bea {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:27:02.202110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:02.303956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812c4e486404d0c8dfdf417d0c4dc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f53f096c8dc49e9be1aae9ecb4e6e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:02.314529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aaaf6d77-fcdb-42e6-b01a-c9cf1cf72cfd tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 200 len: 1313 microversion: 2.1 time: 0.216114 Oct 22 03:27:02.331325 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2596/5088] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:02 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:02.341629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-defa20f6-4607-487d-8749-a579198fdae0 req-1a537ca2-4ea3-49a3-b547-b52dac7c1c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f2223f-8133-453b-bc3a-20cea20c541b", "tag": "9724dee3-4baf-4aad-b861-fa173e22dc22"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:02.357124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-defa20f6-4607-487d-8749-a579198fdae0 req-1a537ca2-4ea3-49a3-b547-b52dac7c1c62 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.357861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-defa20f6-4607-487d-8749-a579198fdae0 req-1a537ca2-4ea3-49a3-b547-b52dac7c1c62 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.358393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-defa20f6-4607-487d-8749-a579198fdae0 req-1a537ca2-4ea3-49a3-b547-b52dac7c1c62 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.376668 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-defa20f6-4607-487d-8749-a579198fdae0 req-1a537ca2-4ea3-49a3-b547-b52dac7c1c62 service nova] Creating event network-changed:9724dee3-4baf-4aad-b861-fa173e22dc22 for instance c2f2223f-8133-453b-bc3a-20cea20c541b on n-h2-862416-2 Oct 22 03:27:02.383529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-defa20f6-4607-487d-8749-a579198fdae0 req-1a537ca2-4ea3-49a3-b547-b52dac7c1c62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047933 Oct 22 03:27:02.384129 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2597/5089] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:02.473085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:02.483325 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-33a771a6-1c0c-4986-87e4-710186ffdc89 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.488324 Oct 22 03:27:02.483936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2493/5090] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:01 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:02.512874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:02.513598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:02.525461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.525962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.526437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.527468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.527930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.528400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.738882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:02.739665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:02.747557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.748334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.748957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.750079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.751077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.751775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.770230 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] HTTP exception thrown: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Request method failure captured: Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e HTTP/1.1 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Cpx_sDdPCAh6PeAQtXSy8eGyMbbevw5OzVqWm_rxfHyK_1Z2XeW7erChZ3omCqTOng5mfBnAcsuSZPgp0oSF1a6s_zI0oimF0FfNrXocc71yxDoHCHm8XMd4PVnJ-LFl_2M2yMTAm-HWAePu438dQWgA3WyVhvYGa2vMtxZRxmzeg Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}] Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 538f74faf48e4343b1794378636552d2 Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'eb680fc8-0d54-4742-b649-b82abbf4884e'} Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:27:02.772074 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.776139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.778143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Returning 404 to user: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:27:02.779264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77ed8246-d060-45de-9dd0-aa25c82ced7a tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 404 len: 111 microversion: 2.20 time: 0.045254 Oct 22 03:27:02.781075 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2494/5091] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:27:02 2022] DELETE /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:27:02.789681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:02.790744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] [instance: eb680fc8-0d54-4742-b649-b82abbf4884e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:02.799094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.800108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.800947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.802060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.802749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.803436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.821717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] HTTP exception thrown: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Request method failure captured: Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e HTTP/1.1 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Cpx_sDdPCAh6PeAQtXSy8eGyMbbevw5OzVqWm_rxfHyK_1Z2XeW7erChZ3omCqTOng5mfBnAcsuSZPgp0oSF1a6s_zI0oimF0FfNrXocc71yxDoHCHm8XMd4PVnJ-LFl_2M2yMTAm-HWAePu438dQWgA3WyVhvYGa2vMtxZRxmzeg Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.20 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0acbea2993cb4d1d81f171c1b7f07443"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0acbea2993cb4d1d81f171c1b7f07443"}]}] Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0acbea2993cb4d1d81f171c1b7f07443 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-249530982 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 538f74faf48e4343b1794378636552d2 Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeShelveTestJSON-249530982-project Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'eb680fc8-0d54-4742-b649-b82abbf4884e'} Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.824127 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:02.829995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.829995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:02.829995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:02.829995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:02.829995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:27:02.829995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:27:02.829995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. Oct 22 03:27:02.829995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:02.831955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] Returning 404 to user: Instance eb680fc8-0d54-4742-b649-b82abbf4884e could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:27:02.833047 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e38ab492-53a8-4509-85ec-3554f198275d tempest-AttachVolumeShelveTestJSON-249530982 tempest-AttachVolumeShelveTestJSON-249530982-project] 10.222.0.25 "GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e" status: 404 len: 111 microversion: 2.20 time: 0.048153 Oct 22 03:27:02.834421 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2495/5092] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:27:02 2022] GET /compute/v2.1/servers/eb680fc8-0d54-4742-b649-b82abbf4884e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:27:02.865543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:02.889200 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4e688ba4-7828-4e09-a4dd-9fba1a0fd091 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.380866 Oct 22 03:27:02.913201 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2598/5093] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:02 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:02.919392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:02.920112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:02.933366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.933959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.934420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:02.935215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:02.936887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:02.938495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:03.094473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:03.099909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:03.114554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:03.115412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:03.116024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:03.116944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:03.118089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:03.118712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:03.420043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:03.436413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4fd4d65a-ce30-4316-8358-0eb5631dbb77 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1701 microversion: 2.1 time: 0.348846 Oct 22 03:27:03.448383 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2599/5094] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:03 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1701 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:03.457338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:03.458190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] [instance: e34bd18f-8662-46f8-9741-7b88afc61bea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:03.464723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:03.465538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:03.466167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:03.467052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:03.467665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:03.468291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:03.494822 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] HTTP exception thrown: Instance e34bd18f-8662-46f8-9741-7b88afc61bea could not be found. Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Request method failure captured: Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea HTTP/1.1 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2K4lbgCQrODSyInszXo1tt2NNdCOWsVODBGJu_ecC5YORXnLLoamSQvNOh1VK_zpOVNeMwDw8zrQ7VBvXbCMZAYCjRmo5mAzcO7SVpY6OcgwUFWV7F4Hd1_E_wtrOjKab4Iw3dYLSAyHuQSKMsnUpLQHALwBnu13OgTaqlDCS3uYSg Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 6f53f096c8dc49e9be1aae9ecb4e6e61 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1434534336 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f53f096c8dc49e9be1aae9ecb4e6e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f53f096c8dc49e9be1aae9ecb4e6e61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f53f096c8dc49e9be1aae9ecb4e6e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f53f096c8dc49e9be1aae9ecb4e6e61"}]}] Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1434534336 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 6f53f096c8dc49e9be1aae9ecb4e6e61 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1434534336 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueTestJSONUnderV235-1434534336-project Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 4812c4e486404d0c8dfdf417d0c4dc46 Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1434534336-project Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance e34bd18f-8662-46f8-9741-7b88afc61bea could not be found. Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e34bd18f-8662-46f8-9741-7b88afc61bea'} Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34bd18f-8662-46f8-9741-7b88afc61bea could not be found. Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34bd18f-8662-46f8-9741-7b88afc61bea could not be found. Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:03.496571 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:03.501564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:03.501564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:03.501564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:03.501564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:03.501564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:27:03.501564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:27:03.501564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34bd18f-8662-46f8-9741-7b88afc61bea could not be found. Oct 22 03:27:03.501564 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:03.507413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] Returning 404 to user: Instance e34bd18f-8662-46f8-9741-7b88afc61bea could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:27:03.508424 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1870a3d9-035b-4ae9-ab42-d76377386b6f tempest-ServerRescueTestJSONUnderV235-1434534336 tempest-ServerRescueTestJSONUnderV235-1434534336-project] 10.222.0.25 "GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea" status: 404 len: 111 microversion: 2.1 time: 0.057965 Oct 22 03:27:03.509012 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2600/5095] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:03 2022] GET /compute/v2.1/servers/e34bd18f-8662-46f8-9741-7b88afc61bea => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:27:03.664072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:03.676936 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b0de1261-e56c-44e9-a413-ad348888379d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.762300 Oct 22 03:27:03.677838 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2496/5096] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:02 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:03.867769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1259310305", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "316c23c4-6eda-4626-bced-03168617187b"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:03.931028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] validate_networks() for [('316c23c4-6eda-4626-bced-03168617187b', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:27:04.463395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:04.465828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:04.482054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:04.495235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:04.497699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:04.503718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:04.504588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:04.505941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:04.647396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98deb80919941558e8fb09e1b4fcc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155c2a3bf2a24d92959c82e15c7645bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:04.658318 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6154bd17-811f-4f92-9bb8-74395378330f tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 200 len: 1634 microversion: 2.1 time: 0.201191 Oct 22 03:27:04.674713 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2497/5097] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:04 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 1634 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:04.715115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-05cfec0e-2887-478c-986d-166878e741a3 req-712dd45b-5415-4c16-b77b-92a03c788641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56532615-7ea4-4368-9039-4e52cd63c4bd", "name": "network-vif-deleted", "tag": "0b989957-1d60-4fe9-a53e-9104e05ee137"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:04.746725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-05cfec0e-2887-478c-986d-166878e741a3 req-712dd45b-5415-4c16-b77b-92a03c788641 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:04.747248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-05cfec0e-2887-478c-986d-166878e741a3 req-712dd45b-5415-4c16-b77b-92a03c788641 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:04.747854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-05cfec0e-2887-478c-986d-166878e741a3 req-712dd45b-5415-4c16-b77b-92a03c788641 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:04.769319 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-05cfec0e-2887-478c-986d-166878e741a3 req-712dd45b-5415-4c16-b77b-92a03c788641 service nova] Creating event network-vif-deleted:0b989957-1d60-4fe9-a53e-9104e05ee137 for instance 56532615-7ea4-4368-9039-4e52cd63c4bd on n-h2-862416-2 Oct 22 03:27:04.781020 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-05cfec0e-2887-478c-986d-166878e741a3 req-712dd45b-5415-4c16-b77b-92a03c788641 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070420 Oct 22 03:27:04.784564 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2498/5098] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:05.693286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:05.694112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] [instance: 56532615-7ea4-4368-9039-4e52cd63c4bd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:05.710076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:05.710899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:05.711548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:05.712500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:05.713163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:05.725070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:05.753645 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] HTTP exception thrown: Instance 56532615-7ea4-4368-9039-4e52cd63c4bd could not be found. Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Request method failure captured: Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd HTTP/1.1 Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2J_hRT18jkWoSEZyqyYj593pqIDK7faC4TvpcJULB6THVBCpLeOwhB2kDrncCj73jYsBhllaRE1fVwjmnsRGRGVSLZzAFLEECC9jUF2JBAo9k4uu3v8GNLMaC3kXZ3uB0caLkJZbkwHTWGmWFJ6rNZBi_7Hq7GkXcCbnmK9If2sAhY Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 155c2a3bf2a24d92959c82e15c7645bd Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestJSON-276500855 Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_155c2a3bf2a24d92959c82e15c7645bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/155c2a3bf2a24d92959c82e15c7645bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/155c2a3bf2a24d92959c82e15c7645bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/155c2a3bf2a24d92959c82e15c7645bd"}]}] Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestJSON-276500855 Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 155c2a3bf2a24d92959c82e15c7645bd Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestJSON-276500855 Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestJSON-276500855-project Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d98deb80919941558e8fb09e1b4fcc9c Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestJSON-276500855-project Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 56532615-7ea4-4368-9039-4e52cd63c4bd could not be found. Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '56532615-7ea4-4368-9039-4e52cd63c4bd'} Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56532615-7ea4-4368-9039-4e52cd63c4bd could not be found. Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56532615-7ea4-4368-9039-4e52cd63c4bd could not be found. Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:05.755739 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:05.759771 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:05.759771 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:05.759771 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:27:05.759771 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:27:05.759771 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56532615-7ea4-4368-9039-4e52cd63c4bd could not be found. Oct 22 03:27:05.759771 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:27:05.762606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Returning 404 to user: Instance 56532615-7ea4-4368-9039-4e52cd63c4bd could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:27:05.763716 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dcaa8e1f-ac31-472a-a40f-f8268c3074d4 tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd" status: 404 len: 111 microversion: 2.1 time: 0.076376 Oct 22 03:27:05.764901 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2499/5099] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:05 2022] GET /compute/v2.1/servers/56532615-7ea4-4368-9039-4e52cd63c4bd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:27:05.774559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49fc1f1b-3ea1-4cd6-8891-7e0c7b6e07de tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] Calling method '.version_select at 0x7f0d1e5169d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:05.823277 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49fc1f1b-3ea1-4cd6-8891-7e0c7b6e07de tempest-ServersTestJSON-276500855 tempest-ServersTestJSON-276500855-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367865601" status: 202 len: 0 microversion: 2.1 time: 0.053575 Oct 22 03:27:05.824298 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2500/5100] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367865601 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:27:05.899521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:27:05.900908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:27:05.911351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:27:05.912166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:27:05.913455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:27:05.929810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:05.932085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:05.934100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:05.935439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:05.936176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:05.936920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:06.015249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:27:06.025320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Getting quotas for user f89d04db39be473097b885f7465115a2 and project 76599914af404f118b425b41a2432291. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:27:06.068874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:27:06.071625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:27:06.157853 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d10de175-fb9a-476b-9aac-d7016c29203a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.293875 Oct 22 03:27:06.165916 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2601/5101] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:27:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:27:06.170027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e4f8cf7-dc74-4162-a2af-85e26a3c2b23 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:06.170646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e4f8cf7-dc74-4162-a2af-85e26a3c2b23 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:06.247924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e4f8cf7-dc74-4162-a2af-85e26a3c2b23 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:06.261812 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e4f8cf7-dc74-4162-a2af-85e26a3c2b23 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1215 microversion: 2.1 time: 0.095630 Oct 22 03:27:06.263041 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2501/5102] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:06 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:07.289778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:07.290578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:07.307167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:07.310565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:07.311131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:07.314091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:07.318112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:07.318860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:07.471950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:07.490574 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b588518a-d686-4c1f-a776-3025b570ca40 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1211 microversion: 2.1 time: 0.206073 Oct 22 03:27:07.493206 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2602/5103] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:07 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1211 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:08.519435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:08.520454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:08.541940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:08.547214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:08.547851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:08.550435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:08.554368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:08.559293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:08.878552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:08.891257 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b38f0b98-3d88-4d9d-810b-dae2d96bde37 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1285 microversion: 2.1 time: 0.376664 Oct 22 03:27:08.900299 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2502/5104] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:08 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1285 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:09.915217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:09.915834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:09.930627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:09.931162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:09.931632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:09.932423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:09.932892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:09.933371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:10.082837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:10.092077 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74a4851a-56e7-4def-a8ad-913d05213035 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1273 microversion: 2.1 time: 0.180887 Oct 22 03:27:10.095449 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2603/5105] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:09 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:11.122716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:11.123428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:11.126037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:11.134872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:11.135320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:11.135802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:11.136906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:11.137457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:11.137999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:11.788550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:11.797974 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a20a540a-780a-4a11-a707-83ec24a0123c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1315 microversion: 2.1 time: 0.678311 Oct 22 03:27:11.799328 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2503/5106] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:11 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:12.826913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:12.827609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:12.834751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:12.835240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:12.845128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:12.846439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:12.847077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:12.847658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:13.248794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-c15ccf56-20eb-41f6-93db-376e69819a68 req-57d864c4-e79a-4432-9bb7-5ef53c9b0682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297044ba-6a61-4fd3-bdeb-2a16517887ed", "tag": "59ad910d-6769-4aa5-9018-8f06d14ba036"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:13.272887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c15ccf56-20eb-41f6-93db-376e69819a68 req-57d864c4-e79a-4432-9bb7-5ef53c9b0682 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:13.273646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c15ccf56-20eb-41f6-93db-376e69819a68 req-57d864c4-e79a-4432-9bb7-5ef53c9b0682 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:13.274313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c15ccf56-20eb-41f6-93db-376e69819a68 req-57d864c4-e79a-4432-9bb7-5ef53c9b0682 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:13.289514 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-c15ccf56-20eb-41f6-93db-376e69819a68 req-57d864c4-e79a-4432-9bb7-5ef53c9b0682 service nova] Creating event network-changed:59ad910d-6769-4aa5-9018-8f06d14ba036 for instance 297044ba-6a61-4fd3-bdeb-2a16517887ed on n-h1-862416-2 Oct 22 03:27:13.299040 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-c15ccf56-20eb-41f6-93db-376e69819a68 req-57d864c4-e79a-4432-9bb7-5ef53c9b0682 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058548 Oct 22 03:27:13.301672 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2504/5107] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:27:13.309477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:13.323348 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e26210d1-ea62-4d07-9afc-b025ba86f869 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1315 microversion: 2.1 time: 0.501116 Oct 22 03:27:13.331506 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2604/5108] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:12 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:14.366433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:14.376290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:14.393554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:14.394690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:14.395591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:14.397492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:14.400544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:14.401313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:14.914050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:14.926232 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a6331a77-da96-427d-8098-fb687584b579 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1315 microversion: 2.1 time: 0.575415 Oct 22 03:27:14.927206 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2505/5109] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:14 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:15.969930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:15.971900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:16.006731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:16.014875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:16.015669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:16.018348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:16.020653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:16.025245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:16.026643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:16.086204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:16.936318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:16.944823 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45808a19-b262-45f8-8aa6-dc7af98eed71 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1315 microversion: 2.1 time: 0.994852 Oct 22 03:27:16.950027 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2605/5110] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:15 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1315 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:17.974727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:17.975648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:17.984896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:17.987632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:17.989500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:17.990308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:17.992302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:17.993036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:17.993715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:18.435455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:18.482522 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-242b92ff-cf5d-4ccf-af66-f43a41f98444 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1315 microversion: 2.1 time: 0.511810 Oct 22 03:27:18.497632 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2506/5111] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:17 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:19.525365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:19.526342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:19.536570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:19.537464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:19.538464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:19.539424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:19.540174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:19.540856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:19.845015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6aeb86f6-48b6-426d-900a-11c36de68d55 req-33defc8b-08cc-4b25-81d7-e5ef7bef6674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297044ba-6a61-4fd3-bdeb-2a16517887ed", "name": "network-vif-plugged", "status": "completed", "tag": "59ad910d-6769-4aa5-9018-8f06d14ba036"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:19.870255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6aeb86f6-48b6-426d-900a-11c36de68d55 req-33defc8b-08cc-4b25-81d7-e5ef7bef6674 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:19.870938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6aeb86f6-48b6-426d-900a-11c36de68d55 req-33defc8b-08cc-4b25-81d7-e5ef7bef6674 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:19.872645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6aeb86f6-48b6-426d-900a-11c36de68d55 req-33defc8b-08cc-4b25-81d7-e5ef7bef6674 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:19.907435 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6aeb86f6-48b6-426d-900a-11c36de68d55 req-33defc8b-08cc-4b25-81d7-e5ef7bef6674 service nova] Creating event network-vif-plugged:59ad910d-6769-4aa5-9018-8f06d14ba036 for instance 297044ba-6a61-4fd3-bdeb-2a16517887ed on n-h1-862416-2 Oct 22 03:27:19.929294 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6aeb86f6-48b6-426d-900a-11c36de68d55 req-33defc8b-08cc-4b25-81d7-e5ef7bef6674 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084660 Oct 22 03:27:19.930769 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2507/5112] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:27:20.023270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:20.054090 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-498aee95-514c-4f54-a8f1-3f882e862a6c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1315 microversion: 2.1 time: 0.533110 Oct 22 03:27:20.054710 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2606/5113] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:19 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:21.082864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:21.083663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:21.104728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:21.106852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:21.109718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:21.113818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:21.114602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:21.116185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:21.728452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:21.744191 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5df30156-3efa-4ba6-9aa7-ff8d5a542a76 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1315 microversion: 2.1 time: 0.666067 Oct 22 03:27:21.748267 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2508/5114] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:21 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:22.770568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:22.771537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:22.786396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:22.787099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:22.787713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:22.788635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:22.789286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:22.789882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:23.167259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:23.183524 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ab3f453-9b2d-4bcf-9eb7-6339161dd643 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1503 microversion: 2.1 time: 0.416273 Oct 22 03:27:23.186163 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2607/5115] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:22 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:23.213053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:23.213575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:23.232099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:23.232762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:23.233209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:23.235284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:23.235936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:23.236399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:23.295166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:23.382358 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-515592ff-0304-4627-a28f-91c33e3cf28e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed/action" status: 202 len: 0 microversion: 2.1 time: 0.173872 Oct 22 03:27:23.393347 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2509/5116] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:27:23 2022] POST /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:27:23.403301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:23.403998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:23.422612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:23.423159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:23.423648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:23.424408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:23.424867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:23.425307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:23.874899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:23.885246 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1478ba8-4699-4d76-b160-634c80b2f4a6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1508 microversion: 2.1 time: 0.487127 Oct 22 03:27:23.902113 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2608/5117] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:23 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:24.913676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:24.914376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:24.922337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:24.923114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:24.923856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:24.924767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:24.925377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:24.925981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:25.283491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:25.299422 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1f5956d-6aec-4639-b73f-29c86a72ed43 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1488 microversion: 2.1 time: 0.389868 Oct 22 03:27:25.301208 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2510/5118] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:24 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1488 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:25.327320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:25.327939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:25.335600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:25.336461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:25.337102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:25.338009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:25.338659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:25.339328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:25.378496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lazy-loading 'flavor' on Instance uuid 297044ba-6a61-4fd3-bdeb-2a16517887ed {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:27:25.731666 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15a93aff-abcc-4054-b8ee-fd188e80ebc9 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed/action" status: 202 len: 0 microversion: 2.1 time: 0.408033 Oct 22 03:27:25.734707 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2609/5119] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:27:25 2022] POST /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:27:25.745785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:25.746852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:25.759520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:25.762801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:25.763501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:25.764124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:25.765118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:25.767939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:25.768633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:25.989422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:26.007562 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d4abbc8b-e637-45a6-895a-13e99103eeaa tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1494 microversion: 2.1 time: 0.268517 Oct 22 03:27:26.014041 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2511/5120] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:25 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1494 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:27.038032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:27.038729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:27.058580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:27.059050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:27.059506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:27.060257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:27.060729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:27.061165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:27.835660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:27.851825 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1fe9d084-4be5-4a71-8e98-88e4edcc6272 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1515 microversion: 2.1 time: 0.818421 Oct 22 03:27:27.857526 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2610/5121] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:27 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1515 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:28.728928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1481527282", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "1dca30ca-b544-47c6-a616-7a126cc52745"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:28.873760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] validate_networks() for [('1dca30ca-b544-47c6-a616-7a126cc52745', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:27:28.882532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:28.883170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:28.905693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:28.906211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:28.912651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:28.916514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:28.922496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:28.923266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:29.717600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:29.725991 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c19cbd80-49e6-4bd7-9881-48d66c043aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.848118 Oct 22 03:27:29.732031 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2611/5122] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:28 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:29.806585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:27:29.807086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:27:29.807658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:27:29.808166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:27:29.808721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:27:29.825590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:29.826806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:29.827359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:29.830953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:29.831670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:29.832389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:29.853022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:27:29.860177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:27:29.877301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:27:29.880327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:27:29.992812 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8936654e-02b8-45e8-b042-18da707b7e1e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.468127 Oct 22 03:27:29.994381 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2512/5123] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:27:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:27:30.005994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40683d29-54b5-4c61-9b75-9d5348b80178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:30.006718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-40683d29-54b5-4c61-9b75-9d5348b80178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:30.232715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-40683d29-54b5-4c61-9b75-9d5348b80178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:30.258147 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40683d29-54b5-4c61-9b75-9d5348b80178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1193 microversion: 2.1 time: 0.253467 Oct 22 03:27:30.259723 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2612/5124] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:30 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1193 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:30.310723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-36c20ded-ec2e-4547-b555-44dfe9679306 req-731f5eaa-ecf8-4261-a695-fc8317662913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297044ba-6a61-4fd3-bdeb-2a16517887ed", "name": "network-vif-plugged", "status": "completed", "tag": "59ad910d-6769-4aa5-9018-8f06d14ba036"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:30.321982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-36c20ded-ec2e-4547-b555-44dfe9679306 req-731f5eaa-ecf8-4261-a695-fc8317662913 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:30.323090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-36c20ded-ec2e-4547-b555-44dfe9679306 req-731f5eaa-ecf8-4261-a695-fc8317662913 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:30.323744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-36c20ded-ec2e-4547-b555-44dfe9679306 req-731f5eaa-ecf8-4261-a695-fc8317662913 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:30.338688 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-36c20ded-ec2e-4547-b555-44dfe9679306 req-731f5eaa-ecf8-4261-a695-fc8317662913 service nova] Creating event network-vif-plugged:59ad910d-6769-4aa5-9018-8f06d14ba036 for instance 297044ba-6a61-4fd3-bdeb-2a16517887ed on n-h1-862416-2 Oct 22 03:27:30.344807 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-36c20ded-ec2e-4547-b555-44dfe9679306 req-731f5eaa-ecf8-4261-a695-fc8317662913 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040656 Oct 22 03:27:30.345762 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2513/5125] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:27:30.762540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:30.763537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:30.774917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:30.779603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:30.781874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:30.784583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:30.788849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:30.789552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:30.880101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:30.881471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:30.913267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:30.915723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:30.918122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:30.921363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:30.922938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:30.923948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:31.002059 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd679c78-d7d7-432f-aeeb-4d01cd7f797c tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/ips" status: 200 len: 150 microversion: 2.1 time: 0.129240 Oct 22 03:27:31.011893 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2514/5126] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:27:30 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/ips => generated 150 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:27:31.154093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:31.187880 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-836194f8-368f-4070-9269-2a0caebe453e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.415703 Oct 22 03:27:31.190741 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2613/5127] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:30 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:31.284243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:31.285222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:31.300688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:31.301616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:31.302345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:31.304308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:31.305198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:31.305907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:31.709747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:31.719228 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f503863-9f42-4b37-9716-def20b9a49a7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1189 microversion: 2.1 time: 0.440766 Oct 22 03:27:31.745331 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2515/5128] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:31 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1189 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:32.215165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:32.216102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:32.220110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:32.246359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:32.247980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:32.248439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:32.251972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:32.253139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:32.254909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:32.274426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:32.752928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:32.754187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:32.764008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:32.779671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:32.780143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:32.781497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:32.781968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:32.782403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:33.173473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:33.199606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-43182006-e345-41c9-86fc-2bcfffacd1ae tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.986927 Oct 22 03:27:33.200688 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2614/5129] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:32 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:33.325336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:33.334686 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cf80437d-befa-4599-9363-29d3be40fb75 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1263 microversion: 2.1 time: 0.585750 Oct 22 03:27:33.341303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2516/5130] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:32 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1263 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:34.061350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce9fa3d-2c44-4060-bf84-a15ade57d15f"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:34.064508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:34.094061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:34.110428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:34.110928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:34.111688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:34.115929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:34.120964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:34.226733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:34.227519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:34.240273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:34.240777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:34.241225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:34.241937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:34.242401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:34.242840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:34.904187 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e729e4f0-a130-4120-9a10-b2d9a4a2cfd4 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847695 Oct 22 03:27:34.909541 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2615/5131] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:27:34 2022] POST /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:27:34.919208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:34.919609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:34.930573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:34.932003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:34.932634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:34.935905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:34.936675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:34.937390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:35.402467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:35.414299 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1dfafb67-afb6-4070-853e-aa166777b2a5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 1.191533 Oct 22 03:27:35.439353 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2517/5132] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:34 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:35.696393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:35.705662 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8be4bb2e-4bce-4dae-9d26-0034fdc501db tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 0.794584 Oct 22 03:27:35.715915 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2616/5133] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:34 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:36.445171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:36.446444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:36.480046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:36.487047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:36.487787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:36.494434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:36.495251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:36.495858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:36.740851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:36.741472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:36.754031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:36.754526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:36.754953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:36.755667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:36.768145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:36.768877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:37.325638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:37.335824 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-258db25f-091e-42a1-a753-e35ce8d9e67a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.894799 Oct 22 03:27:37.336469 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2518/5134] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:36 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:38.365201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:38.365913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:38.378689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:38.379197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:38.381735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:38.382495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:38.386064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:38.386718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:38.742953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:38.757643 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-886deb65-6f7b-4824-9e84-ee4394566c0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 2.020491 Oct 22 03:27:38.760513 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2617/5135] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:36 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:39.560399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:39.573870 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c72fadde-0755-4347-81f4-cd4e62cdc04f tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 1.212988 Oct 22 03:27:39.582732 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2519/5136] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:38 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:39.785025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:39.785919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:39.798706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:39.802188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:39.802915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:39.804439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:39.805090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:39.806110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:40.152251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:40.162139 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-53975882-9fbc-43b2-809c-ab784a7a9f76 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 0.382995 Oct 22 03:27:40.166725 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2618/5137] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:39 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:40.273133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:40.274372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:40.534406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1325189775", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9bd9390b-eb2b-4c98-a134-d8fcea3d41e9"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:40.611762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:40.612693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:40.618382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:40.633817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:40.636814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:40.637282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:40.638025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:40.640397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:40.643359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:40.664917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] validate_networks() for [('9bd9390b-eb2b-4c98-a134-d8fcea3d41e9', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:27:40.942095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:40.959732 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad7e6f0c-44db-482f-b38e-1bf3f712638a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.354386 Oct 22 03:27:40.961952 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2619/5138] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:40 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:41.204329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:41.205365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:41.221350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:41.223532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:41.225827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:41.226833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:41.227906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:41.229929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:42.128997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:42.143068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-684ce2fe-c6d2-49d8-9045-3930b5942584 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 0.941610 Oct 22 03:27:42.162621 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2620/5139] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:41 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:42.177707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:42.178638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:42.195670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:42.196546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:42.200955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:42.201916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:42.203324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:42.203928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:43.284406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:43.294514 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6c467d6-e529-4d6e-b564-23e27433842a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 1.126769 Oct 22 03:27:43.298924 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2621/5140] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:42 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:43.308697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:43.321212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:43.338895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:43.339724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:43.340374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:43.341269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:43.341893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:43.342529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:44.450886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:44.468483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8502853-1826-4470-909e-6155b59f4894 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 1.162664 Oct 22 03:27:44.469160 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2622/5141] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:43 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:44.508754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8f8d65aa-482d-4cda-9d44-b21b8e2bbd60 req-66fa5d83-03d9-446d-bc9d-d5ef4932a9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175b24fd-6d72-4920-bd43-63c33b220d4a", "tag": "6bda4fe1-497d-4056-97c5-93f23c41f5ed"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:44.563497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8f8d65aa-482d-4cda-9d44-b21b8e2bbd60 req-66fa5d83-03d9-446d-bc9d-d5ef4932a9aa service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:44.573811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8f8d65aa-482d-4cda-9d44-b21b8e2bbd60 req-66fa5d83-03d9-446d-bc9d-d5ef4932a9aa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:44.575692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8f8d65aa-482d-4cda-9d44-b21b8e2bbd60 req-66fa5d83-03d9-446d-bc9d-d5ef4932a9aa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:44.636676 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8f8d65aa-482d-4cda-9d44-b21b8e2bbd60 req-66fa5d83-03d9-446d-bc9d-d5ef4932a9aa service nova] Creating event network-changed:6bda4fe1-497d-4056-97c5-93f23c41f5ed for instance 175b24fd-6d72-4920-bd43-63c33b220d4a on n-h2-862416-2 Oct 22 03:27:44.646080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:27:44.646506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:27:44.647000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:27:44.647420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:27:44.647977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:27:44.669253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:44.669787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:44.670356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:44.671722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:44.672449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:44.673051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:44.674502 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8f8d65aa-482d-4cda-9d44-b21b8e2bbd60 req-66fa5d83-03d9-446d-bc9d-d5ef4932a9aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185350 Oct 22 03:27:44.684596 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2623/5142] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:44.701235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Getting quotas for project 8035273d27ca4fd49f244614e742fba8. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:27:44.705126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:44.709326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Getting quotas for user 188501dc57d247e3b623a51b5ef86bd9 and project 8035273d27ca4fd49f244614e742fba8. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:27:44.720243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:44.727993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Going to run 3 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:27:44.730673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:27:44.749220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:44.749558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:44.754978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:44.771562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:44.775540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:44.779794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:44.786283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 332b0090-0378-4b49-922a-f235bde2cc95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=999b73de-61c0-44a5-8cba-868742525e88,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:27:44.915959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=332b0090-0378-4b49-922a-f235bde2cc95,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:27:45.083245 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a315022f-db72-43c4-b454-7a04ef1d5456 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.816048 Oct 22 03:27:45.084436 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2520/5143] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:27:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 4818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:27:45.099177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:45.122550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:45.125250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'deleted': False, 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:27:45.158631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:45.159425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:45.159980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:45.161045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:45.163351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:45.169168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:45.201019 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa51fa91-a30d-4cc5-ab8a-5ca1f929ecc7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.108367 Oct 22 03:27:45.203057 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2521/5144] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:27:45 2022] GET /compute/v2.1/servers => generated 1018 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:45.222106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72aaab0d-cc5b-4a32-ab46-7d64821bac81 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:45.223003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-72aaab0d-cc5b-4a32-ab46-7d64821bac81 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:45.403484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-72aaab0d-cc5b-4a32-ab46-7d64821bac81 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:45.416238 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72aaab0d-cc5b-4a32-ab46-7d64821bac81 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1223 microversion: 2.1 time: 0.205325 Oct 22 03:27:45.428927 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2522/5145] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:45 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1223 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:45.494377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:45.495774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:45.509797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:45.510307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:45.510748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:45.511472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:45.511925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:45.512384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:45.718148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:45.727119 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97ae22f7-ad36-40ed-9545-b24e6e3a4683 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 1.037112 Oct 22 03:27:45.744794 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2624/5146] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:44 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:46.410096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:46.420418 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bed8030a-89aa-489f-825a-1c6d82e048a2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 0.929985 Oct 22 03:27:46.424905 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2523/5147] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:45 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:46.445091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb1eaaf6-c7c3-4908-a597-cf811da6deda tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:46.445091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb1eaaf6-c7c3-4908-a597-cf811da6deda tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:46.759064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:46.759763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:46.767574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:46.773407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:46.773407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:46.776972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:46.778554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:46.780724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:47.076645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb1eaaf6-c7c3-4908-a597-cf811da6deda tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:47.085858 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb1eaaf6-c7c3-4908-a597-cf811da6deda tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1223 microversion: 2.1 time: 0.645757 Oct 22 03:27:47.093215 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2625/5148] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:46 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1223 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:47.289225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:47.303004 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-67a81345-8b7a-470a-94e2-ad5d68cda7c0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.550057 Oct 22 03:27:47.307621 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2524/5149] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:46 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:47.454623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:47.455972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:47.488619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:47.489133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:47.492839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:47.493873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:47.494463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:47.494981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:47.844236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:47.855595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-adf9d448-5015-44ae-9264-5685ed680fdc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 0.404959 Oct 22 03:27:47.880683 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2626/5150] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:47 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:48.116703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:48.117482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:48.129430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:48.135703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:48.136751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:48.140516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:48.142386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:48.143391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:48.357641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:48.359175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:48.375142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:48.381231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:48.382469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:48.385859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:48.387878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:48.388606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:48.404285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:48.419752 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f0c9005-446e-4e00-ab2e-38656e3f049e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1219 microversion: 2.1 time: 0.304345 Oct 22 03:27:48.420534 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2525/5151] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:48 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1219 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:48.887378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:48.887994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:48.904090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:48.904868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:48.928697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:48.932270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:48.933207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:48.934307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:49.235575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:49.254166 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea0a36f6-c2f9-46a1-88b4-10a0ca353177 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.892078 Oct 22 03:27:49.258312 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2627/5152] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:48 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:49.455270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:49.456598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:49.462997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:49.463884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:49.464534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:49.465424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:49.466120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:49.481324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:49.631062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:49.647050 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9f06f3b9-f844-4e3f-9525-9a7d1ab5fd78 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 0.758843 Oct 22 03:27:49.654102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2526/5153] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:48 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:49.684375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:49.701334 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a004392-9175-4b60-b338-d80baaee1d06 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1275 microversion: 2.1 time: 0.258426 Oct 22 03:27:49.704440 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2628/5154] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:49 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1275 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:50.280038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:50.281701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:50.294214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:50.295069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:50.297257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:50.298378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:50.304910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:50.305673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:50.500068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-5b08cd8c-8b87-4ed3-818e-8b9e20d2871e req-ce77e0cf-0c87-48e1-8e9a-4c603844aa46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175b24fd-6d72-4920-bd43-63c33b220d4a", "name": "network-vif-plugged", "status": "completed", "tag": "6bda4fe1-497d-4056-97c5-93f23c41f5ed"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:50.529264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5b08cd8c-8b87-4ed3-818e-8b9e20d2871e req-ce77e0cf-0c87-48e1-8e9a-4c603844aa46 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:50.529792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5b08cd8c-8b87-4ed3-818e-8b9e20d2871e req-ce77e0cf-0c87-48e1-8e9a-4c603844aa46 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:50.530969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-5b08cd8c-8b87-4ed3-818e-8b9e20d2871e req-ce77e0cf-0c87-48e1-8e9a-4c603844aa46 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:50.562094 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-5b08cd8c-8b87-4ed3-818e-8b9e20d2871e req-ce77e0cf-0c87-48e1-8e9a-4c603844aa46 service nova] Creating event network-vif-plugged:6bda4fe1-497d-4056-97c5-93f23c41f5ed for instance 175b24fd-6d72-4920-bd43-63c33b220d4a on n-h2-862416-2 Oct 22 03:27:50.568393 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-5b08cd8c-8b87-4ed3-818e-8b9e20d2871e req-ce77e0cf-0c87-48e1-8e9a-4c603844aa46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074723 Oct 22 03:27:50.570411 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2629/5155] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:50.681035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:50.682564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:50.695019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:50.695743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:50.696628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:50.697566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:50.698224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:50.698812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:51.380386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:51.391645 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ce87e222-8001-4d7f-a2dc-c7499cd10b80 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 1.115973 Oct 22 03:27:51.408147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:51.416423 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2527/5156] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:50 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:51.421488 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-960fb1f9-02e8-4ea8-b483-5317cc49a967 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 0.746356 Oct 22 03:27:51.426323 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2630/5157] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:50 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:51.428644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:51.429861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:51.441678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:51.443703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:51.446911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:51.447993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:51.449159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:51.450327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:52.022776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:52.041172 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9473dc1-cb47-477f-b1c4-15062c88ec09 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1281 microversion: 2.1 time: 0.622088 Oct 22 03:27:52.041801 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2528/5158] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:51 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1281 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:52.417225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:52.418468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:52.428390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:52.435230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:52.436014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:52.437234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:52.437871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:52.438471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:52.449454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:52.450694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:52.481750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:52.482452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:52.483148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:52.484030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:52.491325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:52.492269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:52.540861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:53.035428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:53.037793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:53.046714 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d87d5e8-4543-47d9-b61e-b2aef6c921e7 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.633178 Oct 22 03:27:53.051342 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2631/5159] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:52 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:53.067180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:53.067804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:53.085378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:53.085887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:53.086373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:53.087161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:53.087626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:53.088057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:53.214637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:53.228167 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92d001dd-0380-4953-8cde-bac222e0f57a tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1281 microversion: 2.1 time: 0.163212 Oct 22 03:27:53.231215 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2632/5160] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:53 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:53.358966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:53.383561 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90d7a675-e74a-4713-871f-76f5d3fe456f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1293 microversion: 2.1 time: 0.938064 Oct 22 03:27:53.384165 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2529/5161] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:52 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1293 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:53.619885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce9fa3d-2c44-4060-bf84-a15ade57d15f"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:53.622922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:53.630397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:53.631188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:53.631882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:53.632844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:53.633514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:53.634177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:53.726303 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Invalid volume: volume 2ce9fa3d-2c44-4060-bf84-a15ade57d15f is already attached to instances: d13cb759-d1e1-43a4-a3e4-5f778581559f Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments HTTP/1.1 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 74 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: {"volumeAttachment": {"volumeId": "2ce9fa3d-2c44-4060-bf84-a15ade57d15f"}} Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid volume: volume 2ce9fa3d-2c44-4060-bf84-a15ade57d15f is already attached to instances: d13cb759-d1e1-43a4-a3e4-5f778581559f Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': 'd13cb759-d1e1-43a4-a3e4-5f778581559f', 'body': {'volumeAttachment': {'volumeId': '2ce9fa3d-2c44-4060-bf84-a15ade57d15f'}}} Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ce9fa3d-2c44-4060-bf84-a15ade57d15f is already attached to instances: d13cb759-d1e1-43a4-a3e4-5f778581559f Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:27:53.728299 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ce9fa3d-2c44-4060-bf84-a15ade57d15f is already attached to instances: d13cb759-d1e1-43a4-a3e4-5f778581559f Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ce9fa3d-2c44-4060-bf84-a15ade57d15f is already attached to instances: d13cb759-d1e1-43a4-a3e4-5f778581559f Oct 22 03:27:53.734726 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:53.737491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 400 to user: Invalid volume: volume 2ce9fa3d-2c44-4060-bf84-a15ade57d15f is already attached to instances: d13cb759-d1e1-43a4-a3e4-5f778581559f {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:27:53.738565 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a562bae-94d3-4017-b024-ff82c6ac3489 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122942 Oct 22 03:27:53.745636 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2633/5162] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:27:53 2022] POST /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:27:53.844063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:53.844608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:53.855147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:53.855650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:53.856100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:53.861204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:53.864490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:53.867245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.019057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lazy-loading 'services' on Instance uuid d13cb759-d1e1-43a4-a3e4-5f778581559f {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:27:54.072164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:54.073056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:54.090767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:54.091254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:54.091705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.093042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:54.093502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:54.093930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.194942 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1b9a4ea-0726-42f4-b836-d2f2f4b0e2f9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments/2ce9fa3d-2c44-4060-bf84-a15ade57d15f" status: 202 len: 0 microversion: 2.1 time: 0.355580 Oct 22 03:27:54.195847 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2530/5163] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:27:53 2022] DELETE /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments/2ce9fa3d-2c44-4060-bf84-a15ade57d15f => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:27:54.223195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:54.231869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:54.240817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:54.241310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:54.241813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.242538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:54.242991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:54.243599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.376793 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f6eb8e8-53d8-40aa-983a-129ed6cdba52 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162446 Oct 22 03:27:54.378326 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2531/5164] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:27:54 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:54.400705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:54.401327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:54.434771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:54.438434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:54.439167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.440793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:54.442371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:54.443356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.602812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:54.621309 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d9c0bbe4-2a7e-452c-82e4-94b8af8661b9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1281 microversion: 2.1 time: 0.232923 Oct 22 03:27:54.622287 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2532/5165] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:54 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:54.635092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:54.635555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:54.646079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:54.646578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:54.647016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.653845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:54.654750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:54.658762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:54.667600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:54.699552 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7c5e7f9-87f3-47b4-a521-27da40eb9e81 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.630411 Oct 22 03:27:54.716284 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2634/5166] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:54 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:55.183153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:55.286752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:55.320504 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9d642d3-22e1-470c-973e-c809bc8309c2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1473 microversion: 2.1 time: 0.697026 Oct 22 03:27:55.351056 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2533/5167] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:54 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1473 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:55.391720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:55.395098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:55.417469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:55.421315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:55.423185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:55.426518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:55.427433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:55.429723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:55.534382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1346946138", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:55.542839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:55.567975 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3810c462-8ee1-44b0-ac31-028e3c273211 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181532 Oct 22 03:27:55.577993 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2635/5168] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:27:55 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:55.646520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:55.647210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:55.657763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:55.658264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:55.658709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:55.659432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:55.659950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:55.660423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:55.661404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] validate_networks() for [('1dca30ca-b544-47c6-a616-7a126cc52745', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:27:55.902734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:55.922284 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98cf39a1-ec7d-4992-8c67-876cbcdb801d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 0.279048 Oct 22 03:27:55.925122 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2636/5169] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:55 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:55.934794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:55.935958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:55.944847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:55.945895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:55.946665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:55.948955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:55.949651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:55.951081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:56.216306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:56.232539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-60034713-22fd-43d3-8194-988b8c882954 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.305573 Oct 22 03:27:56.251688 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2637/5170] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:55 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:56.590612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:56.594122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:56.600825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:56.601619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:56.602546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:56.604078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:56.604792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:56.605679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:56.646969 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cbc2feba-4000-436d-b8c3-1c33d3d63a94 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061161 Oct 22 03:27:56.651484 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2638/5171] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:27:56 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:27:56.951508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:56.953478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:56.968737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:56.969289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:56.969678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:56.970394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:56.970857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:56.971287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:57.082371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:57.317131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:57.325921 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6f5c597-ec54-4b5e-90d2-a10e1b74ac3c tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 0.379346 Oct 22 03:27:57.326837 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2639/5172] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:56 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:27:57.332423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:57.333277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:57.339883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:57.341028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:57.341692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:57.343755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:57.344473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:57.345126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:57.744141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:57.757850 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-17bb67f9-1c0e-4f36-907c-27102100e1d5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1507 microversion: 2.1 time: 0.428473 Oct 22 03:27:57.759457 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2640/5173] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:57 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:57.772764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:57.776047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:57.786536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:57.806099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:57.807128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:57.813514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:57.815526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:57.816400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:57.885692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:27:57.886961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:27:57.888248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:27:57.888932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:27:57.889962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:27:57.902873 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d351c746-965e-4cc6-aa18-c97654956142 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141813 Oct 22 03:27:57.918981 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2641/5174] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:27:57 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:57.924626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e35e5be8-374d-41e3-9fd1-303ff9b56f1b req-27c3a82c-1fc4-45b3-a260-b8430f2d8a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999b73de-61c0-44a5-8cba-868742525e88", "tag": "0bb3142f-8269-42ca-899a-4ebe876fd1f1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:57.925005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:27:57.948176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e35e5be8-374d-41e3-9fd1-303ff9b56f1b req-27c3a82c-1fc4-45b3-a260-b8430f2d8a25 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:57.948963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e35e5be8-374d-41e3-9fd1-303ff9b56f1b req-27c3a82c-1fc4-45b3-a260-b8430f2d8a25 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:57.949651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e35e5be8-374d-41e3-9fd1-303ff9b56f1b req-27c3a82c-1fc4-45b3-a260-b8430f2d8a25 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:57.959463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:57.959960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:57.960436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:57.961176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:57.961640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:57.962073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:57.969997 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e35e5be8-374d-41e3-9fd1-303ff9b56f1b req-27c3a82c-1fc4-45b3-a260-b8430f2d8a25 service nova] Creating event network-changed:0bb3142f-8269-42ca-899a-4ebe876fd1f1 for instance 999b73de-61c0-44a5-8cba-868742525e88 on n-h1-862416-2 Oct 22 03:27:57.982025 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e35e5be8-374d-41e3-9fd1-303ff9b56f1b req-27c3a82c-1fc4-45b3-a260-b8430f2d8a25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061302 Oct 22 03:27:57.983088 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2642/5175] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:57.988988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6df16c4-ede1-427f-be4c-a2c7339b6d51"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:58.003087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:58.010188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:58.011024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:58.016952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:58.017812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:58.018522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:58.019202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:58.021273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:27:58.038885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:27:58.092951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:27:58.095328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 1498ac7f-008e-4b3c-b4b9-75c882caa154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:27:58.229970 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d9895d49-ede2-41eb-8bee-2f04fadd273d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.699921 Oct 22 03:27:58.240587 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2534/5176] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:27:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:27:58.246277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17591a01-fd27-4a83-bb4b-745c4375f4c3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:58.247002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17591a01-fd27-4a83-bb4b-745c4375f4c3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 1498ac7f-008e-4b3c-b4b9-75c882caa154] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:58.320933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17591a01-fd27-4a83-bb4b-745c4375f4c3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 1498ac7f-008e-4b3c-b4b9-75c882caa154] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:27:58.537884 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e86de450-84a3-4f8b-82ba-2e12c561892e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553165 Oct 22 03:27:58.539094 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2643/5177] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:27:57 2022] POST /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:58.549795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:58.554132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:58.587984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:58.591031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:58.591953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:58.593552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:58.594033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:58.594478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:58.953529 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17591a01-fd27-4a83-bb4b-745c4375f4c3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154" status: 204 len: 0 microversion: 2.1 time: 0.711179 Oct 22 03:27:58.954071 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2535/5178] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:27:58 2022] DELETE /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:27:58.960575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:58.962287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:58.981997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:58.982981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:58.983513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:58.984663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:58.985333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:58.985843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:59.535537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:59.544189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-843c913a-a7e4-415b-9fbd-e94f20de6c1b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 1.003764 Oct 22 03:27:59.556592 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2644/5179] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:58 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:59.573559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:59.575970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:59.596941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:59.599330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:59.599879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:59.600675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:27:59.601145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:27:59.603957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:27:59.670928 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f86258b6-a856-4aae-be0c-a3bcf977d3ce tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120034 Oct 22 03:27:59.672188 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2645/5180] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:27:59 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:27:59.679519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bed87b61-d48e-47ca-9657-ddb5ffea2527 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:27:59.680471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bed87b61-d48e-47ca-9657-ddb5ffea2527 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 1498ac7f-008e-4b3c-b4b9-75c882caa154] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:27:59.681050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:27:59.687013 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-bed87b61-d48e-47ca-9657-ddb5ffea2527 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bed87b61-d48e-47ca-9657-ddb5ffea2527 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154 HTTP/1.1 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1498ac7f-008e-4b3c-b4b9-75c882caa154'} Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:27:59.689266 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:27:59.693362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:27:59.693362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:27:59.693362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:27:59.693362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:27:59.693362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:27:59.695538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bed87b61-d48e-47ca-9657-ddb5ffea2527 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:27:59.697061 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bed87b61-d48e-47ca-9657-ddb5ffea2527 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154" status: 404 len: 111 microversion: 2.1 time: 0.023669 Oct 22 03:27:59.698595 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2646/5181] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:59 2022] GET /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:27:59.713696 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a6dd8e66-893b-4dad-897a-b9a5435a2abc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1507 microversion: 2.1 time: 0.758384 Oct 22 03:27:59.714366 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2536/5182] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:27:58 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1507 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:27:59.893746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1663675355", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "1dca30ca-b544-47c6-a616-7a126cc52745"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:27:59.990289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] validate_networks() for [('1dca30ca-b544-47c6-a616-7a126cc52745', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:28:00.019672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b43d544c-eff2-4461-91e5-230a8eecb907 req-dc51cdf3-4c94-4fc6-959e-701be6134073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b82fa2-7e05-4441-9ae2-9d7e7eee7514", "tag": "d1f0ca6c-ac8d-438e-93a6-c0791083cfce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:00.034384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b43d544c-eff2-4461-91e5-230a8eecb907 req-dc51cdf3-4c94-4fc6-959e-701be6134073 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:00.035343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b43d544c-eff2-4461-91e5-230a8eecb907 req-dc51cdf3-4c94-4fc6-959e-701be6134073 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:00.037650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b43d544c-eff2-4461-91e5-230a8eecb907 req-dc51cdf3-4c94-4fc6-959e-701be6134073 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:00.058275 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b43d544c-eff2-4461-91e5-230a8eecb907 req-dc51cdf3-4c94-4fc6-959e-701be6134073 service nova] Creating event network-changed:d1f0ca6c-ac8d-438e-93a6-c0791083cfce for instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 on n-h1-862416-2 Oct 22 03:28:00.064428 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b43d544c-eff2-4461-91e5-230a8eecb907 req-dc51cdf3-4c94-4fc6-959e-701be6134073 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.363490 Oct 22 03:28:00.065436 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2647/5183] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:00.074027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-be393954-42c9-46d2-b319-9f71973e2cde req-ee758ebe-dc91-4c82-9587-49d4005fd7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297044ba-6a61-4fd3-bdeb-2a16517887ed", "name": "network-vif-unplugged", "status": "completed", "tag": "59ad910d-6769-4aa5-9018-8f06d14ba036"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:00.088765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-be393954-42c9-46d2-b319-9f71973e2cde req-ee758ebe-dc91-4c82-9587-49d4005fd7a3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:00.089807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-be393954-42c9-46d2-b319-9f71973e2cde req-ee758ebe-dc91-4c82-9587-49d4005fd7a3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:00.090478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-be393954-42c9-46d2-b319-9f71973e2cde req-ee758ebe-dc91-4c82-9587-49d4005fd7a3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:00.113645 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-be393954-42c9-46d2-b319-9f71973e2cde req-ee758ebe-dc91-4c82-9587-49d4005fd7a3 service nova] Creating event network-vif-unplugged:59ad910d-6769-4aa5-9018-8f06d14ba036 for instance 297044ba-6a61-4fd3-bdeb-2a16517887ed on n-h1-862416-2 Oct 22 03:28:00.120104 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-be393954-42c9-46d2-b319-9f71973e2cde req-ee758ebe-dc91-4c82-9587-49d4005fd7a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052708 Oct 22 03:28:00.120790 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2648/5184] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:00.126956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cfba5bc3-e2a3-4a77-9319-0e6d56ead0b2 req-9e6f9067-39d5-449e-bbcb-7835fcb51646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332b0090-0378-4b49-922a-f235bde2cc95", "tag": "86723a95-0020-4cfe-ac3b-fa865781e720"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:00.137037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cfba5bc3-e2a3-4a77-9319-0e6d56ead0b2 req-9e6f9067-39d5-449e-bbcb-7835fcb51646 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:00.137520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cfba5bc3-e2a3-4a77-9319-0e6d56ead0b2 req-9e6f9067-39d5-449e-bbcb-7835fcb51646 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:00.137955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cfba5bc3-e2a3-4a77-9319-0e6d56ead0b2 req-9e6f9067-39d5-449e-bbcb-7835fcb51646 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:00.151294 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cfba5bc3-e2a3-4a77-9319-0e6d56ead0b2 req-9e6f9067-39d5-449e-bbcb-7835fcb51646 service nova] Creating event network-changed:86723a95-0020-4cfe-ac3b-fa865781e720 for instance 332b0090-0378-4b49-922a-f235bde2cc95 on n-h2-862416-2 Oct 22 03:28:00.157371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cfba5bc3-e2a3-4a77-9319-0e6d56ead0b2 req-9e6f9067-39d5-449e-bbcb-7835fcb51646 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034937 Oct 22 03:28:00.158410 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2649/5185] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:00.577290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:00.586152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:00.609033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:00.612986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:00.614389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:00.619164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:00.620665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:00.622401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.263437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:01.266655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:01.274045 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ea3dba7-58f0-413c-a92d-699bfc466ab3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 0.705923 Oct 22 03:28:01.284621 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2650/5186] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:00 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:01.299236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:01.303282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:01.320483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:01.321403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:01.322026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.323009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:01.327784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:01.328642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.400056 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9ce81859-4e0c-48ae-b88a-def5085e4074 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106952 Oct 22 03:28:01.402320 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2651/5187] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:28:01 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:01.417053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:01.421305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:01.430486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:01.431462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:01.433103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.435531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:01.437050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:01.438214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.750319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:28:01.750805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:28:01.751302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:28:01.751788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:28:01.752304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:28:01.790073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:01.790569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:01.791532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.792501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:01.793164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:01.793892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.834865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:01.846705 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e527a537-16b7-440a-be39-e593ba60a469 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 200 len: 1510 microversion: 2.1 time: 0.442703 Oct 22 03:28:01.847300 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2652/5188] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:01 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:01.850492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:28:01.872499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:01.872499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:01.877867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:01.878336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:01.879504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.879504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:01.879983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:01.880707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:01.897893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:28:01.927847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:28:01.938421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:28:02.055623 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1f65902a-6142-460d-b0d3-722c04d4b02a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166307 Oct 22 03:28:02.060044 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2537/5189] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:27:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:28:02.071370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7d02d47-ca01-48d8-acdd-c3d0b397c4be tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:02.075618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7d02d47-ca01-48d8-acdd-c3d0b397c4be tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:02.191143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a7d02d47-ca01-48d8-acdd-c3d0b397c4be tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:02.200878 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7d02d47-ca01-48d8-acdd-c3d0b397c4be tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1221 microversion: 2.1 time: 0.133658 Oct 22 03:28:02.204790 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2538/5190] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:02 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:02.301666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:02.302497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:02.310287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:02.312818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:02.315077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:02.316844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:02.319002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:02.319550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:02.572194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:02.590286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:02.608323 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b80eb0fd-db06-4abe-ab6d-01099ec3a962 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 0.311098 Oct 22 03:28:02.630974 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2539/5191] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:02 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:02.633041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eff5fe81-9837-41ea-8ecb-fa3f9feb218c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.763558 Oct 22 03:28:02.634470 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2653/5192] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:01 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:02.673506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:02.678954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:02.679667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:02.684341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:02.688738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=82 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:02.696532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:02.697034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:02.697548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:02.698330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:02.698793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:02.699226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:02.715328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:02.716498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:02.716949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:02.719014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:02.721161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:02.724182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:02.771401 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47f5866c-71a1-48aa-8cda-bc4c93d55782 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.138872 Oct 22 03:28:02.789556 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2540/5193] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:28:02 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:28:02.854450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:02.855270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:02.865207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:02.866014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:02.866740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:02.867723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:02.868420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:02.869053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:02.906452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:03.035113 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ccc82bdc-1caf-4c62-9f2c-a12a09e83f37 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 204 len: 0 microversion: 2.1 time: 0.185596 Oct 22 03:28:03.036604 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2541/5194] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:02 2022] DELETE /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:28:03.047908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:03.049175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:03.058398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.059168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.059894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.061417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.062168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.063574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.225632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:03.241427 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efe70f40-bbe8-4c6f-b95e-5ee64ad9a46d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.574986 Oct 22 03:28:03.243324 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2654/5195] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:02 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:03.253034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:03.253909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:03.267607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.269656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.271280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.273255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.273987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.274632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.281015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:03.291450 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4099d63-37e7-400c-9846-89c3f98e8b5f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1682 microversion: 2.1 time: 0.249286 Oct 22 03:28:03.313150 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2542/5196] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:03 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1682 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:03.318020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:03.318640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:03.333108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.337808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.338557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.349932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.352503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.353232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.425611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:03.438422 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c778910d-cfd2-498e-bfaa-46c22d6bfab2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1225 microversion: 2.1 time: 0.193621 Oct 22 03:28:03.439659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2655/5197] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:03 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1225 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:03.635459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:03.636456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:03.648193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.648781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.650681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.652556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.654534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.655305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.906823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:03.927917 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-64ec5f91-21ed-4122-8377-9127266d5d38 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.611957 Oct 22 03:28:03.929796 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2543/5198] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:03 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:03.956048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:03.957513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:03.994993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:03.994993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:03.994993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:03.996603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:04.000072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:04.000894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:04.344805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:04.355415 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ea6f747-0455-4d95-bc7d-b58e72e6ae12 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.405116 Oct 22 03:28:04.356473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2544/5199] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:03 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:04.373621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:04.375304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:04.393383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:04.394130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:04.394782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:04.395758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:04.396621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:04.397411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:04.817228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:04.829921 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e4c513c-9dd5-4aa3-9f1e-35247b4258b0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 1.198682 Oct 22 03:28:04.848388 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2656/5200] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:03 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:04.864611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f689fcf-7f61-4c1f-a654-9067cbbe1738 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:04.887020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f689fcf-7f61-4c1f-a654-9067cbbe1738 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:04.888119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f689fcf-7f61-4c1f-a654-9067cbbe1738 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:04.888772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f689fcf-7f61-4c1f-a654-9067cbbe1738 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:04.925173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f689fcf-7f61-4c1f-a654-9067cbbe1738 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Going to try to stop instance {{(pid=120581) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:28:05.023164 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f689fcf-7f61-4c1f-a654-9067cbbe1738 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.171310 Oct 22 03:28:05.027649 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2657/5201] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:28:04 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:28:05.048366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:05.049285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:05.065072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:05.065919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:05.066561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:05.069077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:05.069749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:05.073466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:05.323924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:05.333494 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0182d9d4-a282-4260-9917-ff245c190df4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1279 microversion: 2.1 time: 0.304383 Oct 22 03:28:05.344731 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2658/5202] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:05 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1279 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:05.350126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:05.351144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:05.362469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:05.363329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:05.368372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:05.369297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:05.369932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:05.370578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:05.428030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:05.440955 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b8c5e94-13e6-4505-adeb-462656ae6b31 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1682 microversion: 2.1 time: 1.082859 Oct 22 03:28:05.441547 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2545/5203] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:04 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1682 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:05.855091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:05.855632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:05.865534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:05.866251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:05.866477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:05.867195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:05.867638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:05.868110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:05.868110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:05.881426 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dcf9c29f-d7f6-447b-83f2-86fdbdcca3b8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.532772 Oct 22 03:28:05.882038 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2659/5204] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:05 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:06.301162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9b293bf8-b765-4a07-b316-05ccd2cab655 req-9fac8f34-a8e3-44ae-ad9c-dbd69c198d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999b73de-61c0-44a5-8cba-868742525e88", "name": "network-vif-plugged", "status": "completed", "tag": "0bb3142f-8269-42ca-899a-4ebe876fd1f1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:06.321530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9b293bf8-b765-4a07-b316-05ccd2cab655 req-9fac8f34-a8e3-44ae-ad9c-dbd69c198d17 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:06.325927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9b293bf8-b765-4a07-b316-05ccd2cab655 req-9fac8f34-a8e3-44ae-ad9c-dbd69c198d17 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:06.326960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9b293bf8-b765-4a07-b316-05ccd2cab655 req-9fac8f34-a8e3-44ae-ad9c-dbd69c198d17 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:06.370091 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9b293bf8-b765-4a07-b316-05ccd2cab655 req-9fac8f34-a8e3-44ae-ad9c-dbd69c198d17 service nova] Creating event network-vif-plugged:0bb3142f-8269-42ca-899a-4ebe876fd1f1 for instance 999b73de-61c0-44a5-8cba-868742525e88 on n-h1-862416-2 Oct 22 03:28:06.394035 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9b293bf8-b765-4a07-b316-05ccd2cab655 req-9fac8f34-a8e3-44ae-ad9c-dbd69c198d17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099610 Oct 22 03:28:06.396051 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2660/5205] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 22 03:28:06.404084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:06.416045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:06.423155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:06.423875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:06.425376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:06.426320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:06.429369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:06.432423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:06.588916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:06.599999 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98572b47-6aa5-44b1-ada1-6e0454a95616 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1279 microversion: 2.1 time: 0.202496 Oct 22 03:28:06.600626 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2661/5206] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:06 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1279 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:06.607430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:06.611469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:06.625117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:06.632253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:06.633418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:06.635635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:06.642708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:06.643501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:07.066990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:07.079510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9fa6ef8e-e922-4797-9b59-c020e1bd2651 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1682 microversion: 2.1 time: 0.475681 Oct 22 03:28:07.080753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2662/5207] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:06 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1682 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:07.104758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:07.105589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:07.125169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:07.126685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:07.127989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:07.128770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:07.129238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:07.129693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:07.259364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:07.270525 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b8009c1-23eb-4d97-a68a-8b54ab759da3 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 1.419873 Oct 22 03:28:07.285689 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2546/5208] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:05 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:07.354232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:07.363392 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d9f4b34-9f22-4c47-ba54-4c34677167c1 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.280617 Oct 22 03:28:07.367978 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2663/5209] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:07 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:07.628445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:07.629095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:07.639068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:07.641696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:07.642427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:07.645090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:07.645836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:07.649612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:07.701841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:07.844543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:07.854948 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0dcef301-6a72-41a0-99ea-82178c5ce155 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1279 microversion: 2.1 time: 0.231222 Oct 22 03:28:07.873036 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2547/5210] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:07 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:08.106071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:08.107490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:08.130339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:08.131193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:08.132928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:08.134494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:08.136836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:08.138075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:08.296600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:08.298711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:08.313567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:08.318035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:08.318738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:08.321042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:08.330576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:08.331827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:08.662797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:08.688856 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93ab838d-8899-4462-a7ac-f3acf485b137 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1614 microversion: 2.1 time: 0.582545 Oct 22 03:28:08.691792 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2664/5211] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:08 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1614 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:08.706575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:08.708949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:08.730367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:08.732926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:08.734031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:08.737442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:08.738128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:08.740093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:08.940382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:08.956924 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2cf38111-329e-43f5-a6c8-481333f9768b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 0.657413 Oct 22 03:28:08.958687 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2548/5212] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:08 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:08.964156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9513033f-eb07-433e-93a6-3eaa2cc9fd8e req-c9ee0add-37ad-408f-8e76-16cb1467d2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332b0090-0378-4b49-922a-f235bde2cc95", "name": "network-vif-plugged", "status": "completed", "tag": "86723a95-0020-4cfe-ac3b-fa865781e720"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:08.988435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9513033f-eb07-433e-93a6-3eaa2cc9fd8e req-c9ee0add-37ad-408f-8e76-16cb1467d2e3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:08.989335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9513033f-eb07-433e-93a6-3eaa2cc9fd8e req-c9ee0add-37ad-408f-8e76-16cb1467d2e3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:08.989943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9513033f-eb07-433e-93a6-3eaa2cc9fd8e req-c9ee0add-37ad-408f-8e76-16cb1467d2e3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:09.013038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9513033f-eb07-433e-93a6-3eaa2cc9fd8e req-c9ee0add-37ad-408f-8e76-16cb1467d2e3 service nova] Creating event network-vif-plugged:86723a95-0020-4cfe-ac3b-fa865781e720 for instance 332b0090-0378-4b49-922a-f235bde2cc95 on n-h2-862416-2 Oct 22 03:28:09.023137 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9513033f-eb07-433e-93a6-3eaa2cc9fd8e req-c9ee0add-37ad-408f-8e76-16cb1467d2e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062948 Oct 22 03:28:09.028504 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2549/5213] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:09.048185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e605eba8-8d9d-4fdf-b6d0-98ca2704bf58 req-81cdb901-bde7-499c-8763-8f6933e733af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13cb759-d1e1-43a4-a3e4-5f778581559f", "name": "network-vif-deleted", "tag": "87ad47fe-3221-4711-b326-39b4dc50d735"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:09.059218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e605eba8-8d9d-4fdf-b6d0-98ca2704bf58 req-81cdb901-bde7-499c-8763-8f6933e733af service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:09.069086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e605eba8-8d9d-4fdf-b6d0-98ca2704bf58 req-81cdb901-bde7-499c-8763-8f6933e733af service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:09.069844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e605eba8-8d9d-4fdf-b6d0-98ca2704bf58 req-81cdb901-bde7-499c-8763-8f6933e733af service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:09.093832 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e605eba8-8d9d-4fdf-b6d0-98ca2704bf58 req-81cdb901-bde7-499c-8763-8f6933e733af service nova] Creating event network-vif-deleted:87ad47fe-3221-4711-b326-39b4dc50d735 for instance d13cb759-d1e1-43a4-a3e4-5f778581559f on n-h1-862416-2 Oct 22 03:28:09.100649 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e605eba8-8d9d-4fdf-b6d0-98ca2704bf58 req-81cdb901-bde7-499c-8763-8f6933e733af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070112 Oct 22 03:28:09.101549 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2550/5214] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:09.116454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:09.118449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:09.119330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:09.127821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:09.131704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:09.132135 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-94688196-2b25-4da9-b504-049ceaa9f127 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.436943 Oct 22 03:28:09.132901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:09.133619 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2665/5215] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:08 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:09.135733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:09.136469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:09.137112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:09.339297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:09.349658 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff466066-875b-4e16-99c5-b1483d31031e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1279 microversion: 2.1 time: 0.235617 Oct 22 03:28:09.350748 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2551/5216] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:09 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:09.715232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:09.715854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:09.740657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:09.742062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:09.757915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:09.761738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:09.762787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:09.766050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:09.872671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:09.875534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:09.877566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:09.878668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lazy-loading 'fault' on Instance uuid d13cb759-d1e1-43a4-a3e4-5f778581559f {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:09.985950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:09.986808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:09.996294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:09.997054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:09.997721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:09.999530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:10.000273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:10.000905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:10.084469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:10.087521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:10.103000 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a4b6058-001d-4579-b45e-799d8327abbb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 200 len: 1331 microversion: 2.1 time: 0.391442 Oct 22 03:28:10.118328 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2666/5217] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:09 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 1331 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:10.159231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:10.162940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:10.180579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:10.181081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:10.181698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:10.182383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:10.182868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:10.183299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:10.403687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:10.430488 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-de0c6db4-b24b-4f2a-922e-e426abbdddac tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 0.448775 Oct 22 03:28:10.432718 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2552/5218] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:09 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:10.443092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:10.444524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:10.452816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:10.456451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:10.457148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:10.458694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:10.459511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:10.460114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:10.611580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:10.631081 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8aaa605-59d1-4d1a-98b0-69a7ae641906 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.478323 Oct 22 03:28:10.633043 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2667/5219] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:10 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:10.709023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:10.735754 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c0ac4cc-8106-4e0c-8dd3-f7cbbdeee74f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1321 microversion: 2.1 time: 0.298600 Oct 22 03:28:10.743140 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2553/5220] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:10 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:11.135256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:11.136099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:11.147303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.147904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.148385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.151856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.152658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.153110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.179424 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f HTTP/1.1 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd13cb759-d1e1-43a4-a3e4-5f778581559f'} Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:11.181146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27758387-643e-46fb-afca-5a29ec374c92 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 404 len: 111 microversion: 2.1 time: 0.052342 Oct 22 03:28:11.187415 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2668/5221] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:11 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:28:11.193052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-486ec29e-b47b-40dc-bcd9-879a1c840b42 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '.version_select at 0x7f0d1e5489d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:11.216818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-486ec29e-b47b-40dc-bcd9-879a1c840b42 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435146675" status: 202 len: 0 microversion: 2.1 time: 0.027545 Oct 22 03:28:11.220432 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2554/5222] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435146675 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:28:11.461072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:11.462018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:11.488047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-60a4b6d4-085a-453d-bd88-a998000e91f7 req-e9dad68a-ca73-49b3-b7dc-194c0c66d47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca35a92-b322-4400-a3e2-13831cbd121e", "tag": "96165453-64a3-439e-8e05-eb023cfe75c6"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:11.496470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.497057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.497511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.498289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.500520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.501125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.520088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-60a4b6d4-085a-453d-bd88-a998000e91f7 req-e9dad68a-ca73-49b3-b7dc-194c0c66d47f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.522318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-60a4b6d4-085a-453d-bd88-a998000e91f7 req-e9dad68a-ca73-49b3-b7dc-194c0c66d47f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.524344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-60a4b6d4-085a-453d-bd88-a998000e91f7 req-e9dad68a-ca73-49b3-b7dc-194c0c66d47f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.558271 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-60a4b6d4-085a-453d-bd88-a998000e91f7 req-e9dad68a-ca73-49b3-b7dc-194c0c66d47f service nova] Creating event network-changed:96165453-64a3-439e-8e05-eb023cfe75c6 for instance eca35a92-b322-4400-a3e2-13831cbd121e on n-h2-862416-2 Oct 22 03:28:11.573909 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-60a4b6d4-085a-453d-bd88-a998000e91f7 req-e9dad68a-ca73-49b3-b7dc-194c0c66d47f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091522 Oct 22 03:28:11.575812 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2555/5223] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:11.657755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:11.658657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:11.671072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.674120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.677470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.679354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.692519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.693545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.745126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:11.773119 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73b5a407-6514-43c7-b019-6e8eee66a467 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 0.321581 Oct 22 03:28:11.774180 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2669/5224] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:11 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:11.781613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:11.782549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:11.789178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.789967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.790639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.791593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:11.792315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:11.792991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:11.812284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:12.033815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:12.054742 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-860ed3d8-af18-4fd1-ab17-dfc76b48bdb8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1321 microversion: 2.1 time: 0.273549 Oct 22 03:28:12.070508 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2670/5225] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:11 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:12.198145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=16 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:12.228048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d9a7d835-5a7c-4d58-86fb-27c526cf60b4 req-a3e0611a-1f56-49ff-8905-2e403095eba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b82fa2-7e05-4441-9ae2-9d7e7eee7514", "name": "network-vif-plugged", "status": "completed", "tag": "d1f0ca6c-ac8d-438e-93a6-c0791083cfce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:12.251993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d9a7d835-5a7c-4d58-86fb-27c526cf60b4 req-a3e0611a-1f56-49ff-8905-2e403095eba0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:12.252507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d9a7d835-5a7c-4d58-86fb-27c526cf60b4 req-a3e0611a-1f56-49ff-8905-2e403095eba0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:12.252942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d9a7d835-5a7c-4d58-86fb-27c526cf60b4 req-a3e0611a-1f56-49ff-8905-2e403095eba0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:12.288802 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d9a7d835-5a7c-4d58-86fb-27c526cf60b4 req-a3e0611a-1f56-49ff-8905-2e403095eba0 service nova] Creating event network-vif-plugged:d1f0ca6c-ac8d-438e-93a6-c0791083cfce for instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 on n-h1-862416-2 Oct 22 03:28:12.302957 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d9a7d835-5a7c-4d58-86fb-27c526cf60b4 req-a3e0611a-1f56-49ff-8905-2e403095eba0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090131 Oct 22 03:28:12.304053 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2671/5226] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:12.642616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:12.659282 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d47352a-1d8b-406b-9883-ce8c764a5eb6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 1.004526 Oct 22 03:28:12.661861 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2556/5227] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:11 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:12.798313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:12.799021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:12.818229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:12.822153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:12.822639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:12.823390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:12.824439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:12.824895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:13.081728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:13.082453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:13.102199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:13.102708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:13.103153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:13.103871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:13.104365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:13.104801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:13.260445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:13.285764 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ecb0fc72-2630-4aaf-b90c-c2eff908de18 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1323 microversion: 2.1 time: 0.490897 Oct 22 03:28:13.286008 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2672/5228] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:12 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1323 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:13.486570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-66295189-6a8b-41b1-b069-06cac5c7c168 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: .version_select at 0x7f0d199f3a60>, body: {"keypair": {"name": "tempest-keypair-587517080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWK3Ac5hooxjob7WJpWrTpYbw/s+WCwR2oh5DqN3FVJXYMI+uYsFn//1lb1a8W/FVhSea8dpdo+j/KPbkaem0PpORs+gCV/68A8Pg8l97qAcS0n25FaXaTAWiE+1LxEwQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:13.504879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:13.511599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-66295189-6a8b-41b1-b069-06cac5c7c168 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:28:13.518981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-66295189-6a8b-41b1-b069-06cac5c7c168 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for user 3ad9769823b74399aabb7395eeee44aa and project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:28:13.519895 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee377a4d-57b1-4342-a40e-2e156cc6005c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1321 microversion: 2.1 time: 0.441840 Oct 22 03:28:13.532595 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2557/5229] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:13 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:13.562823 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-66295189-6a8b-41b1-b069-06cac5c7c168 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083498 Oct 22 03:28:13.571351 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2673/5230] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:28:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:13.687134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:13.688719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:13.703228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:13.703835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:13.704330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:13.705131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:13.705714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:13.706038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:13.994917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:14.034924 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e3d046e-c170-4e40-804c-98a406b85f26 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.350929 Oct 22 03:28:14.041766 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2558/5231] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:13 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:14.325431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:14.326055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:14.343931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:14.344460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:14.344906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:14.345625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:14.346083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:14.346530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:14.548847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:14.549407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:14.558530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:14.562516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:14.562800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:14.569497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:14.570281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:14.570892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:14.571415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:14.664003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:14.673235 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a191eaeb-7254-43ef-8e18-df315478dff1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 200 len: 1515 microversion: 2.1 time: 0.367509 Oct 22 03:28:14.688293 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2674/5232] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:14 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:14.699725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:14.703874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 332b0090-0378-4b49-922a-f235bde2cc95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:14.727608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:14.728399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:14.729031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:14.729932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:14.731747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:14.732412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:14.969304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:14.979016 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-84fa5d1e-239a-4a46-afe7-2c425b24f4c6 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95" status: 200 len: 1515 microversion: 2.1 time: 0.283154 Oct 22 03:28:14.981099 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2675/5233] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:14 2022] GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95 => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:15.005345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:15.005987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:15.012896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:15.013646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:15.015631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:15.016603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:15.017224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:15.017815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:15.120581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:15.144904 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ea19a36-eaca-4369-af84-571f83c29a5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1321 microversion: 2.1 time: 0.590143 Oct 22 03:28:15.145615 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2559/5234] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:14 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:15.160919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:15.161389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:15.182569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:15.183073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:15.183516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:15.190223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:15.190961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:15.191420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:15.377416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:15.388754 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-09ba1cd6-f1f0-4739-b8f3-5435e4eafe34 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 200 len: 1515 microversion: 2.1 time: 0.387630 Oct 22 03:28:15.389852 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2676/5235] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:14 2022] GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 1515 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:15.416575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:15.417388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:15.437189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:15.438985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:15.440042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:15.453567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:15.456378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:15.458322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:15.515511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:15.715874 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1404c4de-ddab-40a0-9d70-dc4ff818b099 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 204 len: 0 microversion: 2.1 time: 0.304214 Oct 22 03:28:15.718143 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2677/5236] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:15 2022] DELETE /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:28:15.731023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:15.733136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:15.747821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:15.751706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:15.752781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:15.756234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:15.756839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:15.758572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:16.086199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:16.105264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6744562e-8cf2-4a29-acda-8ba4f74fe705 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1677 microversion: 2.1 time: 0.956695 Oct 22 03:28:16.107565 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2560/5237] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:15 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1677 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:16.121285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:16.133246 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df31e219-deb9-411c-b3ec-6aba3757f1b7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 200 len: 1521 microversion: 2.1 time: 0.411123 Oct 22 03:28:16.134181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2678/5238] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:15 2022] GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:16.176538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:16.178156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:16.193442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:16.194931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:16.195628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:16.196672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:16.197369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:16.198115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:16.988904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:17.001100 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19ccd224-4971-4f43-920d-8a689efca746 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1321 microversion: 2.1 time: 0.831654 Oct 22 03:28:17.019337 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2561/5239] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:16 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:17.138083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:17.144794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:17.147930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:17.151840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:17.166690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:17.168768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:17.171794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:17.172528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:17.173876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:17.174667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:17.175363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:17.176444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:17.177148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:17.178315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:17.179178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:17.180442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:17.250862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lazy-loading 'flavor' on Instance uuid 41b96077-d04d-4bb7-b33b-632d27cebe25 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:17.538091 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8bb4deb2-7682-499f-944a-a9581e9a352c tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/action" status: 200 len: 32 microversion: 2.1 time: 0.396672 Oct 22 03:28:17.539556 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2562/5240] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:28:17 2022] POST /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 22 03:28:17.547402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:17.548626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:17.558926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:17.561229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:17.562310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:17.563452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:17.564599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:17.565372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:17.659702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:17.682238 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20973b0f-e481-43c8-bad3-c5e529082330 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1654 microversion: 2.1 time: 0.547635 Oct 22 03:28:17.683881 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2679/5241] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:17 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1654 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:17.701018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:17.702637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:17.714887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:17.715399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:17.715935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:17.718946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:17.720072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:17.720558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:18.456172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:18.477149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f9ef1bd-9657-4ad2-b155-7f5aba7ff553 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.791483 Oct 22 03:28:18.477969 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2680/5242] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:17 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:18.483574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-759271f5-91ec-4826-bf7d-b56884f46c60 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:18.499325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-759271f5-91ec-4826-bf7d-b56884f46c60 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:18.507933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-759271f5-91ec-4826-bf7d-b56884f46c60 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:18.508976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-759271f5-91ec-4826-bf7d-b56884f46c60 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:18.562993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-759271f5-91ec-4826-bf7d-b56884f46c60 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Going to try to start instance {{(pid=120581) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 03:28:18.617306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:18.627069 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e22cbc8-2248-45b8-99b0-365213059f84 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 200 len: 1521 microversion: 2.1 time: 1.086005 Oct 22 03:28:18.633099 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2563/5243] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:17 2022] GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 1521 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:18.638119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:18.643248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:18.652875 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-759271f5-91ec-4826-bf7d-b56884f46c60 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.173267 Oct 22 03:28:18.653497 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2681/5244] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:28:18 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:28:18.658419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:18.659258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:18.659866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:18.660781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:18.661389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:18.661978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:18.663501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:18.664265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:18.673075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:18.673580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:18.674292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:18.674742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:18.675204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:18.675638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:19.051304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:19.071538 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1751938f-6de5-4a88-8ab9-5a5d4f1c3ddf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1663 microversion: 2.1 time: 0.405664 Oct 22 03:28:19.077406 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2682/5245] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:18 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1663 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:19.091256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a41a03ea-0555-45ba-aebe-b68127f4a7b8 req-b78b6f50-0eb5-4f96-b984-a12cfa4a85e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca35a92-b322-4400-a3e2-13831cbd121e", "name": "network-vif-plugged", "status": "completed", "tag": "96165453-64a3-439e-8e05-eb023cfe75c6"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:19.102696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a41a03ea-0555-45ba-aebe-b68127f4a7b8 req-b78b6f50-0eb5-4f96-b984-a12cfa4a85e2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:19.103195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a41a03ea-0555-45ba-aebe-b68127f4a7b8 req-b78b6f50-0eb5-4f96-b984-a12cfa4a85e2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:19.103639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a41a03ea-0555-45ba-aebe-b68127f4a7b8 req-b78b6f50-0eb5-4f96-b984-a12cfa4a85e2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:19.108235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:19.117079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a41a03ea-0555-45ba-aebe-b68127f4a7b8 req-b78b6f50-0eb5-4f96-b984-a12cfa4a85e2 service nova] Creating event network-vif-plugged:96165453-64a3-439e-8e05-eb023cfe75c6 for instance eca35a92-b322-4400-a3e2-13831cbd121e on n-h2-862416-2 Oct 22 03:28:19.122306 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a41a03ea-0555-45ba-aebe-b68127f4a7b8 req-b78b6f50-0eb5-4f96-b984-a12cfa4a85e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043288 Oct 22 03:28:19.124308 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2683/5246] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:19.130678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-748182123", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db13738c-9ec5-42b7-9de3-e09248983a6a"}], "security_groups": [{"name": "tempest-securitygroup--1481290881"}], "key_name": "tempest-keypair-587517080", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:19.325854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] validate_networks() for [('db13738c-9ec5-42b7-9de3-e09248983a6a', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:28:19.474357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:19.483600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:19.494387 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8993caab-da75-4f89-be3c-7faf320e7758 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1321 microversion: 2.1 time: 0.859188 Oct 22 03:28:19.495576 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2564/5247] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:18 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1321 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:19.506885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:19.507504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:19.532986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:19.534020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:19.534020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:19.534615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:19.535073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:19.535518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:19.905156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:28:19.905670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:28:19.906234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:28:19.906720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:28:19.907225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:28:19.917490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:19.918073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:19.918587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:19.919391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:19.920603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:19.921178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:19.941897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:28:19.948267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Getting quotas for user 3ad9769823b74399aabb7395eeee44aa and project fad1fddb86944bec981cfdd824d8dcf5. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:28:19.963924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:28:19.966544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:28:20.021286 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab15be98-6e3a-43f1-b2d8-343b134550e5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.895708 Oct 22 03:28:20.022378 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2684/5248] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:28:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:28:20.027987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:20.028780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:20.042218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:20.042954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:20.043577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:20.044607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:20.046457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:20.047945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:20.187504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:20.198294 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3a6e26fd-7831-4c64-8186-fcabd0854e2f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 200 len: 1479 microversion: 2.1 time: 0.174111 Oct 22 03:28:20.209191 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2685/5249] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:20 2022] GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 1479 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:20.226031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea7c826c-3e6f-4d96-8a53-f87ac7c21944 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:20.228537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea7c826c-3e6f-4d96-8a53-f87ac7c21944 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:20.240809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:20.316379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:20.331909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea7c826c-3e6f-4d96-8a53-f87ac7c21944 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:20.345986 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea7c826c-3e6f-4d96-8a53-f87ac7c21944 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1240 microversion: 2.1 time: 0.133655 Oct 22 03:28:20.348237 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93c1436d-a7ae-4f74-ab76-9ba6734ed379 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.845905 Oct 22 03:28:20.349379 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2565/5250] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:19 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:20.354410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:20.355438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:20.363047 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2686/5251] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:20 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:20.370827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:20.371997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:20.372688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:20.375126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:20.376123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:20.389500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:20.523202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-00396cfa-c547-4402-8e95-c77942f39193 req-3aa28ecb-fe13-46a7-ad85-6d2f0e7abe56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999b73de-61c0-44a5-8cba-868742525e88", "name": "network-vif-deleted", "tag": "0bb3142f-8269-42ca-899a-4ebe876fd1f1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:20.558801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-00396cfa-c547-4402-8e95-c77942f39193 req-3aa28ecb-fe13-46a7-ad85-6d2f0e7abe56 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:20.559553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-00396cfa-c547-4402-8e95-c77942f39193 req-3aa28ecb-fe13-46a7-ad85-6d2f0e7abe56 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:20.561118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-00396cfa-c547-4402-8e95-c77942f39193 req-3aa28ecb-fe13-46a7-ad85-6d2f0e7abe56 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:20.604815 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-00396cfa-c547-4402-8e95-c77942f39193 req-3aa28ecb-fe13-46a7-ad85-6d2f0e7abe56 service nova] Creating event network-vif-deleted:0bb3142f-8269-42ca-899a-4ebe876fd1f1 for instance 999b73de-61c0-44a5-8cba-868742525e88 on n-h1-862416-2 Oct 22 03:28:20.616721 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-00396cfa-c547-4402-8e95-c77942f39193 req-3aa28ecb-fe13-46a7-ad85-6d2f0e7abe56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098416 Oct 22 03:28:20.620826 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2687/5252] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:20.627271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:20.637237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:20.649832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:20.650520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:20.651103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:20.652003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:20.652573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:20.653085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:21.073680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:21.092954 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5252bcb-91d6-4923-8ae3-b0cb5a24f8f4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1663 microversion: 2.1 time: 0.742276 Oct 22 03:28:21.099587 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2566/5253] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:20 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1663 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:21.212153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:21.230839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:21.231940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:21.232851 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6aecb9ed-0346-4ebe-8903-e556b9d33f22 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1321 microversion: 2.1 time: 0.610305 Oct 22 03:28:21.234324 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2688/5254] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:20 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:21.246245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:21.251216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:21.251958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:21.252896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:21.253669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:21.254418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:21.369547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:21.370447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:21.382996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:21.384868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:21.385365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:21.385796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:21.386529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:21.386974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:21.387449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:21.387577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:21.390383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:21.392388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lazy-loading 'fault' on Instance uuid 999b73de-61c0-44a5-8cba-868742525e88 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:21.499473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:21.507789 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0532239-d7dd-4da1-8a36-0f8508f6caa7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1236 microversion: 2.1 time: 0.142044 Oct 22 03:28:21.509050 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2689/5255] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:21 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1236 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:21.514707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:21.516166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:21.522517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:21.523275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:21.523903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:21.524823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:21.525459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:21.526054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:21.881920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:21.898521 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-68e5883a-b004-4704-8c13-216c9f7ef0ea tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.388152 Oct 22 03:28:21.899403 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2690/5256] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:21 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:21.969514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:21.981538 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fbeca15a-4aa5-4c21-873a-a25a53df94c1 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 200 len: 1313 microversion: 2.1 time: 0.755516 Oct 22 03:28:21.982115 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2567/5257] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:21 2022] GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:22.120431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:22.121908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:22.146125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.146852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.147318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.148072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.148746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.149188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.258258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:22.258823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:22.268471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.269231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.269855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.272011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.273203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.274068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.519795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:22.536519 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea06c7e8-acfb-4d10-b72b-284547074c23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1502 microversion: 2.1 time: 0.283085 Oct 22 03:28:22.537157 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2568/5258] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:22 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:22.581144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:22.581910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:22.587471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:22.604571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.605351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.606175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.607082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74f9092e-768b-43a5-a298-5cfd4e648a7e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1663 microversion: 2.1 time: 0.479320 Oct 22 03:28:22.609830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.610279 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2691/5259] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:22 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1663 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:22.612657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.615092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.627640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:22.633222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:22.649698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.664663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.665292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.666329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.667031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.667685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.808414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:22.835225 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0be1f120-24ca-42b7-b462-06e14dbb9c2a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1300 microversion: 2.1 time: 0.275467 Oct 22 03:28:22.835841 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2569/5260] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:22 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1300 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:22.933979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:22.942094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:22.949241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.949884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.950434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:22.952707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:22.955704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:22.957053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.110555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:23.134117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f1540cf-4edc-4fc7-80d0-7c88b3dc137d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1502 microversion: 2.1 time: 0.512876 Oct 22 03:28:23.136476 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2692/5261] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:22 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1502 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:23.142742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:23.143649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:23.150231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.151048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.151711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.152713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.153387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.154179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.179209 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] HTTP exception thrown: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Request method failure captured: Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 HTTP/1.1 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Ms21FVP45uJZymML5Y9SNcLxTNZThy4S0-tf_G_6eLIFOjHWqMeBkVvd7sscfS0pbwNTYpr6OqLR5nniunzOA5KkIA5NEqXH6FOvDI58Ws3OstDMe9dlx3omQqQZOlfh7HCGZNLWihHRLQyE-UKRlcjSZlKGz-kM_6F7n2gX5vk2Y Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8035273d27ca4fd49f244614e742fba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}] Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 188501dc57d247e3b623a51b5ef86bd9 Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '999b73de-61c0-44a5-8cba-868742525e88'} Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.182217 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:23.186722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.186722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:23.186722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:23.186722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:23.186722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:23.186722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:23.186722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:23.186722 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.189232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Returning 404 to user: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:23.190353 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d8fda93-efa8-4b80-bd85-ac790787b6ae tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 404 len: 111 microversion: 2.1 time: 0.052638 Oct 22 03:28:23.191179 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2693/5262] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:23 2022] GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:28:23.197499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:23.199498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:23.207559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.208499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.209497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.210441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.211119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.211785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.261701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:23.460383 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8a8ef93-588a-4e2d-b4df-a54c7fa8b6fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 204 len: 0 microversion: 2.1 time: 0.267257 Oct 22 03:28:23.461337 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2694/5263] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:23 2022] DELETE /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:28:23.474344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:23.487899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:23.489268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:28:23.495850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.496692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.497346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.498978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.499519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.500016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.585456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:23.603307 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-010cd4e3-76e8-454b-91b8-91dda86cb558 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.678835 Oct 22 03:28:23.603963 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2570/5264] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:22 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:23.610271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:23.610802 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b6287db-1af1-4bc2-9adb-724c8bf0cb50 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.140496 Oct 22 03:28:23.611822 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2695/5265] 10.222.0.25 () {58 vars in 1230 bytes} [Sat Oct 22 03:28:23 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:28:23.616804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:23.626284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c02d9d52-8c55-4277-a079-ad2a248e1c5d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c02d9d52-8c55-4277-a079-ad2a248e1c5d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Request method failure captured: Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Ms21FVP45uJZymML5Y9SNcLxTNZThy4S0-tf_G_6eLIFOjHWqMeBkVvd7sscfS0pbwNTYpr6OqLR5nniunzOA5KkIA5NEqXH6FOvDI58Ws3OstDMe9dlx3omQqQZOlfh7HCGZNLWihHRLQyE-UKRlcjSZlKGz-kM_6F7n2gX5vk2Y Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8035273d27ca4fd49f244614e742fba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}] Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 188501dc57d247e3b623a51b5ef86bd9 Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: action_args: {} Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 22 03:28:23.632804 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 22 03:28:23.637718 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:23.643281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.643398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c02d9d52-8c55-4277-a079-ad2a248e1c5d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:23.643511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.643606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c02d9d52-8c55-4277-a079-ad2a248e1c5d tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016587 Oct 22 03:28:23.643741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.643855 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2696/5266] 10.222.0.25 () {58 vars in 1182 bytes} [Sat Oct 22 03:28:23 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:28:23.643968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.643968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.643968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.645743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:23.646467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:23.655510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.656112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.656589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.657300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:23.657857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:23.658348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:23.955652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:23.972403 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83ce6d95-7e81-497d-9616-66eacdc9c944 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1508 microversion: 2.1 time: 0.365932 Oct 22 03:28:23.976255 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2571/5267] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:23 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1508 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:24.003722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:24.011167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:24.012783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'deleted': False, 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:28:24.020188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.020703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.021350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.022255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.022869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.024795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.029948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:24.047806 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-53063b85-958b-4304-8bd5-0f7f0ac00a24 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.408024 Oct 22 03:28:24.048751 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2697/5268] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:23 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:24.053542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:24.057382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:24.069909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.071318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.071889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.072692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.073157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.073590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.080639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:28:24.134529 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6058d4d9-cf37-443a-9248-f26e5987fd53 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.139980 Oct 22 03:28:24.135428 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2572/5269] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:28:23 2022] GET /compute/v2.1/servers => generated 683 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:24.157707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:24.158237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:24.164948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.166134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.166689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.167539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.168009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.168465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.420800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:24.429413 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9e510ffd-c3e5-4eeb-af39-9c644cf6e1e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.276811 Oct 22 03:28:24.430343 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2573/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:24 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:24.450071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:24.463124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:24.463595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.compute.servers [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Removing options 'limit' from query {{(pid=120582) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 22 03:28:24.464554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'deleted': False, 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:28:24.481473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.482438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.484764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.485916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.493823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.494521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.536008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:28:24.585553 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f93a005-572b-4333-88c7-7a7f9cdafabd tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.139318 Oct 22 03:28:24.594527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2574/5271] 10.222.0.25 () {58 vars in 1144 bytes} [Sat Oct 22 03:28:24 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:24.605796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:24.606619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:24.617161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.617714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.618211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.619067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:24.619524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:24.619947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:24.943451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:24.952354 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e5435caa-f32c-4405-98d1-7739f33b1f6f tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1366 microversion: 2.1 time: 0.902312 Oct 22 03:28:24.965120 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2698/5272] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:24 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1366 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:24.982243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f768d1aa-ba8b-4379-8416-638aaa5885a7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f768d1aa-ba8b-4379-8416-638aaa5885a7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Request method failure captured: Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Ms21FVP45uJZymML5Y9SNcLxTNZThy4S0-tf_G_6eLIFOjHWqMeBkVvd7sscfS0pbwNTYpr6OqLR5nniunzOA5KkIA5NEqXH6FOvDI58Ws3OstDMe9dlx3omQqQZOlfh7HCGZNLWihHRLQyE-UKRlcjSZlKGz-kM_6F7n2gX5vk2Y Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8035273d27ca4fd49f244614e742fba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}] Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 188501dc57d247e3b623a51b5ef86bd9 Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: action_args: {} Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '-1' Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 22 03:28:24.988854 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 22 03:28:24.993351 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:24.997115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f768d1aa-ba8b-4379-8416-638aaa5885a7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:24.999649 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f768d1aa-ba8b-4379-8416-638aaa5885a7 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.042538 Oct 22 03:28:25.003223 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2699/5273] 10.222.0.25 () {58 vars in 1142 bytes} [Sat Oct 22 03:28:24 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:28:25.011815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:25.017230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:25.040743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.041572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.045385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.046780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.048181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.050536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.187106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:25.200323 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2aac7284-f5ce-42b9-8eb3-c0bca186b544 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.599296 Oct 22 03:28:25.202095 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2575/5274] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:24 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:25.212895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:25.213530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:25.229117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.229621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.230061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.230774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.231224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.231699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.359979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:25.373617 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-85f8e7f2-971a-40d4-bd45-d175ecbaff0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.367033 Oct 22 03:28:25.374231 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2700/5275] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:25 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:25.381973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e929a0d5-b3ec-44c5-be7b-3dfe38bdce89 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e929a0d5-b3ec-44c5-be7b-3dfe38bdce89 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Request method failure captured: Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Ms21FVP45uJZymML5Y9SNcLxTNZThy4S0-tf_G_6eLIFOjHWqMeBkVvd7sscfS0pbwNTYpr6OqLR5nniunzOA5KkIA5NEqXH6FOvDI58Ws3OstDMe9dlx3omQqQZOlfh7HCGZNLWihHRLQyE-UKRlcjSZlKGz-kM_6F7n2gX5vk2Y Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8035273d27ca4fd49f244614e742fba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}] Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 188501dc57d247e3b623a51b5ef86bd9 Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: action_args: {} Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi 'testing' Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 22 03:28:25.386810 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 22 03:28:25.392160 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:25.406227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e929a0d5-b3ec-44c5-be7b-3dfe38bdce89 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:25.407618 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e929a0d5-b3ec-44c5-be7b-3dfe38bdce89 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029805 Oct 22 03:28:25.410227 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2701/5276] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:28:25 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:28:25.418121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:25.421436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:25.444477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.445323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.447911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.448964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.453695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.454451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.702754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:25.719752 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d1931096-e424-42fd-977b-d3ec2f1fdb5f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1508 microversion: 2.1 time: 0.513559 Oct 22 03:28:25.719752 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2576/5277] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:25 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1508 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:25.722984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e1cc94f-dde4-4dc1-a130-69189771ed45 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:25.736841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e1cc94f-dde4-4dc1-a130-69189771ed45 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:25.737454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e1cc94f-dde4-4dc1-a130-69189771ed45 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:28:25.755150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.compute.servers [None req-6e1cc94f-dde4-4dc1-a130-69189771ed45 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Flavor 'non_existing_flavor' could not be found {{(pid=120582) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 22 03:28:25.756314 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e1cc94f-dde4-4dc1-a130-69189771ed45 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.036862 Oct 22 03:28:25.756826 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2577/5278] 10.222.0.25 () {58 vars in 1178 bytes} [Sat Oct 22 03:28:25 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:28:25.773606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:25.779904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:25.793265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:28:25.798877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.799364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.799822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.800575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.801040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.801474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.876366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:25.891999 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8bca2173-95d8-4a31-970b-d1b812e317cf tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.479134 Oct 22 03:28:25.894676 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2702/5279] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:25 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:25.927398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:25.928456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:25.938945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.939698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.941831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.942765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:25.945417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:25.947603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:25.962601 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7284979d-aa46-4a86-b481-242b956c7b60 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.193716 Oct 22 03:28:25.963212 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2578/5280] 10.222.0.25 () {58 vars in 1174 bytes} [Sat Oct 22 03:28:25 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:28:25.990730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:25.993588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:26.001568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.002967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.003795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.004969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.005657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.006306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.230372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:26.241335 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03ce0819-4593-4dfa-b73d-e023ef94fce8 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.322474 Oct 22 03:28:26.245964 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2703/5281] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:25 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:26.269945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:26.276028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:26.277306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:28:26.283570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.284808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.285507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.286568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.287246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.287905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.387262 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c016121-aaaf-45a9-b7a5-edd7bfc1f59f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.131957 Oct 22 03:28:26.400843 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2704/5282] 10.222.0.25 () {58 vars in 1184 bytes} [Sat Oct 22 03:28:26 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:28:26.405478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:26.406035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:26.424506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.425013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.425460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.426183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.426647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.427086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.472361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lazy-loading 'flavor' on Instance uuid f6b5a94d-290e-4f62-91e9-2dbd0af49e80 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:26.512437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:26.637928 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e5b7552-0497-4694-8b9c-e37056ea7994 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.242320 Oct 22 03:28:26.639005 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2705/5283] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:28:26 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:28:26.665384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:26.666775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:26.680182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:26.681208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.682060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.683014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.684579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.685365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.686003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.689576 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4b1c45c-48ac-4113-8ac2-6127fb986b4e tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1366 microversion: 2.1 time: 0.712742 Oct 22 03:28:26.690172 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2579/5284] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:25 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1366 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:26.714338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:26.729206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:26.730019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'deleted': False, 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:28:26.741196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.742530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.743018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.744021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.744666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.745155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:26.797445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:28:26.874016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:26.887795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:26.889572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:26.890391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.139078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:27.148344 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-433ef37f-e99d-4f8e-836c-e412dbff8dfa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.507428 Oct 22 03:28:27.148920 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2706/5285] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:26 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:27.170978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:27.174442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:27.192442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.194012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.195420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.197916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.199804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.200899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.500854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:27.523184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f300bfc-773b-4bd7-9f1d-d5d2433fb1bd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1675 microversion: 2.1 time: 0.365659 Oct 22 03:28:27.523800 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2707/5286] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:27 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1675 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:27.531792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:27.532468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:27.538843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.539330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.539767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.540511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.541297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.541800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.562936 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a750bf52-f02c-4668-8a8c-02b4f81600c5 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.860908 Oct 22 03:28:27.580741 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2580/5287] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:28:26 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:27.580741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-966df3db-3dd3-47b6-8e9c-06b88075b64d req-36a135c3-84c0-47c9-bc7a-fddfd74a22c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef4847d-914d-471c-806c-0b1b21dc70c7", "tag": "15b345c7-e9b3-4f14-a7bd-ade48549d5c0"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:27.598377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-966df3db-3dd3-47b6-8e9c-06b88075b64d req-36a135c3-84c0-47c9-bc7a-fddfd74a22c7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.601770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-966df3db-3dd3-47b6-8e9c-06b88075b64d req-36a135c3-84c0-47c9-bc7a-fddfd74a22c7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.602292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-966df3db-3dd3-47b6-8e9c-06b88075b64d req-36a135c3-84c0-47c9-bc7a-fddfd74a22c7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.629241 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-966df3db-3dd3-47b6-8e9c-06b88075b64d req-36a135c3-84c0-47c9-bc7a-fddfd74a22c7 service nova] Creating event network-changed:15b345c7-e9b3-4f14-a7bd-ade48549d5c0 for instance aef4847d-914d-471c-806c-0b1b21dc70c7 on n-h1-862416-2 Oct 22 03:28:27.642177 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-966df3db-3dd3-47b6-8e9c-06b88075b64d req-36a135c3-84c0-47c9-bc7a-fddfd74a22c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076470 Oct 22 03:28:27.645626 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2581/5288] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:27.655186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98e5340a-74eb-4eb5-ae57-2166a6324df0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:27.661839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-98e5340a-74eb-4eb5-ae57-2166a6324df0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:27.663503 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98e5340a-74eb-4eb5-ae57-2166a6324df0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.016544 Oct 22 03:28:27.664935 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2582/5289] 10.222.0.25 () {58 vars in 1178 bytes} [Sat Oct 22 03:28:27 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:28:27.679174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:27.695266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:27.696655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Searching by: {'deleted': False, 'project_id': '8035273d27ca4fd49f244614e742fba8'} {{(pid=120582) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 03:28:27.705984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.706664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.707270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.708302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.708956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.709547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.752469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:27.759111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:27.762181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.multi_cell_list [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120582) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 03:28:27.796314 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4aa83b6-e785-4918-afaa-c5ee496fcf4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1466 microversion: 2.1 time: 0.271313 Oct 22 03:28:27.799404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2708/5290] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:27 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1466 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:27.812580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:27.812580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:27.815022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.815701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.816363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.817930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.818391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.819395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.833937 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a35a119-3bc5-4d2b-a93d-8c315fad240b tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.158848 Oct 22 03:28:27.834647 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2583/5291] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 03:28:27 2022] GET /compute/v2.1/servers => generated 683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:28:27.850298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:27.851089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:27.858011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.858859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.859237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.860607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.860914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.861448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.878190 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] HTTP exception thrown: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Request method failure captured: Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 HTTP/1.1 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Ms21FVP45uJZymML5Y9SNcLxTNZThy4S0-tf_G_6eLIFOjHWqMeBkVvd7sscfS0pbwNTYpr6OqLR5nniunzOA5KkIA5NEqXH6FOvDI58Ws3OstDMe9dlx3omQqQZOlfh7HCGZNLWihHRLQyE-UKRlcjSZlKGz-kM_6F7n2gX5vk2Y Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8035273d27ca4fd49f244614e742fba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}] Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 188501dc57d247e3b623a51b5ef86bd9 Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '999b73de-61c0-44a5-8cba-868742525e88'} Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:27.880040 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Returning 404 to user: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:27.884892 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b88beb1a-afc8-4a4e-b326-c9941123ef98 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 404 len: 111 microversion: 2.1 time: 0.036794 Oct 22 03:28:27.889311 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2584/5292] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:27 2022] DELETE /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:28:27.901242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:27.902031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 332b0090-0378-4b49-922a-f235bde2cc95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:27.909195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.909677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.910175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.910931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:27.911381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:27.911802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:27.950576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 332b0090-0378-4b49-922a-f235bde2cc95] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:28.075035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:28.092818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-78ae226d-40d6-49a7-b1b0-ed3d6da81307 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95" status: 204 len: 0 microversion: 2.1 time: 0.201208 Oct 22 03:28:28.093457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9cf5d70-b2d6-49ea-b6df-7790300a54e3 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1366 microversion: 2.1 time: 0.290770 Oct 22 03:28:28.095985 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2585/5293] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:27 2022] DELETE /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:28:28.105854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:28.106701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:28.110384 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2709/5294] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:27 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:28.115271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.115856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.116767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.117342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.117842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.118504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.150696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:28.177612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:28.178973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:28.186385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.187271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.187785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.188770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.189454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.190092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.246718 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9e091dc-ec44-436e-bc44-39f4ac0c363e tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 204 len: 0 microversion: 2.1 time: 0.146014 Oct 22 03:28:28.250431 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2586/5295] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:28 2022] DELETE /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:28:28.256834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:28.257527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 999b73de-61c0-44a5-8cba-868742525e88] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:28.264744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.265234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.265672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.267090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.267552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.267979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.287759 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] HTTP exception thrown: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Request method failure captured: Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 HTTP/1.1 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Ms21FVP45uJZymML5Y9SNcLxTNZThy4S0-tf_G_6eLIFOjHWqMeBkVvd7sscfS0pbwNTYpr6OqLR5nniunzOA5KkIA5NEqXH6FOvDI58Ws3OstDMe9dlx3omQqQZOlfh7HCGZNLWihHRLQyE-UKRlcjSZlKGz-kM_6F7n2gX5vk2Y Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8035273d27ca4fd49f244614e742fba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}] Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 188501dc57d247e3b623a51b5ef86bd9 Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '999b73de-61c0-44a5-8cba-868742525e88'} Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:28.290542 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Returning 404 to user: Instance 999b73de-61c0-44a5-8cba-868742525e88 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d50ddda9-e5b8-493d-9259-cef356bb0370 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88" status: 404 len: 111 microversion: 2.1 time: 0.040394 Oct 22 03:28:28.298741 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2587/5296] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:28 2022] GET /compute/v2.1/servers/999b73de-61c0-44a5-8cba-868742525e88 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:28:28.302290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:28.302945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 332b0090-0378-4b49-922a-f235bde2cc95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:28.309784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.310348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.310887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.311633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.312082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.312531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.383067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:28.392508 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1ea3ce9a-3ba6-408b-a38c-85c243affc90 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.218570 Oct 22 03:28:28.393173 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2710/5297] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:28 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:28.550404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:28.550925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:28.557468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.557942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.558371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.559066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.559514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.560163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.715355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:28.733283 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ebb66f72-4eb8-4cee-852f-08ae4e681522 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95" status: 200 len: 1521 microversion: 2.1 time: 0.432853 Oct 22 03:28:28.740553 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2588/5298] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:28 2022] GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:28.756428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:28.768253 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f528d57-808d-40ff-9dca-01b85ffb1d15 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1658 microversion: 2.1 time: 0.220015 Oct 22 03:28:28.768950 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2711/5299] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:28 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1658 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:28.793517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:28.794048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:28.803382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.804157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.804900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.805853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.806473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.807292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.833891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:28.834681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:28.847163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.847986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.848678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.849602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.850273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.851839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.888028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.889182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.889965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.890592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lazy-loading 'fault' on Instance uuid eca35a92-b322-4400-a3e2-13831cbd121e {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:28.924430 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ff1befb-a52f-4aed-9e83-fbcba65fc923 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action" status: 202 len: 0 microversion: 2.1 time: 0.134490 Oct 22 03:28:28.926181 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2589/5300] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:28:28 2022] POST /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:28:28.934644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:28.936287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:28.938248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:28.942781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.943346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.943861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.944674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:28.945193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:28.945975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:28.946131 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc4145b4-eb7b-467f-9031-bfd2e8a4077a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 200 len: 1311 microversion: 2.1 time: 0.125085 Oct 22 03:28:28.946615 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2712/5301] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:28 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:29.125026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:29.125719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:29.131785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:29.132594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:29.133243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:29.134168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:29.134849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:29.135482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:29.212526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:29.223106 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46567d88-e016-44c9-bd01-b19311207aa6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1664 microversion: 2.1 time: 0.293014 Oct 22 03:28:29.224001 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2590/5302] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:28 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1664 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:29.293265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:29.303011 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6335dbc-3255-4504-8611-a90f5b464663 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1366 microversion: 2.1 time: 0.182588 Oct 22 03:28:29.304115 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2713/5303] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:29 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:29.425540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:29.426154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:29.467920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:29.469226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:29.470326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:29.481218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:29.481976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:29.483589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:29.759861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:29.760868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 332b0090-0378-4b49-922a-f235bde2cc95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:29.786608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:29.788074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:29.788587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:29.790324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:29.790795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:29.801801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:30.282790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:30.283366 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ed375ed5-2dfd-41f4-a791-3bb31c1034e0 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95" status: 200 len: 1521 microversion: 2.1 time: 0.526835 Oct 22 03:28:30.283988 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2714/5304] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:29 2022] GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:30.290329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-afd7b521-0979-4607-b4e6-2e8eaf4b557e req-203050d7-2143-43c3-8bbb-3125afc405a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca35a92-b322-4400-a3e2-13831cbd121e", "name": "network-vif-deleted", "tag": "96165453-64a3-439e-8e05-eb023cfe75c6"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:30.304925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-afd7b521-0979-4607-b4e6-2e8eaf4b557e req-203050d7-2143-43c3-8bbb-3125afc405a4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:30.305982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-afd7b521-0979-4607-b4e6-2e8eaf4b557e req-203050d7-2143-43c3-8bbb-3125afc405a4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:30.305982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-afd7b521-0979-4607-b4e6-2e8eaf4b557e req-203050d7-2143-43c3-8bbb-3125afc405a4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:30.317218 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-afd7b521-0979-4607-b4e6-2e8eaf4b557e req-203050d7-2143-43c3-8bbb-3125afc405a4 service nova] Creating event network-vif-deleted:96165453-64a3-439e-8e05-eb023cfe75c6 for instance eca35a92-b322-4400-a3e2-13831cbd121e on n-h2-862416-2 Oct 22 03:28:30.322586 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-afd7b521-0979-4607-b4e6-2e8eaf4b557e req-203050d7-2143-43c3-8bbb-3125afc405a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036906 Oct 22 03:28:30.323476 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2715/5305] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:30.328659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:30.329353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:30.335830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:30.336354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:30.336794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:30.337499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:30.338009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:30.338438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:30.343011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:30.343546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:30.352860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f11e3409-b257-4b77-b402-abf174f0a658 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.937601 Oct 22 03:28:30.354183 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2591/5306] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:29 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:30.355732 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e HTTP/1.1 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'eca35a92-b322-4400-a3e2-13831cbd121e'} Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:30.358097 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91d25a45-5532-42ca-aae0-f3d1200c49a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 404 len: 111 microversion: 2.1 time: 0.034872 Oct 22 03:28:30.362457 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2716/5307] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:30 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:28:30.364924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:30.367903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:30.368107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:30.368659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:30.371668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:30.371948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:30.373125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:30.373851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:30.374305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:30.374912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:30.376105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:30.376728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:30.377278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:30.378082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:30.378786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:30.379313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:30.711763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:30.724940 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c8240f7-59cf-43e6-a74b-8cc48a7246ca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1366 microversion: 2.1 time: 0.363525 Oct 22 03:28:30.725794 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2717/5308] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:30 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:30.730515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8e0f9e92-43c5-4b2d-9d06-793bf2a33361 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: .version_select at 0x7f0d18d7ca60>, body: {"keypair": {"name": "tempest-key-1952853586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7jEIlbBNuZ6U4XjJAQokX9KG9YDwDDyK7RIdFGCeEh5/IuVYlvz834xE5tPmW0Mo6u8RAuz6iF26Q7kmmlRKmCOhH1VvCJMJUbfg+v8+0g8fZL24Oj0jB0wIoomc7lsg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:30.754438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-8e0f9e92-43c5-4b2d-9d06-793bf2a33361 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:28:30.776832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-8e0f9e92-43c5-4b2d-9d06-793bf2a33361 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:28:30.783178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:30.793532 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-921d6c73-25d7-46f8-b1f2-3bcaa945ef48 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1664 microversion: 2.1 time: 0.438061 Oct 22 03:28:30.796376 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2592/5309] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:30 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1664 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:30.814059 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8e0f9e92-43c5-4b2d-9d06-793bf2a33361 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.086979 Oct 22 03:28:30.814720 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2718/5310] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:28:30 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:30.827637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bfc999a9-53ee-44a9-a8df-ebe31e2198ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '.version_select at 0x7f0d19af6940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:30.837428 n-d-862416-2 devstack@n-api.service[120582]: WARNING oslo_db.sqlalchemy.utils [None req-bfc999a9-53ee-44a9-a8df-ebe31e2198ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 22 03:28:30.848324 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bfc999a9-53ee-44a9-a8df-ebe31e2198ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.023944 Oct 22 03:28:30.849610 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2593/5311] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:28:30 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:31.075311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cdd80606-2385-456e-9dd5-a2a18601e251 req-b1cd9e50-a4f1-45a6-8938-a48165b7e4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b82fa2-7e05-4441-9ae2-9d7e7eee7514", "name": "network-vif-deleted", "tag": "d1f0ca6c-ac8d-438e-93a6-c0791083cfce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:31.112681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-828531919", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-key-1952853586", "networks": [{"uuid": "1dca30ca-b544-47c6-a616-7a126cc52745"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:31.218181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] validate_networks() for [('1dca30ca-b544-47c6-a616-7a126cc52745', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:28:31.534065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cdd80606-2385-456e-9dd5-a2a18601e251 req-b1cd9e50-a4f1-45a6-8938-a48165b7e4d2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:31.534700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cdd80606-2385-456e-9dd5-a2a18601e251 req-b1cd9e50-a4f1-45a6-8938-a48165b7e4d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:31.535179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cdd80606-2385-456e-9dd5-a2a18601e251 req-b1cd9e50-a4f1-45a6-8938-a48165b7e4d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:31.551771 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cdd80606-2385-456e-9dd5-a2a18601e251 req-b1cd9e50-a4f1-45a6-8938-a48165b7e4d2 service nova] Creating event network-vif-deleted:d1f0ca6c-ac8d-438e-93a6-c0791083cfce for instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 on n-h1-862416-2 Oct 22 03:28:31.558738 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cdd80606-2385-456e-9dd5-a2a18601e251 req-b1cd9e50-a4f1-45a6-8938-a48165b7e4d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.488202 Oct 22 03:28:31.559898 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2719/5312] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:28:31.566689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:31.567493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 332b0090-0378-4b49-922a-f235bde2cc95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:31.574730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:31.575312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:31.575786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:31.576634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:31.577308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:31.578467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:32.421578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '188501dc57d247e3b623a51b5ef86bd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035273d27ca4fd49f244614e742fba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:32.436812 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fedca1b6-a8b8-446c-967d-6d3b36e9e1e9 tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95" status: 200 len: 1521 microversion: 2.1 time: 0.875003 Oct 22 03:28:32.439604 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2720/5313] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:31 2022] GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95 => generated 1521 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:32.457842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:32.458719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:32.478347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:32.481871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:32.485340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:32.486407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:32.487076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:32.487832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:32.523879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:28:32.525437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:28:32.526207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:28:32.528041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:28:32.528771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:28:32.552836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:32.553862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:32.554861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:32.558440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:32.559223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:32.559927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:32.602462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:28:32.609410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:28:32.629137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:28:32.632163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:28:32.675433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:32.731082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f196865f-1892-4aee-b74a-38b409d81358 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623572 Oct 22 03:28:32.735473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2594/5314] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:28:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:28:32.784494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:32.785118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:32.792941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:32.793524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:32.793968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:32.795270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:32.795985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:32.796312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:33.058162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:33.069903 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a188a438-2c50-4258-b3b4-998d95513dc1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.628913 Oct 22 03:28:33.070612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:33.071376 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2721/5315] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:32 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:33.076591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:33.082229 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-815357ed-4efd-4aed-8135-01dbc7e2f265 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1366 microversion: 2.1 time: 0.342906 Oct 22 03:28:33.083760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:33.084369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2595/5316] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:32 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:33.090575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-22abc53a-1656-4178-bbfa-2a28f2678818 req-32c80e97-e289-4f1a-94f6-1af91a6184f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332b0090-0378-4b49-922a-f235bde2cc95", "name": "network-vif-deleted", "tag": "86723a95-0020-4cfe-ac3b-fa865781e720"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:33.119741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:33.121016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:33.123314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:33.124107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:33.124608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:33.125214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:33.126401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-22abc53a-1656-4178-bbfa-2a28f2678818 req-32c80e97-e289-4f1a-94f6-1af91a6184f5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:33.130110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-22abc53a-1656-4178-bbfa-2a28f2678818 req-32c80e97-e289-4f1a-94f6-1af91a6184f5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:33.131390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-22abc53a-1656-4178-bbfa-2a28f2678818 req-32c80e97-e289-4f1a-94f6-1af91a6184f5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:33.164156 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-22abc53a-1656-4178-bbfa-2a28f2678818 req-32c80e97-e289-4f1a-94f6-1af91a6184f5 service nova] Creating event network-vif-deleted:86723a95-0020-4cfe-ac3b-fa865781e720 for instance 332b0090-0378-4b49-922a-f235bde2cc95 on n-h2-862416-2 Oct 22 03:28:33.173044 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-22abc53a-1656-4178-bbfa-2a28f2678818 req-32c80e97-e289-4f1a-94f6-1af91a6184f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085606 Oct 22 03:28:33.173522 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2596/5317] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:33.183832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6143b780-0ec8-4274-86c6-c1d52e6ba051 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:33.186271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6143b780-0ec8-4274-86c6-c1d52e6ba051 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:33.339433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6143b780-0ec8-4274-86c6-c1d52e6ba051 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:33.350363 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6143b780-0ec8-4274-86c6-c1d52e6ba051 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1228 microversion: 2.1 time: 0.172420 Oct 22 03:28:33.369346 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2597/5318] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:33 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1228 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:33.372236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:33.380951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2f17daca-c967-4979-9b6a-9e738f262d6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1664 microversion: 2.1 time: 0.308369 Oct 22 03:28:33.381930 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2722/5319] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:33 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1664 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:33.466822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:33.475248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 332b0090-0378-4b49-922a-f235bde2cc95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:33.483551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:33.485027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:33.485685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:33.486769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:33.487285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:33.487896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:33.502988 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] HTTP exception thrown: Instance 332b0090-0378-4b49-922a-f235bde2cc95 could not be found. Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Request method failure captured: Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95 HTTP/1.1 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Ms21FVP45uJZymML5Y9SNcLxTNZThy4S0-tf_G_6eLIFOjHWqMeBkVvd7sscfS0pbwNTYpr6OqLR5nniunzOA5KkIA5NEqXH6FOvDI58Ws3OstDMe9dlx3omQqQZOlfh7HCGZNLWihHRLQyE-UKRlcjSZlKGz-kM_6F7n2gX5vk2Y Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8035273d27ca4fd49f244614e742fba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}] Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 188501dc57d247e3b623a51b5ef86bd9 Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 332b0090-0378-4b49-922a-f235bde2cc95 could not be found. Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '332b0090-0378-4b49-922a-f235bde2cc95'} Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332b0090-0378-4b49-922a-f235bde2cc95 could not be found. Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332b0090-0378-4b49-922a-f235bde2cc95 could not be found. Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.506294 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:33.511823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.511823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:33.511823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:33.511823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:33.511823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:33.511823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:33.511823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332b0090-0378-4b49-922a-f235bde2cc95 could not be found. Oct 22 03:28:33.511823 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.514703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Returning 404 to user: Instance 332b0090-0378-4b49-922a-f235bde2cc95 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:33.515674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-55964407-f9f5-4981-a627-ccf3002bb9df tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95" status: 404 len: 111 microversion: 2.1 time: 0.053161 Oct 22 03:28:33.519292 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2598/5320] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:33 2022] GET /compute/v2.1/servers/332b0090-0378-4b49-922a-f235bde2cc95 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:28:33.524888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:33.525783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] [instance: 16b82fa2-7e05-4441-9ae2-9d7e7eee7514] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:33.534338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:33.534835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:33.535280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:33.536062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:33.536555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:33.537260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:33.554653 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] HTTP exception thrown: Instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 could not be found. Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Request method failure captured: Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 HTTP/1.1 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Ms21FVP45uJZymML5Y9SNcLxTNZThy4S0-tf_G_6eLIFOjHWqMeBkVvd7sscfS0pbwNTYpr6OqLR5nniunzOA5KkIA5NEqXH6FOvDI58Ws3OstDMe9dlx3omQqQZOlfh7HCGZNLWihHRLQyE-UKRlcjSZlKGz-kM_6F7n2gX5vk2Y Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8035273d27ca4fd49f244614e742fba8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8035273d27ca4fd49f244614e742fba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8035273d27ca4fd49f244614e742fba8"}]}] Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 8035273d27ca4fd49f244614e742fba8 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2117592093 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 188501dc57d247e3b623a51b5ef86bd9 Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ListServersNegativeTestJSON-2117592093-project Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 could not be found. Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '16b82fa2-7e05-4441-9ae2-9d7e7eee7514'} Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 could not be found. Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 could not be found. Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.556863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:33.561034 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.561034 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:33.561034 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:33.561034 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:33.561034 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:33.561034 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:33.561034 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 could not be found. Oct 22 03:28:33.561034 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:33.562806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] Returning 404 to user: Instance 16b82fa2-7e05-4441-9ae2-9d7e7eee7514 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:33.563947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b21ad7f6-2267-4776-bf83-39a1350f123f tempest-ListServersNegativeTestJSON-2117592093 tempest-ListServersNegativeTestJSON-2117592093-project] 10.222.0.25 "GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514" status: 404 len: 111 microversion: 2.1 time: 0.043023 Oct 22 03:28:33.564870 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2723/5321] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:33 2022] GET /compute/v2.1/servers/16b82fa2-7e05-4441-9ae2-9d7e7eee7514 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:28:34.099739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:34.101589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:34.112931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:34.113626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:34.125868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.126635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.127264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.128156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.128939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.129594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.132850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.134194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.134823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.135829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.136379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.136997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.191245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:34.354696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:34.367410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2b81531-681e-4bc9-acf4-36d201e757a4 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.272227 Oct 22 03:28:34.371627 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2599/5322] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:34 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:34.393544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:34.394028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:34.412908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.424925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.425607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.426514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.427155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.427738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.449994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:34.535950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:34.548607 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15574515-7537-408b-ae78-75edec104820 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1280 microversion: 2.1 time: 0.159916 Oct 22 03:28:34.549200 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2600/5323] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:34 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:34.564731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:34.565342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:34.572002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.572519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.572955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.573657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.574108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.574530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.722252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:34.761325 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69e5e29d-87af-474a-a14c-5370ac11a504 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1366 microversion: 2.1 time: 0.651326 Oct 22 03:28:34.764963 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2724/5324] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:34 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1366 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:34.793971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-41adafdb-cd0f-4fee-8e22-f9594d461993 req-0e9aadef-99bd-411f-8d1b-dd09e4361f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef4847d-914d-471c-806c-0b1b21dc70c7", "name": "network-vif-plugged", "status": "completed", "tag": "15b345c7-e9b3-4f14-a7bd-ade48549d5c0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:34.823348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-41adafdb-cd0f-4fee-8e22-f9594d461993 req-0e9aadef-99bd-411f-8d1b-dd09e4361f86 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:34.824134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-41adafdb-cd0f-4fee-8e22-f9594d461993 req-0e9aadef-99bd-411f-8d1b-dd09e4361f86 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:34.824912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-41adafdb-cd0f-4fee-8e22-f9594d461993 req-0e9aadef-99bd-411f-8d1b-dd09e4361f86 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:34.863694 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-41adafdb-cd0f-4fee-8e22-f9594d461993 req-0e9aadef-99bd-411f-8d1b-dd09e4361f86 service nova] Creating event network-vif-plugged:15b345c7-e9b3-4f14-a7bd-ade48549d5c0 for instance aef4847d-914d-471c-806c-0b1b21dc70c7 on n-h1-862416-2 Oct 22 03:28:34.869779 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-41adafdb-cd0f-4fee-8e22-f9594d461993 req-0e9aadef-99bd-411f-8d1b-dd09e4361f86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083908 Oct 22 03:28:34.874464 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2725/5325] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:35.396096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:35.397781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:35.405124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:35.406036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:35.406719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:35.407813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:35.408537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:35.409204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:35.620633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:35.643889 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c819a15-74ee-4a71-93f0-763bca8b36e3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 1.093457 Oct 22 03:28:35.644567 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2601/5326] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:34 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:35.659062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:35.660118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:35.681249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:35.682111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:35.689955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:35.691304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:35.692032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:35.693588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:35.698667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:35.718179 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8359d901-af84-486e-a72f-0c7ae529d8b0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.326186 Oct 22 03:28:35.738752 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2726/5327] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:35 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:35.749539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:35.750313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:35.759650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:35.777674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:35.778338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:35.785656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:35.786956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:35.787402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:35.973134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:35.999183 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3451897-6371-4b91-a0f0-45a78d3f8e9c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1286 microversion: 2.1 time: 0.337393 Oct 22 03:28:36.000293 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2602/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:35 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1286 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:36.015637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:36.016545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:36.024662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:36.025863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:36.026391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:36.027269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:36.027964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:36.028723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:36.338268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:36.483746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:36.494690 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-52b8e3e9-f68b-4aa9-8e5b-720c13730a6a tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1366 microversion: 2.1 time: 0.492988 Oct 22 03:28:36.495632 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2603/5329] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:36 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:36.518359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:36.529530 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74ff2be3-76ea-48f2-89c6-be7f82cb50f3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1667 microversion: 2.1 time: 0.787201 Oct 22 03:28:36.530342 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2727/5330] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:35 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1667 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:36.557833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:36.558355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:36.571388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:36.572525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:36.573200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:36.576516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:36.578052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:36.578886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:36.620447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:36.637736 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.compute.api [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Working on deleting snapshot 4e510001-87d7-455f-ad33-ec2bf3f894b2 from shelved instance... Oct 22 03:28:36.746265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:36.747021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:36.758883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:36.759662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:36.761470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:36.764399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:36.765221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:36.766058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:38.015276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:38.037420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c70e1d9-f489-4d3d-9cae-eceb8ac06f23 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 1.295594 Oct 22 03:28:38.039532 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2728/5331] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:36 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:38.054298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:38.055346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:38.088393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:38.088894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:38.089329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:38.103293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:38.104024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:38.104504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:38.433493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Doing local delete in cell 8445e6fb-6264-4dcd-8d49-6689c2f27048(cell1) {{(pid=120582) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 22 03:28:38.437729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:38.439051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:38.441901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:38.443786 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.compute.api [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 22 03:28:38.458159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] deallocate_for_instance() {{(pid=120582) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 22 03:28:38.805561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:38.849234 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1f91ec87-943a-4d4a-9c38-b2aeb0f5faaf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1328 microversion: 2.1 time: 0.793331 Oct 22 03:28:38.856303 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2729/5332] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:38 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1328 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:38.868481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:38.869322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:38.873073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:38.878927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:38.879840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:38.881252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:38.882208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:38.882857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:38.883287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:39.584449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:39.617748 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-abfeafce-ad49-4126-aba6-97212d3460df tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1556 microversion: 2.1 time: 0.747013 Oct 22 03:28:39.628244 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2730/5333] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:38 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1556 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:39.637777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Updating instance_info_cache with network_info: [] {{(pid=120582) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 22 03:28:39.645874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:39.646794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:39.663051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:39.663769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:39.664419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:39.666030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:39.666774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:39.667587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.022592 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35b73063-e625-4eb0-8397-0c0e5c14bfa4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "DELETE /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 204 len: 0 microversion: 2.1 time: 3.468557 Oct 22 03:28:40.023734 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2604/5334] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:36 2022] DELETE /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 0 bytes in 3470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:28:40.039646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8a980bee-3a89-4b2d-9eaf-e7d3d4d861ba req-d233adf0-a3b6-4bf6-a117-393303b09f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d780379d-b319-49cb-a429-06956dbf0ba4", "tag": "9cf36e12-94b8-478f-948c-97fd873d95d4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:40.073100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8a980bee-3a89-4b2d-9eaf-e7d3d4d861ba req-d233adf0-a3b6-4bf6-a117-393303b09f26 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.075290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8a980bee-3a89-4b2d-9eaf-e7d3d4d861ba req-d233adf0-a3b6-4bf6-a117-393303b09f26 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.078206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8a980bee-3a89-4b2d-9eaf-e7d3d4d861ba req-d233adf0-a3b6-4bf6-a117-393303b09f26 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.098329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:40.111934 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8a980bee-3a89-4b2d-9eaf-e7d3d4d861ba req-d233adf0-a3b6-4bf6-a117-393303b09f26 service nova] Creating event network-changed:9cf36e12-94b8-478f-948c-97fd873d95d4 for instance d780379d-b319-49cb-a429-06956dbf0ba4 on n-h1-862416-2 Oct 22 03:28:40.115688 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f6e186a-58a5-43dd-9b42-3a19a0ac2470 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.488087 Oct 22 03:28:40.119264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2731/5335] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:39 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:40.125863 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8a980bee-3a89-4b2d-9eaf-e7d3d4d861ba req-d233adf0-a3b6-4bf6-a117-393303b09f26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098412 Oct 22 03:28:40.126805 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2605/5336] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:40.129391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:40.130251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:40.144991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:40.145797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:40.150182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.154224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.155991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.156200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.156730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.157238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.157957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.158470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.158910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.161478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.162435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.165050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.400197 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-311dd79c-bf36-46e3-8fb8-8ce30403bbc2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278791 Oct 22 03:28:40.400836 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2732/5337] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:28:40 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:40.408609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:40.408609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 297044ba-6a61-4fd3-bdeb-2a16517887ed] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:40.433213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.434080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.434755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.436484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.437221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.437874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.489104 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] HTTP exception thrown: Instance 297044ba-6a61-4fd3-bdeb-2a16517887ed could not be found. Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Request method failure captured: Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed HTTP/1.1 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Fh1zrAV3t3KXx01cQXblz7hWmYKt-76cC8cmSebtHYnQKQ6-07LBdAlhscB-G6tA0KBEWmhguTVHXtHC-mZ051ajv54b_mHfqK5USw7BTbJtryaehovUtJ4vhB5F5cy2WfuByiSOyHd4j6nJIMUTEwGhnCO-2AV7v1DgpBUt1eVag Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 76599914af404f118b425b41a2432291 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76599914af404f118b425b41a2432291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76599914af404f118b425b41a2432291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}] Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 76599914af404f118b425b41a2432291 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f89d04db39be473097b885f7465115a2 Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 297044ba-6a61-4fd3-bdeb-2a16517887ed could not be found. Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '297044ba-6a61-4fd3-bdeb-2a16517887ed'} Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297044ba-6a61-4fd3-bdeb-2a16517887ed could not be found. Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297044ba-6a61-4fd3-bdeb-2a16517887ed could not be found. Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:40.491193 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:40.495342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:40.495342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:40.495342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:40.495342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:40.495342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:40.495342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297044ba-6a61-4fd3-bdeb-2a16517887ed could not be found. Oct 22 03:28:40.495342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:40.500763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Returning 404 to user: Instance 297044ba-6a61-4fd3-bdeb-2a16517887ed could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:40.501871 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b5c67fd-d44b-47fe-a97b-931635bda7e0 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed" status: 404 len: 111 microversion: 2.1 time: 0.100036 Oct 22 03:28:40.504819 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2733/5338] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:40 2022] GET /compute/v2.1/servers/297044ba-6a61-4fd3-bdeb-2a16517887ed => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:28:40.516664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:40.517578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:40.532709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.537217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.537920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.538891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.540679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.541124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.610352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:40.798581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:40.845342 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2ca8f28-8c22-4f39-8a58-55a22d6585d6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 204 len: 0 microversion: 2.1 time: 0.335201 Oct 22 03:28:40.845981 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2734/5339] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:40 2022] DELETE /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:28:40.854289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:40.855804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:40.861599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:40.878951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.879626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.880245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.880490 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-556b129a-3d9f-45f4-a1d7-61dd30f2a14c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1328 microversion: 2.1 time: 0.746811 Oct 22 03:28:40.881331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:40.881957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:40.884892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:40.906079 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2606/5340] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:40 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1328 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:41.145595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:41.146244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:41.170760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:41.171569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:41.172030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:41.172808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:41.173273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:41.173716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:41.217414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:41.233068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8667c6b-9c51-425c-80e3-abc1ba46108c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1466 microversion: 2.1 time: 0.380519 Oct 22 03:28:41.233858 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2735/5341] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:40 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1466 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:41.558124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:41.576273 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f4f5c435-aad2-4d4a-8eb1-368d932f8ce0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.435683 Oct 22 03:28:41.589456 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2607/5342] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:41 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:41.913740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:41.915063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:41.938920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:41.940096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:41.976237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:41.977044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:41.977558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:41.978008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:42.193725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-50a26744-a4bd-469e-b98a-2e2613ba9144 req-4c433b1f-6265-4909-aacb-c40eeff4b084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297044ba-6a61-4fd3-bdeb-2a16517887ed", "name": "network-vif-deleted", "tag": "59ad910d-6769-4aa5-9018-8f06d14ba036"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:42.224267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-50a26744-a4bd-469e-b98a-2e2613ba9144 req-4c433b1f-6265-4909-aacb-c40eeff4b084 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:42.225147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-50a26744-a4bd-469e-b98a-2e2613ba9144 req-4c433b1f-6265-4909-aacb-c40eeff4b084 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:42.227540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-50a26744-a4bd-469e-b98a-2e2613ba9144 req-4c433b1f-6265-4909-aacb-c40eeff4b084 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:42.251292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.compute.server_external_events [req-50a26744-a4bd-469e-b98a-2e2613ba9144 req-4c433b1f-6265-4909-aacb-c40eeff4b084 service nova] Unable to find a host for instance 297044ba-6a61-4fd3-bdeb-2a16517887ed. Dropping event network-vif-deleted {{(pid=120582) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 03:28:42.252550 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-50a26744-a4bd-469e-b98a-2e2613ba9144 req-4c433b1f-6265-4909-aacb-c40eeff4b084 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.067773 Oct 22 03:28:42.253723 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2608/5343] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (3 switches on core 0) Oct 22 03:28:42.271921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:42.272888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:42.281465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:42.282353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:42.283350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:42.284271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:42.285027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:42.285620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:42.589163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:42.701797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:42.744098 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5df92f6-0601-47e5-b18e-68da7437ec6d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1328 microversion: 2.1 time: 0.831855 Oct 22 03:28:42.744835 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2736/5344] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:41 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1328 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:42.799379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:42.800030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:42.820334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:42.828690 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62c5e1cd-7106-4b58-8281-dddb8c8ec59a tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1466 microversion: 2.1 time: 0.568856 Oct 22 03:28:42.842360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:42.843174 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2609/5345] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:42 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1466 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:42.851371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:42.861451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:42.862402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:42.864080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:42.866344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:43.601275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:43.627355 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba3757e9-153a-4f58-9cec-a09f8ac4ac56 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.851949 Oct 22 03:28:43.643455 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2737/5346] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:42 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:43.772476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:43.773791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:43.776871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:43.789242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:43.789733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:43.790167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:43.790876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:43.791328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:43.791754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:43.856220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:43.856959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:43.865928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:43.866422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:43.869960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:43.876196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:43.876913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:43.877572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:44.197318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:44.215292 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a97140d9-2768-48e7-8861-56fa8ad473e4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1466 microversion: 2.1 time: 0.363006 Oct 22 03:28:44.216384 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2738/5347] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:43 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1466 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:44.332474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2843eba2-2826-4de6-a9b4-1e161716030d req-996eea9b-6a74-499c-a527-e9eb0c4b189e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef4847d-914d-471c-806c-0b1b21dc70c7", "tag": "15b345c7-e9b3-4f14-a7bd-ade48549d5c0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:44.350516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2843eba2-2826-4de6-a9b4-1e161716030d req-996eea9b-6a74-499c-a527-e9eb0c4b189e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:44.352430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2843eba2-2826-4de6-a9b4-1e161716030d req-996eea9b-6a74-499c-a527-e9eb0c4b189e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:44.354419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2843eba2-2826-4de6-a9b4-1e161716030d req-996eea9b-6a74-499c-a527-e9eb0c4b189e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:44.380200 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2843eba2-2826-4de6-a9b4-1e161716030d req-996eea9b-6a74-499c-a527-e9eb0c4b189e service nova] Creating event network-changed:15b345c7-e9b3-4f14-a7bd-ade48549d5c0 for instance aef4847d-914d-471c-806c-0b1b21dc70c7 on n-h1-862416-2 Oct 22 03:28:44.394848 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2843eba2-2826-4de6-a9b4-1e161716030d req-996eea9b-6a74-499c-a527-e9eb0c4b189e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066317 Oct 22 03:28:44.397402 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2739/5348] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:28:44.443919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:44.480940 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f399cc4-4492-4ac0-ad3d-259170fb1b49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1328 microversion: 2.1 time: 0.712409 Oct 22 03:28:44.500395 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2610/5349] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:43 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1328 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:44.650618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:44.651410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:44.660164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:44.667577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:44.668409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:44.669618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:44.670298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:44.671330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:44.939367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:44.949778 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5197ffe1-dbb8-4204-bd76-afae46608b89 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.303135 Oct 22 03:28:44.951515 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2740/5350] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:44 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:45.189399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a161b90b-b8aa-479c-861b-be191c636bf4 req-4beb0140-438e-4dc1-a00a-e0a25cef52eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d780379d-b319-49cb-a429-06956dbf0ba4", "name": "network-vif-plugged", "status": "completed", "tag": "9cf36e12-94b8-478f-948c-97fd873d95d4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:45.221395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a161b90b-b8aa-479c-861b-be191c636bf4 req-4beb0140-438e-4dc1-a00a-e0a25cef52eb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.230805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a161b90b-b8aa-479c-861b-be191c636bf4 req-4beb0140-438e-4dc1-a00a-e0a25cef52eb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.232387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a161b90b-b8aa-479c-861b-be191c636bf4 req-4beb0140-438e-4dc1-a00a-e0a25cef52eb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.247812 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a161b90b-b8aa-479c-861b-be191c636bf4 req-4beb0140-438e-4dc1-a00a-e0a25cef52eb service nova] Creating event network-vif-plugged:9cf36e12-94b8-478f-948c-97fd873d95d4 for instance d780379d-b319-49cb-a429-06956dbf0ba4 on n-h1-862416-2 Oct 22 03:28:45.261702 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a161b90b-b8aa-479c-861b-be191c636bf4 req-4beb0140-438e-4dc1-a00a-e0a25cef52eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077523 Oct 22 03:28:45.266266 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2611/5351] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:45.275826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:45.280042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:45.304312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.307757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.315294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.318052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.318898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.319861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.582271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Calling method '.version_select at 0x7f0d18d7da60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:45.584200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.584728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.585174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.626215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.628428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.628954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.649494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.650320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.650995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.658059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:45.660885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a2f53cc-b844-4bed-b79d-1a676bfed289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1200411399-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.459640 Oct 22 03:28:45.662091 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2741/5352] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:28:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:28:45.673652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:45.674729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:45.683865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.684925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.685718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.688248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.688916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.690249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.780878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:45.785317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:45.799283 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4549f50-7f66-4375-8b88-414f2bd87413 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1466 microversion: 2.1 time: 0.531477 Oct 22 03:28:45.800827 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2612/5353] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:45 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1466 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:45.892154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d27c746c-ad07-4b5a-8517-5ca66725bd12 req-17a41837-38ad-41e8-af2d-6c283d1747ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f2223f-8133-453b-bc3a-20cea20c541b", "name": "network-vif-deleted", "tag": "9724dee3-4baf-4aad-b861-fa173e22dc22"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:45.916486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d27c746c-ad07-4b5a-8517-5ca66725bd12 req-17a41837-38ad-41e8-af2d-6c283d1747ec service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:45.917429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d27c746c-ad07-4b5a-8517-5ca66725bd12 req-17a41837-38ad-41e8-af2d-6c283d1747ec service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:45.918720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d27c746c-ad07-4b5a-8517-5ca66725bd12 req-17a41837-38ad-41e8-af2d-6c283d1747ec service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:45.954455 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d27c746c-ad07-4b5a-8517-5ca66725bd12 req-17a41837-38ad-41e8-af2d-6c283d1747ec service nova] Creating event network-vif-deleted:9724dee3-4baf-4aad-b861-fa173e22dc22 for instance c2f2223f-8133-453b-bc3a-20cea20c541b on n-h2-862416-2 Oct 22 03:28:45.968909 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d27c746c-ad07-4b5a-8517-5ca66725bd12 req-17a41837-38ad-41e8-af2d-6c283d1747ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083614 Oct 22 03:28:45.972335 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2613/5354] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 22 03:28:45.998590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:46.001332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:46.025531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:46.026481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:46.027603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:46.041953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:46.051195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:46.052060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:46.662295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:46.678686 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ecbdf5e-6a62-4168-9d2e-ddf15769f353 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.702895 Oct 22 03:28:46.696444 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2614/5355] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:45 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:46.719175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:46.739194 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d7b1d8fe-43ce-4b75-a321-4469ff039299 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1328 microversion: 2.1 time: 1.075485 Oct 22 03:28:46.741966 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2742/5356] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:45 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1328 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:46.823415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:46.824088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:46.852629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:46.853141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:46.853853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:46.869479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:46.869993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:46.870445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:46.990162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:46.991232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:46.992784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:46.993746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lazy-loading 'fault' on Instance uuid c2f2223f-8133-453b-bc3a-20cea20c541b {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:47.111780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:47.123172 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-358732ee-dc5e-4a5f-a72c-e11fabe043fb tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 200 len: 1304 microversion: 2.1 time: 0.302867 Oct 22 03:28:47.128274 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2615/5357] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:46 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 1304 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:47.706447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:47.707281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:47.720985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:47.723923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:47.724730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:47.745431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:47.746252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:47.746920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:47.767713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:47.768939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:47.792166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:47.793656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:47.797423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:47.799294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:47.799801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:47.803655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.351353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:48.354941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:48.367153 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-80694fba-d607-4efd-b023-5d6e271bd93f tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.664826 Oct 22 03:28:48.371499 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cfcf7555-6065-4908-9fd9-8b3fe3468df6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1509 microversion: 2.1 time: 0.608074 Oct 22 03:28:48.372899 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2743/5358] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:47 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:48.392505 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2616/5359] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:47 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1509 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:48.396641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:48.398107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: c2f2223f-8133-453b-bc3a-20cea20c541b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:48.404865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:48.407273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:48.415641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.419670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.420175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.420319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.420725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.420834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.421444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.421554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.421904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.422161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.422334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.422720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.460878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] HTTP exception thrown: Instance c2f2223f-8133-453b-bc3a-20cea20c541b could not be found. Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Request method failure captured: Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b HTTP/1.1 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Fh1zrAV3t3KXx01cQXblz7hWmYKt-76cC8cmSebtHYnQKQ6-07LBdAlhscB-G6tA0KBEWmhguTVHXtHC-mZ051ajv54b_mHfqK5USw7BTbJtryaehovUtJ4vhB5F5cy2WfuByiSOyHd4j6nJIMUTEwGhnCO-2AV7v1DgpBUt1eVag Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 76599914af404f118b425b41a2432291 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76599914af404f118b425b41a2432291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76599914af404f118b425b41a2432291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}] Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 76599914af404f118b425b41a2432291 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f89d04db39be473097b885f7465115a2 Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance c2f2223f-8133-453b-bc3a-20cea20c541b could not be found. Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'c2f2223f-8133-453b-bc3a-20cea20c541b'} Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f2223f-8133-453b-bc3a-20cea20c541b could not be found. Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f2223f-8133-453b-bc3a-20cea20c541b could not be found. Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:48.466921 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f2223f-8133-453b-bc3a-20cea20c541b could not be found. Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Returning 404 to user: Instance c2f2223f-8133-453b-bc3a-20cea20c541b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:48.471496 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b521c8b-1d6f-40ba-af15-1ce5592bd3db tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b" status: 404 len: 111 microversion: 2.1 time: 0.096982 Oct 22 03:28:48.483175 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2744/5360] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:48 2022] GET /compute/v2.1/servers/c2f2223f-8133-453b-bc3a-20cea20c541b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:28:48.491037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:48.491661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:48.504337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.504913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.507215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.508175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.510237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.510764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.560354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:48.699451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f1e0a2e2-4439-4053-a4bb-bc82c8cbe73c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 204 len: 0 microversion: 2.1 time: 0.209641 Oct 22 03:28:48.706295 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2745/5361] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:48 2022] DELETE /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:28:48.714081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:48.715321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:48.725974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:48.738769 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-acf0dc20-70cf-43d8-a237-d388486672f0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1509 microversion: 2.1 time: 0.341043 Oct 22 03:28:48.742697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.744627 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2617/5362] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:48 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:48.745012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.745577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.747945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.749219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.750525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.764117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:48.764818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:48.772179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.772782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.779084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.779084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.779364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.779560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.816825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:48.928118 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-339d00bc-5111-417f-baeb-87ae5d7f2246 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 204 len: 0 microversion: 2.1 time: 0.167681 Oct 22 03:28:48.929629 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2618/5363] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:48 2022] DELETE /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:28:48.942237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:48.942972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:48.950410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.951174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.951353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:48.952157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:48.952654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:48.953080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:49.029729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:49.046066 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-393fad40-1103-4b37-bfef-dac9df2b01ca tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1508 microversion: 2.1 time: 0.337862 Oct 22 03:28:49.048660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2746/5364] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:48 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:49.344679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:49.352638 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af49d423-d352-4630-a9f1-fe010859d81a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1515 microversion: 2.1 time: 0.415392 Oct 22 03:28:49.364446 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2619/5365] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:48 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1515 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:49.398072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:49.398950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:49.409233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:49.411384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:49.413176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:49.414111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:49.415988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:49.417196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:49.970468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:49.984939 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86f5ca2a-6f70-4edc-9135-5e21d04f2c33 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.591341 Oct 22 03:28:49.985774 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2747/5366] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:49 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:50.073668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:50.075022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:50.086927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:50.092967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:50.093633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:50.094537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:50.095139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:50.096716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:50.379982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:50.380618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:50.392868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:50.393383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:50.393808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:50.394510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:50.394964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:50.395390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:50.428091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:50.464875 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e97636a4-83a4-4375-bff7-495479a5ad6e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1508 microversion: 2.1 time: 0.386470 Oct 22 03:28:50.482414 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2620/5367] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:50 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1508 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:50.807032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:50.816454 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-658810bd-c6cb-43b0-8621-7621a3111b79 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1515 microversion: 2.1 time: 0.440252 Oct 22 03:28:50.829486 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2748/5368] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:50 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1515 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:51.014274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:51.015231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:51.027769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:51.029960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:51.030875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:51.034574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:51.036784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:51.038231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:51.505993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:51.506806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:51.518248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:51.518753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:51.519202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:51.519921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:51.520415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:51.520852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:51.583103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:51.595141 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28cb44d1-ae4f-42b2-b9b5-53f7ed39ed4b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.586039 Oct 22 03:28:51.595744 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2621/5369] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:51 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:51.847901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:51.848969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:51.863747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:51.864658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:51.865323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:51.867720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:51.868831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:51.869553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:51.999563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:52.013648 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3f69164b-994c-4105-b0ee-54cbe8f21239 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1473 microversion: 2.1 time: 0.169102 Oct 22 03:28:52.034180 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2622/5370] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:51 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1473 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:52.088797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f65d97b4-91c0-4b45-90ae-dbb270a92637 req-6054c4d0-f145-42a4-b487-c43051335907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d780379d-b319-49cb-a429-06956dbf0ba4", "name": "network-vif-deleted", "tag": "9cf36e12-94b8-478f-948c-97fd873d95d4"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:52.116666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f65d97b4-91c0-4b45-90ae-dbb270a92637 req-6054c4d0-f145-42a4-b487-c43051335907 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:52.117025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f65d97b4-91c0-4b45-90ae-dbb270a92637 req-6054c4d0-f145-42a4-b487-c43051335907 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:52.121170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f65d97b4-91c0-4b45-90ae-dbb270a92637 req-6054c4d0-f145-42a4-b487-c43051335907 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:52.167481 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f65d97b4-91c0-4b45-90ae-dbb270a92637 req-6054c4d0-f145-42a4-b487-c43051335907 service nova] Creating event network-vif-deleted:9cf36e12-94b8-478f-948c-97fd873d95d4 for instance d780379d-b319-49cb-a429-06956dbf0ba4 on n-h1-862416-2 Oct 22 03:28:52.173798 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f65d97b4-91c0-4b45-90ae-dbb270a92637 req-6054c4d0-f145-42a4-b487-c43051335907 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088630 Oct 22 03:28:52.187336 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2623/5371] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:28:52.611666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:52.621925 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dee2720c-1c44-4278-8fc9-0184e53e65d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1508 microversion: 2.1 time: 1.119842 Oct 22 03:28:52.624165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:52.624913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:52.627633 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2749/5372] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:51 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1508 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:52.637224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:52.637647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:52.638626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:52.639338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:52.639796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:52.640237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:52.841194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:52.853508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab9e2bc4-cce7-4d74-9b01-a419fd6c589a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.236653 Oct 22 03:28:52.871667 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2624/5373] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:52 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:53.047975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:53.049225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:53.067383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:53.068019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:53.069626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:53.071823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:53.072637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:53.074349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:53.156520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:53.157325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:53.157949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:53.158627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lazy-loading 'fault' on Instance uuid d780379d-b319-49cb-a429-06956dbf0ba4 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:53.283778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:53.297628 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5fc6a918-6ff6-440c-ac6b-942821d48d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 200 len: 1318 microversion: 2.1 time: 0.259237 Oct 22 03:28:53.299015 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2750/5374] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:53 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:53.652645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:53.653854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:53.680766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:53.687700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:53.688328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:53.692071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:53.695521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:53.704468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:53.817012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:53.817714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:53.818314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:53.819220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lazy-loading 'fault' on Instance uuid 6f126728-86e7-4959-a830-cb548f164e0c {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:53.879519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:53.880320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:53.890203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:53.890938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:53.891580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:53.892495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:53.893121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:53.893722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:53.984084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:53.993779 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1e2f526-00bb-4889-b846-968fc089c2d4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 200 len: 1304 microversion: 2.1 time: 0.346572 Oct 22 03:28:54.009855 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2625/5375] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:53 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 1304 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:54.238262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-04336173-b8a5-463d-9b6c-c2567caa6009 req-791388f7-db45-40ec-9f8a-8b48d13f1235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f126728-86e7-4959-a830-cb548f164e0c", "name": "network-vif-deleted", "tag": "fe0e1ee2-4811-473e-9504-0bc33fad5b32"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:54.266423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-04336173-b8a5-463d-9b6c-c2567caa6009 req-791388f7-db45-40ec-9f8a-8b48d13f1235 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:54.269577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-04336173-b8a5-463d-9b6c-c2567caa6009 req-791388f7-db45-40ec-9f8a-8b48d13f1235 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:54.273131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-04336173-b8a5-463d-9b6c-c2567caa6009 req-791388f7-db45-40ec-9f8a-8b48d13f1235 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:54.337779 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-04336173-b8a5-463d-9b6c-c2567caa6009 req-791388f7-db45-40ec-9f8a-8b48d13f1235 service nova] Creating event network-vif-deleted:fe0e1ee2-4811-473e-9504-0bc33fad5b32 for instance 6f126728-86e7-4959-a830-cb548f164e0c on n-h2-862416-2 Oct 22 03:28:54.368265 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-04336173-b8a5-463d-9b6c-c2567caa6009 req-791388f7-db45-40ec-9f8a-8b48d13f1235 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134945 Oct 22 03:28:54.369481 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2626/5376] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:28:54.390184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:54.394618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:54.408983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:54.409441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:54.409887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:54.410611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:54.414021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:54.414542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:54.458403 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 HTTP/1.1 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd780379d-b319-49cb-a429-06956dbf0ba4'} Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:54.460087 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:54.466833 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:54.466833 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:54.466833 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:54.466833 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:54.466833 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:54.466833 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:28:54.466833 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:54.466833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:54.467580 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6275f524-7e11-464b-a09b-76d2784f51fd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 404 len: 111 microversion: 2.1 time: 0.096324 Oct 22 03:28:54.468971 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2627/5377] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:54 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:28:54.485047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:54.490014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d79560bd-d05b-48c9-8fd7-4433ecb24a16 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '.version_select at 0x7f0d1a3c8d30>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:54.498283 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9fd9e17-932e-44fc-96cb-212ba1a66ebe tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1734 microversion: 2.1 time: 0.622957 Oct 22 03:28:54.500517 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2751/5378] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:53 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1734 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:54.547453 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d79560bd-d05b-48c9-8fd7-4433ecb24a16 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-1952853586" status: 202 len: 0 microversion: 2.1 time: 0.069040 Oct 22 03:28:54.548950 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2628/5379] 10.222.0.25 () {58 vars in 1209 bytes} [Sat Oct 22 03:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1952853586 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:28:54.713211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1789678823", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "1dca30ca-b544-47c6-a616-7a126cc52745"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:54.793202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] validate_networks() for [('1dca30ca-b544-47c6-a616-7a126cc52745', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:28:55.019461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:55.020763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 6f126728-86e7-4959-a830-cb548f164e0c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:55.032014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.033141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.037670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.039899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.041296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.042450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.071543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] HTTP exception thrown: Instance 6f126728-86e7-4959-a830-cb548f164e0c could not be found. Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Request method failure captured: Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c HTTP/1.1 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Fh1zrAV3t3KXx01cQXblz7hWmYKt-76cC8cmSebtHYnQKQ6-07LBdAlhscB-G6tA0KBEWmhguTVHXtHC-mZ051ajv54b_mHfqK5USw7BTbJtryaehovUtJ4vhB5F5cy2WfuByiSOyHd4j6nJIMUTEwGhnCO-2AV7v1DgpBUt1eVag Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 76599914af404f118b425b41a2432291 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76599914af404f118b425b41a2432291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76599914af404f118b425b41a2432291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}] Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 76599914af404f118b425b41a2432291 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f89d04db39be473097b885f7465115a2 Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 6f126728-86e7-4959-a830-cb548f164e0c could not be found. Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '6f126728-86e7-4959-a830-cb548f164e0c'} Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f126728-86e7-4959-a830-cb548f164e0c could not be found. Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f126728-86e7-4959-a830-cb548f164e0c could not be found. Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:55.080748 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:55.085811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:55.085811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:55.085811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:55.085811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:55.085811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:55.085811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f126728-86e7-4959-a830-cb548f164e0c could not be found. Oct 22 03:28:55.085811 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:28:55.087078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Returning 404 to user: Instance 6f126728-86e7-4959-a830-cb548f164e0c could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:55.089358 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4f9d670-0542-422d-9972-3853e88846cd tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c" status: 404 len: 111 microversion: 2.1 time: 0.073742 Oct 22 03:28:55.092102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2629/5380] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:55 2022] GET /compute/v2.1/servers/6f126728-86e7-4959-a830-cb548f164e0c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:28:55.104375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:55.105076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:55.112912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.113602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.114227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.115118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.115758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.116385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.146048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:28:55.197519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:55.298825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:55.317832 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e3900b2b-8060-421a-b3f3-a654e5f5c11d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 204 len: 0 microversion: 2.1 time: 0.218529 Oct 22 03:28:55.318732 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2630/5381] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:28:55 2022] DELETE /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:28:55.334366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:55.335475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:55.350821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.351321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.351743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.352865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.355602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.356309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.715503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:28:55.718416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:28:55.719277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:28:55.719932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:28:55.720631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:28:55.737641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.738638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.739505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.740833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.747613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.749727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.785548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:28:55.802902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:28:55.830461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:28:55.833465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:28:55.929388 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9b6cfea-5d21-4064-a5e6-8be3a64d4a23 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220062 Oct 22 03:28:55.939355 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2752/5382] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:28:55.945785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:55.946227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:55.954189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.955835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.956699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:55.957605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:55.959522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:55.960144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:56.229199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:56.241776 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd9e4ddb-f3c9-4ecb-ae9d-649c90c89970 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1714 microversion: 2.1 time: 0.307159 Oct 22 03:28:56.242340 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2753/5383] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:55 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1714 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:56.264269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0d61eab7-5989-4be9-a388-6b02cfaff4ed tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:56.265764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0d61eab7-5989-4be9-a388-6b02cfaff4ed tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:56.449446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0d61eab7-5989-4be9-a388-6b02cfaff4ed tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:56.464813 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0d61eab7-5989-4be9-a388-6b02cfaff4ed tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1209 microversion: 2.1 time: 0.213881 Oct 22 03:28:56.487255 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2754/5384] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:56 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1209 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:56.537454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:56.539253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:56.550857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:56.551476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:56.552200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:56.553446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:56.554508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:56.555071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:56.643834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:56.655628 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1aaaac29-6917-4660-88c9-693db8d3998b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1494 microversion: 2.1 time: 1.332159 Oct 22 03:28:56.675014 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2631/5385] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:55 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1494 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:56.719273 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Cannot 'detach_volume' instance 41b96077-d04d-4bb7-b33b-632d27cebe25 while it is in vm_state rescued Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments/c6df16c4-ede1-427f-be4c-a2c7339b6d51 HTTP/1.1 Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: exception: Cannot 'detach_volume' instance 41b96077-d04d-4bb7-b33b-632d27cebe25 while it is in vm_state rescued Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': '41b96077-d04d-4bb7-b33b-632d27cebe25', 'id': 'c6df16c4-ede1-427f-be4c-a2c7339b6d51'} Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 41b96077-d04d-4bb7-b33b-632d27cebe25 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 41b96077-d04d-4bb7-b33b-632d27cebe25 while it is in vm_state rescued Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:56.723776 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:28:56.727723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:28:56.727723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:28:56.727723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:28:56.727723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:28:56.727723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 41b96077-d04d-4bb7-b33b-632d27cebe25 while it is in vm_state rescued Oct 22 03:28:56.727723 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:28:56.733785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 409 to user: Cannot 'detach_volume' instance 41b96077-d04d-4bb7-b33b-632d27cebe25 while it is in vm_state rescued {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:28:56.735183 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6391332c-df93-4f89-a1a3-3de5ba47b8b3 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments/c6df16c4-ede1-427f-be4c-a2c7339b6d51" status: 409 len: 152 microversion: 2.1 time: 0.204506 Oct 22 03:28:56.735969 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2755/5386] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:28:56 2022] DELETE /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments/c6df16c4-ede1-427f-be4c-a2c7339b6d51 => generated 152 bytes in 206 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:28:56.748405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:56.749261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:56.758338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:56.758966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:56.759302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:56.760025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:56.760769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:56.761366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:56.960056 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9fdbf6b5-8665-484e-94a2-fd25e4092366 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/action" status: 202 len: 0 microversion: 2.1 time: 0.217571 Oct 22 03:28:56.963694 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2632/5387] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:28:56 2022] POST /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:28:56.975890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:56.977262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:57.011894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:57.013717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:57.016054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:57.018596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:57.021850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:57.022860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:57.490381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:57.495312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:57.496786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:57.505301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-793ca911-68ef-431d-8c74-e53afecf5f18 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1722 microversion: 2.1 time: 0.539864 Oct 22 03:28:57.506959 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2756/5388] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:56 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1722 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:57.526201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:57.527336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:57.529369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:57.538466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:57.538952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:57.539404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:57.654496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:57.676113 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b37717dc-17ac-405f-8651-85a3556590a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1261 microversion: 2.1 time: 0.185597 Oct 22 03:28:57.690228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:57.692451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:57.697434 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2633/5389] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:57 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:57.705145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:57.705841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:57.707298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:57.708270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:57.709031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:57.709570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:58.112611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:58.143183 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-70d7a9ce-f947-4d05-805a-2ec2d4bceed5 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1494 microversion: 2.1 time: 0.464148 Oct 22 03:28:58.145754 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2757/5390] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:57 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1494 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:58.532578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:58.533369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:58.546896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:58.547397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:58.550411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:58.557831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:58.558690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:58.559586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:58.721930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:58.723122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:58.732966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:58.736486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:58.737858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:58.740548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:58.741165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:58.741619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:58.883900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:58.895207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:28:58.900489 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ec8d0dc-e6c4-4d81-8bf2-1150e09a8178 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1267 microversion: 2.1 time: 0.185012 Oct 22 03:28:58.924075 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2758/5391] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:58 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:58.930116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9cb617e2-1730-463e-a90a-76f646885086 req-b3d76885-f7db-4db7-8093-6c3924951e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea1e556-a429-4dd4-9289-49eb3c33e828", "name": "network-vif-deleted", "tag": "89827cb1-c8eb-4fdc-b1a9-dbc40ef291fb"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:28:58.954689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9cb617e2-1730-463e-a90a-76f646885086 req-b3d76885-f7db-4db7-8093-6c3924951e87 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:58.955453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9cb617e2-1730-463e-a90a-76f646885086 req-b3d76885-f7db-4db7-8093-6c3924951e87 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:58.956790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9cb617e2-1730-463e-a90a-76f646885086 req-b3d76885-f7db-4db7-8093-6c3924951e87 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:58.978719 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9cb617e2-1730-463e-a90a-76f646885086 req-b3d76885-f7db-4db7-8093-6c3924951e87 service nova] Creating event network-vif-deleted:89827cb1-c8eb-4fdc-b1a9-dbc40ef291fb for instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 on n-h2-862416-2 Oct 22 03:28:58.987332 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9cb617e2-1730-463e-a90a-76f646885086 req-b3d76885-f7db-4db7-8093-6c3924951e87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060157 Oct 22 03:28:58.988058 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2759/5392] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:28:59.170243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:59.171866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:59.178603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:59.179448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:59.180124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:59.181116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:59.181787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:59.182426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:59.220857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:59.221668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:59.222349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:59.223023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lazy-loading 'fault' on Instance uuid 5ea1e556-a429-4dd4-9289-49eb3c33e828 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:28:59.283950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:59.296745 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ba09fe2-f8fc-47ee-9175-2a8ed0099a4e tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 200 len: 1304 microversion: 2.1 time: 0.132129 Oct 22 03:28:59.298290 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2760/5393] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:59 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:28:59.730602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:28:59.742761 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d763615a-75e9-4787-b51b-daa89f95dc2a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1722 microversion: 2.1 time: 1.213230 Oct 22 03:28:59.744820 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2634/5394] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:58 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1722 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:28:59.928699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:28:59.929599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:28:59.937699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:59.938449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:59.939062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:28:59.940554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:28:59.941816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:28:59.942401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:00.321004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:00.321980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: 5ea1e556-a429-4dd4-9289-49eb3c33e828] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:00.328878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:00.329710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:00.330158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:00.330866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:00.331329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:00.331760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:00.347244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:00.359046 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] HTTP exception thrown: Instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 could not be found. Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Request method failure captured: Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 HTTP/1.1 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Fh1zrAV3t3KXx01cQXblz7hWmYKt-76cC8cmSebtHYnQKQ6-07LBdAlhscB-G6tA0KBEWmhguTVHXtHC-mZ051ajv54b_mHfqK5USw7BTbJtryaehovUtJ4vhB5F5cy2WfuByiSOyHd4j6nJIMUTEwGhnCO-2AV7v1DgpBUt1eVag Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 76599914af404f118b425b41a2432291 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76599914af404f118b425b41a2432291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76599914af404f118b425b41a2432291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}] Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 76599914af404f118b425b41a2432291 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: f89d04db39be473097b885f7465115a2 Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 could not be found. Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '5ea1e556-a429-4dd4-9289-49eb3c33e828'} Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 could not be found. Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 could not be found. Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:00.363030 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:00.367972 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:00.367972 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:00.367972 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:00.367972 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:29:00.367972 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:29:00.367972 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 could not be found. Oct 22 03:29:00.367972 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:00.370183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Returning 404 to user: Instance 5ea1e556-a429-4dd4-9289-49eb3c33e828 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:29:00.371399 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea6e06b2-694e-4594-adfd-8327913aaee6 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828" status: 404 len: 111 microversion: 2.1 time: 0.054439 Oct 22 03:29:00.373249 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2635/5395] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:00 2022] GET /compute/v2.1/servers/5ea1e556-a429-4dd4-9289-49eb3c33e828 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:29:00.384322 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb556787-4077-404d-8679-d20b5b7db060 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1267 microversion: 2.1 time: 0.457214 Oct 22 03:29:00.385614 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2761/5396] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:28:59 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1267 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:00.391278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:00.392454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:00.399360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:00.400642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:00.401342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:00.402734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:00.404035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:00.404764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:00.448577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:29:00.621602 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d36917d-08c8-4cd1-8409-2dc7edc7daa3 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 204 len: 0 microversion: 2.1 time: 0.236898 Oct 22 03:29:00.628064 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2636/5397] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:29:00 2022] DELETE /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:29:00.640362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:00.644692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:00.652321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:00.653969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:00.657256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:00.658311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:00.658783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:00.659453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:00.774152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:00.775711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:00.787785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:00.788929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:00.789585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:00.790530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:00.791281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:00.791909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:01.209298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:01.228322 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c28e834f-79ae-4543-bf7a-9e5b1bbe5018 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1722 microversion: 2.1 time: 0.461553 Oct 22 03:29:01.228974 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2637/5398] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:00 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:01.411561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:01.412779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:01.437150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:01.438204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:01.442987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:01.444038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:01.448362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:01.449533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:01.488256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:01.511543 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8e3604a6-3fbd-425e-af45-e948aafc1c8b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1673 microversion: 2.1 time: 0.880540 Oct 22 03:29:01.532054 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2762/5399] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:00 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1673 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:01.874979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:01.891842 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad6bdd37-c7a7-426d-aee2-620e73a6bd3d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.484075 Oct 22 03:29:01.893623 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2638/5400] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:01 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:02.257692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:02.258322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:02.261245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:02.290848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:02.291721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:02.296004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:02.297024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:02.297698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:02.298308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:02.538089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:02.539463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:02.551371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:02.553331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:02.554598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:02.556183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:02.557701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:02.561903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:02.725642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:02.737752 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23efb267-2c2b-41ae-9edb-6fee09f38642 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1728 microversion: 2.1 time: 0.483836 Oct 22 03:29:02.739100 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2763/5401] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:02 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1728 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:02.761983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:02.763157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:02.773189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:02.778614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:02.779136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:02.781005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:02.781701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:02.782344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:02.901450 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b0432899-f2f8-4334-b2df-5a8dacedd3ba tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143608 Oct 22 03:29:02.902830 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2764/5402] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:29:02 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:02.921837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:02.922487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:02.939024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:02.940852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:02.942516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:02.943870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:02.944817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:02.947219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:03.457411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:03.479330 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38ebd6c5-a7e4-42eb-9dc2-a2b9d66c4bde tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.561862 Oct 22 03:29:03.496313 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2765/5403] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:02 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:03.611426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:03.621216 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-23e45ccc-1611-4003-a6db-b86378f4b2c4 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1673 microversion: 2.1 time: 1.088606 Oct 22 03:29:03.624120 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2639/5404] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:02 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1673 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:04.510611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:04.511329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:04.530791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:04.531305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:04.531758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:04.532514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:04.538296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:04.539659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:04.651332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:04.651951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:04.672810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:04.673679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:04.675586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:04.678944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:04.679596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:04.680852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:05.022707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:05.031437 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f52d8e05-652b-4d10-9230-1f56f1db375b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.525743 Oct 22 03:29:05.046674 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2766/5405] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:04 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:05.061023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0ded8ffe-b6c5-4c79-8872-a597955bd62a req-41d3c5f7-8ac4-4d9b-8c8a-7ac1d0425c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b96077-d04d-4bb7-b33b-632d27cebe25", "tag": "d3202c78-639a-4940-ab07-4ab3beeea85f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:05.071340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0ded8ffe-b6c5-4c79-8872-a597955bd62a req-41d3c5f7-8ac4-4d9b-8c8a-7ac1d0425c57 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:05.072200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0ded8ffe-b6c5-4c79-8872-a597955bd62a req-41d3c5f7-8ac4-4d9b-8c8a-7ac1d0425c57 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:05.072931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0ded8ffe-b6c5-4c79-8872-a597955bd62a req-41d3c5f7-8ac4-4d9b-8c8a-7ac1d0425c57 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:05.088235 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0ded8ffe-b6c5-4c79-8872-a597955bd62a req-41d3c5f7-8ac4-4d9b-8c8a-7ac1d0425c57 service nova] Creating event network-changed:d3202c78-639a-4940-ab07-4ab3beeea85f for instance 41b96077-d04d-4bb7-b33b-632d27cebe25 on n-h2-862416-2 Oct 22 03:29:05.095718 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0ded8ffe-b6c5-4c79-8872-a597955bd62a req-41d3c5f7-8ac4-4d9b-8c8a-7ac1d0425c57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042244 Oct 22 03:29:05.101251 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2767/5406] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:05.806424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:05.821127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-960674f8-9742-4adc-8b7e-7fe1563615f2 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1673 microversion: 2.1 time: 1.174536 Oct 22 03:29:05.823252 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2640/5407] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:04 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1673 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:06.056250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:06.061127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:06.062114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:06.075111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:06.075992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:06.076116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:06.081413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:06.082184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:06.083469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:06.256795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2bda4141-578f-40cd-bce9-8a14a6b6e87a req-c43f62e0-2951-470d-9767-5b18d6679a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a2ef56-38a7-4243-9b6a-567c091a20f6", "tag": "ad945fba-220b-483c-b0c1-b4dd879ea48f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:06.273709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2bda4141-578f-40cd-bce9-8a14a6b6e87a req-c43f62e0-2951-470d-9767-5b18d6679a40 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:06.274841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2bda4141-578f-40cd-bce9-8a14a6b6e87a req-c43f62e0-2951-470d-9767-5b18d6679a40 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:06.275791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2bda4141-578f-40cd-bce9-8a14a6b6e87a req-c43f62e0-2951-470d-9767-5b18d6679a40 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:06.306319 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2bda4141-578f-40cd-bce9-8a14a6b6e87a req-c43f62e0-2951-470d-9767-5b18d6679a40 service nova] Creating event network-changed:ad945fba-220b-483c-b0c1-b4dd879ea48f for instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 on n-h1-862416-2 Oct 22 03:29:06.337750 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2bda4141-578f-40cd-bce9-8a14a6b6e87a req-c43f62e0-2951-470d-9767-5b18d6679a40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084874 Oct 22 03:29:06.338977 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2641/5408] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:06.461378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:06.756782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:06.817341 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8ac0d0dc-2237-4ef5-b204-ee0f5662793d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.762943 Oct 22 03:29:06.817975 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2768/5409] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:06 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:06.851341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:06.852044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:06.862529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:06.864379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:06.864862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:06.872982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:06.873773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:06.874288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:07.113899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-46701f7e-5816-433a-9e81-6fa663523b34 req-0f465a41-0260-488b-bef3-63ec324d4079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b96077-d04d-4bb7-b33b-632d27cebe25", "tag": "d3202c78-639a-4940-ab07-4ab3beeea85f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:07.148536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-46701f7e-5816-433a-9e81-6fa663523b34 req-0f465a41-0260-488b-bef3-63ec324d4079 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:07.148536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-46701f7e-5816-433a-9e81-6fa663523b34 req-0f465a41-0260-488b-bef3-63ec324d4079 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:07.148536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-46701f7e-5816-433a-9e81-6fa663523b34 req-0f465a41-0260-488b-bef3-63ec324d4079 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:07.158887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:07.169904 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2fe49a80-a7cc-4c5c-b746-368a0df93832 tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1605 microversion: 2.1 time: 0.322955 Oct 22 03:29:07.182644 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2642/5410] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:06 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1605 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:07.188872 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-46701f7e-5816-433a-9e81-6fa663523b34 req-0f465a41-0260-488b-bef3-63ec324d4079 service nova] Creating event network-changed:d3202c78-639a-4940-ab07-4ab3beeea85f for instance 41b96077-d04d-4bb7-b33b-632d27cebe25 on n-h2-862416-2 Oct 22 03:29:07.214201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-46701f7e-5816-433a-9e81-6fa663523b34 req-0f465a41-0260-488b-bef3-63ec324d4079 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104409 Oct 22 03:29:07.219814 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2769/5411] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:07.844471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:07.845469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:07.857512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:07.858073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:07.858435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:07.859152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:07.859604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:07.860310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:08.196284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:08.197148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:08.215152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:08.217397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:08.217868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:08.218608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:08.221050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:08.222191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:08.482106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:08.497546 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75b2e96b-04ec-4cb7-9312-ffc0699a858c tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1605 microversion: 2.1 time: 0.304708 Oct 22 03:29:08.516193 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2770/5412] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:08 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1605 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:08.520370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cff5f91d-1e98-41fb-b988-17e415803266 req-06e5f89a-9eab-42f2-ad2d-648d256c563f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b5a94d-290e-4f62-91e9-2dbd0af49e80", "name": "network-vif-deleted", "tag": "f1cd1c71-fe45-4c77-97d5-add926f686c1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:08.532156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cff5f91d-1e98-41fb-b988-17e415803266 req-06e5f89a-9eab-42f2-ad2d-648d256c563f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:08.533517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cff5f91d-1e98-41fb-b988-17e415803266 req-06e5f89a-9eab-42f2-ad2d-648d256c563f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:08.534153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cff5f91d-1e98-41fb-b988-17e415803266 req-06e5f89a-9eab-42f2-ad2d-648d256c563f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:08.569371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cff5f91d-1e98-41fb-b988-17e415803266 req-06e5f89a-9eab-42f2-ad2d-648d256c563f service nova] Creating event network-vif-deleted:f1cd1c71-fe45-4c77-97d5-add926f686c1 for instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 on n-h1-862416-2 Oct 22 03:29:08.600002 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cff5f91d-1e98-41fb-b988-17e415803266 req-06e5f89a-9eab-42f2-ad2d-648d256c563f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090127 Oct 22 03:29:08.603521 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2771/5413] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:08.815714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:08.834019 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5c39a788-acfa-41a5-a17a-eae82b3e4374 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.994670 Oct 22 03:29:08.837995 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2643/5414] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:07 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:09.524329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:09.525179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:09.546011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:09.546544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:09.546995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:09.547743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:09.548200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:09.548651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:09.645384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:09.648781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:09.648781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:09.648781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lazy-loading 'fault' on Instance uuid f6b5a94d-290e-4f62-91e9-2dbd0af49e80 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:29:09.858686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:09.860111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:09.884737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:09.885324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:09.885974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:09.888400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:09.888878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:09.890499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:10.019810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89d04db39be473097b885f7465115a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76599914af404f118b425b41a2432291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:10.030887 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98761227-bbd4-4a20-8194-8911acdeb94b tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 200 len: 1326 microversion: 2.1 time: 0.511621 Oct 22 03:29:10.057372 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2772/5415] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:09 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 1326 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:10.512164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:10.527966 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-58d348a1-f5f1-4f9e-bf0d-b09f9087dfff tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.673465 Oct 22 03:29:10.529295 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2644/5416] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:09 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:11.066435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:11.067049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] [instance: f6b5a94d-290e-4f62-91e9-2dbd0af49e80] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:11.077603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:11.078083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:11.083386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:11.084367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:11.085014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:11.085605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:11.117764 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] HTTP exception thrown: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 could not be found. Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Request method failure captured: Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 HTTP/1.1 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Fh1zrAV3t3KXx01cQXblz7hWmYKt-76cC8cmSebtHYnQKQ6-07LBdAlhscB-G6tA0KBEWmhguTVHXtHC-mZ051ajv54b_mHfqK5USw7BTbJtryaehovUtJ4vhB5F5cy2WfuByiSOyHd4j6nJIMUTEwGhnCO-2AV7v1DgpBUt1eVag Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 76599914af404f118b425b41a2432291 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76599914af404f118b425b41a2432291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76599914af404f118b425b41a2432291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76599914af404f118b425b41a2432291"}]}] Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 76599914af404f118b425b41a2432291 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1071579743 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: f89d04db39be473097b885f7465115a2 Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1071579743-project Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 could not be found. Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f6b5a94d-290e-4f62-91e9-2dbd0af49e80'} Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 could not be found. Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 could not be found. Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:11.121427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:11.126462 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:11.126462 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:11.126462 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:11.126462 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:29:11.126462 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:29:11.126462 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 could not be found. Oct 22 03:29:11.126462 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:11.137193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Returning 404 to user: Instance f6b5a94d-290e-4f62-91e9-2dbd0af49e80 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:29:11.138592 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b484cfc8-a13c-4489-81f5-eea7bfc6586d tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80" status: 404 len: 111 microversion: 2.1 time: 0.076087 Oct 22 03:29:11.139181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2773/5417] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:11 2022] GET /compute/v2.1/servers/f6b5a94d-290e-4f62-91e9-2dbd0af49e80 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:29:11.147703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-884eb907-b74e-49d1-8017-a97ba5d763bc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] Calling method '.version_select at 0x7f0d1a3c8a60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:11.197602 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-884eb907-b74e-49d1-8017-a97ba5d763bc tempest-ServerActionsTestJSON-1071579743 tempest-ServerActionsTestJSON-1071579743-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-678950926" status: 202 len: 0 microversion: 2.1 time: 0.053833 Oct 22 03:29:11.202701 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2645/5418] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-678950926 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:29:11.554990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:11.555671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:11.566650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:11.569383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:11.570317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:11.573384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:11.574082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:11.574853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:12.222409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:12.244885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95a1d625-1e47-4cb7-a989-e74ef07f33f1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.693592 Oct 22 03:29:12.245952 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2774/5419] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:11 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:13.272671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:13.274066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:13.286655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:13.287500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:13.288282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:13.291657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:13.292523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:13.293210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:13.299643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:13.426571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-86d2aa73-7b5c-4099-8d36-0f28828528af req-52cd1fcb-84cb-432c-85c3-135ae9a69c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a2ef56-38a7-4243-9b6a-567c091a20f6", "name": "network-vif-plugged", "status": "completed", "tag": "ad945fba-220b-483c-b0c1-b4dd879ea48f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:13.479564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86d2aa73-7b5c-4099-8d36-0f28828528af req-52cd1fcb-84cb-432c-85c3-135ae9a69c5e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:13.481819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86d2aa73-7b5c-4099-8d36-0f28828528af req-52cd1fcb-84cb-432c-85c3-135ae9a69c5e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:13.483598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86d2aa73-7b5c-4099-8d36-0f28828528af req-52cd1fcb-84cb-432c-85c3-135ae9a69c5e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:13.523921 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-86d2aa73-7b5c-4099-8d36-0f28828528af req-52cd1fcb-84cb-432c-85c3-135ae9a69c5e service nova] Creating event network-vif-plugged:ad945fba-220b-483c-b0c1-b4dd879ea48f for instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 on n-h1-862416-2 Oct 22 03:29:13.534789 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-86d2aa73-7b5c-4099-8d36-0f28828528af req-52cd1fcb-84cb-432c-85c3-135ae9a69c5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113973 Oct 22 03:29:13.537827 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2775/5420] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:13.559189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:13.568628 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5334a8f-f0a9-4126-b926-795bb47cb6dd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.301443 Oct 22 03:29:13.572246 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2646/5421] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:13 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:14.597331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:14.599869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:14.609547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:14.611160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:14.612230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:14.613338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:14.613898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:14.614560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:15.580344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:15.589312 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4efe83d8-c326-4e90-80d8-28273a25824b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1309 microversion: 2.1 time: 0.996573 Oct 22 03:29:15.592447 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2776/5422] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:14 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1309 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:16.619152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:16.620053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:16.640271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:16.640790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:16.641239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:16.641964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:16.642431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:16.642865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:16.946761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:16.947982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:16.973256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:16.975323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:16.977071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:16.978121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:16.979495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:16.981753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:17.042814 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d8b80a2-d783-4d69-83ab-8f849c954ad8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/ips" status: 200 len: 150 microversion: 2.1 time: 0.753450 Oct 22 03:29:17.046539 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2647/5423] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:29:16 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/ips => generated 150 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:17.104444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:17.126125 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-169cc653-beb2-4a86-a2ab-01bf58728a9f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1489 microversion: 2.1 time: 0.510998 Oct 22 03:29:17.126745 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2777/5424] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:16 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1489 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:17.518924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1789678823", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "1dca30ca-b544-47c6-a616-7a126cc52745"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:17.697033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] validate_networks() for [('1dca30ca-b544-47c6-a616-7a126cc52745', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:29:20.102044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:29:20.102651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:29:20.103874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:29:20.104438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:29:20.105102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:29:20.127078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:20.127935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:20.128636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:20.129777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:20.130470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:20.131136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:20.167686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:29:20.176708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:29:20.197400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:29:20.203509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:29:20.284981 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-620d392a-d270-4062-a146-0a4d00526f35 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.770316 Oct 22 03:29:20.286917 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2648/5425] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:29:20.299789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20920a48-b425-40bf-8b4b-37333feeca4d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:20.301289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20920a48-b425-40bf-8b4b-37333feeca4d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:20.507787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45394346-4fa0-43c0-8c06-2ea3524301e2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:20.510774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:20.517748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-20920a48-b425-40bf-8b4b-37333feeca4d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:20.533447 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20920a48-b425-40bf-8b4b-37333feeca4d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1209 microversion: 2.1 time: 0.237400 Oct 22 03:29:20.537944 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2778/5426] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:20 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1209 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:20.554822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:20.556018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:20.556859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:20.560544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:20.561993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:20.562742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:21.027089 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-619a1dec-732e-4bdf-818e-fb83f62c8988 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "POST /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522615 Oct 22 03:29:21.037928 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2649/5427] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:29:20 2022] POST /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:21.566062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:21.566985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:21.589173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:21.602370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:21.603820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:21.610101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:21.611436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:21.612080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:21.850507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:21.864240 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ed3fdc5-6767-4ac9-93e9-1dbf505a29e3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1261 microversion: 2.1 time: 0.303160 Oct 22 03:29:21.870668 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2779/5428] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:21 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1261 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:22.897705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:22.898415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:22.920625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:22.922472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:22.942664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:22.942664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:22.943850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:22.943850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:23.375936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:23.391132 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c9a6633-641c-4539-beff-f120d86a449a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1267 microversion: 2.1 time: 0.499108 Oct 22 03:29:23.405527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2650/5429] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:22 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1267 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:24.419592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:24.420255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:24.436030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:24.436815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:24.439683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:24.441163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:24.443222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:24.443939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:24.454963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:24.598666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:24.613557 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27db634e-b666-43d3-b656-01b2397dbcce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1267 microversion: 2.1 time: 0.200840 Oct 22 03:29:24.629396 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2780/5430] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:24 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:25.637169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:25.638729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:25.655262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:25.655262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:25.671932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:25.672838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:25.673484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:25.673954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:25.674385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:26.350784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1464916606", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "3b008353-7c70-4034-912d-d3bafef92fe3"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:26.522647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] validate_networks() for [('3b008353-7c70-4034-912d-d3bafef92fe3', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:29:26.725201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:26.742555 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-feee0fab-b3fe-4e68-a919-771ab21ee2df tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 1.108285 Oct 22 03:29:26.751897 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2651/5431] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:25 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:27.693228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f89f962c-fd3a-436b-9e36-d1e54e1ca249 req-c63681f4-97f5-4d6e-86d8-f8d451ca5f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89782eb-e2e0-47b5-98a2-2099c306dde7", "tag": "d1b8022b-ffeb-48a0-924d-ad14130ef56b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:27.717353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f89f962c-fd3a-436b-9e36-d1e54e1ca249 req-c63681f4-97f5-4d6e-86d8-f8d451ca5f36 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:27.718341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f89f962c-fd3a-436b-9e36-d1e54e1ca249 req-c63681f4-97f5-4d6e-86d8-f8d451ca5f36 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:27.719682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f89f962c-fd3a-436b-9e36-d1e54e1ca249 req-c63681f4-97f5-4d6e-86d8-f8d451ca5f36 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:27.751431 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f89f962c-fd3a-436b-9e36-d1e54e1ca249 req-c63681f4-97f5-4d6e-86d8-f8d451ca5f36 service nova] Creating event network-changed:d1b8022b-ffeb-48a0-924d-ad14130ef56b for instance a89782eb-e2e0-47b5-98a2-2099c306dde7 on n-h2-862416-2 Oct 22 03:29:27.767364 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f89f962c-fd3a-436b-9e36-d1e54e1ca249 req-c63681f4-97f5-4d6e-86d8-f8d451ca5f36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080593 Oct 22 03:29:27.770003 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2652/5432] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:27.783861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:27.791013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:27.824033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:27.824033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:27.828638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:27.830208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:27.830944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:27.831713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:28.826256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:28.837678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:29:28.838876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:29:28.841462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:29:28.841605 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea2cafbb-56e0-4fa0-98bf-871b418bba1b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 1.065163 Oct 22 03:29:28.842677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:29:28.843371 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2653/5433] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:27 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:28.843508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:29:28.894491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:28.895534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:28.896017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:28.899168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:28.899674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:28.900119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:28.956771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Getting quotas for project c89fd7c3d03f4e05b837f86969b2e095. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:29:28.966985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Getting quotas for user 13bba226e79645aabd4d5404cf129ad8 and project c89fd7c3d03f4e05b837f86969b2e095. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:29:28.998396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:29:29.008878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:29:29.151401 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-61c59df0-a5a8-4f35-9061-ca1caedf6bea tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.494927 Oct 22 03:29:29.159931 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2781/5434] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:29:29.166358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6f89759f-9d72-46c6-8d88-2e90b7358416 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:29.167114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6f89759f-9d72-46c6-8d88-2e90b7358416 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:29.601733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6f89759f-9d72-46c6-8d88-2e90b7358416 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:29.614335 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6f89759f-9d72-46c6-8d88-2e90b7358416 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1228 microversion: 2.1 time: 0.453019 Oct 22 03:29:29.615327 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2654/5435] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:29 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1228 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:29.867571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:29.868323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:29.878230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:29.881486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:29.882849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:29.884998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:29.886211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:29.887859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:30.309677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:30.318117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aad8c4f8-c51b-4a9a-875e-4479cfd4b13b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 0.455966 Oct 22 03:29:30.318717 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2782/5436] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:29 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:30.644722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:30.645340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:30.659215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:30.661086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:30.661753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:30.662419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:30.673503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:30.675895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:30.679461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:31.189306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:31.196134 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cf771c17-4f0a-4e69-a8be-e6479fabf365 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1280 microversion: 2.1 time: 0.553533 Oct 22 03:29:31.197371 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2655/5437] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:30 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1280 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:31.346726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:31.347424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:31.382511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:31.383118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:31.383588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:31.393667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:31.397923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:31.398422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:32.225085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:32.227476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:32.254607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:32.257406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:32.258249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:32.260874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:32.263224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:32.263940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:32.431386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:32.445052 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b178cea9-afd4-40a7-992d-7c9c78b4bd10 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 1.102952 Oct 22 03:29:32.445868 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2783/5438] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:31 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:32.557055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:32.571309 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1965ece7-1141-4155-9a68-70a5f79894da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1286 microversion: 2.1 time: 0.353578 Oct 22 03:29:32.588826 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2656/5439] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:32 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1286 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:33.477531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:33.478610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:33.488196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:33.490310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:33.491903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:33.492577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:33.493683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:33.494314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:33.495628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:33.599038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:33.600822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:33.613884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:33.614391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:33.614829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:33.620655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:33.621672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:33.623436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:33.835943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:33.849676 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eea3508a-2589-428f-9a9c-2320e5b340f3 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1286 microversion: 2.1 time: 0.255427 Oct 22 03:29:33.865188 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2657/5440] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:33 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1286 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:33.911999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:33.923042 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-134c8b9b-8723-4228-b8ff-584fde8cf717 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 0.458333 Oct 22 03:29:33.925033 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2784/5441] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:33 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:34.878712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:34.879520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:34.894908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:34.895591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:34.904072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:34.906791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:34.907928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:34.908988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:34.948712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:34.950864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:34.970222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:34.971087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:34.971749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:34.974977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:34.975714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:34.976414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:35.494288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:35.509421 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-002c91a7-f685-4c81-b27c-6fb5d4eff4ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 0.564710 Oct 22 03:29:35.512890 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2785/5442] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:34 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:35.821563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:35.848568 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83c4b71d-0733-46e8-bf8d-1c72a353c728 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1328 microversion: 2.1 time: 0.973183 Oct 22 03:29:35.850483 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2658/5443] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:34 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1328 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:36.545094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:36.546330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:36.554340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:36.555111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:36.555726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:36.557481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:36.560837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:36.561623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:36.743491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-304840072", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "2da8b335-9afd-466d-8f9b-bbbe26e72867"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:36.880327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] validate_networks() for [('2da8b335-9afd-466d-8f9b-bbbe26e72867', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:29:36.895084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:36.904170 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c6101452-7a42-4050-a60a-880ef468f059 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 0.370498 Oct 22 03:29:36.904911 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2786/5444] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:36 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:36.913882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:36.914890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:36.923847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:36.925529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:36.926419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:36.927529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:36.928240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:36.928926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:37.173251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:37.181912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5c335ff7-e12a-4d14-80cd-9e894efcd32c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1328 microversion: 2.1 time: 0.276022 Oct 22 03:29:37.187446 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2787/5445] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:36 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1328 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:37.932979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:37.941034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:37.977514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:37.980774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:37.989990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:37.990772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:37.991250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:37.996734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:38.641157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:38.661401 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5895b75a-eb1d-4b4b-a1ff-82981ee870af tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 0.732428 Oct 22 03:29:38.662607 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2788/5446] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:37 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:38.669860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3871ce0b-a406-4192-9866-ea6e546e3da4 req-11ef3998-7e93-4152-9daf-d9a4090af60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8", "tag": "e7ad05bb-14ad-428f-94c5-dd978de03352"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:38.694389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3871ce0b-a406-4192-9866-ea6e546e3da4 req-11ef3998-7e93-4152-9daf-d9a4090af60a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:38.695141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3871ce0b-a406-4192-9866-ea6e546e3da4 req-11ef3998-7e93-4152-9daf-d9a4090af60a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:38.695749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3871ce0b-a406-4192-9866-ea6e546e3da4 req-11ef3998-7e93-4152-9daf-d9a4090af60a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:38.711786 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3871ce0b-a406-4192-9866-ea6e546e3da4 req-11ef3998-7e93-4152-9daf-d9a4090af60a service nova] Creating event network-changed:e7ad05bb-14ad-428f-94c5-dd978de03352 for instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 on n-h1-862416-2 Oct 22 03:29:38.718840 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3871ce0b-a406-4192-9866-ea6e546e3da4 req-11ef3998-7e93-4152-9daf-d9a4090af60a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054046 Oct 22 03:29:38.720000 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2789/5447] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:38.727554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:38.728298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:38.738136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:38.738646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:38.739088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:38.739810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:38.740325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:38.740771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:38.913058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:38.978708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:39.225510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:39.236705 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c6dad73a-0285-4af4-98dc-483790a00088 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1328 microversion: 2.1 time: 0.515339 Oct 22 03:29:39.237352 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2790/5448] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:38 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1328 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:39.253252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:39.253767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:39.273577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:39.276803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:39.279520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:39.280313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:39.280797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:39.287277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:39.358832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:29:39.359340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:29:39.360864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:29:39.361558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:29:39.362197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:29:39.382545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:39.385737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:39.398676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:39.406229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:39.407592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:39.408631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:39.486002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Getting quotas for project a9f0271d17c442ce84bf9e979b31bed2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:29:39.495071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Getting quotas for user 5d2fd6f8394843e0bc68316ef8a5c1dd and project a9f0271d17c442ce84bf9e979b31bed2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:29:39.543666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:29:39.549845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lazy-loading 'services' on Instance uuid aef4847d-914d-471c-806c-0b1b21dc70c7 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:29:39.550518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:29:39.641908 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9f42ae2d-c0d5-4324-a759-a257ae8bf027 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.064795 Oct 22 03:29:39.646437 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2659/5449] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:29:39.679651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc036128-fa04-4cb7-bcbc-4cf26dbb9986 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:39.680391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cc036128-fa04-4cb7-bcbc-4cf26dbb9986 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:39.722760 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9d01067-254c-4274-9208-9486e65981cc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments/45394346-4fa0-43c0-8c06-2ea3524301e2" status: 202 len: 0 microversion: 2.1 time: 0.482630 Oct 22 03:29:39.723666 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2791/5450] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:29:39 2022] DELETE /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments/45394346-4fa0-43c0-8c06-2ea3524301e2 => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:29:39.731859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:39.740642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:39.755511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:39.756013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:39.765132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:39.771626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:39.772447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:39.780918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:40.124153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cc036128-fa04-4cb7-bcbc-4cf26dbb9986 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:40.132629 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cc036128-fa04-4cb7-bcbc-4cf26dbb9986 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1216 microversion: 2.1 time: 0.479920 Oct 22 03:29:40.136652 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2660/5451] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:39 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1216 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:40.145179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:40.147418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:40.160754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:40.161310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:40.161819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:40.162736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:40.163875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:40.164600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:40.275596 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-538c5993-614d-49a2-8628-2d933f24fa88 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137570 Oct 22 03:29:40.276340 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2661/5452] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:29:40 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:40.291548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:40.292170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:40.318224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:40.318660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:40.319099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:40.319828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:40.330927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:40.331417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:40.961437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:40.990991 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9923bbf2-89e9-4302-9872-1a409bc0251e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 1.264294 Oct 22 03:29:40.994902 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2792/5453] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:39 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:41.009084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6af56fa2-1929-4f9a-bf00-831154b8c910 req-d4ce9e44-d4e7-478a-865a-64b9f185736a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89782eb-e2e0-47b5-98a2-2099c306dde7", "name": "network-vif-plugged", "status": "completed", "tag": "d1b8022b-ffeb-48a0-924d-ad14130ef56b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:41.056045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6af56fa2-1929-4f9a-bf00-831154b8c910 req-d4ce9e44-d4e7-478a-865a-64b9f185736a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:41.056626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6af56fa2-1929-4f9a-bf00-831154b8c910 req-d4ce9e44-d4e7-478a-865a-64b9f185736a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:41.057175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6af56fa2-1929-4f9a-bf00-831154b8c910 req-d4ce9e44-d4e7-478a-865a-64b9f185736a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:41.094127 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6af56fa2-1929-4f9a-bf00-831154b8c910 req-d4ce9e44-d4e7-478a-865a-64b9f185736a service nova] Creating event network-vif-plugged:d1b8022b-ffeb-48a0-924d-ad14130ef56b for instance a89782eb-e2e0-47b5-98a2-2099c306dde7 on n-h2-862416-2 Oct 22 03:29:41.118904 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6af56fa2-1929-4f9a-bf00-831154b8c910 req-d4ce9e44-d4e7-478a-865a-64b9f185736a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117827 Oct 22 03:29:41.122094 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2793/5454] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:41.162688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:41.163319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:41.180382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:41.180892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:41.181341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:41.182072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:41.182538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:41.182971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:41.403677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:41.414696 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6bf241ab-1ce1-4626-b741-23597d2d3b88 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1220 microversion: 2.1 time: 0.256379 Oct 22 03:29:41.429688 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2794/5455] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:41 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1220 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:41.442200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:41.447496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:41.473511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:41.474993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:41.479136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:41.480099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:41.480970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:41.481572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:41.562900 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1fd3eea2-9444-4a78-b41e-d03c4b8685fc tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131662 Oct 22 03:29:41.566100 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2795/5456] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:29:41 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:41.817203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:41.829561 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ee7e55f-124d-4470-ba84-be0033a5a1da tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1328 microversion: 2.1 time: 1.549864 Oct 22 03:29:41.830442 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2662/5457] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:40 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1328 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:42.018440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:42.020858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:42.036196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:42.036765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:42.037219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:42.038006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:42.040620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:42.041503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:42.448373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:42.450224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:42.463949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:42.469969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:42.470782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:42.472821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:42.473537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:42.474240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:42.656663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:42.667321 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b0d911e-53a0-4adf-9d91-d77760d2b06a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 0.653389 Oct 22 03:29:42.672186 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2796/5458] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:42 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:42.687989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:42.693602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:42.715274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:42.715789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:42.717922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:42.722384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:42.722876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:42.724466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:42.732305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:42.754516 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0409c2e-e818-4d41-bd91-51cea09f6081 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1268 microversion: 2.1 time: 0.309844 Oct 22 03:29:42.758303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2663/5459] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:42 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1268 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:42.858346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:42.858983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:42.879739 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32261ae8-8aee-48e3-9f15-30e05e300f3b tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205848 Oct 22 03:29:42.884712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:42.888167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:42.888693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:42.889451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:42.894782 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2797/5460] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:29:42 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:42.897450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:42.901634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:43.694009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:43.695221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:43.710373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:43.711194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:43.711816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:43.713497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:43.714127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:43.715337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:43.820598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:44.323529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:44.327886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:44.350508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f85d1021-24f2-4381-a005-611cf9208d9d tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1328 microversion: 2.1 time: 1.485275 Oct 22 03:29:44.357934 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2664/5461] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:42 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1328 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:44.383754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:44.384442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:44.416415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:44.422143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:44.422660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:44.429771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:44.441384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:44.448134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:44.798390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:44.812696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:44.815469 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c8d6d83-f5b2-4854-9195-2353502b5eaa tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1274 microversion: 2.1 time: 0.451851 Oct 22 03:29:44.828423 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5142b7c5-2105-4177-bc19-2eb8fdeae1bf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1309 microversion: 2.1 time: 1.135275 Oct 22 03:29:44.829435 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2798/5462] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:43 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1309 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:44.839691 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2665/5463] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:44 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1274 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:44.843192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:44.862671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:44.869861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:44.874681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:44.875252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:44.876077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:44.882949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:44.883512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:44.961660 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce8bee5b-3db9-48c3-9d31-827ec1dca6f8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130903 Oct 22 03:29:44.980992 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2799/5464] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:29:44 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:45.386098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:45.386858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:45.397703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:45.398204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:45.398644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:45.403174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:45.404078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:45.404560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:45.453654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-47aeb81e-cdd6-427e-9fcd-c92792b8fa92 req-84c41fff-4c69-43ad-b380-7168a8a4d7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8", "name": "network-vif-plugged", "status": "completed", "tag": "e7ad05bb-14ad-428f-94c5-dd978de03352"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:45.482853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-47aeb81e-cdd6-427e-9fcd-c92792b8fa92 req-84c41fff-4c69-43ad-b380-7168a8a4d7b7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:45.487786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-47aeb81e-cdd6-427e-9fcd-c92792b8fa92 req-84c41fff-4c69-43ad-b380-7168a8a4d7b7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:45.488359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-47aeb81e-cdd6-427e-9fcd-c92792b8fa92 req-84c41fff-4c69-43ad-b380-7168a8a4d7b7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:45.514206 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-47aeb81e-cdd6-427e-9fcd-c92792b8fa92 req-84c41fff-4c69-43ad-b380-7168a8a4d7b7 service nova] Creating event network-vif-plugged:e7ad05bb-14ad-428f-94c5-dd978de03352 for instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 on n-h1-862416-2 Oct 22 03:29:45.520545 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-47aeb81e-cdd6-427e-9fcd-c92792b8fa92 req-84c41fff-4c69-43ad-b380-7168a8a4d7b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072009 Oct 22 03:29:45.522070 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2800/5465] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:45.864921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:45.866883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:45.885437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:45.887016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:45.888088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:45.889738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:45.891471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:45.898247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:46.622501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:46.635909 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80907d98-b835-40ff-bf42-df7790289863 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1328 microversion: 2.1 time: 1.254574 Oct 22 03:29:46.652455 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2666/5466] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:45 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1328 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:46.652455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:46.660840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:46.678308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:46.679195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:46.679668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:46.681335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:46.681919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:46.682369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:46.794167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:46.823664 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-492de2f1-4bb7-4e62-a500-2d69ba5b5fa6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1274 microversion: 2.1 time: 0.174460 Oct 22 03:29:46.825218 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2667/5467] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:46 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:46.842657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:46.845478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:46.863653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:46.868180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:46.871478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:46.872367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:46.874053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:46.877948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:46.967306 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18f9a227-6a4a-4ab8-9be0-35bba56c7cdb tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136367 Oct 22 03:29:46.968615 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2668/5468] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:29:46 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:46.999317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:47.011168 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-00c4b65f-8093-456b-ba13-e48eadfd8b2c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1489 microversion: 2.1 time: 1.152780 Oct 22 03:29:47.016543 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2801/5469] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:45 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1489 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:47.054314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:47.055064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:47.064254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:47.065532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:47.066700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:47.067967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:47.068678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:47.069414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:47.249144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:47.261914 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0652a32e-9a6d-4749-b65b-7a9d27d2d693 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1489 microversion: 2.1 time: 0.214602 Oct 22 03:29:47.268838 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2669/5470] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:47 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1489 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:47.298705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:47.299732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:47.306857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:47.307746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:47.308621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:47.309579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:47.310294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:47.310950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:47.674697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:47.675512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:47.699433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:47.700285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:47.701382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:47.702387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:47.703578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:47.704432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:47.948698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:47.962565 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6dd983b4-ce94-4ca1-8a91-369e5b4e494c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1489 microversion: 2.1 time: 0.668581 Oct 22 03:29:47.968174 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2802/5471] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:47 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1489 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:48.010342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:48.014148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:48.026343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:48.028321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:48.033051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:48.034193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:48.034881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:48.035549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:48.165662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:48.175544 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-421e178d-623a-4e9d-be98-aa69b5daca53 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1328 microversion: 2.1 time: 0.508215 Oct 22 03:29:48.179232 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2670/5472] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:47 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1328 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:48.193605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:48.196412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:48.210848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:48.215786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:48.217525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:48.220013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:48.222087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:48.223541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:48.275496 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90e72047-abdc-4974-b114-facf22347d30 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094195 Oct 22 03:29:48.281942 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2671/5473] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:29:48 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:48.307937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:48.312382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:48.325374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:48.326116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:48.326854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:48.327857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:48.328610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:48.329211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:48.366251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:29:48.518962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3dd1256-79fe-46a4-b9c9-c5fda48a410f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 204 len: 0 microversion: 2.1 time: 0.234551 Oct 22 03:29:48.522472 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2672/5474] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:29:48 2022] DELETE /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:29:48.537074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:48.539455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:48.555392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:48.565713 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a86bd362-f939-4263-b277-9d35201838e3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.582486 Oct 22 03:29:48.566020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:48.566887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:48.567960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:48.572239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:48.573032 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2803/5475] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:47 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:48.582486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:48.584305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:48.929861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:48.952013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d0ebd17-9b86-4093-9a88-efa221145185 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1495 microversion: 2.1 time: 0.425575 Oct 22 03:29:48.953032 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2673/5476] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:48 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1495 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:49.207798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:49.208453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:49.227265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:49.227750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:49.228189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:49.228952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:49.229409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:49.230123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:49.289719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:49.294008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:49.301979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:49.302750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:49.303609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:49.304249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:49.304842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:49.305260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:49.358078 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8d58f418-8eb2-4224-94ca-cb1879c6b055 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072977 Oct 22 03:29:49.363458 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2674/5477] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:29:49 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:49.607214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:49.607932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:49.611407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:49.618220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:49.618864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:49.619467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:49.620379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:49.621163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:49.621812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:49.805227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:49.818161 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1cb009b-576f-4154-80d8-0d28c92ed10c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1528 microversion: 2.1 time: 0.613691 Oct 22 03:29:49.820840 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2804/5478] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:49 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1528 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:49.844918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:49.845537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:49.856737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:49.857629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:49.859566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:49.860850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:49.861487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:49.862122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.102294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:50.112737 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6139203a-3658-4345-8b78-2929ad0e217e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.511164 Oct 22 03:29:50.119264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2675/5479] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:49 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:50.124377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:50.129017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:50.131429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=16 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:50.145968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:50.150578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:50.151297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.155112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:50.155772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:50.156414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.437487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:50.457352 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15e7d7b1-7761-4e7f-9340-f4d44fa0bcc1 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1528 microversion: 2.1 time: 0.616315 Oct 22 03:29:50.457955 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2805/5480] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:49 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1528 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:29:50.463028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:50.479019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:50.485837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:50.486613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:50.487231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.488118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:50.488768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:50.489365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.532141 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19846ac7-569c-4526-82d7-8eaabf948753 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072865 Oct 22 03:29:50.533413 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2806/5481] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:29:50 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:29:50.650761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:50.663088 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37c224b6-0bc2-4779-aa8f-096af4529bae tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1495 microversion: 2.1 time: 0.542446 Oct 22 03:29:50.683937 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2676/5482] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:50 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1495 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:50.694682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:50.701134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:50.720979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:50.721479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:50.721922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.722713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:50.723357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:50.723957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.766432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:29:50.897396 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2b61f694-fc30-4ff7-b411-6ce29d4eddca tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 204 len: 0 microversion: 2.1 time: 0.211420 Oct 22 03:29:50.900429 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2677/5483] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:29:50 2022] DELETE /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:29:50.932697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:50.935712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:50.951972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:50.952514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:50.953927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.956252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:50.959381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:50.960036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:50.971996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:51.015680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:51.016197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:51.030819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.033268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.033758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.037005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.037647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.038996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.062024 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] HTTP exception thrown: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Request method failure captured: Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 HTTP/1.1 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2OVnB7FxDRKJjw2jBW_KPc-2nmgBrM_xSHIx4FZnoxtbJD0Pj81UxJ5f1a3Kds71Fu0l1qQdkdr0dSiGSZDvWYgQqcusK0J5rtxuPYl3d1VxItpEDADBY-BTVJWWafhjl0U2h8o97NOgCY3QlMHfqa0nsldCGwZuZt69OysH-BU_Jk Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: b555dfb91c5a42bab2f0bad67fc5a463 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-203423506 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b555dfb91c5a42bab2f0bad67fc5a463"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b555dfb91c5a42bab2f0bad67fc5a463"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b555dfb91c5a42bab2f0bad67fc5a463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b555dfb91c5a42bab2f0bad67fc5a463"}]}] Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-203423506 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: b555dfb91c5a42bab2f0bad67fc5a463 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-203423506 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestMultiTenantJSON-203423506-project Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: dd62e50f73a048eb845ce7dd509e7fe7 Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-203423506-project Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8'} Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:29:51.064083 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.069009 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.072082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Returning 404 to user: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:29:51.074267 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b442de9-e36b-44c1-a5ad-466332f14957 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 404 len: 111 microversion: 2.1 time: 0.539474 Oct 22 03:29:51.080193 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2807/5484] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:29:50 2022] DELETE /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 111 bytes in 546 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:29:51.087949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:51.090048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:51.099483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.100376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.101082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.102880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.103867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.104655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.397155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:51.403621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:51.421459 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6368afc-a6a5-4f2a-bed6-eda558fde2e2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1681 microversion: 2.1 time: 0.515292 Oct 22 03:29:51.422403 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2678/5485] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:50 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1681 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:51.426917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2a9f71f7-0875-4b89-83b9-11ed088c1d09 req-f7ee6eec-5a51-4ff4-9ad5-35b82050248b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38dde064-4b72-41c1-bb2a-a9a409090ae8", "tag": "ccb53179-9c75-4208-bed6-51b7b2f38fca"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:51.447363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2a9f71f7-0875-4b89-83b9-11ed088c1d09 req-f7ee6eec-5a51-4ff4-9ad5-35b82050248b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.449466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2a9f71f7-0875-4b89-83b9-11ed088c1d09 req-f7ee6eec-5a51-4ff4-9ad5-35b82050248b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.450386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2a9f71f7-0875-4b89-83b9-11ed088c1d09 req-f7ee6eec-5a51-4ff4-9ad5-35b82050248b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.458689 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c52a62c3-be2f-4158-8c59-b5f17dfd0041 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1528 microversion: 2.1 time: 0.375646 Oct 22 03:29:51.460051 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2808/5486] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:51 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1528 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:51.476486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:51.476895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:51.493177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.493677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.497991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.498836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.499322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.499763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.508015 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2a9f71f7-0875-4b89-83b9-11ed088c1d09 req-f7ee6eec-5a51-4ff4-9ad5-35b82050248b service nova] Creating event network-changed:ccb53179-9c75-4208-bed6-51b7b2f38fca for instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 on n-h1-862416-2 Oct 22 03:29:51.521933 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2a9f71f7-0875-4b89-83b9-11ed088c1d09 req-f7ee6eec-5a51-4ff4-9ad5-35b82050248b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097580 Oct 22 03:29:51.522561 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2679/5487] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:51.528122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Action: 'update', calling method: >, body: {"server": {"name": "bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8_new"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:51.541028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:51.561266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.562137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.562812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.563774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.566292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.566996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.605550 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] HTTP exception thrown: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Request method failure captured: Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: request: PUT /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 HTTP/1.1 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 64 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2OVnB7FxDRKJjw2jBW_KPc-2nmgBrM_xSHIx4FZnoxtbJD0Pj81UxJ5f1a3Kds71Fu0l1qQdkdr0dSiGSZDvWYgQqcusK0J5rtxuPYl3d1VxItpEDADBY-BTVJWWafhjl0U2h8o97NOgCY3QlMHfqa0nsldCGwZuZt69OysH-BU_Jk Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: b555dfb91c5a42bab2f0bad67fc5a463 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-203423506 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b555dfb91c5a42bab2f0bad67fc5a463"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b555dfb91c5a42bab2f0bad67fc5a463"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b555dfb91c5a42bab2f0bad67fc5a463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b555dfb91c5a42bab2f0bad67fc5a463"}]}] Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-203423506 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: b555dfb91c5a42bab2f0bad67fc5a463 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-203423506 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestMultiTenantJSON-203423506-project Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: dd62e50f73a048eb845ce7dd509e7fe7 Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-203423506-project Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: {"server": {"name": "bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8_new"}} Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8', 'body': {'server': {'name': 'bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8_new'}}} Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:29:51.612729 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:29:51.617987 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:51.620012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] Returning 404 to user: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:29:51.622742 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ee370fb-cc41-4cdd-8b6e-e5f3fa925467 tempest-ServersNegativeTestMultiTenantJSON-203423506 tempest-ServersNegativeTestMultiTenantJSON-203423506-project] 10.222.0.25 "PUT /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 404 len: 111 microversion: 2.1 time: 0.098768 Oct 22 03:29:51.627604 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2680/5488] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:29:51 2022] PUT /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:29:51.635189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d6711f35-0493-4959-b86a-2e4bc5cd0c69 req-7bd7b10a-893f-410b-8d4b-eacd7cc66c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89782eb-e2e0-47b5-98a2-2099c306dde7", "name": "network-vif-deleted", "tag": "d1b8022b-ffeb-48a0-924d-ad14130ef56b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:51.646610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d6711f35-0493-4959-b86a-2e4bc5cd0c69 req-7bd7b10a-893f-410b-8d4b-eacd7cc66c54 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.647382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d6711f35-0493-4959-b86a-2e4bc5cd0c69 req-7bd7b10a-893f-410b-8d4b-eacd7cc66c54 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.648174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d6711f35-0493-4959-b86a-2e4bc5cd0c69 req-7bd7b10a-893f-410b-8d4b-eacd7cc66c54 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.662771 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d6711f35-0493-4959-b86a-2e4bc5cd0c69 req-7bd7b10a-893f-410b-8d4b-eacd7cc66c54 service nova] Creating event network-vif-deleted:d1b8022b-ffeb-48a0-924d-ad14130ef56b for instance a89782eb-e2e0-47b5-98a2-2099c306dde7 on n-h2-862416-2 Oct 22 03:29:51.669290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d6711f35-0493-4959-b86a-2e4bc5cd0c69 req-7bd7b10a-893f-410b-8d4b-eacd7cc66c54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038314 Oct 22 03:29:51.670696 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2681/5489] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:29:51.676504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:51.677476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:51.685160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.686217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.687025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.687998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.688719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.689402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.723896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:29:51.854021 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cc276eb9-fe5e-44e4-92fb-3147669d31ce tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 204 len: 0 microversion: 2.1 time: 0.180443 Oct 22 03:29:51.855497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2682/5490] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:29:51 2022] DELETE /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:29:51.864582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:51.866346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:51.870010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:51.876155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.882723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.888136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.889537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.890227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.891343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.941013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:51.942074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:51.942836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:51.943593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lazy-loading 'fault' on Instance uuid a89782eb-e2e0-47b5-98a2-2099c306dde7 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:29:52.006898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:52.017343 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b98fb218-f54b-4e7b-ab64-99e4715959b1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 200 len: 1299 microversion: 2.1 time: 0.159295 Oct 22 03:29:52.032263 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2683/5491] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:51 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 1299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:52.056737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:52.060683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:52.071629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:52.072345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:52.072849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:52.074383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:52.074383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:52.075448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:52.115291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:52.125480 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ca869d7-70bb-45b6-a3d9-62a9066c66f3 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.664320 Oct 22 03:29:52.139966 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2809/5492] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:51 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:52.358721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:52.369894 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b2cb2ff-1bc3-42be-921b-b22fafe2bc8b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1534 microversion: 2.1 time: 0.346548 Oct 22 03:29:52.384560 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2684/5493] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:52 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1534 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:52.450014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:52.451188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:52.464305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:52.466834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:52.470017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:52.471115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:52.475371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:52.476247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:52.780402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:52.795218 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8647179e-d890-4f33-b8e6-811a1c024f06 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1681 microversion: 2.1 time: 0.349659 Oct 22 03:29:52.795830 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2810/5494] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:52 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1681 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:53.050135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:53.051390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:53.066092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.067474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.069375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.070812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.073065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.075491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.119727 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 HTTP/1.1 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'a89782eb-e2e0-47b5-98a2-2099c306dde7'} Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:53.122663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e78b62a7-08ff-4ee4-a855-465484f167e4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 404 len: 111 microversion: 2.1 time: 0.078571 Oct 22 03:29:53.129549 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2685/5495] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:53 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:29:53.137160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:53.138141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:53.146638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.147202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.147708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.148526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.149171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.149705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.156753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:53.157370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:53.169254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.169747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.170188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.170906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.171358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.171783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.190047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:29:53.370303 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c43767c7-4794-4e97-9a5b-f28c22d5a366 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 204 len: 0 microversion: 2.1 time: 0.224588 Oct 22 03:29:53.382753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2811/5496] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:29:53 2022] DELETE /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:29:53.392019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:53.393059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:53.402029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.402886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.403585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.420051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.421481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.424043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.602938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:53.613065 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e925e12-47f8-420e-acdf-7c1d46e5eaeb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.466947 Oct 22 03:29:53.613662 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2686/5497] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:53 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:53.626173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:53.626798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:53.649235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.650103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.650584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.651350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.652374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.652817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.945335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:53.955111 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3df43619-e60f-4ce2-ad18-cdd06382470c tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1534 microversion: 2.1 time: 0.336005 Oct 22 03:29:53.958777 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2687/5498] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:53 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1534 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:53.964501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:53.965992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:53.975668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.976424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.978596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:53.979526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:53.981893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:53.982783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:54.305331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:54.307023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:54.316465 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c6fdfef-708a-43ff-9561-c41dcac53ffe tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1681 microversion: 2.1 time: 0.356204 Oct 22 03:29:54.326324 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7f41c2c2-b55c-47f5-92c2-f4e8ba3e1ca9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1495 microversion: 2.1 time: 0.936778 Oct 22 03:29:54.328532 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2812/5499] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:53 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1495 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:54.342111 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2688/5500] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:53 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1681 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:54.641972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:54.642587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:54.661290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:54.662193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:54.662643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:54.663367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:54.663830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:54.664284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:54.988368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:54.989205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:55.004998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:55.007154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:55.008104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:55.010099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:55.010578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:55.012025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:55.068443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:55.083233 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e03cef89-0e9f-4a46-9094-af47e5c9169d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.445253 Oct 22 03:29:55.084135 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2813/5501] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:54 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:55.349660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:55.350541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:55.361563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:55.362062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:55.362506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:55.374029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:55.374701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:55.380765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:55.418880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:55.824223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:55.842438 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4d6d2ad-d9b1-48c4-a197-145a1d8d51cf tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1681 microversion: 2.1 time: 0.497153 Oct 22 03:29:55.844921 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2814/5502] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:55 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1681 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:55.855544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:55.857357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:55.873685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:55.874667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:55.875760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:55.892166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:55.894181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:55.896419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:56.054656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:56.070769 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-37310054-6a94-4915-8f11-029569d80967 tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1534 microversion: 2.1 time: 1.087270 Oct 22 03:29:56.071870 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2689/5503] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:54 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1534 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:56.131819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:56.132473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:56.144106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:56.144693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:56.145137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:56.156781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:56.157567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:56.158170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:56.408767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:56.418074 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e46aa4fa-6235-4a38-a6cc-721deba0d05e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1495 microversion: 2.1 time: 0.569335 Oct 22 03:29:56.419217 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2815/5504] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:55 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1495 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:56.612347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:56.626297 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bc8fe217-84eb-4707-b13f-b00b5f256a52 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.498202 Oct 22 03:29:56.626893 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2690/5505] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:56 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:56.870767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:56.871485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:56.887515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:56.888087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:56.888563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:56.895688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:56.898394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:56.899139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:56.960908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-53e4f749-815f-44fb-9ad6-7fedcffac2b1 req-c076fb7c-8f85-486a-82c4-ea1e51080a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8", "name": "network-vif-deleted", "tag": "e7ad05bb-14ad-428f-94c5-dd978de03352"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:56.981354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-53e4f749-815f-44fb-9ad6-7fedcffac2b1 req-c076fb7c-8f85-486a-82c4-ea1e51080a23 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:56.982120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-53e4f749-815f-44fb-9ad6-7fedcffac2b1 req-c076fb7c-8f85-486a-82c4-ea1e51080a23 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:56.982722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-53e4f749-815f-44fb-9ad6-7fedcffac2b1 req-c076fb7c-8f85-486a-82c4-ea1e51080a23 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:57.012856 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-53e4f749-815f-44fb-9ad6-7fedcffac2b1 req-c076fb7c-8f85-486a-82c4-ea1e51080a23 service nova] Creating event network-vif-deleted:e7ad05bb-14ad-428f-94c5-dd978de03352 for instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 on n-h1-862416-2 Oct 22 03:29:57.021976 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-53e4f749-815f-44fb-9ad6-7fedcffac2b1 req-c076fb7c-8f85-486a-82c4-ea1e51080a23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064861 Oct 22 03:29:57.031662 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2691/5506] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:57.104517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:57.106220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:57.116634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:57.117848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:57.118681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:57.119586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:57.120230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:57.121711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:57.183696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:57.196595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d902a0e-423d-445c-a051-0fffb6dd1528 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1613 microversion: 2.1 time: 0.329971 Oct 22 03:29:57.199367 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2816/5507] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:56 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1613 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:57.333761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:57.345151 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86522d6d-970b-46fe-b5fc-2cd9cb12179a tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1492 microversion: 2.1 time: 0.247398 Oct 22 03:29:57.346135 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2692/5508] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:57 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1492 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:57.442604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:57.444124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:57.453686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:57.454393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:57.455358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:57.456314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:57.456964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:57.458139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:57.597915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:57.634678 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e17ebd0-77eb-4b2a-ba04-c9ef13579f4b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 200 len: 1453 microversion: 2.1 time: 0.189916 Oct 22 03:29:57.637463 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2817/5509] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:57 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:57.654546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:57.659048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:57.667790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:57.672505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:57.673275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:57.674875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:57.676753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:57.677371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:57.926539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:57.944724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90bd5692-a55a-4945-8e53-b8e4c5ee8b1a tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.297519 Oct 22 03:29:57.945322 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2693/5510] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:57 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:58.233554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:58.235506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:58.249306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.251282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.253797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.255084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.258339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.260743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.361208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.361944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.362401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.362865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lazy-loading 'fault' on Instance uuid aef4847d-914d-471c-806c-0b1b21dc70c7 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:29:58.373697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:58.375636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:58.392092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.404351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.406404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.407940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.412408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.422309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.570215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.577000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.581540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.582327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lazy-loading 'fault' on Instance uuid bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:29:58.777743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:58.787222 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16d3ed31-5b71-4c22-97bf-430f7b831cf1 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1330 microversion: 2.1 time: 0.566268 Oct 22 03:29:58.792933 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2818/5511] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:58 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1330 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:58.804828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:58.805798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:58.807727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13bba226e79645aabd4d5404cf129ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89fd7c3d03f4e05b837f86969b2e095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:58.817991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.818512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.821363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.822046 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f0f09298-5a54-40ea-adcc-891bb01c558b tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 200 len: 1318 microversion: 2.1 time: 0.453506 Oct 22 03:29:58.822664 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2694/5512] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:58 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:58.823172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.824803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.825550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.851665 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 HTTP/1.1 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '94a2ef56-38a7-4243-9b6a-567c091a20f6'} Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:29:58.861504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0b6f963-0d07-4381-93d3-93cfb13c25f3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 404 len: 111 microversion: 2.1 time: 0.068846 Oct 22 03:29:58.867539 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2819/5513] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:58 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:29:58.971333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:58.973577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:58.983515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.986346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.986892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:58.989446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:58.993460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:58.993997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:59.059235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d96fc8fe-63fd-4a39-bb8e-2cb176f053d7 req-9b41885d-3712-4302-bce3-c1aa4a67de62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a2ef56-38a7-4243-9b6a-567c091a20f6", "name": "network-vif-deleted", "tag": "ad945fba-220b-483c-b0c1-b4dd879ea48f"}, {"server_uuid": "aef4847d-914d-471c-806c-0b1b21dc70c7", "name": "network-vif-deleted", "tag": "15b345c7-e9b3-4f14-a7bd-ade48549d5c0"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:59.092814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d96fc8fe-63fd-4a39-bb8e-2cb176f053d7 req-9b41885d-3712-4302-bce3-c1aa4a67de62 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:59.096746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d96fc8fe-63fd-4a39-bb8e-2cb176f053d7 req-9b41885d-3712-4302-bce3-c1aa4a67de62 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:59.102602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d96fc8fe-63fd-4a39-bb8e-2cb176f053d7 req-9b41885d-3712-4302-bce3-c1aa4a67de62 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:59.125434 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d96fc8fe-63fd-4a39-bb8e-2cb176f053d7 req-9b41885d-3712-4302-bce3-c1aa4a67de62 service nova] Creating event network-vif-deleted:ad945fba-220b-483c-b0c1-b4dd879ea48f for instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 on n-h1-862416-2 Oct 22 03:29:59.126306 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d96fc8fe-63fd-4a39-bb8e-2cb176f053d7 req-9b41885d-3712-4302-bce3-c1aa4a67de62 service nova] Creating event network-vif-deleted:15b345c7-e9b3-4f14-a7bd-ade48549d5c0 for instance aef4847d-914d-471c-806c-0b1b21dc70c7 on n-h1-862416-2 Oct 22 03:29:59.135337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d96fc8fe-63fd-4a39-bb8e-2cb176f053d7 req-9b41885d-3712-4302-bce3-c1aa4a67de62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080722 Oct 22 03:29:59.137264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2820/5514] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:29:59.148343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-575476317", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "1dca30ca-b544-47c6-a616-7a126cc52745"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:29:59.246796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] validate_networks() for [('1dca30ca-b544-47c6-a616-7a126cc52745', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:29:59.546332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:29:59.553506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:29:59.560199 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a712fac8-75b0-4dfb-aedb-983256164e10 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.593020 Oct 22 03:29:59.580841 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2695/5515] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:58 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:29:59.824459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:29:59.830733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:29:59.860580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:59.864179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:59.864921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:29:59.869768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:29:59.871816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:29:59.874422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:00.013639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:00.015087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:00.015547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:00.016023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lazy-loading 'fault' on Instance uuid aef4847d-914d-471c-806c-0b1b21dc70c7 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:30:00.106977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad9769823b74399aabb7395eeee44aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad1fddb86944bec981cfdd824d8dcf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:00.116803 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ce72ae0-6010-4ba4-bf01-ce67c7127dd2 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 200 len: 1330 microversion: 2.1 time: 0.305709 Oct 22 03:30:00.117430 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2696/5516] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:29:59 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 1330 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:00.143350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:00.144201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] [instance: bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:00.153196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:00.155142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:00.155884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:00.159950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:00.160760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:00.161483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:00.230327 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] HTTP exception thrown: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Request method failure captured: Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 HTTP/1.1 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2N9F7vXlwScVTjzWzSTEm8v_Bj-9sfxJ6fNJUJhVTaW_jiV-npktSTYpJuKKk1pYnMqCE9Mv1g-6n9tK8PegzrEKNWehrVFqW4ZbuhiwcrTBVqi2h9M2FNeF9hsmEOwikPE-hXpqpnYezobLpNa-pIdRIO2Mv9UzKNCtHHXIA3SCb8 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: c89fd7c3d03f4e05b837f86969b2e095 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1190298280 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c89fd7c3d03f4e05b837f86969b2e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c89fd7c3d03f4e05b837f86969b2e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c89fd7c3d03f4e05b837f86969b2e095"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c89fd7c3d03f4e05b837f86969b2e095"}]}] Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1190298280 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: c89fd7c3d03f4e05b837f86969b2e095 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1190298280 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1190298280-project Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 13bba226e79645aabd4d5404cf129ad8 Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1190298280-project Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8'} Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:30:00.232673 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] Returning 404 to user: Instance bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:00.237362 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-909dad6a-3a26-4cc9-b38c-cfcab30478dd tempest-ServersNegativeTestMultiTenantJSON-1190298280 tempest-ServersNegativeTestMultiTenantJSON-1190298280-project] 10.222.0.25 "GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8" status: 404 len: 111 microversion: 2.1 time: 0.097867 Oct 22 03:30:00.276075 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2697/5517] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:00 2022] GET /compute/v2.1/servers/bfa9ada4-7c8d-4e01-bfc7-d40aed420ab8 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:00.373383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:00.374196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:00.387629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:00.388124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:00.397074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:00.397875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:00.398363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:00.398803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:00.752705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lazy-loading 'services' on Instance uuid 41b96077-d04d-4bb7-b33b-632d27cebe25 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:30:00.993682 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1133f8d-ff90-4bc1-9842-c348860e8110 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments/c6df16c4-ede1-427f-be4c-a2c7339b6d51" status: 202 len: 0 microversion: 2.1 time: 0.627786 Oct 22 03:30:00.994441 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2698/5518] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:30:00 2022] DELETE /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments/c6df16c4-ede1-427f-be4c-a2c7339b6d51 => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:30:01.067239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:01.068415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:01.099614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:01.103357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:01.104084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:01.107799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:01.108866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:01.109550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:01.880836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:01.890999 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ecb2218b-a001-4950-844d-473396e1a4eb tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.884770 Oct 22 03:30:01.896614 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2699/5519] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:00 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:01.905367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:01.907682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:01.913955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:01.914702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:01.915322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:01.916352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:01.917061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:01.918118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:01.946951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:30:01.947625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:30:01.948126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:30:01.948797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:30:01.949457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:30:01.966247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:01.967018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:01.970110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:01.971417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:01.972081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:01.972729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:01.977937 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9f61ad62-c1fd-4f8c-bf89-b646f8cc98cf tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076649 Oct 22 03:30:01.978858 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2700/5520] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:01 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:02.004656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:02.005789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:02.029781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:02.031493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:02.032535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:02.034224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:02.038137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:02.039296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:02.056302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:30:02.075965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:30:02.092179 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 HTTP/1.1 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'aef4847d-914d-471c-806c-0b1b21dc70c7'} Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:02.097688 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:02.103095 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:02.103095 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:02.103095 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:02.103095 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:02.103095 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:02.103095 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:02.103095 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:02.105965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:02.110616 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3bb859f1-c85f-4234-a3ff-f0ccc6774915 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 404 len: 111 microversion: 2.1 time: 0.130622 Oct 22 03:30:02.115609 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2701/5521] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:01 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:02.128952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63d6f1b8-0d37-4b5e-a7f1-205e2edefa34 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '.version_select at 0x7f0d1993d670>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:02.132623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:30:02.137457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:30:02.196941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63d6f1b8-0d37-4b5e-a7f1-205e2edefa34 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587517080" status: 202 len: 0 microversion: 2.1 time: 0.076283 Oct 22 03:30:02.205605 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2702/5522] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:30:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587517080 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:30:02.241072 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3562a153-e090-4608-921c-339b5a3e3a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.101981 Oct 22 03:30:02.241753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2821/5523] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:29:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:30:02.256351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6648543-db0a-4db1-9463-d58141394b1a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:02.257412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6648543-db0a-4db1-9463-d58141394b1a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:02.616933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6648543-db0a-4db1-9463-d58141394b1a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:02.654085 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6648543-db0a-4db1-9463-d58141394b1a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1208 microversion: 2.1 time: 0.399670 Oct 22 03:30:02.655626 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2703/5524] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:02 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1208 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:02.923646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:02.924445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:02.946611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:02.952304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:02.953669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:02.955684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:02.960146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:02.961701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:02.991217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:02.994006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:03.003238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:03.006657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:03.007364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:03.014739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:03.017903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:03.018624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:03.115941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f56b1fb-c378-4b01-93aa-d88e68f246c0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128510 Oct 22 03:30:03.119372 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2704/5525] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:02 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:03.435985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:03.447847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f2c1859-bdfc-452b-97a0-b2d9a590125c tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.525314 Oct 22 03:30:03.449565 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2822/5526] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:02 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:03.679889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:03.681618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:03.703534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:03.705482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:03.706269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:03.709462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:03.710031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:03.710720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:04.133474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:04.137906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:04.162740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:04.174995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:04.176094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:04.177040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:04.178607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:04.180900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:04.181447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:04.205876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:04.217436 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68fd1d97-83f6-4fbb-9a69-dc9b81429dce tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1260 microversion: 2.1 time: 0.541837 Oct 22 03:30:04.220358 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2705/5527] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:03 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1260 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:04.285548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b20b26e9-34fa-4ac1-aa06-e3d9410734e6 req-02e30f93-1fc2-4513-a32e-44034c8f89c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dde064-4b72-41c1-bb2a-a9a409090ae8", "name": "network-vif-plugged", "status": "completed", "tag": "ccb53179-9c75-4208-bed6-51b7b2f38fca"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:04.301417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b20b26e9-34fa-4ac1-aa06-e3d9410734e6 req-02e30f93-1fc2-4513-a32e-44034c8f89c4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:04.305563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b20b26e9-34fa-4ac1-aa06-e3d9410734e6 req-02e30f93-1fc2-4513-a32e-44034c8f89c4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:04.306916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b20b26e9-34fa-4ac1-aa06-e3d9410734e6 req-02e30f93-1fc2-4513-a32e-44034c8f89c4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:04.351191 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b20b26e9-34fa-4ac1-aa06-e3d9410734e6 req-02e30f93-1fc2-4513-a32e-44034c8f89c4 service nova] Creating event network-vif-plugged:ccb53179-9c75-4208-bed6-51b7b2f38fca for instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 on n-h1-862416-2 Oct 22 03:30:04.358853 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f9d614e-18c6-4a22-bbd9-e5ce0df55d42 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.229034 Oct 22 03:30:04.364032 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2823/5528] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:04 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:04.372970 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b20b26e9-34fa-4ac1-aa06-e3d9410734e6 req-02e30f93-1fc2-4513-a32e-44034c8f89c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091002 Oct 22 03:30:04.378704 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2706/5529] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:30:04.476453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:04.477250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:04.531771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:04.537206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:04.540642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:04.541849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:04.545607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:04.546280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:05.249049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:05.249757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:05.263688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:05.266960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:05.268413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:05.274650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:05.275158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:05.280412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:05.405521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:05.418631 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa2e78f7-4616-4719-a9ca-7a9719dba1c6 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1316 microversion: 2.1 time: 0.947863 Oct 22 03:30:05.419551 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2824/5530] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:04 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1316 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:05.437671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:05.441111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:05.449173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:05.450354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:05.451082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:05.452064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:05.452790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:05.453448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:05.545142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:05.550902 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7fd0f73f-3e42-4c30-a07e-a8e82bbf7fa8 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130261 Oct 22 03:30:05.555930 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2825/5531] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:05 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:05.556737 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f29243a-a89c-4aa1-816d-e6d8cb2f231b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1266 microversion: 2.1 time: 0.312100 Oct 22 03:30:05.568241 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2707/5532] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:05 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:06.442962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:06.443690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:06.463316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:06.466801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:06.469336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:06.472069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:06.474932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:06.491616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:06.563754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:06.567076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:06.579873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:06.581584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:06.583069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:06.584915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:06.586400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:06.587930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:06.694640 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d9b2ddb3-038c-41e0-87a6-eb193c2d5779 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132167 Oct 22 03:30:06.695225 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2708/5533] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:06 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:06.709687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:06.710321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:06.723609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:06.724102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:06.727287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:06.732829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:06.735722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:06.736406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.063944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:07.086005 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f1716b9-f921-4230-aab6-c837869db461 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1505 microversion: 2.1 time: 0.643028 Oct 22 03:30:07.086005 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2826/5534] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:06 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:07.138426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:07.138939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:07.147174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.147670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.148116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.157577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.158434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.159204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.203783 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d420b558-bd9b-4101-b5dd-98f454fc5fd0 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8/ips" status: 200 len: 109 microversion: 2.1 time: 0.079228 Oct 22 03:30:07.209662 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2827/5535] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:30:07 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8/ips => generated 109 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:07.223739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:07.224581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:07.238605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:07.258236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.258869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.259408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.260300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.261854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.266342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.266533 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4776a84d-3007-4796-a493-80da6bca8f77 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1266 microversion: 2.1 time: 0.566145 Oct 22 03:30:07.269883 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2709/5536] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:06 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1266 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:07.351530 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-58398840-9182-4b2d-b482-82099df79f60 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8/ips" status: 200 len: 109 microversion: 2.1 time: 0.132806 Oct 22 03:30:07.358832 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2828/5537] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:30:07 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8/ips => generated 109 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:07.365631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:07.367548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:07.389058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.390952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.392758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.394672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.396241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.398351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.456530 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7cca0e4a-0397-4720-a8d2-8b85b9ca42cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8/ips/tempest-ServerAddressesTestJSON-1036005779-network" status: 200 len: 94 microversion: 2.1 time: 0.095461 Oct 22 03:30:07.457766 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2710/5538] 10.222.0.25 () {58 vars in 1401 bytes} [Sat Oct 22 03:30:07 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8/ips/tempest-ServerAddressesTestJSON-1036005779-network => generated 94 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:30:07.475131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:07.476631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:07.490136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.490959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.491652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.492673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.493722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.494617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.547332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:30:07.741184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:07.767766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:07.799835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.802960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.803593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.807342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.807957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.808443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.809887 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8cbcb9a6-bea2-4c56-8e0c-2924c23d3b2d tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "DELETE /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 204 len: 0 microversion: 2.1 time: 0.340587 Oct 22 03:30:07.810515 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2829/5539] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:07 2022] DELETE /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:30:07.837503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:07.843598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:07.855870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.859533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.860521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.864989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:07.866231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:07.869207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:07.903785 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5c8f3cc-1cd0-4d2d-8a20-01eb9eb23159 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196671 Oct 22 03:30:07.911293 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2711/5540] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:07 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:08.295066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:08.296022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:08.309061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:08.309778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:08.310401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:08.313828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:08.314487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:08.318186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:08.366259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:08.393030 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f42cf3c8-fb50-45db-91aa-406916858c28 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1511 microversion: 2.1 time: 0.576159 Oct 22 03:30:08.393645 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2830/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:07 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1511 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:08.501555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:08.517539 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4886d277-928f-430e-9db6-5547bb4be1d1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1266 microversion: 2.1 time: 0.227198 Oct 22 03:30:08.520314 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2712/5542] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:08 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:08.920063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:08.924807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:08.941181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:08.941684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:08.942132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:08.942854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:08.949640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:08.950377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:09.049659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:09.082156 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2f05d481-f187-4faa-9b61-d09f86844936 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168031 Oct 22 03:30:09.088488 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2831/5543] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:08 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:09.417635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:09.418935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:09.438839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:09.439604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:09.440344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:09.441251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:09.441976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:09.442441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:09.549855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:09.550475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:09.590654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:09.592602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:09.595833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:09.598840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:09.599563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:09.605134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:10.457711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:10.489771 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b9e2813-b39f-438d-b5fa-5395e14d6628 tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1511 microversion: 2.1 time: 1.075090 Oct 22 03:30:10.509097 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2713/5544] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:09 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1511 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:10.529493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:10.539521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:10.554773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:10.555567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:10.556180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:10.557216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:10.559344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:10.560015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:10.644348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:10.648730 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd0c76ae-2bbd-43eb-9816-5d95dbfa2c0e tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137739 Oct 22 03:30:10.656331 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2714/5545] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:10 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:10.661876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-80e28c79-3dc9-48b5-9554-61ca2d5e00d3 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 1.109301 Oct 22 03:30:10.668366 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2832/5546] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:09 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:11.522099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:11.523391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:11.539490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:11.544421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:11.545782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:11.549098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:11.553693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:11.554426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:11.666699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:11.670451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:11.691419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:11.692637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:11.693308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:11.694276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:11.694934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:11.695569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:11.782508 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bea21c5f-342b-4e76-85f1-b6db5e7e9879 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120567 Oct 22 03:30:11.785600 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2833/5547] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:30:11 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:30:11.794263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fd6f8394843e0bc68316ef8a5c1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f0271d17c442ce84bf9e979b31bed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:11.804710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:11.850375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:11.858774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:11.865327 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ef0494d-4ece-4b75-8d54-019dddd537cc tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 200 len: 1469 microversion: 2.1 time: 0.344399 Oct 22 03:30:11.871816 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2715/5548] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:11 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 1469 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:11.897389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2f34a82f-1933-421b-b727-094a069892c3 req-e71a4590-f381-4a84-aebf-b199f55718a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dde064-4b72-41c1-bb2a-a9a409090ae8", "name": "network-vif-deleted", "tag": "ccb53179-9c75-4208-bed6-51b7b2f38fca"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:11.899025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:11.908693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:11.910887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:11.911763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:11.916036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:11.921473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:11.954468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2f34a82f-1933-421b-b727-094a069892c3 req-e71a4590-f381-4a84-aebf-b199f55718a2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:11.956089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2f34a82f-1933-421b-b727-094a069892c3 req-e71a4590-f381-4a84-aebf-b199f55718a2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:11.959702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2f34a82f-1933-421b-b727-094a069892c3 req-e71a4590-f381-4a84-aebf-b199f55718a2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:12.023029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:12.023489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2f34a82f-1933-421b-b727-094a069892c3 req-e71a4590-f381-4a84-aebf-b199f55718a2 service nova] Creating event network-vif-deleted:ccb53179-9c75-4208-bed6-51b7b2f38fca for instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 on n-h1-862416-2 Oct 22 03:30:12.034098 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2f34a82f-1933-421b-b727-094a069892c3 req-e71a4590-f381-4a84-aebf-b199f55718a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160287 Oct 22 03:30:12.035317 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2716/5549] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:12.048041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:12.051820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:12.071563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:12.075314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:12.076932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:12.077883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:12.078540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:12.079994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:12.115108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:12.150335 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Cannot 'reboot' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8/action HTTP/1.1 Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 28 Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: {"reboot": {"type": "HARD"}} Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot 'reboot' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd097da5a-0301-425a-8004-5bfbdfc3ebe8', 'body': {'reboot': {'type': 'HARD'}}} Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:30:12.159295 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued Oct 22 03:30:12.165390 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.167842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 409 to user: Cannot 'reboot' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:12.173081 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e1ab94ab-eb71-4579-aa9c-7f46cfb4dff7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8/action" status: 409 len: 145 microversion: 2.1 time: 0.128417 Oct 22 03:30:12.175400 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2717/5550] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:30:12 2022] POST /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8/action => generated 145 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:30:12.189628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:12.197878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:12.234278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:12.235657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:12.237475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:12.239990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:12.241699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:12.242401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:12.387281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Cannot 'rebuild' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8/action HTTP/1.1 Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 65 Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: exception: Cannot 'rebuild' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd097da5a-0301-425a-8004-5bfbdfc3ebe8', 'body': {'rebuild': {'imageRef': '78462069-c4b0-4a1c-b064-2d19ad600046'}}} Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:30:12.389604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:12.394392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 409 to user: Cannot 'rebuild' instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 while it is in vm_state rescued {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:12.396635 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08717c36-bdd4-4a7e-b429-b3d4109456fc tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "POST /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8/action" status: 409 len: 146 microversion: 2.1 time: 0.212876 Oct 22 03:30:12.408490 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2718/5551] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:30:12 2022] POST /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8/action => generated 146 bytes in 227 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:30:12.462388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:12.466430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:12.521774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:12.540427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:12.543786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:12.547520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:12.549221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:12.550784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:12.639463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:12.689949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:30:13.060595 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9661930-1dc4-4591-9939-8afebd3de8d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 204 len: 0 microversion: 2.1 time: 0.636749 Oct 22 03:30:13.063525 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2719/5552] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:12 2022] DELETE /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:30:13.092105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:13.097236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] [instance: 38dde064-4b72-41c1-bb2a-a9a409090ae8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:13.123418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:13.124432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:13.125227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:13.126189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:13.126914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:13.127668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:13.200302 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] HTTP exception thrown: Instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 could not be found. Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Request method failure captured: Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 HTTP/1.1 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2OgAVbcg9Cwl950bbevamO3BowyXZ6pQ0U0yxQJMi9qFikAu7eW2EysB4Zrq_PzJLuV_52KuGUJqXXbAfIvAJYl6Ub4FASMTV1PyZwVpNY6BECE9tcPTtV5bfSazdHlJQZc0aLtWey4gaBriaqnn_Mk_XiXdi5cQ1N64YuVkkKWnss Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a9f0271d17c442ce84bf9e979b31bed2 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerAddressesTestJSON-440240483 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9f0271d17c442ce84bf9e979b31bed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9f0271d17c442ce84bf9e979b31bed2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9f0271d17c442ce84bf9e979b31bed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9f0271d17c442ce84bf9e979b31bed2"}]}] Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerAddressesTestJSON-440240483 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a9f0271d17c442ce84bf9e979b31bed2 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerAddressesTestJSON-440240483 Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerAddressesTestJSON-440240483-project Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 5d2fd6f8394843e0bc68316ef8a5c1dd Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerAddressesTestJSON-440240483-project Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 could not be found. Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '38dde064-4b72-41c1-bb2a-a9a409090ae8'} Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 could not be found. Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 could not be found. Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:13.202037 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:13.207199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:13.207199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:13.207199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:13.207199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:13.207199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:13.207199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 could not be found. Oct 22 03:30:13.207199 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:13.216648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] Returning 404 to user: Instance 38dde064-4b72-41c1-bb2a-a9a409090ae8 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:13.218453 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8b2fb767-5ad8-4895-95de-d53535af915e tempest-ServerAddressesTestJSON-440240483 tempest-ServerAddressesTestJSON-440240483-project] 10.222.0.25 "GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8" status: 404 len: 111 microversion: 2.1 time: 0.151119 Oct 22 03:30:13.224628 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2720/5553] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:13 2022] GET /compute/v2.1/servers/38dde064-4b72-41c1-bb2a-a9a409090ae8 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:13.232973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:13.244491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:13.276139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:13.286206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:13.287266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:13.300721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:13.301344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:13.306124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:13.878069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:13.889611 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f84c4d6e-37b8-40bc-bb77-497f049531ee tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1688 microversion: 2.1 time: 0.660721 Oct 22 03:30:13.906036 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2721/5554] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:13 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1688 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:14.014375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:14.028959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1dc7b7a-fb37-418b-8da4-83d674f6d2cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 2.239792 Oct 22 03:30:14.031662 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2834/5555] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:11 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:14.128361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-dadd38f4-9f53-4afc-97cd-9fe7b7d2b94c req-69cc2496-697b-4058-b8b5-f718ac776da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e587ea14-f2df-40d1-9b72-595d7445d5fd", "tag": "bd3f541c-4dd2-4296-b2cd-6027f590f4b0"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:14.178167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dadd38f4-9f53-4afc-97cd-9fe7b7d2b94c req-69cc2496-697b-4058-b8b5-f718ac776da3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:14.180977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dadd38f4-9f53-4afc-97cd-9fe7b7d2b94c req-69cc2496-697b-4058-b8b5-f718ac776da3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:14.184084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dadd38f4-9f53-4afc-97cd-9fe7b7d2b94c req-69cc2496-697b-4058-b8b5-f718ac776da3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:14.223023 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-dadd38f4-9f53-4afc-97cd-9fe7b7d2b94c req-69cc2496-697b-4058-b8b5-f718ac776da3 service nova] Creating event network-changed:bd3f541c-4dd2-4296-b2cd-6027f590f4b0 for instance e587ea14-f2df-40d1-9b72-595d7445d5fd on n-h2-862416-2 Oct 22 03:30:14.250298 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-dadd38f4-9f53-4afc-97cd-9fe7b7d2b94c req-69cc2496-697b-4058-b8b5-f718ac776da3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125681 Oct 22 03:30:14.251255 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2722/5556] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:14.919741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:14.920643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:14.941321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:14.942062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:14.946751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:14.948337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:14.949002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:14.949618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:15.055224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:15.062643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:15.091930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:15.091930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:15.091930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:15.094028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:15.097611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:15.098570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:15.462197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:15.483451 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-286fb746-a0da-4914-ab08-94c81ee2da31 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 0.433465 Oct 22 03:30:15.500484 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2723/5557] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:15 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:16.150954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:16.168463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-76934ef6-a72e-4922-969c-7f4eb02bfda5 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1688 microversion: 2.1 time: 1.252869 Oct 22 03:30:16.188096 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2835/5558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:14 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1688 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:16.509074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:16.509942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:16.541037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:16.542026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:16.542813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:16.543643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:16.544113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:16.544586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:17.202103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:17.203484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:17.254451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:17.257729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:17.266058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:17.272401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:17.273188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:17.277425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:17.804960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:17.818427 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db41bb99-b652-448e-b438-81bd9b5d0d37 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 1.314991 Oct 22 03:30:17.840466 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2724/5559] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:16 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:18.291148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:18.301199 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5381be40-db96-4fb1-b479-ffab1a365f94 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1688 microversion: 2.1 time: 1.105638 Oct 22 03:30:18.308749 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2836/5560] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:17 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1688 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:18.848312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:18.849787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:18.861515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:18.879476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:18.883411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:18.886807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:18.890111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:18.891835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:18.896708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:19.331359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:19.333312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:19.363497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:19.364957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:19.367716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:19.370366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:19.371258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:19.371958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:19.828840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:19.842479 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25492e97-d16e-419e-ace6-51513f4822d0 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1621 microversion: 2.1 time: 0.516191 Oct 22 03:30:19.847800 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2837/5561] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:19 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1621 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:19.869075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:19.869591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:19.893641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:19.894052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:19.894493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:19.895206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:19.895775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:19.896072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:19.926502 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 HTTP/1.1 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'aef4847d-914d-471c-806c-0b1b21dc70c7'} Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:19.928312 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:19.935427 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:19.939698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:19.940641 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2c3f5c0e-f959-4376-8f5e-41de815ee408 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 404 len: 111 microversion: 2.1 time: 0.085276 Oct 22 03:30:19.943053 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2838/5562] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:19 2022] DELETE /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:19.947650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:19.972551 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0ce2dbf-e3ba-45bd-9f36-4c18995c2cbb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 1.128539 Oct 22 03:30:19.974626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:19.983457 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2725/5563] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:18 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:19.985508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: aef4847d-914d-471c-806c-0b1b21dc70c7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:19.997596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:19.999918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:20.001124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:20.001867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:20.002334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:20.002764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:20.044754 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 HTTP/1.1 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'aef4847d-914d-471c-806c-0b1b21dc70c7'} Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:20.046355 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance aef4847d-914d-471c-806c-0b1b21dc70c7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:20.051254 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de00a9a1-8e7b-46cc-90f1-1d08db80d5f5 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7" status: 404 len: 111 microversion: 2.1 time: 0.094018 Oct 22 03:30:20.053981 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2839/5564] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:19 2022] GET /compute/v2.1/servers/aef4847d-914d-471c-806c-0b1b21dc70c7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:20.875704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:20.876674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:20.895421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:20.895920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:20.900049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:20.904609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:20.905124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:20.908360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:21.002370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:21.002978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:21.018014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:21.025905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:21.026739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:21.029176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:21.033079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:21.035706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:21.353640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:21.362424 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dd9fedb7-fe40-4f55-b80f-994e06a7daeb tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1621 microversion: 2.1 time: 0.491786 Oct 22 03:30:21.368453 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2726/5565] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:20 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1621 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:22.074442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:22.085633 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8fee023b-09c5-4342-83eb-5007573d19a4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 1.084875 Oct 22 03:30:22.107801 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2840/5566] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:20 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:22.244579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-df428493-c1de-4c70-ab3d-eba085d58cb5 req-6191b241-3324-4c64-a437-d6ff886667de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b96077-d04d-4bb7-b33b-632d27cebe25", "name": "network-vif-deleted", "tag": "d3202c78-639a-4940-ab07-4ab3beeea85f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:22.268508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-df428493-c1de-4c70-ab3d-eba085d58cb5 req-6191b241-3324-4c64-a437-d6ff886667de service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:22.269871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-df428493-c1de-4c70-ab3d-eba085d58cb5 req-6191b241-3324-4c64-a437-d6ff886667de service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:22.271725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-df428493-c1de-4c70-ab3d-eba085d58cb5 req-6191b241-3324-4c64-a437-d6ff886667de service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:22.299117 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-df428493-c1de-4c70-ab3d-eba085d58cb5 req-6191b241-3324-4c64-a437-d6ff886667de service nova] Creating event network-vif-deleted:d3202c78-639a-4940-ab07-4ab3beeea85f for instance 41b96077-d04d-4bb7-b33b-632d27cebe25 on n-h2-862416-2 Oct 22 03:30:22.311266 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-df428493-c1de-4c70-ab3d-eba085d58cb5 req-6191b241-3324-4c64-a437-d6ff886667de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070350 Oct 22 03:30:22.314092 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2727/5567] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:22.388610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:22.389512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:22.407527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:22.408324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:22.408957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:22.412649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:22.413851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:22.414526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:22.503530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:22.504453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:22.505098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:22.509355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lazy-loading 'fault' on Instance uuid 41b96077-d04d-4bb7-b33b-632d27cebe25 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:30:23.122350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:23.123776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:23.130478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:23.141091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:23.141898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:23.142913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:23.143897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:23.144679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:23.265476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:23.274861 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c8516c8-604a-4e0b-91bd-307877833526 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 200 len: 1334 microversion: 2.1 time: 0.891461 Oct 22 03:30:23.275471 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2841/5568] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:22 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 1334 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:23.724426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:23.741116 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8494f17d-e9d8-405e-8b8f-3e76a4804962 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 0.625647 Oct 22 03:30:23.742203 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2728/5569] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:23 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:24.308194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:24.310167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: 41b96077-d04d-4bb7-b33b-632d27cebe25] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:24.337241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:24.337864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:24.338336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:24.339171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:24.339639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:24.340073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:24.372743 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Instance 41b96077-d04d-4bb7-b33b-632d27cebe25 could not be found. Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 HTTP/1.1 Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 41b96077-d04d-4bb7-b33b-632d27cebe25 could not be found. Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '41b96077-d04d-4bb7-b33b-632d27cebe25'} Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b96077-d04d-4bb7-b33b-632d27cebe25 could not be found. Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b96077-d04d-4bb7-b33b-632d27cebe25 could not be found. Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:24.378511 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b96077-d04d-4bb7-b33b-632d27cebe25 could not be found. Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:24.383046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 404 to user: Instance 41b96077-d04d-4bb7-b33b-632d27cebe25 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:24.387495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ecf49ecc-ddae-4ae3-b02f-d4bac4a26d86 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25" status: 404 len: 111 microversion: 2.1 time: 0.087460 Oct 22 03:30:24.388099 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2842/5570] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:24 2022] GET /compute/v2.1/servers/41b96077-d04d-4bb7-b33b-632d27cebe25 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:24.396477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d68759e0-3fc5-4aef-a2ca-0d698bfd65e1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '.version_select at 0x7f0d1e51eee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:24.454306 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d68759e0-3fc5-4aef-a2ca-0d698bfd65e1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859723391" status: 202 len: 0 microversion: 2.1 time: 0.061710 Oct 22 03:30:24.454903 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2729/5571] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:30:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859723391 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:30:24.767002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:24.767828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:24.786224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:24.787040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:24.787813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:24.788746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:24.789378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:24.789977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:25.962895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:25.983564 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69bc0ddb-52a8-480f-b5a0-9ea54194dcb9 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 1.220364 Oct 22 03:30:25.984181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2843/5572] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:24 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:26.518252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4d0f6559-79fc-42b6-b735-1b6c234008d6 req-426a4fda-1aad-4f8d-ba9d-e761f14b9250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e587ea14-f2df-40d1-9b72-595d7445d5fd", "name": "network-vif-plugged", "status": "completed", "tag": "bd3f541c-4dd2-4296-b2cd-6027f590f4b0"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:26.581149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4d0f6559-79fc-42b6-b735-1b6c234008d6 req-426a4fda-1aad-4f8d-ba9d-e761f14b9250 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:26.581585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4d0f6559-79fc-42b6-b735-1b6c234008d6 req-426a4fda-1aad-4f8d-ba9d-e761f14b9250 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:26.582019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4d0f6559-79fc-42b6-b735-1b6c234008d6 req-426a4fda-1aad-4f8d-ba9d-e761f14b9250 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:26.613104 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4d0f6559-79fc-42b6-b735-1b6c234008d6 req-426a4fda-1aad-4f8d-ba9d-e761f14b9250 service nova] Creating event network-vif-plugged:bd3f541c-4dd2-4296-b2cd-6027f590f4b0 for instance e587ea14-f2df-40d1-9b72-595d7445d5fd on n-h2-862416-2 Oct 22 03:30:26.661852 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4d0f6559-79fc-42b6-b735-1b6c234008d6 req-426a4fda-1aad-4f8d-ba9d-e761f14b9250 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.704611 Oct 22 03:30:26.668646 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2730/5573] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:26.960639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:26.961151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:26.978372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:26.981193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:26.981688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:26.986237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:26.987026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:26.988637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.011299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:27.013644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:27.040676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:27.049322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:27.050162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.054132 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.055479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:27.056253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:27.056934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f HTTP/1.1 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd13cb759-d1e1-43a4-a3e4-5f778581559f'} Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:27.063692 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.068146 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.081085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:27.082963 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8c0833c-a636-40a8-bac3-c367b2b477c8 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 404 len: 111 microversion: 2.1 time: 0.126296 Oct 22 03:30:27.086779 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2844/5574] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:26 2022] DELETE /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:27.099130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:27.107550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: d13cb759-d1e1-43a4-a3e4-5f778581559f] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:27.127862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:27.133322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:27.134070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.137995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:27.138649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:27.139244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.192749 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f HTTP/1.1 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd13cb759-d1e1-43a4-a3e4-5f778581559f'} Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:27.222711 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.236735 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.236735 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:27.236735 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:27.236735 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:27.236735 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:27.236735 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. Oct 22 03:30:27.236735 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.261918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance d13cb759-d1e1-43a4-a3e4-5f778581559f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:27.271788 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-176ebe86-6efc-48b2-b116-b1bb030793ac tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f" status: 404 len: 111 microversion: 2.1 time: 0.181481 Oct 22 03:30:27.274998 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2845/5575] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:27 2022] GET /compute/v2.1/servers/d13cb759-d1e1-43a4-a3e4-5f778581559f => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:27.298517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:27.301929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:27.323947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:27.327205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:27.329572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.334240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:27.335862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:27.337614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.413595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 HTTP/1.1 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1c0147bb-0dba-4e7b-8a85-5816ab10aa14'} Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:27.420802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.428690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.435560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:27.442476 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a5baca22-f470-4b3f-9ed0-ad820e8dd5b9 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 404 len: 111 microversion: 2.1 time: 0.154893 Oct 22 03:30:27.460295 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2846/5576] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:27 2022] DELETE /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:27.516059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:27.522871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: 1c0147bb-0dba-4e7b-8a85-5816ab10aa14] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:27.551838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:27.557261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:27.557855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.565910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:27.566830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:27.574450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:27.663843 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 HTTP/1.1 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1c0147bb-0dba-4e7b-8a85-5816ab10aa14'} Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:27.690189 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.694811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:27.694811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:27.694811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:27.694811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:27.694811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:27.694811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. Oct 22 03:30:27.694811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:27.700906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance 1c0147bb-0dba-4e7b-8a85-5816ab10aa14 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:27.705758 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48666f6b-022a-4ae7-b5da-d1442c63a2d7 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14" status: 404 len: 111 microversion: 2.1 time: 0.239767 Oct 22 03:30:27.709811 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2847/5577] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:27 2022] GET /compute/v2.1/servers/1c0147bb-0dba-4e7b-8a85-5816ab10aa14 => generated 111 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:27.885278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:27.956049 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-845a6cc2-d58c-4a27-adbb-e287e7709b15 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1308 microversion: 2.1 time: 0.945967 Oct 22 03:30:27.961713 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2731/5578] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:27 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1308 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:28.985299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:28.989259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:29.017342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:29.019339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:29.023402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:29.033528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:29.043334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:29.044187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:30.399722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:30.412248 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dcde930d-5c86-45d7-9dab-f7b1ef25c2ec tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1488 microversion: 2.1 time: 1.434803 Oct 22 03:30:30.416956 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2848/5579] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:28 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1488 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:30.443082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:30.446674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:30.471857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:30.473761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:30.475329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:30.477087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:30.480513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:30.481331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:30.676967 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a08df8a8-a67a-4f95-bbe5-831e5211fc85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "PUT /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1083 microversion: 2.1 time: 0.238269 Oct 22 03:30:30.689249 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2732/5580] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:30:30 2022] PUT /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1083 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:30.715538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:30.715943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:30.747217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:30.748175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:30.753097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:30.754078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:30.755046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:30.755757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:31.389801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:31.403507 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eab40c7a-1bf6-4a55-9f25-af47493ca30f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1509 microversion: 2.1 time: 0.697971 Oct 22 03:30:31.404746 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2849/5581] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:30 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1509 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:31.433245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:31.434139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:31.450630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:31.454052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:31.455377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:31.456439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:31.458757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:31.464720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:32.195211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:32.210404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5dd46ae-da07-4ba4-bd1d-d01635142a62 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1509 microversion: 2.1 time: 0.779294 Oct 22 03:30:32.213049 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2733/5582] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:31 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1509 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:32.240806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:32.241750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:32.284038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:32.286564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:32.302101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:32.309623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:32.312790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:32.313603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:32.409642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:30:32.703739 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b345fbf-61bf-49ed-9768-2fc42c86610f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 204 len: 0 microversion: 2.1 time: 0.473797 Oct 22 03:30:32.708843 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2850/5583] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:32 2022] DELETE /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:30:32.715725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:32.716573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:32.727805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:32.734380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:32.736747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:32.737697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:32.748159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:32.753233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:33.370707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:33.408950 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27a944bb-4cb6-4bb7-8b14-7acc5928e574 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1515 microversion: 2.1 time: 0.698094 Oct 22 03:30:33.436154 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2734/5584] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:32 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1515 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:34.436006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:34.437067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:34.439788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:34.455356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:34.480019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:34.480453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:34.492406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:34.492935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:34.493385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:34.525157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:35.927083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:35.927650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:35.969595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:35.972809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:35.973539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:35.974471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:35.986464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:35.987096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:35.991940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:36.025161 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2a5fc66-735d-41bc-bb03-d690229f8716 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1515 microversion: 2.1 time: 1.592656 Oct 22 03:30:36.037240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:36.039848 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 HTTP/1.1 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'bbfd6354-0b31-4bcf-8abb-a408e84093d8'} Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:36.046156 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.052728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.059362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:36.061224 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e08ce15f-4c36-45fc-8cbe-9427441b8604 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 404 len: 111 microversion: 2.1 time: 0.137976 Oct 22 03:30:36.062386 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2735/5586] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:35 2022] DELETE /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:30:36.067103 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2851/5586] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:34 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1515 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:36.082144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:36.084560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] [instance: bbfd6354-0b31-4bcf-8abb-a408e84093d8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:36.100655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:36.102896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:36.105668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:36.107852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:36.109365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:36.121436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:36.150260 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] HTTP exception thrown: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Request method failure captured: Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 HTTP/1.1 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2JFm_HCOSHO2L6_eij76U1ZXqQVET1wrDVikunHe-jWYJ2ezfM76LWIEEEdNFRLVeBS1nmDm6-k2JmARk6UNm1iZbR90uD9CO0tj74WPBqsAceN9hwdKAoFe7m_VAU8FGZ_wozkGyoBJ9XcHwQhLGVs8Yrt615C4KgmB5lGkooBmd8 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fad1fddb86944bec981cfdd824d8dcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fad1fddb86944bec981cfdd824d8dcf5"}]}] Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: fad1fddb86944bec981cfdd824d8dcf5 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1837090521 Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 3ad9769823b74399aabb7395eeee44aa Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeNegativeTest-1837090521-project Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'bbfd6354-0b31-4bcf-8abb-a408e84093d8'} Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:36.153805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.161145 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:36.161145 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:36.161145 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:36.161145 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:36.161145 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:36.161145 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. Oct 22 03:30:36.161145 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:36.165749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] Returning 404 to user: Instance bbfd6354-0b31-4bcf-8abb-a408e84093d8 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:36.171082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8155b923-0c0f-4d7f-9f84-31d3081798f0 tempest-AttachVolumeNegativeTest-1837090521 tempest-AttachVolumeNegativeTest-1837090521-project] 10.222.0.25 "GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8" status: 404 len: 111 microversion: 2.1 time: 0.100762 Oct 22 03:30:36.174859 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2736/5587] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:36 2022] GET /compute/v2.1/servers/bbfd6354-0b31-4bcf-8abb-a408e84093d8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:37.055510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:37.056130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:37.068478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:37.068742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:37.069023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:37.081885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:37.083931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:37.083931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:37.308234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:37.316629 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8ac21f5-4c31-41bf-9e64-9febe625debd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1473 microversion: 2.1 time: 0.265035 Oct 22 03:30:37.317229 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2852/5588] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:37 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1473 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:37.955321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-96fa897d-8d4d-4ef8-8a7a-2c3f70635a9b req-94195c46-cdc6-447f-82ef-1878aa004959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e587ea14-f2df-40d1-9b72-595d7445d5fd", "name": "network-vif-deleted", "tag": "bd3f541c-4dd2-4296-b2cd-6027f590f4b0"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:38.016540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96fa897d-8d4d-4ef8-8a7a-2c3f70635a9b req-94195c46-cdc6-447f-82ef-1878aa004959 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:38.021041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96fa897d-8d4d-4ef8-8a7a-2c3f70635a9b req-94195c46-cdc6-447f-82ef-1878aa004959 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:38.021885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96fa897d-8d4d-4ef8-8a7a-2c3f70635a9b req-94195c46-cdc6-447f-82ef-1878aa004959 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:38.062873 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-96fa897d-8d4d-4ef8-8a7a-2c3f70635a9b req-94195c46-cdc6-447f-82ef-1878aa004959 service nova] Creating event network-vif-deleted:bd3f541c-4dd2-4296-b2cd-6027f590f4b0 for instance e587ea14-f2df-40d1-9b72-595d7445d5fd on n-h2-862416-2 Oct 22 03:30:38.075318 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-96fa897d-8d4d-4ef8-8a7a-2c3f70635a9b req-94195c46-cdc6-447f-82ef-1878aa004959 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.599883 Oct 22 03:30:38.078811 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2737/5589] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:38.356401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:38.357684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:38.381963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:38.382885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:38.388442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:38.389689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:38.402605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:38.403580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:38.506238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:38.506922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:38.507475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:38.508129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lazy-loading 'fault' on Instance uuid e587ea14-f2df-40d1-9b72-595d7445d5fd {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:30:40.087091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:40.106607 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e5e3293c-844e-431d-bd22-c442c9c836b8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 200 len: 1319 microversion: 2.1 time: 1.761615 Oct 22 03:30:40.124262 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2853/5590] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:38 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 1319 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:41.152586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:41.153501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:41.184317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:41.184818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:41.185261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:41.185981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:41.186437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:41.197879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:41.296719 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd HTTP/1.1 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'e587ea14-f2df-40d1-9b72-595d7445d5fd'} Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:41.310322 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:41.315892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:41.315892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:41.315892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:41.315892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:41.315892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:41.315892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:30:41.315892 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:30:41.317193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:41.339664 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb219fc5-2ec1-4baa-a145-b0f0dcd5bb85 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 404 len: 111 microversion: 2.1 time: 0.200665 Oct 22 03:30:41.340953 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2738/5591] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:41 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:41.977365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-990799558", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "1dca30ca-b544-47c6-a616-7a126cc52745"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:42.268424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] validate_networks() for [('1dca30ca-b544-47c6-a616-7a126cc52745', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:30:44.941584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:44.942629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:44.960453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:44.961237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:44.961928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:44.966230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:44.967898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:44.970374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:45.007857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:30:45.263556 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ffa9e1e-30b3-4687-8a92-422b260cf629 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 204 len: 0 microversion: 2.1 time: 0.326603 Oct 22 03:30:45.272934 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2739/5592] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:44 2022] DELETE /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:30:45.288952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:45.289836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:45.301879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:45.302522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:45.302981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:45.305156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:45.306288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:45.307892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:47.182060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:47.202712 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b520709-3b7a-419d-adf9-c9d1bc70d510 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1508 microversion: 2.1 time: 1.927685 Oct 22 03:30:47.203270 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2740/5593] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:45 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1508 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:48.000254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:30:48.000831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:30:48.001005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:30:48.001573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:30:48.002179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:30:48.047708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:48.063539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:48.068814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:48.069682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:48.074718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:48.118134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:48.234113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:48.235713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:48.247453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:48.256279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:48.256958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:48.259122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:48.259122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:48.259122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:48.300864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:30:48.338535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Getting quotas for user 439172d993f047bcb9ad3e34dfadb229 and project cc8a2438275e42c9901bb2f3baa90c19. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:30:48.384139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:30:48.397829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:30:48.525115 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-047db3da-7f03-4911-a261-4cff77f95435 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.552654 Oct 22 03:30:48.533061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2854/5594] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:30:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 6561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:30:48.538249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-135b75b1-da13-4945-a7f0-fadd4dd5091f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:48.539156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-135b75b1-da13-4945-a7f0-fadd4dd5091f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:48.749478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-135b75b1-da13-4945-a7f0-fadd4dd5091f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:48.761343 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-135b75b1-da13-4945-a7f0-fadd4dd5091f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1208 microversion: 2.1 time: 0.226510 Oct 22 03:30:48.762017 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2855/5595] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:48 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1208 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:49.094841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:49.116962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac7f9435-6b5d-4e76-bcc7-8e3b0a1036b1 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1508 microversion: 2.1 time: 0.874338 Oct 22 03:30:49.119718 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2741/5596] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:48 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1508 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:49.301649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e58083b1-61ed-4c3b-91fd-209223bbced9 req-74e92c82-2dc9-48da-8c1e-7be9382fe5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097da5a-0301-425a-8004-5bfbdfc3ebe8", "name": "network-vif-deleted", "tag": "16b99da1-2d29-4542-9dda-0b8a68a38adb"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:49.331023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e58083b1-61ed-4c3b-91fd-209223bbced9 req-74e92c82-2dc9-48da-8c1e-7be9382fe5a4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:49.332577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e58083b1-61ed-4c3b-91fd-209223bbced9 req-74e92c82-2dc9-48da-8c1e-7be9382fe5a4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:49.333438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e58083b1-61ed-4c3b-91fd-209223bbced9 req-74e92c82-2dc9-48da-8c1e-7be9382fe5a4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:49.348183 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e58083b1-61ed-4c3b-91fd-209223bbced9 req-74e92c82-2dc9-48da-8c1e-7be9382fe5a4 service nova] Creating event network-vif-deleted:16b99da1-2d29-4542-9dda-0b8a68a38adb for instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 on n-h1-862416-2 Oct 22 03:30:49.358314 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e58083b1-61ed-4c3b-91fd-209223bbced9 req-74e92c82-2dc9-48da-8c1e-7be9382fe5a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063618 Oct 22 03:30:49.360305 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2856/5597] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:49.795933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-296713af-77ec-4b51-b3fc-ee289ae55db1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:49.796683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-296713af-77ec-4b51-b3fc-ee289ae55db1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:49.970888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-296713af-77ec-4b51-b3fc-ee289ae55db1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:49.980070 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-296713af-77ec-4b51-b3fc-ee289ae55db1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1208 microversion: 2.1 time: 0.190921 Oct 22 03:30:49.982861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1776060641", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "2289e419-587f-4069-9c2e-d1a14728acaa"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:50.004871 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2857/5598] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:49 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1208 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:50.051085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:50.145499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:50.146096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:50.164792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:50.169432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:50.174931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:50.178928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:50.179419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:50.179856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:50.217718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] validate_networks() for [('2289e419-587f-4069-9c2e-d1a14728acaa', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:30:50.372455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:50.382565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:50.383371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:50.389211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lazy-loading 'fault' on Instance uuid d097da5a-0301-425a-8004-5bfbdfc3ebe8 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:30:50.552424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:50.573149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6615cd6-a083-44be-8e01-8369672999fa tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 200 len: 1311 microversion: 2.1 time: 0.429854 Oct 22 03:30:50.576197 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2858/5599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:50 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 1311 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:51.015846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:51.022139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:51.043510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:51.045061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:51.050625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:51.053677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:51.056380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:51.062921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:51.360890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:51.385444 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1260 microversion: 2.1 time: 0.375623 Oct 22 03:30:51.401991 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2859/5600] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:51 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1260 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:51.405651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:51.413203 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6dfe03c9-b6e1-4a97-ab29-4fc1f67da98b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.010031 Oct 22 03:30:51.414134 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2860/5601] 10.222.0.25 () {56 vars in 886 bytes} [Sat Oct 22 03:30:51 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 03:30:51.561454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:30:51.562543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:30:51.563211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:30:51.563793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:30:51.564442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:30:51.576005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:51.576728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:51.577698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:51.578077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:51.578724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:51.579331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:51.602950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:51.604830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: d097da5a-0301-425a-8004-5bfbdfc3ebe8] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:51.628394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:51.629416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:51.644933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:51.645969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:51.646620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:51.653235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:51.707108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Getting quotas for project e69258935f404f1e8a6966ef1c99f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:30:51.709200 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 could not be found. Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 HTTP/1.1 Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 could not be found. Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd097da5a-0301-425a-8004-5bfbdfc3ebe8'} Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 could not be found. Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 could not be found. Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:51.713712 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:51.719796 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:51.719796 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:51.719796 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:51.719796 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:51.719796 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:51.719796 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:51.719796 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 could not be found. Oct 22 03:30:51.719796 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:51.723641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 404 to user: Instance d097da5a-0301-425a-8004-5bfbdfc3ebe8 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:51.726672 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f39c069-e0c7-426b-945b-f55a622bb2ae tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8" status: 404 len: 111 microversion: 2.1 time: 0.127585 Oct 22 03:30:51.731757 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2861/5602] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:51 2022] GET /compute/v2.1/servers/d097da5a-0301-425a-8004-5bfbdfc3ebe8 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:51.733514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Getting quotas for user 2b85a53fb087446193eb7e13331e11bc and project e69258935f404f1e8a6966ef1c99f9e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:30:51.744641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:51.745516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:51.761744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:51.762560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:51.763804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:51.765699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:30:51.766138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:51.766791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:51.767404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:51.770796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:30:51.829760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:30:51.868253 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-abd8ee52-0f23-4f21-a5be-62ef63d3de18 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.251417 Oct 22 03:30:51.872853 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2742/5603] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:30:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:30:51.883620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-870ce201-4ec0-414b-bb64-ae154e7c00f0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:51.885259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-870ce201-4ec0-414b-bb64-ae154e7c00f0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:52.070864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb36f2dd-3696-4c00-923c-e97d4ee15dc7 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 204 len: 0 microversion: 2.1 time: 0.335750 Oct 22 03:30:52.072613 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2862/5604] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:30:51 2022] DELETE /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:30:52.108842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:52.109711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:52.134814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:52.135623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:52.136334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:52.137318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:52.149851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:52.150904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:52.158946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-870ce201-4ec0-414b-bb64-ae154e7c00f0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:52.172459 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-870ce201-4ec0-414b-bb64-ae154e7c00f0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1216 microversion: 2.1 time: 0.292515 Oct 22 03:30:52.176637 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2743/5605] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:51 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1216 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:52.420913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:52.423647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:52.436015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:52.437452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:52.439302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:52.440764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:52.442182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:52.462388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:52.769185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:52.830075 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43b824a8-6952-4682-8f0f-19a16fe55180 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1266 microversion: 2.1 time: 0.414061 Oct 22 03:30:52.836692 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2744/5606] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:52 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:52.929351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:52.942093 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e670e554-28be-46a3-bf23-c574820b9e36 tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 0.861307 Oct 22 03:30:52.942886 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2863/5607] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:52 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:53.204160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-302d4129-05d0-4cf4-8f7f-7fb4ac01a117 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:53.205107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-302d4129-05d0-4cf4-8f7f-7fb4ac01a117 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:53.373399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-302d4129-05d0-4cf4-8f7f-7fb4ac01a117 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:53.390341 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-302d4129-05d0-4cf4-8f7f-7fb4ac01a117 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1216 microversion: 2.1 time: 0.187062 Oct 22 03:30:53.405369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2745/5608] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:53 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1216 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:53.866922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:53.868361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:53.898629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:53.907136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:53.911955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:53.918115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:53.918682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:53.921736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:54.008691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:54.009294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:54.024107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:54.024629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:54.025073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:54.025928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:54.026390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:54.026819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:54.071509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:54.122487 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8851933f-0afd-4748-abfe-a61a92cec787 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1266 microversion: 2.1 time: 0.252803 Oct 22 03:30:54.124059 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2864/5609] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:53 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:54.421845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:54.423500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:54.460644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:54.464604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:54.465356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:54.480101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:54.481270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:54.482366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:54.940465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:54.957096 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b45da571-c7ef-4478-9fd0-3c9215a2f8bc tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1212 microversion: 2.1 time: 0.542476 Oct 22 03:30:54.971721 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2865/5610] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:54 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1212 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:55.155157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:55.155905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:55.179323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:55.180269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:55.180944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:55.182024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:55.182718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:55.183376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:55.574123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:55.583624 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-14dbf01e-e40d-4974-bf52-e60b145f322b tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1521 microversion: 2.1 time: 1.579282 Oct 22 03:30:55.598166 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2746/5611] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:54 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1521 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:55.986827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:55.987778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:56.002233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:56.004079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:56.010265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:56.011531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:56.014254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:56.015952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:56.103978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:56.126387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-06e48a51-dc77-4bc0-8a34-ade6f0a1332e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 0.978380 Oct 22 03:30:56.128733 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2866/5612] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:55 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:56.614361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:56.615730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:56.632811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:56.633624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:56.634251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:56.635812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:56.636791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:56.637460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:56.725620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:56.737490 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8391740e-abda-4d3f-a6fb-13d03d3c891a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1274 microversion: 2.1 time: 0.754508 Oct 22 03:30:56.763482 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2747/5613] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:55 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1274 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:56.770440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1ff35202-3154-4f22-97c5-2a8615022027 req-c8bc41da-bab5-4acc-a1af-1c9bd6d04534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97055cc-112a-4d01-9d20-bfa7f95d9886", "name": "network-vif-deleted", "tag": "a63a763d-2107-4dfb-abd1-11f0810c08e1"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:56.786346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1ff35202-3154-4f22-97c5-2a8615022027 req-c8bc41da-bab5-4acc-a1af-1c9bd6d04534 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:56.786932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1ff35202-3154-4f22-97c5-2a8615022027 req-c8bc41da-bab5-4acc-a1af-1c9bd6d04534 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:56.787619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1ff35202-3154-4f22-97c5-2a8615022027 req-c8bc41da-bab5-4acc-a1af-1c9bd6d04534 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:56.810428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76fb02af67184c1ca83c5b55c381f195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3de0ae4c844bfa92316a20a1974e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:56.811170 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1ff35202-3154-4f22-97c5-2a8615022027 req-c8bc41da-bab5-4acc-a1af-1c9bd6d04534 service nova] Creating event network-vif-deleted:a63a763d-2107-4dfb-abd1-11f0810c08e1 for instance a97055cc-112a-4d01-9d20-bfa7f95d9886 on n-h1-862416-2 Oct 22 03:30:56.821834 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57ca989e-4c97-42bd-ab1a-0ad88b60be0a tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 200 len: 1306 microversion: 2.1 time: 0.214947 Oct 22 03:30:56.830967 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1ff35202-3154-4f22-97c5-2a8615022027 req-c8bc41da-bab5-4acc-a1af-1c9bd6d04534 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065592 Oct 22 03:30:56.831217 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2867/5614] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:56 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 1306 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:56.832032 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2748/5615] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:30:57.155048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:57.155669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:57.171914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:57.172455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:57.172893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:57.173806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:57.174450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:57.175055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:57.781176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:57.782304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:57.797751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:57.798610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:57.799160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:57.800892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:57.801482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:57.802019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:57.970968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:57.986019 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec186289-a028-4f7e-9f89-0d1578fdbb45 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 0.831848 Oct 22 03:30:57.989556 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2868/5616] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:57 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:58.002504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:58.003501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] [instance: a97055cc-112a-4d01-9d20-bfa7f95d9886] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:58.028346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:58.033223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:58.035486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:58.038769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:58.040185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:58.041712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:58.085461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] HTTP exception thrown: Instance a97055cc-112a-4d01-9d20-bfa7f95d9886 could not be found. Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Request method failure captured: Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 HTTP/1.1 Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2J1GXXdatRH_V_w1U0eWS8qft4HKVAAnKTzmxQ-bHQsy8dddIr_sMwbWcZGVDtYwzJVG5ClddBkUb750_-TJNjgJta52x7z0JwpokBiVeCzu8ZuBDGCFS2ygs3f24t0QAIMN91mQMXyhdvEYH9BlVzTiaC247zSXK0YljcgoaFlCeo Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc3de0ae4c844bfa92316a20a1974e0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc3de0ae4c844bfa92316a20a1974e0f"}]}] Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: fc3de0ae4c844bfa92316a20a1974e0f Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-215854671 Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 76fb02af67184c1ca83c5b55c381f195 Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerRescueNegativeTestJSON-215854671-project Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a97055cc-112a-4d01-9d20-bfa7f95d9886 could not be found. Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a97055cc-112a-4d01-9d20-bfa7f95d9886'} Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97055cc-112a-4d01-9d20-bfa7f95d9886 could not be found. Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97055cc-112a-4d01-9d20-bfa7f95d9886 could not be found. Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:58.089597 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:30:58.097154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:58.097154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:30:58.097154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:30:58.097154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:30:58.097154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:30:58.097154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:30:58.097154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97055cc-112a-4d01-9d20-bfa7f95d9886 could not be found. Oct 22 03:30:58.097154 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:30:58.102013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] Returning 404 to user: Instance a97055cc-112a-4d01-9d20-bfa7f95d9886 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:30:58.103691 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16c0308e-755d-4a66-bc8c-e4595d7da7db tempest-ServerRescueNegativeTestJSON-215854671 tempest-ServerRescueNegativeTestJSON-215854671-project] 10.222.0.25 "GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886" status: 404 len: 111 microversion: 2.1 time: 0.112614 Oct 22 03:30:58.105305 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2869/5617] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:57 2022] GET /compute/v2.1/servers/a97055cc-112a-4d01-9d20-bfa7f95d9886 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:30:58.257702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:58.274625 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3c687ed-48ff-4f94-b7c2-6e6e62915347 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1274 microversion: 2.1 time: 0.499580 Oct 22 03:30:58.280519 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2749/5618] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:57 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1274 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:30:59.020886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:59.021663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:59.024614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:59.032053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:59.032622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:59.033069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:59.033791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:59.034254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:59.034688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:59.299195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:30:59.299805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:30:59.310441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:59.311211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:59.312777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:59.315062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:59.316607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:59.318427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:59.905481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:30:59.920847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-191dcded-6710-4cd3-99bc-5c1fee7ff9e7 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 0.908390 Oct 22 03:30:59.922147 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2870/5619] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:59 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:30:59.928836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4df2f649-ceec-46bf-a84e-a51e5c8272cb req-c3ac7069-af15-417a-b575-9a266a627ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fb53a9-088a-4a08-ac02-c7f9625e8189", "tag": "23ac3391-5abc-4bec-b466-c54aab172c6b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:30:59.968095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4df2f649-ceec-46bf-a84e-a51e5c8272cb req-c3ac7069-af15-417a-b575-9a266a627ad4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:30:59.969290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4df2f649-ceec-46bf-a84e-a51e5c8272cb req-c3ac7069-af15-417a-b575-9a266a627ad4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:30:59.969943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4df2f649-ceec-46bf-a84e-a51e5c8272cb req-c3ac7069-af15-417a-b575-9a266a627ad4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:30:59.992603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:30:59.996172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:00.022294 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4df2f649-ceec-46bf-a84e-a51e5c8272cb req-c3ac7069-af15-417a-b575-9a266a627ad4 service nova] Creating event network-changed:23ac3391-5abc-4bec-b466-c54aab172c6b for instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 on n-h2-862416-2 Oct 22 03:31:00.032767 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4df2f649-ceec-46bf-a84e-a51e5c8272cb req-c3ac7069-af15-417a-b575-9a266a627ad4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108319 Oct 22 03:31:00.034200 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2871/5620] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:00.410309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:00.419105 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17f2258b-0b9b-4417-a69d-30c170d1edd9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 1.123708 Oct 22 03:31:00.448328 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2750/5621] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:30:59 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:00.958784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:00.960611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:00.978748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:00.985618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:00.987519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:00.990417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:00.991558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:00.994918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:01.459952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:01.460654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:01.475255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:01.475745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:01.479652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:01.481428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:01.482191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:01.483005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:01.649690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:01.680546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:01.689819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b46673b6-3938-472c-81b4-3098e001e234 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 0.744133 Oct 22 03:31:01.699786 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2872/5622] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:00 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:02.027025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:02.042036 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2af9e1ff-e761-4606-a787-4d1167002d9b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 0.586597 Oct 22 03:31:02.050822 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2751/5623] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:01 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:02.456571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-59fc3e47-aa37-4e93-bad5-b9cb5385fca5 req-ce84ec63-a0c5-4053-8b81-2cceaa89b7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e14fc5-c376-4d77-9091-99319066eb55", "tag": "f06ee202-4508-4f97-b7ac-c6f2cd3fd289"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:02.475526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-59fc3e47-aa37-4e93-bad5-b9cb5385fca5 req-ce84ec63-a0c5-4053-8b81-2cceaa89b7b7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:02.476426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-59fc3e47-aa37-4e93-bad5-b9cb5385fca5 req-ce84ec63-a0c5-4053-8b81-2cceaa89b7b7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:02.477413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-59fc3e47-aa37-4e93-bad5-b9cb5385fca5 req-ce84ec63-a0c5-4053-8b81-2cceaa89b7b7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:02.518615 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-59fc3e47-aa37-4e93-bad5-b9cb5385fca5 req-ce84ec63-a0c5-4053-8b81-2cceaa89b7b7 service nova] Creating event network-changed:f06ee202-4508-4f97-b7ac-c6f2cd3fd289 for instance 02e14fc5-c376-4d77-9091-99319066eb55 on n-h1-862416-2 Oct 22 03:31:02.525384 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-59fc3e47-aa37-4e93-bad5-b9cb5385fca5 req-ce84ec63-a0c5-4053-8b81-2cceaa89b7b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079307 Oct 22 03:31:02.526816 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2873/5624] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:02.721685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:02.722500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:02.736547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:02.737883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:02.738536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:02.741276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:02.742547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:02.745348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:03.081726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:03.082556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:03.100425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:03.101189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:03.101740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:03.102640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:03.103365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:03.103936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:03.274216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:03.286288 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83954287-c7ca-4991-a39a-fc572f2a54a5 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 0.568712 Oct 22 03:31:03.290558 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2752/5625] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:02 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:03.638746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:03.879981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ebba2706-4c3a-459f-a661-b528e10937fd tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Action: 'create', calling method: .version_select at 0x7f0d19266790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1241041437"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:04.161853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:04.179229 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4850ee22-ed3e-4bf2-9839-f180c9683582 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 1.098406 Oct 22 03:31:04.196241 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2874/5626] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:03 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:04.313008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:04.313995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:04.329196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:04.331344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:04.332428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:04.334191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:04.337720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:04.343762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:04.618186 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ebba2706-4c3a-459f-a661-b528e10937fd tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.984809 Oct 22 03:31:04.620766 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2753/5627] 10.222.0.25 () {60 vars in 1155 bytes} [Sat Oct 22 03:31:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 988 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 22 03:31:04.634030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-afb4c133-0bd3-4342-8386-0cc5837dd235 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d192870d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:04.775695 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-afb4c133-0bd3-4342-8386-0cc5837dd235 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 200 len: 345 microversion: 2.1 time: 0.144912 Oct 22 03:31:04.777311 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2754/5628] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:04 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:05.138899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:05.147699 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-66a2a3d9-17c1-4c16-8985-10588ec58851 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 0.841653 Oct 22 03:31:05.152576 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2875/5629] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:04 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:31:05.213263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:05.215206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:05.226271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:05.227066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:05.227694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:05.232927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:05.233432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:05.233884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:05.791448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75ac7d0a-092c-4e00-b735-68e069d400c1 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d199a93a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:05.892604 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75ac7d0a-092c-4e00-b735-68e069d400c1 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 200 len: 345 microversion: 2.1 time: 0.105423 Oct 22 03:31:05.893718 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2876/5630] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:05 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:05.948156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:05.962941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d59b83a8-8b3c-4257-8f2c-9204364c7c07 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 0.752910 Oct 22 03:31:05.966626 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2755/5631] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:05 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:06.175216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:06.176134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:06.189991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:06.197124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:06.198071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:06.198681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:06.199797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:06.200666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:06.201258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:06.907141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-78fdee23-9181-4692-8e8b-6e682ae41c7f tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d1929db80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:07.009077 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-78fdee23-9181-4692-8e8b-6e682ae41c7f tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 200 len: 346 microversion: 2.1 time: 0.105862 Oct 22 03:31:07.009812 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2756/5632] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:06 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:31:07.015982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:07.016638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:07.043350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:07.044160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:07.045351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:07.052758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:07.053705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:07.054329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:07.349313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:07.361574 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-76bab5a5-6a33-478b-8801-0187a2370d4a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 1.190609 Oct 22 03:31:07.362189 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2877/5633] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:06 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:07.378785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a031908-5405-46c5-bf85-1c080561947b tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Action: 'create', calling method: .version_select at 0x7f0d199a9280>, body: {"snapshot": {"volume_id": "3ff0b013-f25b-433c-9631-9073895c8257", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-481713373"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:07.408129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:07.429284 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6678e983-c8d3-4590-9509-bb2b38c7e5cf tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 0.418199 Oct 22 03:31:07.430414 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2757/5634] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:07 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:07.737953 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a031908-5405-46c5-bf85-1c080561947b tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.363531 Oct 22 03:31:07.738820 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2878/5635] 10.222.0.25 () {60 vars in 1162 bytes} [Sat Oct 22 03:31:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:07.763668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-10c23091-05f3-455e-9319-9914b4eb1515 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19287040>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:07.886298 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-10c23091-05f3-455e-9319-9914b4eb1515 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 200 len: 286 microversion: 2.1 time: 0.125995 Oct 22 03:31:07.891993 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2758/5636] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:07 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:07.904444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c7815450-338c-4fec-a2da-44df4fb443e6 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19870790>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:08.028169 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c7815450-338c-4fec-a2da-44df4fb443e6 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.129213 Oct 22 03:31:08.028857 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2879/5637] 10.222.0.25 () {58 vars in 1140 bytes} [Sat Oct 22 03:31:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:08.041804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef3b1754-ccc9-4fe5-861c-437837bccb7f tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19277790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:08.101476 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef3b1754-ccc9-4fe5-861c-437837bccb7f tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 200 len: 286 microversion: 2.1 time: 0.065077 Oct 22 03:31:08.102760 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2759/5638] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:08 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:31:08.389171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:08.389995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:08.403758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:08.405217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:08.406674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:08.410837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:08.411463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:08.412023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:08.459019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:08.460076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:08.474320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:08.480123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:08.481564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:08.492782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:08.493390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:08.494691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:08.552672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:08.979534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:08.996064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f30a684-4651-4b73-816d-8b3ae6609630 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 0.604505 Oct 22 03:31:08.997059 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2880/5639] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:08 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:09.115316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a367181-6f68-435c-8e04-57e52423e730 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19591ca0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:09.186287 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a367181-6f68-435c-8e04-57e52423e730 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 200 len: 286 microversion: 2.1 time: 0.071024 Oct 22 03:31:09.187464 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2881/5640] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:09 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:31:10.027261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:10.029897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:10.045465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:10.052783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:10.053810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:10.054847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:10.055570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:10.057027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:10.097657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:10.130925 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5005f289-847a-4712-9040-812b9c4784df tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 1.676172 Oct 22 03:31:10.136889 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2760/5641] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:08 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:31:10.204066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a67befb-03ac-4f87-b5b5-a59e395e8b46 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d1922aca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:10.276806 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a67befb-03ac-4f87-b5b5-a59e395e8b46 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 200 len: 286 microversion: 2.1 time: 0.081626 Oct 22 03:31:10.278055 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2761/5642] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:10 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:11.173732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:11.174715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:11.221236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:11.234255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:11.239147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:11.240472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:11.241514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:11.247806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:11.248815 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b60092c4-1389-4bd0-bfbe-834a5f185f6e tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 1.224813 Oct 22 03:31:11.252725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:11.266133 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2882/5643] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:10 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:11.291569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fd4842d-aec0-4620-8e29-612a024a65db tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d1e569550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:11.364612 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1fd4842d-aec0-4620-8e29-612a024a65db tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 200 len: 287 microversion: 2.1 time: 0.078335 Oct 22 03:31:11.365485 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2883/5644] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:11 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:11.377710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a54a9e6-3268-4332-9000-3ffcee50b804 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d198703a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:11.520421 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a54a9e6-3268-4332-9000-3ffcee50b804 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 202 len: 0 microversion: 2.1 time: 0.147174 Oct 22 03:31:11.521287 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2884/5645] 10.222.0.25 () {58 vars in 1254 bytes} [Sat Oct 22 03:31:11 2022] DELETE /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:31:11.527536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3a553cb8-461b-4ff6-a48a-f8a2bf03307e req-612e87a7-d86f-4a6f-aa33-e77142fed821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fb53a9-088a-4a08-ac02-c7f9625e8189", "name": "network-vif-plugged", "status": "completed", "tag": "23ac3391-5abc-4bec-b466-c54aab172c6b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:11.558250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a553cb8-461b-4ff6-a48a-f8a2bf03307e req-612e87a7-d86f-4a6f-aa33-e77142fed821 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:11.559036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a553cb8-461b-4ff6-a48a-f8a2bf03307e req-612e87a7-d86f-4a6f-aa33-e77142fed821 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:11.562159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a553cb8-461b-4ff6-a48a-f8a2bf03307e req-612e87a7-d86f-4a6f-aa33-e77142fed821 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:11.615590 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3a553cb8-461b-4ff6-a48a-f8a2bf03307e req-612e87a7-d86f-4a6f-aa33-e77142fed821 service nova] Creating event network-vif-plugged:23ac3391-5abc-4bec-b466-c54aab172c6b for instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 on n-h2-862416-2 Oct 22 03:31:11.640261 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3a553cb8-461b-4ff6-a48a-f8a2bf03307e req-612e87a7-d86f-4a6f-aa33-e77142fed821 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115182 Oct 22 03:31:11.644762 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2885/5646] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:11.661119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3847837a-5a08-4185-92b6-a9651833360d tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19591b80>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:11.747348 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3847837a-5a08-4185-92b6-a9651833360d tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 200 len: 286 microversion: 2.1 time: 0.101291 Oct 22 03:31:11.754169 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2886/5647] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:11 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:12.198024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:12.218782 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a8d5ec2-1d9e-4894-9ae2-bbfaa53ff968 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 1.056704 Oct 22 03:31:12.235990 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2762/5648] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:11 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:12.276523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:12.277841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:12.292780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:12.293275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:12.295653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:12.296709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:12.301287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:12.301988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:12.767741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7216869c-01af-4d3a-814c-cb9771a3e99b tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d1929d790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:12.822668 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7216869c-01af-4d3a-814c-cb9771a3e99b tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 200 len: 286 microversion: 2.1 time: 0.061045 Oct 22 03:31:12.827859 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2763/5649] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:12 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:13.246459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:13.247901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:13.262149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:13.264374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:13.266456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:13.267411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:13.274469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:13.275125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:13.499442 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:31:13.500283 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 03:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 (ip 10.222.0.25) !!! Oct 22 03:31:13.616042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:13.636297 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e95a6d60-f2d6-4ad1-95c6-a20d60b9b71d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1308 microversion: 2.1 time: 1.367657 Oct 22 03:31:13.658590 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2887/5650] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:12 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1308 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:13.811731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:13.827852 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-34823202-f8c3-4e7e-b504-8fa3e5fa2b3a tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 0.584559 Oct 22 03:31:13.839911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cde47c21-0d8f-40d5-b3db-6d57ad8af3d9 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19591040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:13.852935 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2764/5651] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:13 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:13.889411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9754b2ed-09cd-43cc-936e-ef0dfea3aad0 req-b83a2339-e613-403a-a391-ee78dd559e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e14fc5-c376-4d77-9091-99319066eb55", "name": "network-vif-plugged", "status": "completed", "tag": "f06ee202-4508-4f97-b7ac-c6f2cd3fd289"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:13.902395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9754b2ed-09cd-43cc-936e-ef0dfea3aad0 req-b83a2339-e613-403a-a391-ee78dd559e57 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:13.903564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9754b2ed-09cd-43cc-936e-ef0dfea3aad0 req-b83a2339-e613-403a-a391-ee78dd559e57 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:13.904350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9754b2ed-09cd-43cc-936e-ef0dfea3aad0 req-b83a2339-e613-403a-a391-ee78dd559e57 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:13.921399 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cde47c21-0d8f-40d5-b3db-6d57ad8af3d9 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 200 len: 286 microversion: 2.1 time: 0.089986 Oct 22 03:31:13.922480 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2888/5652] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:13 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:13.971391 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9754b2ed-09cd-43cc-936e-ef0dfea3aad0 req-b83a2339-e613-403a-a391-ee78dd559e57 service nova] Creating event network-vif-plugged:f06ee202-4508-4f97-b7ac-c6f2cd3fd289 for instance 02e14fc5-c376-4d77-9091-99319066eb55 on n-h1-862416-2 Oct 22 03:31:13.982739 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9754b2ed-09cd-43cc-936e-ef0dfea3aad0 req-b83a2339-e613-403a-a391-ee78dd559e57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108410 Oct 22 03:31:13.984369 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2765/5653] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:14.664599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:14.665901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:14.685843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:14.687807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:14.688459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:14.690557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:14.691208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:14.692680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:14.885788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:14.887931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:14.918907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:14.920686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:14.922827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:14.923798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:14.926183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:14.929367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:15.595623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:15.626902 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-868af8a1-edd4-4297-b379-09eb021ec2ba tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1488 microversion: 2.1 time: 0.963786 Oct 22 03:31:15.628320 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2889/5654] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:14 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1488 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:15.634849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6955848-ee6c-4766-abf5-e16954a9225a tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d199f3dc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:15.713527 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b6955848-ee6c-4766-abf5-e16954a9225a tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] HTTP exception thrown: Snapshot 70664ad2-11d9-4d0d-8385-a111834d4bfe could not be found. Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6955848-ee6c-4766-abf5-e16954a9225a tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Request method failure captured: Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe HTTP/1.1 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2P3JU89KhcgJac_5m28md-MAvh2SQxBhhW4o4koVJTsSQpub2DWh_D9kQU1O3TLKqYIwvyKJOKsYXKic_j2a3AVteVY6Sr_gZAu-h_ilupxUZhDx5QCx7zIvzTMnaTJjLcYaEowQBsr_BAEjy2MqG6_XZ-dEAmDOEoIRQO2yjQslIg Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 8f251b5b34ae431eaacad6fe226f1467 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f251b5b34ae431eaacad6fe226f1467"}]}] Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 8f251b5b34ae431eaacad6fe226f1467 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesSnapshotsTestJSON-636027655-project Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 798ec6a9f24b4efcbc9b3131aa3d8d9b Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesSnapshotsTestJSON-636027655-project Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: exception: Snapshot 70664ad2-11d9-4d0d-8385-a111834d4bfe could not be found. Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '70664ad2-11d9-4d0d-8385-a111834d4bfe'} Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 70664ad2-11d9-4d0d-8385-a111834d4bfe could not be found. (HTTP 404) (Request-ID: req-b8c4f490-6a30-49bd-9a1a-7a62a1c69f3c) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:31:15.745085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 70664ad2-11d9-4d0d-8385-a111834d4bfe could not be found. Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 70664ad2-11d9-4d0d-8385-a111834d4bfe could not be found. Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 70664ad2-11d9-4d0d-8385-a111834d4bfe could not be found. Oct 22 03:31:15.750680 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:15.756235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6955848-ee6c-4766-abf5-e16954a9225a tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Returning 404 to user: Snapshot 70664ad2-11d9-4d0d-8385-a111834d4bfe could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:15.756235 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6955848-ee6c-4766-abf5-e16954a9225a tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe" status: 404 len: 111 microversion: 2.1 time: 0.126339 Oct 22 03:31:15.757301 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2890/5655] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:31:15 2022] GET /compute/v2.1/os-snapshots/70664ad2-11d9-4d0d-8385-a111834d4bfe => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:15.777620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-203640072"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:15.795663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:15.820832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:15.822085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:15.823948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:15.824908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:15.834442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:15.835087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:16.017289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:16.044431 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-44009614-e50c-4367-9539-727f1a729c47 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1316 microversion: 2.1 time: 1.158291 Oct 22 03:31:16.049172 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2766/5656] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:14 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1316 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:16.064575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5b8aa28-21fd-4ee3-9246-951fa9ccca2d tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d1987b280>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:16.123369 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5db800f7-8b39-48a6-bfb2-ddda74990954 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "PUT /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1073 microversion: 2.1 time: 0.359591 Oct 22 03:31:16.124456 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2891/5657] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:31:15 2022] PUT /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1073 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:16.147987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:16.151343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:16.168107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:16.170886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:16.171762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:16.172705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:16.175428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:16.176070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:16.307317 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5b8aa28-21fd-4ee3-9246-951fa9ccca2d tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 202 len: 0 microversion: 2.1 time: 0.255005 Oct 22 03:31:16.308174 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2767/5658] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:31:16 2022] DELETE /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:31:16.322374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e653aace-5a8d-4656-a383-dc0cd1d55b1e tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19670940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:16.483755 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e653aace-5a8d-4656-a383-dc0cd1d55b1e tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 200 len: 345 microversion: 2.1 time: 0.171049 Oct 22 03:31:16.484586 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2768/5659] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:16 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:17.083782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:17.085464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:17.099356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:17.104147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:17.105201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:17.106363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:17.107219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:17.107882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:17.973587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:18.004522 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d01a8dc9-de93-46b9-a513-f37037764551 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1504 microversion: 2.1 time: 0.918511 Oct 22 03:31:18.037297 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2769/5660] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:17 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1504 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:31:18.050111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f6001648-3f14-4930-bb5c-753950f3088c tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d1927c8b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:18.173464 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f6001648-3f14-4930-bb5c-753950f3088c tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 200 len: 345 microversion: 2.1 time: 0.134797 Oct 22 03:31:18.176249 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2770/5661] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:18 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:18.193129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:18.204108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:18.220638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:18.223525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:18.227005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:18.229247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:18.234222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:18.238852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:18.350386 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fcc81adb-9bcf-4b8d-88c3-fc151b2b4e78 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.172405 Oct 22 03:31:18.352001 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2771/5662] 10.222.0.25 () {58 vars in 1296 bytes} [Sat Oct 22 03:31:18 2022] DELETE /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55/os-server-password => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:31:18.362187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:18.363187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:18.384751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:18.388935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:18.389667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:18.394407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:18.398547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:18.399377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:18.500496 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9d8439c-0b22-4f4e-acec-bb7940f125e0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.142684 Oct 22 03:31:18.509157 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2772/5663] 10.222.0.25 () {58 vars in 1293 bytes} [Sat Oct 22 03:31:18 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55/os-server-password => generated 16 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:31:18.514515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:18.522691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:18.539435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:18.540724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:18.541356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:18.542373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:18.543007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:18.548746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:18.630925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:31:18.899051 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa8add68-11ae-482f-849c-e68eaa15f3d9 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 204 len: 0 microversion: 2.1 time: 0.388260 Oct 22 03:31:18.908764 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2773/5664] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:18 2022] DELETE /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:31:18.921090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:18.922069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:18.937333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:18.939869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:18.941317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:18.948303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:18.949153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:18.949827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:19.382749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:19.393078 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-868e3d08-8134-46f9-b8f1-559e1f5ae7cb tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1510 microversion: 2.1 time: 0.476310 Oct 22 03:31:19.405952 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2774/5665] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:18 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:19.416026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-baebac05-d827-4727-bdbd-384754daaaf5 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d1e509280>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:19.532111 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-baebac05-d827-4727-bdbd-384754daaaf5 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 200 len: 345 microversion: 2.1 time: 0.124982 Oct 22 03:31:19.539647 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2775/5666] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:19 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:19.911656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:19.940964 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dab396b8-6059-4d85-b613-72b2d714b6b0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1499 microversion: 2.1 time: 3.796851 Oct 22 03:31:19.956768 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2892/5667] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:16 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1499 bytes in 3813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:19.976578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:19.977565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:19.992405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:19.993911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:19.997906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:19.998882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:20.002280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:20.003206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:20.418789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:20.419811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:20.436979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:20.439502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:20.440160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:20.440766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:20.441236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:20.441684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:20.599901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:20.615296 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b61780d2-65b4-4b71-96e7-1c0d6363106f tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1499 microversion: 2.1 time: 0.645238 Oct 22 03:31:20.628233 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2776/5668] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:19 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1499 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:20.629121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-186bcc16-4346-4cb2-94b0-e31afaa636bd tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d198de3a0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:20.736254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-186bcc16-4346-4cb2-94b0-e31afaa636bd tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 200 len: 345 microversion: 2.1 time: 0.116286 Oct 22 03:31:20.737423 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2777/5669] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:20 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:20.742780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6243cdec-e790-4f9c-98bb-f33729ceb3a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:20.749416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:20.770251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243cdec-e790-4f9c-98bb-f33729ceb3a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:20.770748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243cdec-e790-4f9c-98bb-f33729ceb3a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:20.771187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6243cdec-e790-4f9c-98bb-f33729ceb3a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:20.865555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6243cdec-e790-4f9c-98bb-f33729ceb3a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Going to try to stop instance {{(pid=120582) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:31:20.979269 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6243cdec-e790-4f9c-98bb-f33729ceb3a1 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "POST /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189/action" status: 202 len: 0 microversion: 2.1 time: 0.240390 Oct 22 03:31:20.983755 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2778/5670] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:31:20 2022] POST /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:31:21.303073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:21.312541 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-731441fd-f399-45ef-a8b7-6ae71df7cf6b tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1510 microversion: 2.1 time: 0.899703 Oct 22 03:31:21.313144 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2893/5671] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:20 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1510 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:21.331548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:21.344151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:21.362305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:21.365236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:21.368066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:21.369903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:21.373593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:21.375036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:21.521014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-666249cc-323a-431f-b47f-cf0e165d7dd9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'create', calling method: .version_select at 0x7f0d198de040>, body: {"keypair": {"name": "tempest-keypair-1774330581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBUVIlzJTnFeST0Z0xsje0ur8Cq3EXrivOLOdutM/9g+9WEyAHyDeaktvI+xupWcO1uyxoaTZ16+FAPBB6iO5VxeQvVZoCFbZX5suzoYKSXqCMj6itVxRqATYtKn3PWPw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:21.593683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-666249cc-323a-431f-b47f-cf0e165d7dd9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Getting quotas for project 7aab6dcaeb1541729cb8d92b3a361c80. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:31:21.608817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-666249cc-323a-431f-b47f-cf0e165d7dd9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Getting quotas for user da9a6c11ec7640efa8693fadad60259d and project 7aab6dcaeb1541729cb8d92b3a361c80. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:31:21.690113 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-666249cc-323a-431f-b47f-cf0e165d7dd9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.703578 Oct 22 03:31:21.691037 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2779/5672] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:31:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:21.753758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80dc7c54-f9f3-4b89-9fed-e13cfdc527f4 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19266670>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:21.802637 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-80dc7c54-f9f3-4b89-9fed-e13cfdc527f4 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] HTTP exception thrown: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80dc7c54-f9f3-4b89-9fed-e13cfdc527f4 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Request method failure captured: Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 HTTP/1.1 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2P3JU89KhcgJac_5m28md-MAvh2SQxBhhW4o4koVJTsSQpub2DWh_D9kQU1O3TLKqYIwvyKJOKsYXKic_j2a3AVteVY6Sr_gZAu-h_ilupxUZhDx5QCx7zIvzTMnaTJjLcYaEowQBsr_BAEjy2MqG6_XZ-dEAmDOEoIRQO2yjQslIg Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8f251b5b34ae431eaacad6fe226f1467 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f251b5b34ae431eaacad6fe226f1467"}]}] Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8f251b5b34ae431eaacad6fe226f1467 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesSnapshotsTestJSON-636027655-project Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 798ec6a9f24b4efcbc9b3131aa3d8d9b Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesSnapshotsTestJSON-636027655-project Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: exception: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '3ff0b013-f25b-433c-9631-9073895c8257'} Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. (HTTP 404) (Request-ID: req-83f74ec7-f11c-48d2-9660-234dee29e63b) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:31:21.807571 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.814579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.820691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80dc7c54-f9f3-4b89-9fed-e13cfdc527f4 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Returning 404 to user: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:21.823241 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80dc7c54-f9f3-4b89-9fed-e13cfdc527f4 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 404 len: 109 microversion: 2.1 time: 0.075104 Oct 22 03:31:21.825788 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2780/5673] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:21 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:21.843725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2174840a-3f1c-4ace-b714-18ec4183a551 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d19266ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:21.920628 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-2174840a-3f1c-4ace-b714-18ec4183a551 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] HTTP exception thrown: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2174840a-3f1c-4ace-b714-18ec4183a551 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Request method failure captured: Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 HTTP/1.1 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2P3JU89KhcgJac_5m28md-MAvh2SQxBhhW4o4koVJTsSQpub2DWh_D9kQU1O3TLKqYIwvyKJOKsYXKic_j2a3AVteVY6Sr_gZAu-h_ilupxUZhDx5QCx7zIvzTMnaTJjLcYaEowQBsr_BAEjy2MqG6_XZ-dEAmDOEoIRQO2yjQslIg Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8f251b5b34ae431eaacad6fe226f1467 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f251b5b34ae431eaacad6fe226f1467"}]}] Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8f251b5b34ae431eaacad6fe226f1467 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesSnapshotsTestJSON-636027655-project Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 798ec6a9f24b4efcbc9b3131aa3d8d9b Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesSnapshotsTestJSON-636027655-project Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: exception: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '3ff0b013-f25b-433c-9631-9073895c8257'} Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. (HTTP 404) (Request-ID: req-50c7d867-46ac-486f-8684-049b98356de6) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:31:21.924606 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:21.930290 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:21.938143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2174840a-3f1c-4ace-b714-18ec4183a551 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Returning 404 to user: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:21.939617 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2174840a-3f1c-4ace-b714-18ec4183a551 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 404 len: 109 microversion: 2.1 time: 0.108037 Oct 22 03:31:21.940864 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2781/5674] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:31:21 2022] DELETE /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:21.967218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b634ad0-4986-405e-adf2-0245248344c8 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Calling method '.version_select at 0x7f0d196d63a0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:22.023555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:22.036804 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5981789d-111d-4935-bccf-23746ae22446 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1509 microversion: 2.1 time: 0.719653 Oct 22 03:31:22.037075 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-5b634ad0-4986-405e-adf2-0245248344c8 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] HTTP exception thrown: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:22.040039 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2894/5675] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:21 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1509 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b634ad0-4986-405e-adf2-0245248344c8 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Request method failure captured: Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 HTTP/1.1 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2P3JU89KhcgJac_5m28md-MAvh2SQxBhhW4o4koVJTsSQpub2DWh_D9kQU1O3TLKqYIwvyKJOKsYXKic_j2a3AVteVY6Sr_gZAu-h_ilupxUZhDx5QCx7zIvzTMnaTJjLcYaEowQBsr_BAEjy2MqG6_XZ-dEAmDOEoIRQO2yjQslIg Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8f251b5b34ae431eaacad6fe226f1467 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f251b5b34ae431eaacad6fe226f1467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f251b5b34ae431eaacad6fe226f1467"}]}] Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8f251b5b34ae431eaacad6fe226f1467 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-636027655 Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesSnapshotsTestJSON-636027655-project Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 798ec6a9f24b4efcbc9b3131aa3d8d9b Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesSnapshotsTestJSON-636027655-project Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: exception: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '3ff0b013-f25b-433c-9631-9073895c8257'} Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. (HTTP 404) (Request-ID: req-3c343979-a9e3-4fbe-886e-f2916b7faf2c) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:31:22.041964 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b634ad0-4986-405e-adf2-0245248344c8 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] Returning 404 to user: Volume 3ff0b013-f25b-433c-9631-9073895c8257 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5b634ad0-4986-405e-adf2-0245248344c8 tempest-VolumesSnapshotsTestJSON-636027655 tempest-VolumesSnapshotsTestJSON-636027655-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257" status: 404 len: 109 microversion: 2.1 time: 0.098033 Oct 22 03:31:22.046474 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2782/5676] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:21 2022] GET /compute/v2.1/os-volumes/3ff0b013-f25b-433c-9631-9073895c8257 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:22.341375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:22.342650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:22.345474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6f607429-b1dc-429e-a689-3ebe77cd6419 req-71cd8db9-e1c6-48f1-b8c2-0406f95ada8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e14fc5-c376-4d77-9091-99319066eb55", "name": "network-vif-deleted", "tag": "f06ee202-4508-4f97-b7ac-c6f2cd3fd289"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:22.365504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:22.366239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:22.366703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:22.367702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:22.368901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:22.369655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:22.391613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f607429-b1dc-429e-a689-3ebe77cd6419 req-71cd8db9-e1c6-48f1-b8c2-0406f95ada8e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:22.413028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f607429-b1dc-429e-a689-3ebe77cd6419 req-71cd8db9-e1c6-48f1-b8c2-0406f95ada8e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:22.413706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f607429-b1dc-429e-a689-3ebe77cd6419 req-71cd8db9-e1c6-48f1-b8c2-0406f95ada8e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:22.456784 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6f607429-b1dc-429e-a689-3ebe77cd6419 req-71cd8db9-e1c6-48f1-b8c2-0406f95ada8e service nova] Creating event network-vif-deleted:f06ee202-4508-4f97-b7ac-c6f2cd3fd289 for instance 02e14fc5-c376-4d77-9091-99319066eb55 on n-h1-862416-2 Oct 22 03:31:22.486134 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6f607429-b1dc-429e-a689-3ebe77cd6419 req-71cd8db9-e1c6-48f1-b8c2-0406f95ada8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148659 Oct 22 03:31:22.493486 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2783/5677] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:31:22.738936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b85a53fb087446193eb7e13331e11bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e69258935f404f1e8a6966ef1c99f9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:22.751871 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18938298-8f1e-4ba8-b1aa-da772b3f9ac0 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 200 len: 1301 microversion: 2.1 time: 0.415809 Oct 22 03:31:22.757773 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2895/5678] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:22 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 1301 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:23.065487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:23.066628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:23.085500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:23.086011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:23.086454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:23.101793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:23.118762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:23.119356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:23.781447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:23.782195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] [instance: 02e14fc5-c376-4d77-9091-99319066eb55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:23.807449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:23.809084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:23.810209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:23.811675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:23.813168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:23.813837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:23.852358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] HTTP exception thrown: Instance 02e14fc5-c376-4d77-9091-99319066eb55 could not be found. Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Request method failure captured: Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 HTTP/1.1 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2PpFBzWqkcy9aQV8lZeK3LbAbd_kGNM6JE2pYryyZl2Pin0QnyF0r8hqWtqyepgGc2R-20xzSujp4QgoIFJFTx43ZFgBHguOnlLM1eh44-zM76qiInb9mFt_CwkdAFTOyyoOLdCN4g-Gyf2m_ZnZuWgj1poc1DRvmmSbEWFyn6ZSEQ Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: e69258935f404f1e8a6966ef1c99f9e2 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerPasswordTestJSON-26782812 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e69258935f404f1e8a6966ef1c99f9e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e69258935f404f1e8a6966ef1c99f9e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e69258935f404f1e8a6966ef1c99f9e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e69258935f404f1e8a6966ef1c99f9e2"}]}] Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerPasswordTestJSON-26782812 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: e69258935f404f1e8a6966ef1c99f9e2 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerPasswordTestJSON-26782812 Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerPasswordTestJSON-26782812-project Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 2b85a53fb087446193eb7e13331e11bc Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerPasswordTestJSON-26782812-project Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 02e14fc5-c376-4d77-9091-99319066eb55 could not be found. Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '02e14fc5-c376-4d77-9091-99319066eb55'} Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e14fc5-c376-4d77-9091-99319066eb55 could not be found. Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e14fc5-c376-4d77-9091-99319066eb55 could not be found. Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:23.865662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:23.871769 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:23.871769 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:23.871769 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:23.871769 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:23.871769 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:23.871769 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e14fc5-c376-4d77-9091-99319066eb55 could not be found. Oct 22 03:31:23.871769 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:23.875011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] Returning 404 to user: Instance 02e14fc5-c376-4d77-9091-99319066eb55 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:23.875566 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5077d546-1770-425b-8bab-40c839b98882 tempest-ServerPasswordTestJSON-26782812 tempest-ServerPasswordTestJSON-26782812-project] 10.222.0.25 "GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55" status: 404 len: 111 microversion: 2.1 time: 0.099680 Oct 22 03:31:23.880406 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2896/5679] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:23 2022] GET /compute/v2.1/servers/02e14fc5-c376-4d77-9091-99319066eb55 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:24.109561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:24.118789 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e136b7d-35ff-42e1-a72e-e03a6bca3ff0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1509 microversion: 2.1 time: 1.057694 Oct 22 03:31:24.123613 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2784/5680] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:23 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1509 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:25.147953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:25.148530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:25.162399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:25.166642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:25.168084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:25.172369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:25.173121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:25.173773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:25.550519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba659c9e-ed36-40ac-b0e5-6183f6f83f09 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Action: 'create', calling method: .version_select at 0x7f0d19277dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1778957271", "metadata": {"Type": "work"}}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:26.203677 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba659c9e-ed36-40ac-b0e5-6183f6f83f09 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.910540 Oct 22 03:31:26.204787 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2785/5681] 10.222.0.25 () {60 vars in 1156 bytes} [Sat Oct 22 03:31:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 912 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 22 03:31:26.217593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c62dea37-2ff5-48bb-af59-646c4a0acf18 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d19232310>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:26.342388 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c62dea37-2ff5-48bb-af59-646c4a0acf18 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 200 len: 353 microversion: 2.1 time: 0.126840 Oct 22 03:31:26.343558 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2786/5682] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:26 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:26.414825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:26.423593 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-94d16914-f6e0-4dcb-85f1-f87dda2fb50a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1509 microversion: 2.1 time: 1.280333 Oct 22 03:31:26.427756 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2897/5683] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:25 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1509 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:27.373383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-10fe0603-2602-409b-9bd5-39f5bef68058 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d196d6d30>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:27.456059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:27.456751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:27.473965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:27.474457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:27.474893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:27.482143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:27.487040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:27.488808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:27.492511 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-10fe0603-2602-409b-9bd5-39f5bef68058 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 200 len: 353 microversion: 2.1 time: 0.134473 Oct 22 03:31:27.500909 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2787/5684] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:27 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:28.131872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:28.140851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:28.146358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c398185b-7ac7-477b-b21e-8ae1f4b4995b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1509 microversion: 2.1 time: 0.694991 Oct 22 03:31:28.149744 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2898/5685] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:27 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1509 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:28.437212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-669809857", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3ad5752-73fe-401e-9777-95f0106cdaa8"}], "security_groups": [{"name": "tempest-securitygroup--1739159221"}], "key_name": "tempest-keypair-1774330581", "user_data": "}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:28.513450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9ead2269-6b1e-46bb-80c9-673e9342dfcf tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d19937b80>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:28.639250 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9ead2269-6b1e-46bb-80c9-673e9342dfcf tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 200 len: 354 microversion: 2.1 time: 0.134929 Oct 22 03:31:28.640690 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2899/5686] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:28 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:31:28.654929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b1c33a0b-6682-4366-8e3b-702bb27d22ff tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d199a9700>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:28.736561 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b1c33a0b-6682-4366-8e3b-702bb27d22ff tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 200 len: 354 microversion: 2.1 time: 0.086938 Oct 22 03:31:28.738050 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2900/5687] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:28 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:28.753104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2de8df15-814c-4fd4-ae61-fe2509ff401d tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d19f659d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:28.836113 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2de8df15-814c-4fd4-ae61-fe2509ff401d tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 202 len: 0 microversion: 2.1 time: 0.087566 Oct 22 03:31:28.836767 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2901/5688] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:31:28 2022] DELETE /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:31:28.857733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d478a1aa-4a99-40c1-a50d-d6f58217dc4f tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d19f65af0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:28.959675 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d478a1aa-4a99-40c1-a50d-d6f58217dc4f tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 200 len: 353 microversion: 2.1 time: 0.118300 Oct 22 03:31:28.960786 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2902/5689] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:28 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:28.997619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] validate_networks() for [('a3ad5752-73fe-401e-9777-95f0106cdaa8', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:31:29.177813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:29.179160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:29.192679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:29.196740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:29.197819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:29.200996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:29.202879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:29.205525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:30.213442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:30.228318 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f2e0dd2-fede-42c3-af95-772d54628b0d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1509 microversion: 2.1 time: 1.055438 Oct 22 03:31:30.229095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2903/5690] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:29 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1509 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:30.251050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-334923b5-8d43-4c5e-8677-af1cf1da2dec tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d19f65430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:30.327996 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-334923b5-8d43-4c5e-8677-af1cf1da2dec tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 200 len: 353 microversion: 2.1 time: 0.097644 Oct 22 03:31:30.329506 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2904/5691] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:30 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:30.437668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:31:30.438175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:31:30.438548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:31:30.438953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:31:30.439363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:31:30.470142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:30.470896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:30.471531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:30.472460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:30.473095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:30.473695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:30.530244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Getting quotas for project 7aab6dcaeb1541729cb8d92b3a361c80. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:31:30.547753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Getting quotas for user da9a6c11ec7640efa8693fadad60259d and project 7aab6dcaeb1541729cb8d92b3a361c80. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:31:30.578320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:31:30.588107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:31:30.721337 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-691c6bc8-65ad-455d-b59c-c2ea0322103e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.290513 Oct 22 03:31:30.733630 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2788/5692] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:31:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:31:30.737372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-62cdf33f-1340-436d-8f09-25a1c70e2531 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:30.737997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-62cdf33f-1340-436d-8f09-25a1c70e2531 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:31.262122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:31.262763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:31.278024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:31.278527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:31.278977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:31.279710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:31.284875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62cdf33f-1340-436d-8f09-25a1c70e2531 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:31.295322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:31.295775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:31.312293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:31.339340 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-62cdf33f-1340-436d-8f09-25a1c70e2531 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1237 microversion: 2.1 time: 0.606087 Oct 22 03:31:31.344519 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2905/5693] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:30 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1237 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:31.367248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91480b74-b023-4820-a0c1-22e351f04f2e tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d19f65430>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:31.506733 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91480b74-b023-4820-a0c1-22e351f04f2e tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 200 len: 353 microversion: 2.1 time: 0.157096 Oct 22 03:31:31.507337 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2906/5694] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:31 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:31.871057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:31.887924 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9dc95deb-13e5-4844-841c-4264214b02fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1509 microversion: 2.1 time: 0.629973 Oct 22 03:31:31.904058 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2789/5695] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:31 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1509 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:32.371601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:32.373022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:32.385719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:32.395288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:32.395931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:32.396997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:32.397638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:32.398268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:32.537695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd985395-95af-4e18-8951-79db72a6e4d9 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d19234820>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:32.656577 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd985395-95af-4e18-8951-79db72a6e4d9 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 200 len: 353 microversion: 2.1 time: 0.138633 Oct 22 03:31:32.657661 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2790/5696] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:32 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:32.913037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:32.915479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:32.936233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:32.943729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:32.944727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:32.948770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:32.950291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:32.954378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:32.961817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:32.978483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8b553d7-d5bb-4f94-bb07-1b58e9a7faeb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1289 microversion: 2.1 time: 0.612282 Oct 22 03:31:32.988916 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2907/5697] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:32 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1289 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:33.538987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:33.553367 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b3425bd6-57bd-4ef7-9bd6-6bd86e5aa725 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1509 microversion: 2.1 time: 0.645114 Oct 22 03:31:33.554688 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2791/5698] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:32 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1509 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:31:33.671601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dab810d6-8ab2-4c90-bb0f-09ec5f887047 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Calling method '.version_select at 0x7f0d199df8b0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:33.723125 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-dab810d6-8ab2-4c90-bb0f-09ec5f887047 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] HTTP exception thrown: Volume 2792c49b-4d72-4bcf-99c1-a6c5d61dc67f could not be found. Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dab810d6-8ab2-4c90-bb0f-09ec5f887047 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Request method failure captured: Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f HTTP/1.1 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2QNCSHUV6BjAFtRHh9cSIRKUMAvpbdUJzmi8jen_tDr58WQy-c9Hqaciun2hLVUWgpiPj-teYm6HFw_Hj1I4950B7FD7xeVmaRM4t9NkdjceFaeTzlT6aQWk0NghiWW0w08tKXyWYBcR6yrsEl45MqA3jR04nSlNI0EqLcUhW7-lp8 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: ccd30fd99d0543ac8bad0a27761edf18 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesGetTestJSON-991441044 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ccd30fd99d0543ac8bad0a27761edf18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ccd30fd99d0543ac8bad0a27761edf18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ccd30fd99d0543ac8bad0a27761edf18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ccd30fd99d0543ac8bad0a27761edf18"}]}] Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesGetTestJSON-991441044 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: ccd30fd99d0543ac8bad0a27761edf18 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesGetTestJSON-991441044 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesGetTestJSON-991441044-project Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 54ea8c4ddb3149d49cc417e4922e6985 Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesGetTestJSON-991441044-project Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: exception: Volume 2792c49b-4d72-4bcf-99c1-a6c5d61dc67f could not be found. Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '2792c49b-4d72-4bcf-99c1-a6c5d61dc67f'} Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2792c49b-4d72-4bcf-99c1-a6c5d61dc67f could not be found. (HTTP 404) (Request-ID: req-15c5247d-ac26-4ba4-bab9-5a860a7f5530) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:31:33.731741 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2792c49b-4d72-4bcf-99c1-a6c5d61dc67f could not be found. Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2792c49b-4d72-4bcf-99c1-a6c5d61dc67f could not be found. Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2792c49b-4d72-4bcf-99c1-a6c5d61dc67f could not be found. Oct 22 03:31:33.738460 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:33.747912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dab810d6-8ab2-4c90-bb0f-09ec5f887047 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] Returning 404 to user: Volume 2792c49b-4d72-4bcf-99c1-a6c5d61dc67f could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:33.749099 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dab810d6-8ab2-4c90-bb0f-09ec5f887047 tempest-VolumesGetTestJSON-991441044 tempest-VolumesGetTestJSON-991441044-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f" status: 404 len: 109 microversion: 2.1 time: 0.081589 Oct 22 03:31:33.750252 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2908/5699] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:33 2022] GET /compute/v2.1/os-volumes/2792c49b-4d72-4bcf-99c1-a6c5d61dc67f => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:34.020196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:34.021475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:34.042679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:34.044890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:34.048406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:34.049534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:34.053418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:34.054632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:34.541809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:34.553390 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2310afb3-eb32-4b46-9233-ef529e0985f0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1295 microversion: 2.1 time: 0.540266 Oct 22 03:31:34.556663 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2792/5700] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:34 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1295 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:34.583196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:34.592179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:34.617648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:34.619805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:34.621357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:34.635006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:34.635988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:34.639777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:35.580352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:35.581637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:35.591352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:35.592177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:35.592848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:35.593929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:35.597004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:35.597630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:35.662656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:35.676881 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-412b5c0c-3f4e-4a19-a0f3-03b248d024bc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1509 microversion: 2.1 time: 1.095172 Oct 22 03:31:35.677659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2909/5701] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:34 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1509 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:36.086267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:36.111868 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cc6e59ce-2894-4d44-8650-d7b1c428d92c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1295 microversion: 2.1 time: 0.536901 Oct 22 03:31:36.112545 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2793/5702] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:35 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1295 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:36.705837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:36.706426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:36.718791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=38 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:36.724120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:36.734384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:36.735493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:36.736535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:36.737250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:36.737963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:37.141094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:37.141831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:37.155700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:37.157495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:37.159037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:37.160452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:37.161504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:37.162067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:37.761247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:37.777715 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1979dd7c-c140-4005-a1eb-fb8d516ffd8d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1486 microversion: 2.1 time: 1.076623 Oct 22 03:31:37.779879 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2910/5703] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:36 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1486 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:37.810180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-747991010"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:37.813343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:37.840356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:37.841000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:37.841161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:37.841453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:37.842372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:37.843120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:37.843724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:37.862604 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38213e54-253c-41b0-9645-72f8b0601543 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.726322 Oct 22 03:31:37.869563 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2794/5704] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:37 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:38.064699 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f7bbe2c8-9b54-4d30-8eb1-bcdc28aa95cf tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "PUT /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1059 microversion: 2.1 time: 0.259762 Oct 22 03:31:38.067183 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2911/5705] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 03:31:37 2022] PUT /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1059 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:31:38.090028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:38.091691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:38.104508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:38.106814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:38.110355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:38.115324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:38.116075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:38.134430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:38.891117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:38.892401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:38.911988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:38.914052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:38.915772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:38.918774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:38.921854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:38.922515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:39.499653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:39.518002 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77be5186-6962-45b2-8ee8-51076342689b tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1486 microversion: 2.1 time: 1.430362 Oct 22 03:31:39.519016 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2795/5706] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:38 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1486 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:39.543218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:39.544609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:39.552051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:39.552866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:39.553585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:39.554718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:39.555499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:39.556375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:39.806322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:39.824021 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2166750f-5b36-4330-bcd7-8a1e964c488a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.936838 Oct 22 03:31:39.849686 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2912/5707] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:38 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:40.469426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:40.490785 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5604cb95-3bd4-49ef-89a1-696e4fc58899 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1486 microversion: 2.1 time: 0.950142 Oct 22 03:31:40.510060 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2796/5708] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:39 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1486 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:40.520054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:40.521244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:40.529621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:40.530783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:40.531499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:40.532668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:40.533498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:40.534186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:40.567869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:31:40.865795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:40.866743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:40.879805 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8cc8e6c6-bf56-4e69-81a7-b734b35f95fc tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 204 len: 0 microversion: 2.1 time: 0.357620 Oct 22 03:31:40.881077 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2913/5709] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:40 2022] DELETE /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:31:40.882340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:40.886005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:40.893145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:40.899632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:40.900756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:40.902211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:40.904457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:40.904787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:40.911272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:40.911651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:40.948132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:40.955165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:40.956311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:40.957341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:40.957975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:40.960638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:41.336291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:41.578114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:41.590998 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1aaa5738-25d5-403b-ab77-14b089a1cd58 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.732726 Oct 22 03:31:41.598544 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2797/5710] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:40 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:41.660182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:41.670966 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91b60dbe-373b-4a99-bb8b-a2ad5d9bde38 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1492 microversion: 2.1 time: 0.784151 Oct 22 03:31:41.676447 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2914/5711] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:40 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1492 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:41.684584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7828e965-6661-4850-8d61-821432375e6c req-d4e3c7d2-15a2-430b-aab5-70162dbb85a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7107260e-38b5-4ece-8d42-3508a91d4e95", "tag": "a9dfb3e8-26e7-4219-9a85-1ccb4051a2ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:41.723223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7828e965-6661-4850-8d61-821432375e6c req-d4e3c7d2-15a2-430b-aab5-70162dbb85a2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:41.730062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7828e965-6661-4850-8d61-821432375e6c req-d4e3c7d2-15a2-430b-aab5-70162dbb85a2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:41.733042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7828e965-6661-4850-8d61-821432375e6c req-d4e3c7d2-15a2-430b-aab5-70162dbb85a2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:41.783611 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7828e965-6661-4850-8d61-821432375e6c req-d4e3c7d2-15a2-430b-aab5-70162dbb85a2 service nova] Creating event network-changed:a9dfb3e8-26e7-4219-9a85-1ccb4051a2ac for instance 7107260e-38b5-4ece-8d42-3508a91d4e95 on n-h1-862416-2 Oct 22 03:31:41.792690 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7828e965-6661-4850-8d61-821432375e6c req-d4e3c7d2-15a2-430b-aab5-70162dbb85a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113321 Oct 22 03:31:41.795045 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2915/5712] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:42.045847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-521100866", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "1b383273-9075-4734-b6ad-0cb9b72fa6cb"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:42.161698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] validate_networks() for [('1b383273-9075-4734-b6ad-0cb9b72fa6cb', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:31:42.627645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:42.628693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:42.654670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:42.665658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:42.666903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:42.667843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:42.668655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:42.669593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:43.179636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:43.191759 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e68b832-bdec-49fd-95f6-5d41f8c137b2 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.568376 Oct 22 03:31:43.195641 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2916/5713] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:42 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:31:43.203486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:43.208647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:43.219377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:43.224712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:43.225487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:43.226456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:43.227663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:43.228380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:43.605040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:43.617439 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-51526ae8-2f36-47a8-b109-35529a0353fb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1492 microversion: 2.1 time: 0.419487 Oct 22 03:31:43.619715 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2917/5714] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:43 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1492 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:44.129945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bfd91e9-cef9-4c1d-8d2a-18786df99747 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Action: 'create', calling method: .version_select at 0x7f0d199dfa60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-768712548", "metadata": {"Type": "work"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bfd91e9-cef9-4c1d-8d2a-18786df99747 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Request method failure captured: Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 121 Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2QfAaeu-vSSRj1QWrFo5KZLPzkbyXbjFlxfjyAg4LQEvshBMtCjQ-VexOpB98N-rCSkplbEEpcMphb2iG35-o0h98r3Is5e4mLHzvrnHEdAvaNzoPx0KBGO2jEF2pXkpNaSZyHPYc3PywLcrWeDX3D83ur4QSHzT8-xywwknqsMYNk Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}] Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 23fc4c839691493cbca66ed3ce4483aa Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-768712548", "metadata": {"Type": "work"}}} Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-768712548', 'metadata': {'Type': 'work'}}}} Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '#$%' Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:31:44.141851 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 22 03:31:44.151469 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.162334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2bfd91e9-cef9-4c1d-8d2a-18786df99747 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:44.163233 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2bfd91e9-cef9-4c1d-8d2a-18786df99747 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.538566 Oct 22 03:31:44.164147 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2918/5715] 10.222.0.25 () {60 vars in 1156 bytes} [Sat Oct 22 03:31:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 543 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:31:44.174193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6df5353b-e69d-46ea-95b7-10aa1edfb453 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Action: 'create', calling method: .version_select at 0x7f0d1e523310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-997029213", "metadata": {"Type": "work"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6df5353b-e69d-46ea-95b7-10aa1edfb453 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Request method failure captured: Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 119 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2QfAaeu-vSSRj1QWrFo5KZLPzkbyXbjFlxfjyAg4LQEvshBMtCjQ-VexOpB98N-rCSkplbEEpcMphb2iG35-o0h98r3Is5e4mLHzvrnHEdAvaNzoPx0KBGO2jEF2pXkpNaSZyHPYc3PywLcrWeDX3D83ur4QSHzT8-xywwknqsMYNk Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}] Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 23fc4c839691493cbca66ed3ce4483aa Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-997029213", "metadata": {"Type": "work"}}} Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-997029213', 'metadata': {'Type': 'work'}}}} Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '0' Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:31:44.181639 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6df5353b-e69d-46ea-95b7-10aa1edfb453 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:44.190122 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6df5353b-e69d-46ea-95b7-10aa1edfb453 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012958 Oct 22 03:31:44.200809 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2919/5716] 10.222.0.25 () {60 vars in 1156 bytes} [Sat Oct 22 03:31:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:31:44.213828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05588b7d-f481-4338-96c0-6eb83e1240f6 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Action: 'create', calling method: .version_select at 0x7f0d199dfa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1626337340", "metadata": {"Type": "work"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05588b7d-f481-4338-96c0-6eb83e1240f6 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Request method failure captured: Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 119 Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2QfAaeu-vSSRj1QWrFo5KZLPzkbyXbjFlxfjyAg4LQEvshBMtCjQ-VexOpB98N-rCSkplbEEpcMphb2iG35-o0h98r3Is5e4mLHzvrnHEdAvaNzoPx0KBGO2jEF2pXkpNaSZyHPYc3PywLcrWeDX3D83ur4QSHzT8-xywwknqsMYNk Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}] Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 23fc4c839691493cbca66ed3ce4483aa Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1626337340", "metadata": {"Type": "work"}}} Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1626337340', 'metadata': {'Type': 'work'}}}} Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise error Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi '' Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 03:31:44.218234 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05588b7d-f481-4338-96c0-6eb83e1240f6 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05588b7d-f481-4338-96c0-6eb83e1240f6 tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017588 Oct 22 03:31:44.226037 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2920/5717] 10.222.0.25 () {60 vars in 1156 bytes} [Sat Oct 22 03:31:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:31:44.247766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:44.248429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:44.256492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:44.256994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:44.257439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:44.258784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:44.259469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:44.259960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:44.611811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:44.618700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:31:44.619453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:31:44.619867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:31:44.620425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:31:44.620916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:31:44.626668 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5dedc5be-5f97-4c5b-a5ca-44f71abffd91 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.405580 Oct 22 03:31:44.638752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:44.639177 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2921/5718] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:44 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:44.655326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:44.655869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:44.656831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:44.657376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:44.657888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:44.667719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e169744d-cc0c-454a-a5c5-0d870a4f7d2f tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Calling method '.version_select at 0x7f0d199a9280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:44.679100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Getting quotas for project 0767a76a13c9436b88b7db7837bcdd0f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:31:44.684957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Getting quotas for user ca99bf2d89ee4ef9b34b6f502f562f90 and project 0767a76a13c9436b88b7db7837bcdd0f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:31:44.709201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:31:44.713283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:31:44.762231 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e169744d-cc0c-454a-a5c5-0d870a4f7d2f tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] HTTP exception thrown: Volume tempest-invalid-1191583493 could not be found. Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e169744d-cc0c-454a-a5c5-0d870a4f7d2f tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Request method failure captured: Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1191583493 HTTP/1.1 Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2QfAaeu-vSSRj1QWrFo5KZLPzkbyXbjFlxfjyAg4LQEvshBMtCjQ-VexOpB98N-rCSkplbEEpcMphb2iG35-o0h98r3Is5e4mLHzvrnHEdAvaNzoPx0KBGO2jEF2pXkpNaSZyHPYc3PywLcrWeDX3D83ur4QSHzT8-xywwknqsMYNk Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}] Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 23fc4c839691493cbca66ed3ce4483aa Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: method: Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: exception: Volume tempest-invalid-1191583493 could not be found. Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'tempest-invalid-1191583493'} Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1191583493 could not be found. (HTTP 404) (Request-ID: req-d3d89227-df77-44cb-a489-6d38c1a39730) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:31:44.764972 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1191583493 could not be found. Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1191583493 could not be found. Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1191583493 could not be found. Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e169744d-cc0c-454a-a5c5-0d870a4f7d2f tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Returning 404 to user: Volume tempest-invalid-1191583493 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:44.773281 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e169744d-cc0c-454a-a5c5-0d870a4f7d2f tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1191583493" status: 404 len: 99 microversion: 2.1 time: 0.130442 Oct 22 03:31:44.782188 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2922/5719] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 03:31:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1191583493 => generated 99 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 22 03:31:44.802618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:44.804393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:44.833896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:44.838931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:44.840486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:44.842990 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63615793-e8f5-459a-acc5-2745c36c8883 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.241081 Oct 22 03:31:44.843735 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2798/5720] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3245 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:31:44.845247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:44.847215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:44.848395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:44.859102 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5758019a-ad67-435d-9f51-5e1926e4324f tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014140 Oct 22 03:31:44.860038 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2799/5721] 10.222.0.25 () {58 vars in 1140 bytes} [Sat Oct 22 03:31:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 03:31:44.869356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-87796a6e-1863-4cdd-82d0-7f746dca4e34 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:44.870389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-87796a6e-1863-4cdd-82d0-7f746dca4e34 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:45.076769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87796a6e-1863-4cdd-82d0-7f746dca4e34 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:45.086125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87796a6e-1863-4cdd-82d0-7f746dca4e34 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:45.096805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87796a6e-1863-4cdd-82d0-7f746dca4e34 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:45.098041 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-87796a6e-1863-4cdd-82d0-7f746dca4e34 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1261 microversion: 2.26 time: 0.236660 Oct 22 03:31:45.098648 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2800/5722] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:44 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:31:45.124739 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b295acac-fc63-45d6-80df-ea63ff5c151d tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010494 Oct 22 03:31:45.144810 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2801/5723] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Oct 22 03:31:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 22 03:31:45.150231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8df5ccdb-7b99-4a0d-855a-e09a0ce5ff2b tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Calling method '.version_select at 0x7f0d192fdc10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:45.221015 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-8df5ccdb-7b99-4a0d-855a-e09a0ce5ff2b tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] HTTP exception thrown: Volume 3efe39ce-277a-4ad7-85df-2de9b22c273b could not be found. Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8df5ccdb-7b99-4a0d-855a-e09a0ce5ff2b tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Request method failure captured: Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/os-volumes/3efe39ce-277a-4ad7-85df-2de9b22c273b HTTP/1.1 Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2QfAaeu-vSSRj1QWrFo5KZLPzkbyXbjFlxfjyAg4LQEvshBMtCjQ-VexOpB98N-rCSkplbEEpcMphb2iG35-o0h98r3Is5e4mLHzvrnHEdAvaNzoPx0KBGO2jEF2pXkpNaSZyHPYc3PywLcrWeDX3D83ur4QSHzT8-xywwknqsMYNk Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}] Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 23fc4c839691493cbca66ed3ce4483aa Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: exception: Volume 3efe39ce-277a-4ad7-85df-2de9b22c273b could not be found. Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '3efe39ce-277a-4ad7-85df-2de9b22c273b'} Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3efe39ce-277a-4ad7-85df-2de9b22c273b could not be found. (HTTP 404) (Request-ID: req-a8647629-4eb7-4af8-8204-06adbd7bbd5a) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:31:45.223080 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3efe39ce-277a-4ad7-85df-2de9b22c273b could not be found. Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3efe39ce-277a-4ad7-85df-2de9b22c273b could not be found. Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3efe39ce-277a-4ad7-85df-2de9b22c273b could not be found. Oct 22 03:31:45.228425 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.234176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8df5ccdb-7b99-4a0d-855a-e09a0ce5ff2b tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Returning 404 to user: Volume 3efe39ce-277a-4ad7-85df-2de9b22c273b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:45.234176 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8df5ccdb-7b99-4a0d-855a-e09a0ce5ff2b tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3efe39ce-277a-4ad7-85df-2de9b22c273b" status: 404 len: 109 microversion: 2.1 time: 0.087803 Oct 22 03:31:45.234176 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2802/5724] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:31:45 2022] DELETE /compute/v2.1/os-volumes/3efe39ce-277a-4ad7-85df-2de9b22c273b => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:45.249816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8bd145b5-51d4-4349-ab1e-2c7b8f3a4a2c tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Calling method '.version_select at 0x7f0d19277ee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:45.297698 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-8bd145b5-51d4-4349-ab1e-2c7b8f3a4a2c tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] HTTP exception thrown: Volume 36816266-fd8d-49f4-b21e-779606f4ef7b could not be found. Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8bd145b5-51d4-4349-ab1e-2c7b8f3a4a2c tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Request method failure captured: Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/os-volumes/36816266-fd8d-49f4-b21e-779606f4ef7b HTTP/1.1 Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2QfAaeu-vSSRj1QWrFo5KZLPzkbyXbjFlxfjyAg4LQEvshBMtCjQ-VexOpB98N-rCSkplbEEpcMphb2iG35-o0h98r3Is5e4mLHzvrnHEdAvaNzoPx0KBGO2jEF2pXkpNaSZyHPYc3PywLcrWeDX3D83ur4QSHzT8-xywwknqsMYNk Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/451ff0ab07954d02b174af63f029bf9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ff0ab07954d02b174af63f029bf9e"}]}] Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 451ff0ab07954d02b174af63f029bf9e Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesNegativeTest-1957272412 Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 23fc4c839691493cbca66ed3ce4483aa Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesNegativeTest-1957272412-project Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: method: Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: exception: Volume 36816266-fd8d-49f4-b21e-779606f4ef7b could not be found. Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '36816266-fd8d-49f4-b21e-779606f4ef7b'} Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36816266-fd8d-49f4-b21e-779606f4ef7b could not be found. (HTTP 404) (Request-ID: req-3390ef4c-c54f-451a-9690-b3ac504f8740) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 22 03:31:45.299658 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36816266-fd8d-49f4-b21e-779606f4ef7b could not be found. Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36816266-fd8d-49f4-b21e-779606f4ef7b could not be found. Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36816266-fd8d-49f4-b21e-779606f4ef7b could not be found. Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8bd145b5-51d4-4349-ab1e-2c7b8f3a4a2c tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] Returning 404 to user: Volume 36816266-fd8d-49f4-b21e-779606f4ef7b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8bd145b5-51d4-4349-ab1e-2c7b8f3a4a2c tempest-VolumesNegativeTest-1957272412 tempest-VolumesNegativeTest-1957272412-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/36816266-fd8d-49f4-b21e-779606f4ef7b" status: 404 len: 109 microversion: 2.1 time: 0.061218 Oct 22 03:31:45.306182 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2803/5725] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Oct 22 03:31:45 2022] GET /compute/v2.1/os-volumes/36816266-fd8d-49f4-b21e-779606f4ef7b => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:45.551439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:45.591225 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b55dde8-559c-400c-89f2-163dc927ba99 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1492 microversion: 2.1 time: 0.784791 Oct 22 03:31:45.595943 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2923/5726] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:44 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1492 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:45.661468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:45.662085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:45.670916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:45.685001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:45.685455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:45.686200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:45.686665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:45.687097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:46.129794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:46.130549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:46.142848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:46.143620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:46.150844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:46.151879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:46.153072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:46.155483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:46.880073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:46.891187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:46.892860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:46.899381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:46.900973 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55c894d1-d23e-445e-ad3e-46a3890aabbb tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1257 microversion: 2.26 time: 0.776353 Oct 22 03:31:46.903108 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2924/5727] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:46 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1257 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:31:46.907924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a64b1fbf-1769-4d4c-ba26-87e5ba67abdf req-dc22ce7b-3cbe-4f66-89c5-021ded724244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fb53a9-088a-4a08-ac02-c7f9625e8189", "name": "network-vif-deleted", "tag": "23ac3391-5abc-4bec-b466-c54aab172c6b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:46.923591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea8e5014-1c35-4444-b257-28aff3455ec7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 1.265675 Oct 22 03:31:46.924859 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2804/5728] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:45 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:46.932621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a64b1fbf-1769-4d4c-ba26-87e5ba67abdf req-dc22ce7b-3cbe-4f66-89c5-021ded724244 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:46.933481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a64b1fbf-1769-4d4c-ba26-87e5ba67abdf req-dc22ce7b-3cbe-4f66-89c5-021ded724244 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:46.933784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:46.934414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a64b1fbf-1769-4d4c-ba26-87e5ba67abdf req-dc22ce7b-3cbe-4f66-89c5-021ded724244 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:46.934563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:46.957442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:46.975050 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a64b1fbf-1769-4d4c-ba26-87e5ba67abdf req-dc22ce7b-3cbe-4f66-89c5-021ded724244 service nova] Creating event network-vif-deleted:23ac3391-5abc-4bec-b466-c54aab172c6b for instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 on n-h2-862416-2 Oct 22 03:31:46.991575 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a64b1fbf-1769-4d4c-ba26-87e5ba67abdf req-dc22ce7b-3cbe-4f66-89c5-021ded724244 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086951 Oct 22 03:31:46.992619 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2925/5729] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:46.996543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:46.998911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:47.002628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:47.003365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:47.004042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:47.065113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:47.066186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:47.066358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:47.066687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lazy-loading 'fault' on Instance uuid 27fb53a9-088a-4a08-ac02-c7f9625e8189 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:31:47.235613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:47.247930 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e229a344-34a1-4b35-8469-859d01343749 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 200 len: 1309 microversion: 2.1 time: 0.321995 Oct 22 03:31:47.263934 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2805/5730] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:46 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 1309 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:47.951868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:47.952680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:47.956451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:47.961549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:47.981054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:47.984595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:47.986383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:47.987568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:47.993040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:47.994447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:47.997888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.001084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.002419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.004078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.006529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.007503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.090515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:48.207236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:48.224804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:48.228392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:48.229864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73f90ef9-dcbf-494b-8bb2-5a4974df7f79 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1319 microversion: 2.26 time: 0.303920 Oct 22 03:31:48.261709 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2926/5731] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:47 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:31:48.276715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.279595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:48.292831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.293421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.294089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.296325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.297123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.297998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.329170 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 HTTP/1.1 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '27fb53a9-088a-4a08-ac02-c7f9625e8189'} Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.331316 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.338577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.338577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.338577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.338577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:48.338577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:48.338577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.338577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.338577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:48.344638 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9381a39-cda2-4569-9749-440553a053bb tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 404 len: 111 microversion: 2.1 time: 0.061109 Oct 22 03:31:48.345260 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2927/5732] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:48 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:31:48.358546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.359126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:48.372747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.373763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.374488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.378435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.379218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.379359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.424047 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 HTTP/1.1 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '27fb53a9-088a-4a08-ac02-c7f9625e8189'} Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:48.426501 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.432805 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.435517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:48.436634 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7841704f-daf5-4fe0-b3c5-819b1f295ec2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 404 len: 111 microversion: 2.1 time: 0.082126 Oct 22 03:31:48.440387 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2928/5733] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:48 2022] DELETE /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:48.454215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.454833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 27fb53a9-088a-4a08-ac02-c7f9625e8189] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:48.465035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.465533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.466052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.466957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.467740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.468566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.493089 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 HTTP/1.1 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '27fb53a9-088a-4a08-ac02-c7f9625e8189'} Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.495208 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.500933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.500933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.500933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.500933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:48.500933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:48.500933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. Oct 22 03:31:48.500933 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.505438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 27fb53a9-088a-4a08-ac02-c7f9625e8189 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:48.506483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a66e812f-27a8-4b4a-8a25-7c906462c0a0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189" status: 404 len: 111 microversion: 2.1 time: 0.058541 Oct 22 03:31:48.510512 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2929/5734] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:48 2022] GET /compute/v2.1/servers/27fb53a9-088a-4a08-ac02-c7f9625e8189 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:48.517491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.518927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:48.528869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.529740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.530256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.531952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.532825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.533528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.568559 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd HTTP/1.1 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e587ea14-f2df-40d1-9b72-595d7445d5fd'} Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:48.579787 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.584425 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.587665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:48.590681 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d596f3df-539a-411e-9fd1-e58d78ee284d tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 404 len: 111 microversion: 2.1 time: 0.078672 Oct 22 03:31:48.592319 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2930/5735] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:48 2022] DELETE /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:48.601234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.605011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: e587ea14-f2df-40d1-9b72-595d7445d5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:48.618523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.619187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.620683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.621713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.622414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.623096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.642510 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd HTTP/1.1 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'e587ea14-f2df-40d1-9b72-595d7445d5fd'} Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.644477 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.649563 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.649563 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.649563 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.649563 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:48.649563 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:48.649563 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. Oct 22 03:31:48.649563 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.652812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance e587ea14-f2df-40d1-9b72-595d7445d5fd could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:48.654342 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e3aefd40-ba0d-46aa-9b71-2a58c175f0d8 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd" status: 404 len: 111 microversion: 2.1 time: 0.057885 Oct 22 03:31:48.655477 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2931/5736] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:48 2022] GET /compute/v2.1/servers/e587ea14-f2df-40d1-9b72-595d7445d5fd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:48.663490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.664961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:48.674534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.675386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.676054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.677134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.677873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.678741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.698663 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 HTTP/1.1 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a89782eb-e2e0-47b5-98a2-2099c306dde7'} Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:48.701031 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.705708 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.710095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:48.711532 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2b700d4-4fdb-4ce9-8df4-44552ae47b5a tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 404 len: 111 microversion: 2.1 time: 0.052254 Oct 22 03:31:48.712894 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2932/5737] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:48 2022] DELETE /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:48.723137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.724089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: a89782eb-e2e0-47b5-98a2-2099c306dde7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:48.734977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.736361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.765247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.766327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.766912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.769557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.809259 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 HTTP/1.1 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a89782eb-e2e0-47b5-98a2-2099c306dde7'} Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.814485 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.822684 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.822684 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.822684 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.822684 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:48.822684 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:48.822684 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. Oct 22 03:31:48.822684 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.822684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance a89782eb-e2e0-47b5-98a2-2099c306dde7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:48.827400 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-363ff94b-6b26-42f5-8e3e-78475bd7f7ab tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7" status: 404 len: 111 microversion: 2.1 time: 0.105723 Oct 22 03:31:48.827573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:48.827756 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2933/5738] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:48 2022] GET /compute/v2.1/servers/a89782eb-e2e0-47b5-98a2-2099c306dde7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:48.839716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.840598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:48.842411 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5bc0a5a2-d70d-47ee-b6d3-651611bb8e19 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.893907 Oct 22 03:31:48.843090 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2806/5739] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:47 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:48.888885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.890703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.893034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.896048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:48.915182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:48.917295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:48.960157 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 HTTP/1.1 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '94a2ef56-38a7-4243-9b6a-567c091a20f6'} Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:48.971767 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:48.979582 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c03666ed-079b-4788-82b1-af1935a8c8cd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 404 len: 111 microversion: 2.1 time: 0.146133 Oct 22 03:31:48.984436 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2934/5740] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:48 2022] DELETE /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:31:48.986372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:48.987100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 94a2ef56-38a7-4243-9b6a-567c091a20f6] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.003270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.003844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.004325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.005058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.008382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.008972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.041461 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 HTTP/1.1 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '94a2ef56-38a7-4243-9b6a-567c091a20f6'} Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.043052 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 94a2ef56-38a7-4243-9b6a-567c091a20f6 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-91061323-7aa8-4c85-9723-697d83d2fa6c tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6" status: 404 len: 111 microversion: 2.1 time: 0.063775 Oct 22 03:31:49.049631 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2807/5741] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:48 2022] GET /compute/v2.1/servers/94a2ef56-38a7-4243-9b6a-567c091a20f6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:31:49.053829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.054446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.086877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.087566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.090324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.091102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.091589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.096450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.146149 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 HTTP/1.1 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd780379d-b319-49cb-a429-06956dbf0ba4'} Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:49.150048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:49.154866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1bbd9d30-73d6-402e-afb4-2f020497d698 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 404 len: 111 microversion: 2.1 time: 0.105121 Oct 22 03:31:49.163507 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2935/5742] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:49 2022] DELETE /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:49.171927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.172445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: d780379d-b319-49cb-a429-06956dbf0ba4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.182236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.182726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.192563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.193328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.193886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.194321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.224102 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 HTTP/1.1 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd780379d-b319-49cb-a429-06956dbf0ba4'} Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.226381 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance d780379d-b319-49cb-a429-06956dbf0ba4 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:49.233421 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff6a1fd0-c263-4ba6-a994-5b1e867ff8d6 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4" status: 404 len: 111 microversion: 2.1 time: 0.064388 Oct 22 03:31:49.246052 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2808/5743] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:49 2022] GET /compute/v2.1/servers/d780379d-b319-49cb-a429-06956dbf0ba4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:49.248304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.249188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.261755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.262400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.263037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.263755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.264415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.267183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.268886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.273951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.282643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.283138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.283639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.284338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.286745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.287207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.316834 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e HTTP/1.1 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'eca35a92-b322-4400-a3e2-13831cbd121e'} Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:49.321364 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-471cc2c9-1733-47c0-8c6e-236926cb0b84 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 404 len: 111 microversion: 2.1 time: 0.083637 Oct 22 03:31:49.332595 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2936/5744] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:49 2022] DELETE /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:49.348086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.361617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: eca35a92-b322-4400-a3e2-13831cbd121e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.379328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.381151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.384860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.387011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.387735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.388418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.434239 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e HTTP/1.1 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'eca35a92-b322-4400-a3e2-13831cbd121e'} Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.436694 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.442235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.442235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.442235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.442235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:49.442235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:49.442235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. Oct 22 03:31:49.442235 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.452804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance eca35a92-b322-4400-a3e2-13831cbd121e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:49.458065 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c96972c9-afed-439d-b13f-c6a9388ebba0 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e" status: 404 len: 111 microversion: 2.1 time: 0.113716 Oct 22 03:31:49.464867 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2937/5745] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:49 2022] GET /compute/v2.1/servers/eca35a92-b322-4400-a3e2-13831cbd121e => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:49.481303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a00e030b-8f97-42a6-b388-ed9c5d291a93 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.485063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a00e030b-8f97-42a6-b388-ed9c5d291a93 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 1498ac7f-008e-4b3c-b4b9-75c882caa154] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.507907 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a00e030b-8f97-42a6-b388-ed9c5d291a93 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.513390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a00e030b-8f97-42a6-b388-ed9c5d291a93 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154 HTTP/1.1 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1498ac7f-008e-4b3c-b4b9-75c882caa154'} Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.520143 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.525908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.525908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.525908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.525908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:49.525908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:49.525908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.525908 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.528865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a00e030b-8f97-42a6-b388-ed9c5d291a93 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:49.532177 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a00e030b-8f97-42a6-b388-ed9c5d291a93 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154" status: 404 len: 111 microversion: 2.1 time: 0.066215 Oct 22 03:31:49.534107 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:49.538135 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2938/5746] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:49 2022] DELETE /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:49.548767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:49.550248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32620643-a7c3-4354-90d2-f95ee53cb6b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1319 microversion: 2.26 time: 0.291013 Oct 22 03:31:49.552392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5c0fcd4b-f714-4d3b-8dd7-a59fb2036de2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.553184 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2809/5747] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:49 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:31:49.566187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5c0fcd4b-f714-4d3b-8dd7-a59fb2036de2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 1498ac7f-008e-4b3c-b4b9-75c882caa154] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.590955 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5c0fcd4b-f714-4d3b-8dd7-a59fb2036de2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5c0fcd4b-f714-4d3b-8dd7-a59fb2036de2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154 HTTP/1.1 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1498ac7f-008e-4b3c-b4b9-75c882caa154'} Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:49.593367 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:49.598950 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:49.598950 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:49.598950 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:49.598950 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. Oct 22 03:31:49.598950 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:49.601456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5c0fcd4b-f714-4d3b-8dd7-a59fb2036de2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 1498ac7f-008e-4b3c-b4b9-75c882caa154 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:49.605555 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5c0fcd4b-f714-4d3b-8dd7-a59fb2036de2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154" status: 404 len: 111 microversion: 2.1 time: 0.065263 Oct 22 03:31:49.606345 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2939/5748] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:49 2022] GET /compute/v2.1/servers/1498ac7f-008e-4b3c-b4b9-75c882caa154 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:49.615482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.616331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.628746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.632078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.632795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.635175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.637032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.638408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.706228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:31:49.866036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.866959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.887429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.890258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.891842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.894226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.894725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.895178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.933859 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f10cd61c-0c39-4048-9dac-da4687e37a49 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "DELETE /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 204 len: 0 microversion: 2.1 time: 0.321058 Oct 22 03:31:49.940096 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2810/5749] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:31:49 2022] DELETE /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:31:49.964056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:49.964825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:49.980844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.982014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.982763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:49.983753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:49.984997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:49.986169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:50.198495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:50.209396 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0234a58b-f454-4a61-b7f8-6e0bbff8c491 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.347563 Oct 22 03:31:50.231406 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2940/5750] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:49 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:31:50.581799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:50.582419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:50.594368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:50.594889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:50.595335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:50.596067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:50.596583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:50.602107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:51.042587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:51.045877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:51.073166 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f63cb709-b269-4112-bdcc-d113a44eb0e2 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1479 microversion: 2.1 time: 1.126878 Oct 22 03:31:51.074388 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2811/5751] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:49 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1479 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:51.238650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:51.239768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:51.252770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:51.254587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:51.257761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:51.259278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:51.267499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:51.268200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:51.268881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:51.313720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:51.351978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:51.356628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:51.358343 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3d163d75-2ff8-4164-81d9-68f2b8dc8ba9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1361 microversion: 2.26 time: 0.781268 Oct 22 03:31:51.359535 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2941/5752] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:50 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1361 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:31:52.103587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:52.104226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:52.121664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:52.123943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:52.125895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:52.126644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:52.129425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:52.129875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:52.159032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:52.169660 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-332b12df-06bb-47bd-8876-898796154bbf tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.936167 Oct 22 03:31:52.176176 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2812/5753] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:51 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:52.403229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:52.404055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:52.414958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:52.420966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:52.427903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:52.428935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:52.429565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:52.430450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:52.542157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:52.556153 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7406101b-7f90-4358-aa46-967782acb323 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1479 microversion: 2.1 time: 0.452819 Oct 22 03:31:52.557164 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2942/5754] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:52 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1479 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:31:53.203016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:53.203813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:53.221657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:53.222233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:53.222681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:53.223416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:53.223873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:53.224331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:53.304645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:53.320991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:53.322482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:53.323713 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f04ebf58-a6ef-438e-9e7c-9fc74e926f73 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1361 microversion: 2.26 time: 0.925457 Oct 22 03:31:53.342881 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2813/5755] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:52 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1361 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:31:53.534971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-94d6ba84-7c4f-490a-8f56-1d98a2ce75f3 req-e03c532e-d86b-4e38-89a1-843b079cbc8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7107260e-38b5-4ece-8d42-3508a91d4e95", "name": "network-vif-plugged", "status": "completed", "tag": "a9dfb3e8-26e7-4219-9a85-1ccb4051a2ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:53.558168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-94d6ba84-7c4f-490a-8f56-1d98a2ce75f3 req-e03c532e-d86b-4e38-89a1-843b079cbc8b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:53.565187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-94d6ba84-7c4f-490a-8f56-1d98a2ce75f3 req-e03c532e-d86b-4e38-89a1-843b079cbc8b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:53.565841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-94d6ba84-7c4f-490a-8f56-1d98a2ce75f3 req-e03c532e-d86b-4e38-89a1-843b079cbc8b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:53.588598 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-94d6ba84-7c4f-490a-8f56-1d98a2ce75f3 req-e03c532e-d86b-4e38-89a1-843b079cbc8b service nova] Creating event network-vif-plugged:a9dfb3e8-26e7-4219-9a85-1ccb4051a2ac for instance 7107260e-38b5-4ece-8d42-3508a91d4e95 on n-h1-862416-2 Oct 22 03:31:53.608997 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-94d6ba84-7c4f-490a-8f56-1d98a2ce75f3 req-e03c532e-d86b-4e38-89a1-843b079cbc8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081815 Oct 22 03:31:53.610466 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2814/5756] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:53.621919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:53.650287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:53.675225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:53.690406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:53.691242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:53.692156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:53.692783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:53.697448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:54.201589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:54.210546 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5fa1ba61-af1c-436e-bbc2-bffb50fd08e3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 1.012315 Oct 22 03:31:54.222265 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2943/5757] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:53 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:54.297086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439172d993f047bcb9ad3e34dfadb229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8a2438275e42c9901bb2f3baa90c19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:54.312450 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1553936d-942a-49b3-953e-fe3e89d65fb4 tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 200 len: 1479 microversion: 2.1 time: 0.696600 Oct 22 03:31:54.313178 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2815/5758] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:53 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 1479 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:54.371193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:54.371773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:54.384226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:54.389000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:54.397627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:54.401796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:54.403415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:54.404017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:54.455087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2d201768-d5af-48ff-ab55-8a87314fdc92 req-0262dabc-7bad-4dd7-8fd2-7796947b7e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175b24fd-6d72-4920-bd43-63c33b220d4a", "name": "network-vif-deleted", "tag": "6bda4fe1-497d-4056-97c5-93f23c41f5ed"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:54.495843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d201768-d5af-48ff-ab55-8a87314fdc92 req-0262dabc-7bad-4dd7-8fd2-7796947b7e01 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:54.498729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d201768-d5af-48ff-ab55-8a87314fdc92 req-0262dabc-7bad-4dd7-8fd2-7796947b7e01 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:54.515180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d201768-d5af-48ff-ab55-8a87314fdc92 req-0262dabc-7bad-4dd7-8fd2-7796947b7e01 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:54.549035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2d201768-d5af-48ff-ab55-8a87314fdc92 req-0262dabc-7bad-4dd7-8fd2-7796947b7e01 service nova] Creating event network-vif-deleted:6bda4fe1-497d-4056-97c5-93f23c41f5ed for instance 175b24fd-6d72-4920-bd43-63c33b220d4a on n-h2-862416-2 Oct 22 03:31:54.563234 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2d201768-d5af-48ff-ab55-8a87314fdc92 req-0262dabc-7bad-4dd7-8fd2-7796947b7e01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112534 Oct 22 03:31:54.575681 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2816/5759] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:31:54.937227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:54.956482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:54.960920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:54.960920 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3afa12ad-9b60-443f-aafd-c79401a2b30d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1361 microversion: 2.26 time: 0.593692 Oct 22 03:31:54.960920 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2944/5760] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:54 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1361 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:31:55.239695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:55.240691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:55.251084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:55.256718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:31:55.262355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:55.263094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:55.265007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:55.266071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:55.275078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:55.275974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:55.342675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:55.343411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] [instance: 175b24fd-6d72-4920-bd43-63c33b220d4a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:55.354779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:55.355504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:55.356087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:55.357062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:55.363785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:55.364472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:55.406565 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] HTTP exception thrown: Instance 175b24fd-6d72-4920-bd43-63c33b220d4a could not be found. Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Request method failure captured: Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a HTTP/1.1 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Mg9HuCwOnUwnvlwXi1JvWTDTuKw68r8lqu1Bqjc-fgqAyxOfAcKYW0HxyBuaSy3KRdImuh_LdTE9p5ZcVFplGCpu6AD_rlQsz6tWnpF-tzcTJhbKkuUOYoPxTnaLkwdDOWwtUP76CiHvGblFU1aFsQNzFHYQdj05SsGQDb6TkTuwc Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc8a2438275e42c9901bb2f3baa90c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc8a2438275e42c9901bb2f3baa90c19"}]}] Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersTestJSON-1105243205 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: cc8a2438275e42c9901bb2f3baa90c19 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersTestJSON-1105243205 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 439172d993f047bcb9ad3e34dfadb229 Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersTestJSON-1105243205-project Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 175b24fd-6d72-4920-bd43-63c33b220d4a could not be found. Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '175b24fd-6d72-4920-bd43-63c33b220d4a'} Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175b24fd-6d72-4920-bd43-63c33b220d4a could not be found. Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175b24fd-6d72-4920-bd43-63c33b220d4a could not be found. Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:31:55.410404 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:55.415535 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:31:55.415535 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:31:55.415535 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:31:55.415535 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:31:55.415535 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:31:55.415535 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175b24fd-6d72-4920-bd43-63c33b220d4a could not be found. Oct 22 03:31:55.415535 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:31:55.417278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] Returning 404 to user: Instance 175b24fd-6d72-4920-bd43-63c33b220d4a could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:31:55.418550 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8790513-a763-491a-82f8-159f7ebe3ccd tempest-ServersTestJSON-1105243205 tempest-ServersTestJSON-1105243205-project] 10.222.0.25 "GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a" status: 404 len: 111 microversion: 2.1 time: 0.080329 Oct 22 03:31:55.419600 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2945/5761] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:55 2022] GET /compute/v2.1/servers/175b24fd-6d72-4920-bd43-63c33b220d4a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:31:55.844941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:55.856541 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6af17506-3019-40f3-b8e4-f458f8f3c2c8 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1363 microversion: 2.1 time: 0.624608 Oct 22 03:31:55.857350 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2817/5762] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:55 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1363 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:55.994137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:55.995426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:56.006234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:56.012895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:56.015356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:56.016299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:56.018478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:56.019109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:56.487651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:56.520578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:56.524567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:56.527972 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c942e1ca-a496-412e-9273-88e8c200a3a7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1361 microversion: 2.26 time: 0.538404 Oct 22 03:31:56.542195 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2946/5763] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:55 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:31:56.605194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d127e4d6-53ca-4dee-ae50-aab7dca54692 req-1c8fdcb4-2342-4ce1-8660-fa35a6e242e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f71973-0afc-422f-b5eb-c6cb8d550928", "tag": "a48b7867-fc5a-4b39-a7a9-f108ba6d894d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:31:56.632042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d127e4d6-53ca-4dee-ae50-aab7dca54692 req-1c8fdcb4-2342-4ce1-8660-fa35a6e242e2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:56.635098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d127e4d6-53ca-4dee-ae50-aab7dca54692 req-1c8fdcb4-2342-4ce1-8660-fa35a6e242e2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:56.640176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d127e4d6-53ca-4dee-ae50-aab7dca54692 req-1c8fdcb4-2342-4ce1-8660-fa35a6e242e2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:56.688809 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d127e4d6-53ca-4dee-ae50-aab7dca54692 req-1c8fdcb4-2342-4ce1-8660-fa35a6e242e2 service nova] Creating event network-changed:a48b7867-fc5a-4b39-a7a9-f108ba6d894d for instance 58f71973-0afc-422f-b5eb-c6cb8d550928 on n-h1-862416-2 Oct 22 03:31:56.705645 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d127e4d6-53ca-4dee-ae50-aab7dca54692 req-1c8fdcb4-2342-4ce1-8660-fa35a6e242e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104903 Oct 22 03:31:56.706277 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2818/5764] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:56.882557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:56.883716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:56.898873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:56.899269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:56.900048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:56.900947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:56.901602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:56.902215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:57.280987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:57.312959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8e4bad7-6183-4532-9927-7b4f959b8199 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1547 microversion: 2.1 time: 0.434801 Oct 22 03:31:57.316276 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2947/5765] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:31:56 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1547 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:31:57.341639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:57.342227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:57.358238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:57.361756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:57.363361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:57.364530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:57.365851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:57.368053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:57.558868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:57.559490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:57.584833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:57.589389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:57.590384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:57.591357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:57.592051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:57.592826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:57.750504 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0b24016-d3ab-457c-8324-87e0582fff44 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.414230 Oct 22 03:31:57.761963 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2819/5766] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:31:57 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-interface => generated 284 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:31:58.024544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:58.044184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:58.047630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:31:58.049958 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a811b4d1-2231-445a-af3a-3d3d9550b16c tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1361 microversion: 2.26 time: 0.495563 Oct 22 03:31:58.053132 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2948/5767] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:57 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1361 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:31:59.076372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:31:59.076988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:31:59.090806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:59.091586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:59.092424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:31:59.093320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:31:59.101166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:31:59.102505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:01.281020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:01.294028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:01.295495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:01.299478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2b896f18-af3c-4e13-9449-5f05e32ac017 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1361 microversion: 2.26 time: 2.225066 Oct 22 03:32:01.322433 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2820/5768] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:31:59 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1361 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:01.877045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-90315cc0-93e6-476a-88de-afe8374f9d93 req-e3bcd1f1-926a-4e91-bafe-07db05dc3a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f71973-0afc-422f-b5eb-c6cb8d550928", "name": "network-vif-plugged", "status": "completed", "tag": "a48b7867-fc5a-4b39-a7a9-f108ba6d894d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:32:01.900505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-90315cc0-93e6-476a-88de-afe8374f9d93 req-e3bcd1f1-926a-4e91-bafe-07db05dc3a19 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:01.901212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-90315cc0-93e6-476a-88de-afe8374f9d93 req-e3bcd1f1-926a-4e91-bafe-07db05dc3a19 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:01.901851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-90315cc0-93e6-476a-88de-afe8374f9d93 req-e3bcd1f1-926a-4e91-bafe-07db05dc3a19 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:01.930118 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-90315cc0-93e6-476a-88de-afe8374f9d93 req-e3bcd1f1-926a-4e91-bafe-07db05dc3a19 service nova] Creating event network-vif-plugged:a48b7867-fc5a-4b39-a7a9-f108ba6d894d for instance 58f71973-0afc-422f-b5eb-c6cb8d550928 on n-h1-862416-2 Oct 22 03:32:01.939022 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-90315cc0-93e6-476a-88de-afe8374f9d93 req-e3bcd1f1-926a-4e91-bafe-07db05dc3a19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065655 Oct 22 03:32:01.941292 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2949/5769] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:32:02.326709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:02.327919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:02.346268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7b1ffef8-e74c-4d26-b72a-dc3d120c8edd req-3df34a68-b742-4f80-9d0c-e56f93930723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7107260e-38b5-4ece-8d42-3508a91d4e95", "tag": "a9dfb3e8-26e7-4219-9a85-1ccb4051a2ac"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:32:02.370396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:02.372175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:02.375236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:02.381535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:02.382038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:02.383151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7b1ffef8-e74c-4d26-b72a-dc3d120c8edd req-3df34a68-b742-4f80-9d0c-e56f93930723 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:02.384881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7b1ffef8-e74c-4d26-b72a-dc3d120c8edd req-3df34a68-b742-4f80-9d0c-e56f93930723 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:02.385205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:02.389854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7b1ffef8-e74c-4d26-b72a-dc3d120c8edd req-3df34a68-b742-4f80-9d0c-e56f93930723 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:02.425538 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7b1ffef8-e74c-4d26-b72a-dc3d120c8edd req-3df34a68-b742-4f80-9d0c-e56f93930723 service nova] Creating event network-changed:a9dfb3e8-26e7-4219-9a85-1ccb4051a2ac for instance 7107260e-38b5-4ece-8d42-3508a91d4e95 on n-h1-862416-2 Oct 22 03:32:02.434567 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7b1ffef8-e74c-4d26-b72a-dc3d120c8edd req-3df34a68-b742-4f80-9d0c-e56f93930723 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092113 Oct 22 03:32:02.443492 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2950/5770] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:32:02.791173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:02.806063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:02.810355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:02.814931 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2e2bf9ed-4247-4969-b6c9-9eebcf280f1e tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1361 microversion: 2.26 time: 0.490913 Oct 22 03:32:02.817382 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2821/5771] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:02 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1361 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:32:03.844619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:03.845335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:03.891642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:03.894584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:03.895054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:03.915271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:03.919083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:03.919551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:04.429607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:04.443618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:04.445013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:04.446768 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47c7e0b0-216a-42fa-99e6-d2413f3ce385 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1545 microversion: 2.26 time: 0.606791 Oct 22 03:32:04.447353 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2951/5772] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:03 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1545 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:04.480859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d191dfca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:04.518585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:04.524696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:04.525305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:04.526120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:04.541377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:04.543423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:04.544460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:04.550780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:04.551518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:04.552171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:04.626361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:04.631556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:04.634103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:04.709569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:04.710482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:04.712736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:04.825057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:04.891114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b7fad26d-0f73-494c-88aa-622ac35669cd tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-886109811" status: 201 len: 0 microversion: 2.26 time: 0.415976 Oct 22 03:32:04.900476 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2822/5773] 10.222.0.25 () {62 vars in 1377 bytes} [Sat Oct 22 03:32:04 2022] PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-886109811 => generated 0 bytes in 426 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 22 03:32:04.904526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc0ad046-65a2-4502-999d-7685cd90010a tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d19f659d0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:04.928800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ad046-65a2-4502-999d-7685cd90010a tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:04.929292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ad046-65a2-4502-999d-7685cd90010a tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:04.929792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc0ad046-65a2-4502-999d-7685cd90010a tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:04.990957 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc0ad046-65a2-4502-999d-7685cd90010a tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-886109811" status: 204 len: 0 microversion: 2.26 time: 0.092938 Oct 22 03:32:04.995659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2952/5774] 10.222.0.25 () {60 vars in 1358 bytes} [Sat Oct 22 03:32:04 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-886109811 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:32:05.004941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d1929dc10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:05.027364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.027811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.038249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.044007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:05.082961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.083613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.084712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.086752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.087303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.092633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.150547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.152004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.152847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.180909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:05.212947 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cecb0847-82b5-4417-b6cc-db98154479b7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 204 len: 0 microversion: 2.26 time: 0.212963 Oct 22 03:32:05.220521 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2823/5775] 10.222.0.25 () {60 vars in 1295 bytes} [Sat Oct 22 03:32:04 2022] DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:32:05.230498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-377cb273-2482-4ab5-a7c0-1b0b10d9d83d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d19fef550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:05.241410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-377cb273-2482-4ab5-a7c0-1b0b10d9d83d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.244919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-377cb273-2482-4ab5-a7c0-1b0b10d9d83d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.245632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-377cb273-2482-4ab5-a7c0-1b0b10d9d83d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.259468 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-377cb273-2482-4ab5-a7c0-1b0b10d9d83d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 200 len: 12 microversion: 2.26 time: 0.037219 Oct 22 03:32:05.260779 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2953/5776] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 03:32:05 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 12 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:32:05.271978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d1927c820>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:05.286199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.287029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.287860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.288533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:05.297399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.298732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.299472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.300469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.301066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.301756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.356763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.357893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.358473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.371294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.371969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.372775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.422857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:05.457783 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5c463351-ae72-43eb-a201-a133306777df tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1684477477" status: 201 len: 0 microversion: 2.26 time: 0.189659 Oct 22 03:32:05.459268 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2824/5777] 10.222.0.25 () {62 vars in 1380 bytes} [Sat Oct 22 03:32:05 2022] PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1684477477 => generated 0 bytes in 193 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 22 03:32:05.470251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8384f305-307b-4175-92d0-bad6bc05dad3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d1e4acee0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:05.484042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8384f305-307b-4175-92d0-bad6bc05dad3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.485081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8384f305-307b-4175-92d0-bad6bc05dad3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.486116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8384f305-307b-4175-92d0-bad6bc05dad3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.498929 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8384f305-307b-4175-92d0-bad6bc05dad3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 200 len: 36 microversion: 2.26 time: 0.032678 Oct 22 03:32:05.513131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d191a2160>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:05.517745 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2954/5778] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 03:32:05 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 36 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:32:05.521703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.522769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.523889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.524576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:05.531746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.532315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.532916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.533766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.534380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.534811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.592047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.592937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.593390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.628086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:05.651732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:05.680309 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3918cab-7bae-494d-b9cc-d949c36a87f3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1684477477" status: 204 len: 0 microversion: 2.26 time: 0.171892 Oct 22 03:32:05.681311 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2825/5779] 10.222.0.25 () {60 vars in 1364 bytes} [Sat Oct 22 03:32:05 2022] DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1684477477 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:32:05.689851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03ae915b-6765-4903-8449-8465a6c00169 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d1e4a93a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:05.723747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ae915b-6765-4903-8449-8465a6c00169 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.724297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ae915b-6765-4903-8449-8465a6c00169 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.724728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ae915b-6765-4903-8449-8465a6c00169 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.744428 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03ae915b-6765-4903-8449-8465a6c00169 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 200 len: 12 microversion: 2.26 time: 0.058902 Oct 22 03:32:05.750503 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2955/5780] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 03:32:05 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 12 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:32:05.757028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d192345e0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:05.782263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.782752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.783186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.783664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:05.803860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.806133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.807763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.808804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.809413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.809980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.842432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.843074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.843770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.858350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:05.876107 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0021f485-59f8-4926-8ca6-5933f625692f tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 204 len: 0 microversion: 2.26 time: 0.124346 Oct 22 03:32:05.877005 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2826/5781] 10.222.0.25 () {60 vars in 1295 bytes} [Sat Oct 22 03:32:05 2022] DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:32:05.888107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d1e527dc0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:05.905394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.906670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.907313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.907942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:05.919319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.919966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.920699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.921966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:05.922627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:05.923219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:05.975438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:06.065343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.065851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.066278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.082557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.083074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.083523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.155075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:06.192022 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8ba33d7-b8d0-4b96-8577-aff675cafbb8 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1253970557" status: 201 len: 0 microversion: 2.26 time: 0.309517 Oct 22 03:32:06.193064 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2956/5782] 10.222.0.25 () {62 vars in 1380 bytes} [Sat Oct 22 03:32:05 2022] PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1253970557 => generated 0 bytes in 311 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 22 03:32:06.204490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d191a28b0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:06.222038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.222297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.222755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.223214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:06.240196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.240958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.241658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.243840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.244508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.245084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.301360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.308877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.309343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.327422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.327917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.328401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.385846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:06.416189 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cecf99ed-eebc-41ca-b814-0b9b5199cdf6 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1524477407" status: 201 len: 0 microversion: 2.26 time: 0.215792 Oct 22 03:32:06.421644 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2827/5783] 10.222.0.25 () {62 vars in 1380 bytes} [Sat Oct 22 03:32:06 2022] PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1524477407 => generated 0 bytes in 222 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 22 03:32:06.430727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d19fefc10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:06.458563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.459057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.459500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.459982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:06.497949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.499300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.500179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.504525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.506086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.507321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.619271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.630785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.630785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.663561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:06.699824 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1547b21-49e8-4c32-9216-2b4d12f6e6c9 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 204 len: 0 microversion: 2.26 time: 0.277274 Oct 22 03:32:06.702188 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2957/5784] 10.222.0.25 () {60 vars in 1295 bytes} [Sat Oct 22 03:32:06 2022] DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 22 03:32:06.710293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7364e3df-d80a-40f9-b334-2123a30eddf7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d19277790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:06.731561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7364e3df-d80a-40f9-b334-2123a30eddf7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.732307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7364e3df-d80a-40f9-b334-2123a30eddf7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.732924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7364e3df-d80a-40f9-b334-2123a30eddf7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.749427 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7364e3df-d80a-40f9-b334-2123a30eddf7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 200 len: 12 microversion: 2.26 time: 0.043399 Oct 22 03:32:06.750367 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2828/5785] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 03:32:06 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:32:06.762792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d1e527160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:06.782845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:06.791900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.795343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.795853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.796403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:06.815465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.819018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.819673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.821707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.825639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.825639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.864780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.865520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.866100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.881167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:06.905940 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8fa928e3-6c44-4331-a3a6-25635e3c4936 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 204 len: 0 microversion: 2.26 time: 0.149398 Oct 22 03:32:06.926785 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2958/5786] 10.222.0.25 () {60 vars in 1295 bytes} [Sat Oct 22 03:32:06 2022] DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:32:06.935715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d19232550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:06.962763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:06.964539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:06.966632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:06.976604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:06.999825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.001319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.003802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.007367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.010200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.011569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.087757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.088626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.089259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.116736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.119478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.120105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.181664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:07.210261 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e1b39ca-55bd-4678-89ec-99b9580ae18b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1171651650" status: 201 len: 0 microversion: 2.26 time: 0.281565 Oct 22 03:32:07.212257 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2829/5787] 10.222.0.25 () {62 vars in 1380 bytes} [Sat Oct 22 03:32:06 2022] PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1171651650 => generated 0 bytes in 285 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 22 03:32:07.224558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d195135e0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:07.263795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.271447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.272802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.276932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:07.299389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.299939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.300450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.301187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.301663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.309746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.383505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.384374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.385004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.397610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.398764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.400858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.456672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:07.484064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-88482284-e9d4-4afd-bd9c-03a4e5521d64 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1459451201" status: 201 len: 0 microversion: 2.26 time: 0.265150 Oct 22 03:32:07.490670 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2959/5788] 10.222.0.25 () {62 vars in 1380 bytes} [Sat Oct 22 03:32:07 2022] PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags/tempest-tag-1459451201 => generated 0 bytes in 272 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 22 03:32:07.497174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Action: 'update_all', calling method: .version_select at 0x7f0d19277af0>, body: {"tags": ["tempest-tag-906154484", "tempest-tag-1322115034"]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:32:07.526883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.532994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.533510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.534019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:07.552383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.556512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.556970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.557729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.558449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.558880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.622245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.622748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.623475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.672405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:07.706376 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e74b7b90-ce4d-4c7a-af89-1596533c0f36 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 200 len: 61 microversion: 2.26 time: 0.215215 Oct 22 03:32:07.707437 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2830/5789] 10.222.0.25 () {62 vars in 1312 bytes} [Sat Oct 22 03:32:07 2022] PUT /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 61 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:32:07.719180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e57733c4-83f7-4f01-8ad9-d4010007df54 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d1e5271f0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:07.727864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57733c4-83f7-4f01-8ad9-d4010007df54 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.728631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57733c4-83f7-4f01-8ad9-d4010007df54 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.729246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e57733c4-83f7-4f01-8ad9-d4010007df54 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.744534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e57733c4-83f7-4f01-8ad9-d4010007df54 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 200 len: 61 microversion: 2.26 time: 0.029305 Oct 22 03:32:07.745918 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2960/5790] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Oct 22 03:32:07 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 61 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:32:07.757842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '.version_select at 0x7f0d1922aee0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:07.769154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.769912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.770498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.771153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:07.780158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.780832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.781414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.782597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.783520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.784394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.811161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.812241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.813098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.838774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'flavor' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:07.876077 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e56bfb51-4efe-40f6-a5eb-23343cb554d7 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags" status: 204 len: 0 microversion: 2.26 time: 0.122231 Oct 22 03:32:07.877918 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2831/5791] 10.222.0.25 () {60 vars in 1295 bytes} [Sat Oct 22 03:32:07 2022] DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928/tags => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:32:07.889195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:07.889796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:07.909645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.910958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.911409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.915677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:07.916557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:07.918735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:07.997332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:32:08.164958 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e41a5a9e-04df-4a47-828c-4ffb4be5867d tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 204 len: 0 microversion: 2.26 time: 0.280166 Oct 22 03:32:08.168649 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2961/5792] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:32:07 2022] DELETE /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 22 03:32:08.181944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:08.181944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:08.192542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:08.193994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:08.196955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:08.199513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:08.201091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:08.202950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:08.537090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:08.562385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:08.570259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:08.574921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19410d4a-3ef7-4a0d-a1ab-4823e2d32508 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1551 microversion: 2.26 time: 0.401072 Oct 22 03:32:08.576626 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2832/5793] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:08 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1551 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:09.603826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:09.604565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:09.621427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:09.621937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:09.622390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:09.629715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:09.631211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:09.632383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:10.091398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:10.102864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:10.108308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:10.112807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f3e099f-6e77-4872-8197-f41175646c58 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1551 microversion: 2.26 time: 0.513638 Oct 22 03:32:10.134873 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2962/5794] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:09 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1551 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:10.778639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f71973-0afc-422f-b5eb-c6cb8d550928", "name": "network-vif-deleted", "tag": "a48b7867-fc5a-4b39-a7a9-f108ba6d894d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:32:10.841395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:10.843163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:10.851202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:10.885112 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] Creating event network-vif-deleted:a48b7867-fc5a-4b39-a7a9-f108ba6d894d for instance 58f71973-0afc-422f-b5eb-c6cb8d550928 on n-h1-862416-2 Oct 22 03:32:10.899179 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124487 Oct 22 03:32:10.902030 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2833/5795] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:32:11.142083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:11.142694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:11.163184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:11.168450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:11.169108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:11.169741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:11.170215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:11.170643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:11.257124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:11.258186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:11.272822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:11.274717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lazy-loading 'fault' on Instance uuid 58f71973-0afc-422f-b5eb-c6cb8d550928 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:32:11.361814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:11.379078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:11.382099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca99bf2d89ee4ef9b34b6f502f562f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0767a76a13c9436b88b7db7837bcdd0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:11.390871 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 200 len: 1351 microversion: 2.26 time: 0.253009 Oct 22 03:32:11.394120 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2963/5796] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:11 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 1351 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:12.310924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:12.312829 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002633 Oct 22 03:32:12.313831 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2834/5797] 10.222.0.25 () {56 vars in 886 bytes} [Sat Oct 22 03:32:12 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 03:32:12.323655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:12.338170 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.015119 Oct 22 03:32:12.338639 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2964/5798] 10.222.0.25 () {54 vars in 1035 bytes} [Sat Oct 22 03:32:12 2022] GET /compute/v2/ => generated 379 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 22 03:32:12.346535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:12.350179 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-09056220-ec4c-48e7-a36a-1feae6c192cb req-ed584c96-1419-467e-8890-342a3aaa371c service nova] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003527 Oct 22 03:32:12.351683 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2835/5799] 10.222.0.25 () {54 vars in 1041 bytes} [Sat Oct 22 03:32:12 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:32:12.360600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:12.361793 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b75b5ac0-e330-46a0-b048-6d69ccfaada3 tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001803 Oct 22 03:32:12.362274 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2965/5800] 10.222.0.25 () {56 vars in 886 bytes} [Sat Oct 22 03:32:12 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 22 03:32:12.424491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:12.425418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] [instance: 58f71973-0afc-422f-b5eb-c6cb8d550928] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:12.436374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:12.451571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:12.452307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:12.453204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:12.455945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:12.456588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:12.500839 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] HTTP exception thrown: Instance 58f71973-0afc-422f-b5eb-c6cb8d550928 could not be found. Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Request method failure captured: Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 HTTP/1.1 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Qc98cHUrOsD0bsx3Uz1cCHMW_RAXz8L5E9dJfPskDpxo05uG-sghIwJHtlJ31-0lzAeaASGw9SGaegjH4qNVIdGoO3KjglvXz0VsQ3TkhkyYD9Jai9K_vWa45jUMeHn-JBJfBs35JSk8SkS-3jpdpGEu9wV0GWQHs8jVU1_K_7lCE Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.26 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0767a76a13c9436b88b7db7837bcdd0f Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerTagsTestJSON-79153916 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0767a76a13c9436b88b7db7837bcdd0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0767a76a13c9436b88b7db7837bcdd0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0767a76a13c9436b88b7db7837bcdd0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0767a76a13c9436b88b7db7837bcdd0f"}]}] Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerTagsTestJSON-79153916 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0767a76a13c9436b88b7db7837bcdd0f Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerTagsTestJSON-79153916 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerTagsTestJSON-79153916-project Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: ca99bf2d89ee4ef9b34b6f502f562f90 Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerTagsTestJSON-79153916-project Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 58f71973-0afc-422f-b5eb-c6cb8d550928 could not be found. Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '58f71973-0afc-422f-b5eb-c6cb8d550928'} Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f71973-0afc-422f-b5eb-c6cb8d550928 could not be found. Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f71973-0afc-422f-b5eb-c6cb8d550928 could not be found. Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:32:12.502589 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f71973-0afc-422f-b5eb-c6cb8d550928 could not be found. Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] Returning 404 to user: Instance 58f71973-0afc-422f-b5eb-c6cb8d550928 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:32:12.506855 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ce4a684c-332d-42a8-95a8-b84bc11c986b tempest-ServerTagsTestJSON-79153916 tempest-ServerTagsTestJSON-79153916-project] 10.222.0.25 "GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928" status: 404 len: 111 microversion: 2.26 time: 0.084110 Oct 22 03:32:12.525182 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2836/5801] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:12 2022] GET /compute/v2.1/servers/58f71973-0afc-422f-b5eb-c6cb8d550928 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 22 03:32:26.224041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:26.224958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=72,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:26.701525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-832005845", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": "none"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:32:26.775407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:32:26.775769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:32:26.776301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:32:26.776708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:32:26.777284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:32:26.787515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:26.788959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:26.789589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:26.790543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:26.791194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:26.791819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:26.817529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Getting quotas for project 0a3afddf52124c7eb4a1bc2698d37a97. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:32:26.825558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Getting quotas for user b97368f4b6bb4c57beefc6b1489c39c4 and project 0a3afddf52124c7eb4a1bc2698d37a97. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:32:26.840359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:32:26.848134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:32:26.925199 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b3dac5c-4a4d-4268-b6e6-26c278e75c20 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.712410 Oct 22 03:32:26.926568 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2966/5802] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Oct 22 03:32:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 22 03:32:26.938486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6ebc6b7-4054-4b3f-8d37-e3d1cf7be6fe tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:26.940043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6ebc6b7-4054-4b3f-8d37-e3d1cf7be6fe tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:26.943883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=63 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:26.946607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=69,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:27.111019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6ebc6b7-4054-4b3f-8d37-e3d1cf7be6fe tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:27.124252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6ebc6b7-4054-4b3f-8d37-e3d1cf7be6fe tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:27.140627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6ebc6b7-4054-4b3f-8d37-e3d1cf7be6fe tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:27.141828 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6ebc6b7-4054-4b3f-8d37-e3d1cf7be6fe tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1277 microversion: 2.57 time: 0.207617 Oct 22 03:32:27.156240 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2837/5803] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:26 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:28.201574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:28.202339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:28.215510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:28.216715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:28.217766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:28.220433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:28.221365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:28.222790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:28.368261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:28.390307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:28.394713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:28.399670 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7260b08-d7da-4e02-b503-a1e908a63c0b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1273 microversion: 2.57 time: 0.203558 Oct 22 03:32:28.404254 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2967/5804] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:28 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:29.432299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:29.432915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:29.441017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:29.446301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:29.446773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:29.447534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:29.448000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:29.449310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:29.603671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:29.620126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:29.622434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:29.623511 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01030a63-067b-4a90-961d-c402c1680dd8 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1335 microversion: 2.57 time: 0.196609 Oct 22 03:32:29.646684 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2838/5805] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:29 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1335 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:30.652738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:30.653951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:30.667253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:30.667829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:30.668523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:30.669495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:30.670311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:30.670949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:30.826943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:30.839553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:30.844484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:30.846209 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3cf52bd9-a0f7-4829-a70c-0dfd9243cbaa tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1335 microversion: 2.57 time: 0.199141 Oct 22 03:32:30.850489 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2968/5806] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:30 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1335 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:31.879730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:31.880458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:31.894430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:31.896005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:31.899952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:31.901132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:31.901765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:31.902382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:32.018018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:32.036863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:32.038886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:32.040082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3c6f808-5367-475c-91a3-97388e57ef38 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1335 microversion: 2.57 time: 0.164937 Oct 22 03:32:32.047593 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2839/5807] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:31 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1335 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:33.071618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:33.073241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:33.084509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:33.086344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:33.088166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:33.089877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:33.091170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:33.092179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:33.275051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:33.287471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:33.287471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:33.289414 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0eeb6650-4854-439f-a4e5-6a709aa7bd53 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1356 microversion: 2.57 time: 0.223194 Oct 22 03:32:33.290296 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2969/5808] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:33 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1356 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:33.322686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:32:33.328069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:33.347463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:33.349355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:33.352581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:33.354371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:33.357152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:33.357802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:33.493975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:32:33.494406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:32:33.495004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:32:33.495421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:32:33.495973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:32:33.633885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:33.646754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:33.661336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:33.661853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:33.662670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:33.663752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:33.669393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:33.779565 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-96eb02d9-a5fa-4036-b77f-1c04ef0e856b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "POST /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7/action" status: 202 len: 1137 microversion: 2.57 time: 0.466983 Oct 22 03:32:33.780327 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2840/5809] 10.222.0.25 () {62 vars in 1320 bytes} [Sat Oct 22 03:32:33 2022] POST /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7/action => generated 1137 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 22 03:32:33.817768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:33.818888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:33.837996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:33.838753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:33.839378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:33.841269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:33.842210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:33.843317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:34.015752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:34.028868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:34.030317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:34.032864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4512eec4-86bb-4861-b78d-521cc8557f29 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.230680 Oct 22 03:32:34.040962 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2970/5810] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:33 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:35.073861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:35.078802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:35.095244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:35.096558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:35.097541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:35.098908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:35.101536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:35.104859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:35.171865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:35.172564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:35.189460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:35.192598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:35.197447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:35.200540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:35.202458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:35.202897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:35.262891 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb455f8d-486b-47a0-9c88-432b808a6f10 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/ips" status: 200 len: 143 microversion: 2.1 time: 0.093920 Oct 22 03:32:35.271216 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2971/5811] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:32:35 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/ips => generated 143 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:32:35.311945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:35.323926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:35.325784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:35.337296 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82e6aa11-ba76-4a72-9798-bd022e664c75 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.273050 Oct 22 03:32:35.340805 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2841/5812] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:35 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:36.370038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:36.370653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:36.385361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:36.386727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:36.388153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:36.390808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:36.392101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:36.392959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:36.497498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:36.515293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:36.517623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:36.519160 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-14dc344c-7ea7-4130-bba0-7ccab96ee5b6 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.153252 Oct 22 03:32:36.533032 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2972/5813] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:36 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:37.548063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:37.549196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:37.566100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:37.574172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:37.577761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:37.579034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:37.584383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:37.587579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:37.589760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:37.796311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:37.810363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:37.812953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:37.817242 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-88089872-bd06-4530-bfd7-d23eac88a82f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.274288 Oct 22 03:32:37.821146 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2842/5814] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:37 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:38.854699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:38.856048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:38.858265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:38.859376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:38.896519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:38.912104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:38.913422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:38.916997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:38.917942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:38.921251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:39.083047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:39.097701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:39.106858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:39.112507 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5abfb88f-d31a-435e-b59e-32ed934dabd2 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.264559 Oct 22 03:32:39.119526 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2973/5815] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:38 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:40.145156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:40.145777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:40.154139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:40.154805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:40.155389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:40.156275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:40.156873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:40.157967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:40.398657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3409567-6424-43fb-be66-cfee9e93f357"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:32:40.401851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:40.420449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:40.421121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:40.421673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:40.422622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:40.423212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:40.423510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:40.424011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:40.433625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:40.436139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:40.437114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ca7b5f1b-2008-4bb0-bca3-55bbe675144f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.295793 Oct 22 03:32:40.448316 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2843/5816] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:40 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:41.030772 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-80bdc308-1a0f-4ed0-803d-cad23a1743df tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.636582 Oct 22 03:32:41.032128 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2974/5817] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:32:40 2022] POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:32:41.476991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:41.478267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:41.488927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:41.489320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:41.492725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:41.493655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:41.495786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:41.497022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:41.847235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:41.874865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:41.880823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:41.892772 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-03401455-4363-48a1-924c-f4ac8be1f767 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.424621 Oct 22 03:32:41.907762 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2844/5818] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:41 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:42.921784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:42.922514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:42.944950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:42.946123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:42.947264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:42.951643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:42.953640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:42.956040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:43.190289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:43.204749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:43.208876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:43.213859 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0f55d28-9878-42e3-921e-7aeb86824210 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.296702 Oct 22 03:32:43.214468 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2975/5819] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:42 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:44.242135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:44.242753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:44.252149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:44.261337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:44.261881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:44.268134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:44.271614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:44.276301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:44.736807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:44.768923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:44.776771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:44.781572 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f93fe79-c955-48de-b9aa-0120d0353e4f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.543604 Oct 22 03:32:44.789492 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2845/5820] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:44 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:45.817693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:45.819045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:45.842255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:45.843006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:45.844457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:45.847574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:45.849661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:45.851875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:46.118107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:46.130155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:46.135988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:46.137272 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7e8167ef-1199-4707-acf5-77e0cd665667 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.325716 Oct 22 03:32:46.140194 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2976/5821] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:45 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:47.170269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:47.173136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:47.190459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:47.193373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:47.196415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:47.198756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:47.201131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:47.202235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:48.068163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:48.079032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:48.083564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:48.087346 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5b952f7c-2f59-42f9-b257-c54bcdcce8a9 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.923149 Oct 22 03:32:48.125607 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2846/5822] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:47 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:49.118299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:49.120434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:49.138985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:49.147257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:49.150003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:49.155153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:49.157204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:49.158947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:49.484470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:49.503522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:49.524021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:49.525349 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0f1efe5-4ba1-4930-bba9-8bd03c66c449 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.411511 Oct 22 03:32:49.536152 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2977/5823] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:49 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:50.562048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:50.563060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:50.585918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:50.586417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:50.586858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:50.594458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:50.597286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:50.601704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:50.857230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:50.877162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:50.888724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:50.900455 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c6764e91-a65a-407d-9937-c829bf0db01e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.339842 Oct 22 03:32:50.918410 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2847/5824] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:50 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:51.936689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:51.937443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:51.953331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:51.957097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:51.959503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:51.960813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:51.962942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:51.966463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:52.167896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:52.186674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:52.196643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:52.199592 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f33bb22c-1cfe-4c2b-9bb4-8575510383bc tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.266943 Oct 22 03:32:52.206546 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2978/5825] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:51 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:53.234819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:53.236381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:53.248198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:53.248986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:53.253456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:53.254456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:53.262610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:53.263355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:53.833434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:53.844942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:53.859053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:53.867189 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08c21ef5-a05f-4769-a4f5-7a801a31605d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.630089 Oct 22 03:32:53.870200 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2848/5826] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:53 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:54.903545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:54.904271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:54.931997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:54.934522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:54.938504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:54.939562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:54.940601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:54.943662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:55.132259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:55.142072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:55.143534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:55.144776 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-36f21ad9-c9ce-406e-bbff-b55b659b206f tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.246233 Oct 22 03:32:55.156484 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2979/5827] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:54 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:56.181274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:56.182440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:56.199030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:56.202123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:56.202613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:56.203370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:56.203996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:56.204454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:56.483795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:56.511381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:56.516115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:56.517968 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41d8c2f6-be1a-4611-8ebe-28d852e0e917 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.340686 Oct 22 03:32:56.534520 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2849/5828] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:56 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:57.554547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:57.555887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:57.569566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:57.591933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:57.592728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:57.595019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:57.597018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:57.599501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:57.603173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:57.729091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:57.883989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:57.900628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:57.909003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:57.915582 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33267c17-082e-4294-bb9f-26222ae8f35c tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.367727 Oct 22 03:32:57.929777 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2980/5829] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:57 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:32:58.947189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:32:58.947814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:32:58.962604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=33 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:58.965953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:58.967916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:58.969478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:58.970630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:32:58.972595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:32:58.974083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:32:59.046296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:32:59.189014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:59.224562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:59.227261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:32:59.228913 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47a57b9b-d4e4-4cc4-bffe-8fa7ca41de31 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.286937 Oct 22 03:32:59.254253 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2850/5830] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:32:58 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:33:00.261874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:00.262485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:00.274612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:00.275102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:00.278864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:00.280088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:00.280613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:00.281049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:00.453326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:00.469051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:00.470558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:00.471782 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc8f142e-bbda-49ee-b437-9fc10b08a31a tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1365 microversion: 2.57 time: 0.214198 Oct 22 03:33:00.494244 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2981/5831] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:00 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:33:01.504120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:01.505624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:01.521353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:01.525157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:01.526049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:01.527688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:01.528442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:01.531782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:01.874836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:01.896517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:01.903910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:01.906579 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-14b5154c-bbb6-4323-88fe-9bbaa7aee641 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1371 microversion: 2.57 time: 0.406837 Oct 22 03:33:01.907926 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2851/5832] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:01 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:33:02.449866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb2a5d4d-b9ad-4951-ae43-f1cac5604b31 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:33:02.465744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2a5d4d-b9ad-4951-ae43-f1cac5604b31 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:02.478093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2a5d4d-b9ad-4951-ae43-f1cac5604b31 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:02.478973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb2a5d4d-b9ad-4951-ae43-f1cac5604b31 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:02.542917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb2a5d4d-b9ad-4951-ae43-f1cac5604b31 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Going to try to stop instance {{(pid=120581) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:33:02.718201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb2a5d4d-b9ad-4951-ae43-f1cac5604b31 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/action" status: 202 len: 0 microversion: 2.1 time: 0.272045 Oct 22 03:33:02.722371 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2982/5833] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:33:02 2022] POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:33:02.728299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:02.728977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:02.736487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:02.736914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:02.737370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:02.738134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:02.738664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:02.739037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:02.937850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:02.940656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:02.963172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:02.964964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:02.966894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:02.967816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:02.972253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:02.972952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:03.081948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:03.101138 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65b61e32-d643-4691-b50c-23d4e180a026 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1721 microversion: 2.1 time: 0.377481 Oct 22 03:33:03.102675 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2852/5834] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:02 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:03.642476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:03.651593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:03.668550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:03.673142 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33c0d42c-baa5-4f85-a6f1-117ef59c520e tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1371 microversion: 2.57 time: 0.738257 Oct 22 03:33:03.679551 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2983/5835] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:02 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1371 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:33:04.126940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:04.127847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:04.149186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:04.152924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:04.157269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:04.170669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:04.172769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:04.174813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:04.706721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:04.709216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:04.727898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:04.729165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:04.731043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:04.732318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:04.735061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:04.736408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:04.914140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:04.931072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:04.936503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:04.940053 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4e23679e-8718-4a2a-8a1e-c373a3c8337b tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1371 microversion: 2.57 time: 0.238980 Oct 22 03:33:04.940804 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2984/5836] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:04 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:33:05.047192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:05.056110 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e3f41590-57bd-42b0-9f69-36f993df6185 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1721 microversion: 2.1 time: 0.933791 Oct 22 03:33:05.090241 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2853/5837] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:04 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1721 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:05.970624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:05.971339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:05.981390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:05.983248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:05.986258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:05.988272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:05.990538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:05.993086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:05.997856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fd398810-a2b7-43cf-af22-9a24e5c88884 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Action: 'create', calling method: .version_select at 0x7f0d1a308310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-189866235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX73xeO+bIMaT/At6mvJShwS9fHBtfhXQj0/z8W3naae3ZBt9ipo43SHSkP0ZuUfMWIuioueS7NeK5euurlSQaPyHK4Yywy9hy1uXyD7SXCWEl4IzfvP9c1Q0yRkXBFfw=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:33:06.040541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fd398810-a2b7-43cf-af22-9a24e5c88884 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Getting quotas for project 8dd0dd13b97d40f2a4558707cc18481e. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:33:06.061130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fd398810-a2b7-43cf-af22-9a24e5c88884 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Getting quotas for user 4bbbfdb649d142439a780764226f631c and project 8dd0dd13b97d40f2a4558707cc18481e. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:33:06.110905 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fd398810-a2b7-43cf-af22-9a24e5c88884 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.168071 Oct 22 03:33:06.120602 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2985/5838] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:33:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:33:06.130603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:06.131267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:06.147063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:06.148896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:06.149817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:06.151095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:06.152170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:06.153380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:06.227846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:06.245731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:06.252769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:06.257580 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fdcd8a0c-8063-4f10-8689-755be3555a90 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1356 microversion: 2.57 time: 0.290546 Oct 22 03:33:06.275437 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2854/5839] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:05 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1356 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 22 03:33:06.292977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:06.293771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:06.310555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:06.311858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:06.312502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:06.313624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:06.315870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:06.316509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:06.358057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:33:06.547440 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-24f557d2-0afd-4df7-a036-cddccf926481 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "DELETE /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 204 len: 0 microversion: 2.57 time: 0.257877 Oct 22 03:33:06.551550 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2855/5840] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Oct 22 03:33:06 2022] DELETE /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 22 03:33:06.569031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:06.571664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:06.588523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:06.589109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:06.589445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:06.592920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:06.595206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:06.598441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:06.837215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:06.857117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:06.863363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:06.864663 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5c72e4a-4e68-4552-b9b9-e352a0d76970 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1362 microversion: 2.57 time: 0.311534 Oct 22 03:33:06.868045 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2856/5841] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:06 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:33:07.044267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:07.056223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4227f23-06e8-40b1-9481-2232f850819f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1721 microversion: 2.1 time: 0.933927 Oct 22 03:33:07.060642 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2986/5842] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:06 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1721 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:07.901430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:07.903731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:07.913928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:07.917325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:07.918252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:07.919246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:07.920000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:07.920681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:08.075886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:08.089379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:08.090771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:08.091396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:08.096759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:08.099166 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9705c85-30b8-4593-a8e5-44680760514d tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1362 microversion: 2.57 time: 0.205827 Oct 22 03:33:08.103303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2857/5843] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:07 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:33:08.105348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:08.105846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:08.106294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:08.107017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:08.107483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:08.107922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:08.765964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:08.785157 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6c21a04-9b7c-4006-92a2-b6231083a578 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1721 microversion: 2.1 time: 0.694427 Oct 22 03:33:08.789524 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2987/5844] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:08 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1721 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:33:09.137521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:09.138439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:09.161788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:09.162436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:09.185510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:09.186294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:09.196056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:09.197976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:09.393030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:09.400038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:09.402475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:09.403605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lazy-loading 'fault' on Instance uuid 599acac7-b6d2-403e-9c51-31e02742adf7 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:33:09.541904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:09.588093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:09.590037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97368f4b6bb4c57beefc6b1489c39c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a3afddf52124c7eb4a1bc2698d37a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:09.593440 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-569928e3-bc6c-4130-a95e-c67ab0bbacc5 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 200 len: 1367 microversion: 2.57 time: 0.460589 Oct 22 03:33:09.598284 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2858/5845] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:09 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 1367 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 22 03:33:09.811059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:09.812415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:09.821351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:09.822343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:09.822946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:09.824861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:09.841058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:09.842710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:10.624412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:10.625881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] [instance: 599acac7-b6d2-403e-9c51-31e02742adf7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:10.643285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:10.644908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:10.652385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:10.655825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:10.656868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:10.664668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:10.728836 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] HTTP exception thrown: Instance 599acac7-b6d2-403e-9c51-31e02742adf7 could not be found. Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Request method failure captured: Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 HTTP/1.1 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2RJfsVeY_2z8B8cshMatWFaTNgf_1A-Ao_Rv7qLoMv8DrsEta4Qv2QAqefSpa0SZsurjuRs6CLLYK6tJTMyDls82osLZj2nPIhOTGkqEuFI1zBT9Gy23I7J_ltqu8MJoWbkIEqoGWanpqAwVjnHA6t3f2fxZsf7PRnfqSA4WuSfg4w Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Openstack-Nova-Api-Version: 2.57 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0a3afddf52124c7eb4a1bc2698d37a97 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerShowV257Test-2084079882 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a3afddf52124c7eb4a1bc2698d37a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a3afddf52124c7eb4a1bc2698d37a97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a3afddf52124c7eb4a1bc2698d37a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a3afddf52124c7eb4a1bc2698d37a97"}]}] Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerShowV257Test-2084079882 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0a3afddf52124c7eb4a1bc2698d37a97 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerShowV257Test-2084079882 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerShowV257Test-2084079882-project Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: b97368f4b6bb4c57beefc6b1489c39c4 Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerShowV257Test-2084079882-project Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 599acac7-b6d2-403e-9c51-31e02742adf7 could not be found. Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '599acac7-b6d2-403e-9c51-31e02742adf7'} Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599acac7-b6d2-403e-9c51-31e02742adf7 could not be found. Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599acac7-b6d2-403e-9c51-31e02742adf7 could not be found. Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:33:10.730555 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599acac7-b6d2-403e-9c51-31e02742adf7 could not be found. Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] Returning 404 to user: Instance 599acac7-b6d2-403e-9c51-31e02742adf7 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-091b82d1-dbf2-487f-a5db-587e69054186 tempest-ServerShowV257Test-2084079882 tempest-ServerShowV257Test-2084079882-project] 10.222.0.25 "GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7" status: 404 len: 111 microversion: 2.57 time: 0.112335 Oct 22 03:33:10.735629 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2859/5846] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Oct 22 03:33:10 2022] GET /compute/v2.1/servers/599acac7-b6d2-403e-9c51-31e02742adf7 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 22 03:33:11.289852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:11.310711 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8aa087f0-760e-4b27-a2b0-2988522ec957 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1721 microversion: 2.1 time: 1.503565 Oct 22 03:33:11.311317 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2988/5847] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:09 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1721 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:12.346603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:12.347374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:12.359859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:12.362892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:12.364856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:12.369195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:12.369805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:12.370494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:12.982367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:12.996423 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-88e3ccab-49aa-4642-a07b-a3a1d20e20f7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1721 microversion: 2.1 time: 0.660538 Oct 22 03:33:12.997320 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2860/5848] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:12 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1721 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:14.023526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:14.024874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:14.042460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:14.043197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:14.044163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:14.045142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:14.045760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:14.046344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:14.978708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:14.996008 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-adfb4e68-58fd-45fe-b94f-094804bf395c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1721 microversion: 2.1 time: 0.976886 Oct 22 03:33:15.001796 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2989/5849] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:14 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1721 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:16.032830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:16.035162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:16.067193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:16.069239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:16.072512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:16.074291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:16.077350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:16.079349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:16.696670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:17.201316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:17.227932 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-89e736b0-c4e6-4be3-a963-b4404f80070b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1721 microversion: 2.1 time: 1.200697 Oct 22 03:33:17.230466 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2861/5850] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:16 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1721 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:17.910938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-639def9f-061a-4aba-8051-6cfb5e874141 tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] Calling method '.version_select at 0x7f0d1a4bb3a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:18.263915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:18.265216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:18.279196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:18.281996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:18.285714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:18.288014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:18.288546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:18.290901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:19.042644 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-639def9f-061a-4aba-8051-6cfb5e874141 tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e/defaults" status: 200 len: 371 microversion: 2.1 time: 2.354244 Oct 22 03:33:19.043261 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2990/5851] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:33:16 2022] GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e/defaults => generated 371 bytes in 2356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:33:19.056878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-83bdf4c0-8f1c-4a6c-92e1-343dea4c6de1 tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] Calling method '.version_select at 0x7f0d1a05a310>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:19.381261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:19.409218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49fa6d49-05e4-41a6-876d-34b4c7c7b4ff tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1698 microversion: 2.1 time: 1.149588 Oct 22 03:33:19.412675 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2862/5852] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:18 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1698 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:19.442137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5f7897f-a356-41c9-9f99-b85b800d0f99 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:33:19.468245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5f7897f-a356-41c9-9f99-b85b800d0f99 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:19.469022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5f7897f-a356-41c9-9f99-b85b800d0f99 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:19.470888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5f7897f-a356-41c9-9f99-b85b800d0f99 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:19.578748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5f7897f-a356-41c9-9f99-b85b800d0f99 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Going to try to start instance {{(pid=120582) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 03:33:19.759306 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5f7897f-a356-41c9-9f99-b85b800d0f99 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/action" status: 202 len: 0 microversion: 2.1 time: 0.303864 Oct 22 03:33:19.764257 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2863/5853] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:33:19 2022] POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:33:19.781000 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-83bdf4c0-8f1c-4a6c-92e1-343dea4c6de1 tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e" status: 200 len: 371 microversion: 2.1 time: 0.729252 Oct 22 03:33:19.792320 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2991/5854] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:33:19 2022] GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e => generated 371 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:33:19.813409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fbf8b6be-dfac-436a-b999-4fcc357c3cee tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] Calling method '.version_select at 0x7f0d199df3a0>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:19.830330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:19.841241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:19.882222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:19.885554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:19.886777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:19.887563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:19.888045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:19.900772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:19.937855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:20.500723 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fbf8b6be-dfac-436a-b999-4fcc357c3cee tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.701254 Oct 22 03:33:20.501643 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2992/5855] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:33:19 2022] GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e/defaults => generated 371 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:33:20.519092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a03b82e-80d8-4465-8c43-d28f23553f88 tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] Calling method '.version_select at 0x7f0d1e5c7b80>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:20.884810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:20.899304 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f58edc3-4b35-4fe6-ab61-af915a781062 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1707 microversion: 2.1 time: 1.128055 Oct 22 03:33:20.899973 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2864/5856] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:19 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1707 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:21.191139 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a03b82e-80d8-4465-8c43-d28f23553f88 tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e" status: 200 len: 371 microversion: 2.1 time: 0.676113 Oct 22 03:33:21.205620 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2993/5857] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 03:33:20 2022] GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e => generated 371 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:33:21.206698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bff3f8e8-c7fb-4d5b-ab39-5d621dff9e0b tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] Calling method '.version_select at 0x7f0d191df1f0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:21.925294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:21.926637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:21.969116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:21.970616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:21.971531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:21.972571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:21.973340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:21.976348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:22.042823 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bff3f8e8-c7fb-4d5b-ab39-5d621dff9e0b tempest-QuotasTestJSON-718316400 tempest-QuotasTestJSON-718316400-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e?user_id=4900aaa5c58e48f49005d499e920d898" status: 200 len: 371 microversion: 2.1 time: 0.835662 Oct 22 03:33:22.054442 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2865/5858] 10.222.0.25 () {58 vars in 1323 bytes} [Sat Oct 22 03:33:21 2022] GET /compute/v2.1/os-quota-sets/3f9463ebffba432fa74654f50914865e?user_id=4900aaa5c58e48f49005d499e920d898 => generated 371 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:33:22.617558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:22.638359 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e4f5099-c279-48f6-a0bf-6f547fda9693 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1707 microversion: 2.1 time: 0.717775 Oct 22 03:33:22.641282 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2994/5859] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:21 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1707 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:23.673082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:23.674927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:23.691798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:23.692748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:23.694010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:23.696362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:23.697660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:23.698499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:24.599873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:24.613625 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32375ad8-d717-470c-a6ee-f57749a62d4a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1711 microversion: 2.1 time: 0.948647 Oct 22 03:33:24.631841 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2866/5860] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:23 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1711 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:31.792128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1655180208-access_point-797999041", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "9c83ad81-ba4d-4d41-83bb-0e21da32527f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-189866235", "security_groups": [{"name": "tempest-secgroup_access--1121001374"}, {"name": "tempest-secgroup_general--1807978403"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:33:31.835213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:31.844966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:32.119222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] validate_networks() for [('9c83ad81-ba4d-4d41-83bb-0e21da32527f', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:33:32.628177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:34.368611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:33:34.369646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:33:34.370447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:33:34.371027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:33:34.371602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:33:34.385462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:34.390481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:34.392916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:34.395200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:34.401998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:34.402453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:34.488221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Getting quotas for project 8dd0dd13b97d40f2a4558707cc18481e. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:33:34.508032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Getting quotas for user 4bbbfdb649d142439a780764226f631c and project 8dd0dd13b97d40f2a4558707cc18481e. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:33:34.571525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:33:34.585663 n-d-862416-2 devstack@n-api.service[120581]: WARNING nova.utils [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1655180208-access_point-797999041 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1655180208-ac Oct 22 03:33:34.586371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:33:34.898659 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28144a98-9e29-4891-b732-5129ede55ef8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 3.111701 Oct 22 03:33:34.906958 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2995/5861] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:33:31 2022] POST /compute/v2.1/servers => generated 458 bytes in 3121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:33:34.917706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:34.919071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:34.921108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=9 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:34.929096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-700a4c17-17fd-4e66-a9d8-7995c4f14b35 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:34.930442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-700a4c17-17fd-4e66-a9d8-7995c4f14b35 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:35.259612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-700a4c17-17fd-4e66-a9d8-7995c4f14b35 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:35.269571 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-700a4c17-17fd-4e66-a9d8-7995c4f14b35 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1293 microversion: 2.1 time: 0.355745 Oct 22 03:33:35.293171 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2867/5862] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:34 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1293 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:33:36.300549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:36.301347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:36.327961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:36.328863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:36.329526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:36.330587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:36.331259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:36.331903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:36.470593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:36.480568 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-75ccd83c-65ff-498a-ad80-ccd30687ad93 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1345 microversion: 2.1 time: 0.184718 Oct 22 03:33:36.484582 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2996/5863] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:36 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:37.511272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:37.511893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:37.532262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:37.532767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:37.541085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:37.541861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:37.542335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:37.542767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:37.728705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:37.749521 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-337e31e7-823a-456b-8311-4b13b6e0b135 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1351 microversion: 2.1 time: 0.242092 Oct 22 03:33:37.765095 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2868/5864] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:37 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1351 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:33:38.780966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:38.782400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:38.800685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:38.801359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:38.803035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:38.804430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:38.806421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:38.807047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:38.986564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:38.997396 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c025018-ef0b-43c5-ae81-9ebfb4d7aa90 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1351 microversion: 2.1 time: 0.219956 Oct 22 03:33:38.999454 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2997/5865] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:38 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:40.023592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:40.024200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:40.051516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:40.053972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:40.054721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:40.055877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:40.057568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:40.059038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:41.193345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:41.210431 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-31a1e905-5eba-4582-9c72-75e18823124d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 1.189231 Oct 22 03:33:41.212853 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2869/5866] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:40 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:42.242718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:42.244298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:42.258309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:42.259105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:42.259850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:42.260908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:42.262808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:42.271905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:42.275712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-72feb986-fedb-4df6-ae87-8ec700adb314 req-6713dbd1-978f-4ded-a227-598597825280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882c7917-2168-4ac8-9353-c9f7b5dc8f28", "tag": "bf5d4e61-2743-4680-ab77-a63d3e89e3f1"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:33:42.295437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-72feb986-fedb-4df6-ae87-8ec700adb314 req-6713dbd1-978f-4ded-a227-598597825280 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:42.297457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-72feb986-fedb-4df6-ae87-8ec700adb314 req-6713dbd1-978f-4ded-a227-598597825280 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:42.298313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-72feb986-fedb-4df6-ae87-8ec700adb314 req-6713dbd1-978f-4ded-a227-598597825280 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:42.350046 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-72feb986-fedb-4df6-ae87-8ec700adb314 req-6713dbd1-978f-4ded-a227-598597825280 service nova] Creating event network-changed:bf5d4e61-2743-4680-ab77-a63d3e89e3f1 for instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 on n-h2-862416-2 Oct 22 03:33:42.365993 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-72feb986-fedb-4df6-ae87-8ec700adb314 req-6713dbd1-978f-4ded-a227-598597825280 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098129 Oct 22 03:33:42.375508 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2870/5867] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:33:42.850185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:42.859982 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0aa6a93e-11ea-4fba-93cc-b222107564ff tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 0.621638 Oct 22 03:33:42.880706 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2998/5868] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:42 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:43.897887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:43.897887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:43.918505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:43.919536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:43.921036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:43.922942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:43.932742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:43.933731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:45.265505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:45.464910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:45.499546 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fcf77d05-8682-428e-9f39-c0f366a7fdf2 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 1.612998 Oct 22 03:33:45.501817 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2871/5869] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:43 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:46.531788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:46.534811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:46.541446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:46.542787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:33:46.548646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:46.549623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:46.550308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:46.551151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:46.551842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:46.553008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:47.136291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:47.152086 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e2e7440-a600-4c4f-8a6d-59786b51349f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 0.627745 Oct 22 03:33:47.164270 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 2999/5870] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:46 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:33:48.296754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:48.297970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:48.312807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:48.313579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:48.314223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:48.315119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:48.317151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:48.317875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:48.834114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:48.847826 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dae577dd-42f0-455f-b350-1ca3ed044fc6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 0.554453 Oct 22 03:33:48.848828 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2872/5871] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:48 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:49.876698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:49.877320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:49.889692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:49.890547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:49.891143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:49.892034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:49.894284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:49.894889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:50.495575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:50.523627 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8bb3caf0-02c3-4ca1-9e66-826a295c8981 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 0.650537 Oct 22 03:33:50.530909 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3000/5872] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:49 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:51.557697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:51.558330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:51.571492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:51.572911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:51.573668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:51.574742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:51.575510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:51.576119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:52.458079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:52.471486 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db15c493-023b-441e-b024-bb500aa8ef5b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 0.917569 Oct 22 03:33:52.472674 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2873/5873] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:51 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:52.888534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2d5210f5-52a6-4080-b93c-47762ab7b3f6 req-62112370-f3e5-48c2-9e2b-cb22be0b88d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882c7917-2168-4ac8-9353-c9f7b5dc8f28", "name": "network-vif-plugged", "status": "completed", "tag": "bf5d4e61-2743-4680-ab77-a63d3e89e3f1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:33:52.914500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2d5210f5-52a6-4080-b93c-47762ab7b3f6 req-62112370-f3e5-48c2-9e2b-cb22be0b88d2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:52.914990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2d5210f5-52a6-4080-b93c-47762ab7b3f6 req-62112370-f3e5-48c2-9e2b-cb22be0b88d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:52.915436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2d5210f5-52a6-4080-b93c-47762ab7b3f6 req-62112370-f3e5-48c2-9e2b-cb22be0b88d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:52.929364 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2d5210f5-52a6-4080-b93c-47762ab7b3f6 req-62112370-f3e5-48c2-9e2b-cb22be0b88d2 service nova] Creating event network-vif-plugged:bf5d4e61-2743-4680-ab77-a63d3e89e3f1 for instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 on n-h2-862416-2 Oct 22 03:33:52.942744 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2d5210f5-52a6-4080-b93c-47762ab7b3f6 req-62112370-f3e5-48c2-9e2b-cb22be0b88d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057492 Oct 22 03:33:52.957440 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3001/5874] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:33:53.500252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:53.500885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:53.510995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:53.515735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:53.516195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:53.517015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:53.517462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:53.517896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:53.968063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:53.981071 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e48bf4c8-384c-459b-9862-29518adae642 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 0.483563 Oct 22 03:33:53.988596 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2874/5875] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:53 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:55.009828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:55.010719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:55.023000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:55.023500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:55.027539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:55.028548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:55.030883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:55.032392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:56.007576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:56.035660 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c6182622-fefc-4e21-803f-5a1ef7456041 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1471 microversion: 2.1 time: 1.030984 Oct 22 03:33:56.045380 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3002/5876] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:55 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1471 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:57.070204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:57.075973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:57.087371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:57.087851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:57.098742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:57.099685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:57.100174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:57.100648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:57.641185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:57.650383 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-379c5e0f-e1c5-42bc-82ee-0a4b5181b0d8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1642 microversion: 2.1 time: 0.585350 Oct 22 03:33:57.656604 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2875/5877] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:57 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1642 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:57.680106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:57.684451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:57.685492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:57.689309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:57.720925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:57.726648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:57.727181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:57.729057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:57.731121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:57.732820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:57.733878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:57.734660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:57.735367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:57.741494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:57.741991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:57.742517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:58.019592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lazy-loading 'services' on Instance uuid 7107260e-38b5-4ece-8d42-3508a91d4e95 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:33:58.196024 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dbef43c2-23ea-4dca-8247-8b09f1ba5051 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-volume_attachments/d3409567-6424-43fb-be66-cfee9e93f357" status: 202 len: 0 microversion: 2.1 time: 0.517372 Oct 22 03:33:58.197576 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2876/5878] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:33:57 2022] DELETE /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-volume_attachments/d3409567-6424-43fb-be66-cfee9e93f357 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:33:58.561304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:33:58.581280 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-654db4f3-bd52-421a-a49d-9409b301caf7 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1642 microversion: 2.1 time: 0.905329 Oct 22 03:33:58.600536 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3003/5879] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:57 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1642 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:33:58.610927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:33:58.611843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:33:58.619108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:58.619768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:58.621096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:33:58.624096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:33:58.624812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:33:58.625436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:00.108035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18f900ab-337f-42b0-bcba-640ff693d6c7 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1793 microversion: 2.1 time: 1.499366 Oct 22 03:34:00.119341 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2877/5880] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:33:58 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1793 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:06.170844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b56ef6f4-852a-4fbc-a66b-e7dfc24adde3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:34:06.173658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:34:06.180337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b56ef6f4-852a-4fbc-a66b-e7dfc24adde3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:06.180830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b56ef6f4-852a-4fbc-a66b-e7dfc24adde3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:06.181274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b56ef6f4-852a-4fbc-a66b-e7dfc24adde3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:06.184064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=47 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:34:06.212142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b56ef6f4-852a-4fbc-a66b-e7dfc24adde3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Going to try to stop instance {{(pid=120581) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 03:34:06.282127 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b56ef6f4-852a-4fbc-a66b-e7dfc24adde3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/action" status: 202 len: 0 microversion: 2.1 time: 0.115103 Oct 22 03:34:06.284773 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3004/5881] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:34:06 2022] POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:34:06.294315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:06.295829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:06.306807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=25 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:34:06.310633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:06.311474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:06.312111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:06.314740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:06.315804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:06.316495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:06.343161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:34:06.730818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:06.747038 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84302646-8dd4-401a-b2e0-da3c3e3c2514 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1675 microversion: 2.1 time: 0.456535 Oct 22 03:34:06.748147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2878/5882] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:06 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1675 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:07.658087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-69bfe341-e17d-4538-91c5-2ab5dc7dc7c2 req-422d6343-294e-4eeb-ac33-04d4f3bcef0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882c7917-2168-4ac8-9353-c9f7b5dc8f28", "tag": "bf5d4e61-2743-4680-ab77-a63d3e89e3f1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:34:07.678211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-69bfe341-e17d-4538-91c5-2ab5dc7dc7c2 req-422d6343-294e-4eeb-ac33-04d4f3bcef0e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:07.679086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-69bfe341-e17d-4538-91c5-2ab5dc7dc7c2 req-422d6343-294e-4eeb-ac33-04d4f3bcef0e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:07.679712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-69bfe341-e17d-4538-91c5-2ab5dc7dc7c2 req-422d6343-294e-4eeb-ac33-04d4f3bcef0e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:07.742350 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-69bfe341-e17d-4538-91c5-2ab5dc7dc7c2 req-422d6343-294e-4eeb-ac33-04d4f3bcef0e service nova] Creating event network-changed:bf5d4e61-2743-4680-ab77-a63d3e89e3f1 for instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 on n-h2-862416-2 Oct 22 03:34:07.768315 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-69bfe341-e17d-4538-91c5-2ab5dc7dc7c2 req-422d6343-294e-4eeb-ac33-04d4f3bcef0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.667644 Oct 22 03:34:07.771895 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3005/5883] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:34:07.773416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:07.774042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:07.797067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:07.798878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:07.799473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:07.805101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:07.805589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:07.806033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:08.921782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:08.935507 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3f74e99f-f7bb-4c02-8d5f-56426df067da tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1675 microversion: 2.1 time: 1.166227 Oct 22 03:34:08.937101 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2879/5884] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:07 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1675 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:09.964243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:09.964952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:09.999260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:09.999846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:10.000346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:10.001075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:10.001534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:10.008192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:10.388475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:10.397935 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bbcb87e9-642b-4cb8-a15e-eaf73c0fb815 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1675 microversion: 2.1 time: 0.438067 Oct 22 03:34:10.398479 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3006/5885] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:09 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1675 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:11.425362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:11.427146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:11.437500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:11.439674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:11.440560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:11.441495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:11.442380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:11.443027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:11.959433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:11.967653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18f9bf46-324a-415d-8d37-c4a19b9296bb tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1675 microversion: 2.1 time: 0.547254 Oct 22 03:34:11.974621 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2880/5886] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:11 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1675 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:13.004472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:13.005232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:13.044933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:13.046261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:13.052324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:13.053892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:13.058354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:13.059795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:13.753002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:13.766576 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74f27b75-63aa-4402-8e27-17a4c627adea tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1675 microversion: 2.1 time: 0.767987 Oct 22 03:34:13.770451 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3007/5887] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:12 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1675 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:14.802074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:14.803070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:14.817935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:14.823651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:14.824507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:14.825462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:14.826380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:14.827405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:15.155922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:15.165838 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b82a07c-b639-4ef9-b1af-7ce8e8835812 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1675 microversion: 2.1 time: 0.370850 Oct 22 03:34:15.166399 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2881/5888] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:14 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1675 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:16.196584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:16.197610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:16.233120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:16.236420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:16.238396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:16.242204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:16.242993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:16.244575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:16.886757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:16.907159 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8dd3dedf-6133-450d-b650-659e19f9d929 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1675 microversion: 2.1 time: 0.715078 Oct 22 03:34:16.915377 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3008/5889] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:16 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1675 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:17.951158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:17.951527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:17.970643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:17.976895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:17.977361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:17.978224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:17.978860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:17.979614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:18.796115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:18.817767 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-51786fe4-8185-47db-8db9-3d85d5061e56 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1652 microversion: 2.1 time: 0.869697 Oct 22 03:34:18.844102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2882/5890] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:17 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1652 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:18.850858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9d66a746-c887-45da-9af6-f46e2c75967d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:34:18.865644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d66a746-c887-45da-9af6-f46e2c75967d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:18.868984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d66a746-c887-45da-9af6-f46e2c75967d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:18.870597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d66a746-c887-45da-9af6-f46e2c75967d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:18.901670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9d66a746-c887-45da-9af6-f46e2c75967d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Going to try to start instance {{(pid=120581) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 03:34:19.003905 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9d66a746-c887-45da-9af6-f46e2c75967d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/action" status: 202 len: 0 microversion: 2.1 time: 0.160658 Oct 22 03:34:19.005375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3009/5891] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:34:18 2022] POST /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:34:19.014882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:19.017661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:19.033176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:19.035277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:19.036057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:19.037329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:19.039080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:19.039654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:19.746309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Calling method '.version_select at 0x7f0d19ffc040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:19.747301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:19.749592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:19.751507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:19.805504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:19.806025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:19.806483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:19.838540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:19.839047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:19.839497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:19.866602 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac9b7c04-17b6-4ee2-bbfc-60d6d8ed983f tempest-PortsAdminExtendedAttrsTestJSON-999664942 tempest-PortsAdminExtendedAttrsTestJSON-999664942-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.709575 Oct 22 03:34:19.869148 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3010/5892] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 03:34:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:34:20.083587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:20.096358 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79507d7a-af51-47a7-aeed-42c17f5967ba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1661 microversion: 2.1 time: 1.087071 Oct 22 03:34:20.105020 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2883/5893] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:19 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1661 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:21.130212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:21.130212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:21.153360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:21.153856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:21.155435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:21.156448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:21.157072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:21.157733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:21.984556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:21.994550 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18e30233-194a-428c-b21f-cbba16b5437f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1661 microversion: 2.1 time: 0.870919 Oct 22 03:34:21.995686 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3011/5894] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:21 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1661 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:23.022598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:23.023607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:23.051702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:23.053078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:23.053550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:23.055356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:23.056099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:23.056715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:23.625084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:23.640172 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9ed45eb-3fab-4385-8273-ed046410b02b tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1661 microversion: 2.1 time: 0.618698 Oct 22 03:34:23.641599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2884/5895] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:23 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1661 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:24.673348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:24.673978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:24.691182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:24.691182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:24.691182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:24.693337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:24.693842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:24.694291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:25.103791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:25.115497 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd2ef081-8801-4de0-9b50-79be7063cbba tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1665 microversion: 2.1 time: 0.446502 Oct 22 03:34:25.117073 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3012/5896] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:24 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1665 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:57.439292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=13 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:34:57.441879 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 22 03:34:57.446817 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:34:57.446980 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 03:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-volume_attachments (ip 10.222.0.25) !!! Oct 22 03:34:57.451055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=41 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:34:57.476881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:57.486711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:57.514713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:57.515238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:57.517275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:57.522291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:57.524515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:57.524996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:57.653975 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-11016bf3-4dcc-4d9d-97fc-ebe5a578bea1 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.218051 Oct 22 03:34:57.658093 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2885/5897] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:34:57 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95/os-volume_attachments => generated 25 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:34:57.758740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:57.760105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:57.770956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=19 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:34:57.772195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:34:57.777312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:57.777828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:57.781537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:57.782311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:57.784877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:57.785334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:57.875593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:34:58.025204 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ddb5ac38-908d-48c4-b0fe-b2ed6580ebcc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 204 len: 0 microversion: 2.1 time: 0.271609 Oct 22 03:34:58.027153 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3013/5898] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:34:57 2022] DELETE /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:34:58.036473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:58.037804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:58.047864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:58.048740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:58.050749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:58.051987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:58.052825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:58.053476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:58.909929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:34:58.921839 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db4c26d9-d10d-4f69-b1d2-a09ada7d5824 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1671 microversion: 2.1 time: 0.889413 Oct 22 03:34:58.924473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2886/5899] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:58 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1671 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:34:59.953118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:34:59.953917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:34:59.965845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:59.967319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:59.967787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:34:59.968733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:34:59.969213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:34:59.969652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:00.461097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:00.499079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efe7884c-238a-434c-8582-6e98c7ed965e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1671 microversion: 2.1 time: 0.551592 Oct 22 03:35:00.506379 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3014/5900] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:34:59 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1671 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:01.339954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1278108997", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:01.434517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:35:01.551654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:01.552545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:01.568995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:01.570925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:01.571646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:01.573145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:01.574600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:01.576627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:02.122888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:02.137774 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c64a664c-20b0-4203-ad1e-6d46f85dd854 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1671 microversion: 2.1 time: 0.593685 Oct 22 03:35:02.139012 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3015/5901] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:01 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1671 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:02.218136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:35:02.218664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:35:02.219245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:35:02.219730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:35:02.220231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:35:02.240053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:02.241908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:02.242798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:02.244780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:02.246969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:02.247876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:02.283377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Getting quotas for project d4502179e08241769dfcb48e05be43f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:35:02.292013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Getting quotas for user 141c7b023a16433db374bb544038cc70 and project d4502179e08241769dfcb48e05be43f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:35:02.319920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:35:02.323497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:35:02.398216 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f20de8c3-7ea6-4498-bff0-c3419e9d85d2 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062822 Oct 22 03:35:02.400149 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2887/5902] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:35:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:35:02.411161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5011032d-edfb-480b-aec9-226400696379 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:02.412136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5011032d-edfb-480b-aec9-226400696379 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:02.574049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5011032d-edfb-480b-aec9-226400696379 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:02.581669 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5011032d-edfb-480b-aec9-226400696379 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1215 microversion: 2.1 time: 0.174208 Oct 22 03:35:02.587975 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3016/5903] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:02 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:03.163679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:03.164564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:03.188033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:03.188596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:03.189030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:03.204880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:03.205416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:03.208873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:03.618519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:03.619295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:03.635085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:03.636118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:03.637371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:03.638575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:03.641318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:03.642045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:03.847900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:03.860469 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a023a559-99b9-4f79-9bdf-0fa44a8f1837 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1603 microversion: 2.1 time: 0.701418 Oct 22 03:35:03.868305 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2888/5904] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:03 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1603 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:03.887198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-485d8b56-d154-4cf3-9e06-bc5bd5ba3657 req-08fd3c81-8113-4c24-9bac-2c9ebacd4b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7107260e-38b5-4ece-8d42-3508a91d4e95", "name": "network-vif-deleted", "tag": "a9dfb3e8-26e7-4219-9a85-1ccb4051a2ac"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:03.931042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-485d8b56-d154-4cf3-9e06-bc5bd5ba3657 req-08fd3c81-8113-4c24-9bac-2c9ebacd4b69 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:03.931522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-485d8b56-d154-4cf3-9e06-bc5bd5ba3657 req-08fd3c81-8113-4c24-9bac-2c9ebacd4b69 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:03.934127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-485d8b56-d154-4cf3-9e06-bc5bd5ba3657 req-08fd3c81-8113-4c24-9bac-2c9ebacd4b69 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:03.969277 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-485d8b56-d154-4cf3-9e06-bc5bd5ba3657 req-08fd3c81-8113-4c24-9bac-2c9ebacd4b69 service nova] Creating event network-vif-deleted:a9dfb3e8-26e7-4219-9a85-1ccb4051a2ac for instance 7107260e-38b5-4ece-8d42-3508a91d4e95 on n-h1-862416-2 Oct 22 03:35:03.992169 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-485d8b56-d154-4cf3-9e06-bc5bd5ba3657 req-08fd3c81-8113-4c24-9bac-2c9ebacd4b69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116637 Oct 22 03:35:03.993065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2889/5905] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:03.998910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:04.010753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50f88252-f9ec-4677-a722-dcb75e44d817 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1211 microversion: 2.1 time: 0.397532 Oct 22 03:35:04.011792 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3017/5906] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:03 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1211 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:04.933114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:04.933839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:04.951081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:04.952125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:04.952607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:04.953330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:04.953783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:04.954209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:05.008737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:05.009515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:05.010183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:05.011111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lazy-loading 'fault' on Instance uuid 7107260e-38b5-4ece-8d42-3508a91d4e95 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:35:05.046150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:05.047477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:05.087736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:05.088325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:05.088775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:05.092391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:05.092901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:05.098150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:05.113465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:05.123235 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad9928f0-6568-4f77-b5c0-90bf130c712a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 200 len: 1327 microversion: 2.1 time: 0.236310 Oct 22 03:35:05.129693 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2890/5907] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:04 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 1327 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:05.236946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:05.249425 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-baaf80f6-d471-4a87-88d9-8a521ce4048a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1273 microversion: 2.1 time: 0.210175 Oct 22 03:35:05.264234 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3018/5908] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:05 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:06.154083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:06.154477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:06.166351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:06.166851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:06.167284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:06.168000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:06.168505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:06.168910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:06.209367 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] HTTP exception thrown: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Request method failure captured: Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 HTTP/1.1 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2QIKhMS66djg1gFwHol-eFD7uxV9jlHr2Dp-UfYy5FxM_0k0Zz_OjPmoiNWTdSkwoICevNWMZdJ_1VJS5hjnDL2z31qZdAC0MtiXeoOK_sf0XBSExwRnHDH7jxT9wVXVBIa6nbmqfgRQkllgV1g5Tn00QiUgKj2ouvCthtzD_bMY4Y Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}] Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: da9a6c11ec7640efa8693fadad60259d Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '7107260e-38b5-4ece-8d42-3508a91d4e95'} Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:35:06.211223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Returning 404 to user: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:35:06.216230 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba012622-66a6-4bc1-bdbf-d7188a8c77b7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 404 len: 111 microversion: 2.1 time: 0.063316 Oct 22 03:35:06.222132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38fdb3c5-770a-4695-bf32-e86efefd9852 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '.version_select at 0x7f0d1e5c7040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:06.233353 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2891/5909] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:06 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:35:06.272844 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38fdb3c5-770a-4695-bf32-e86efefd9852 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774330581" status: 202 len: 0 microversion: 2.1 time: 0.054672 Oct 22 03:35:06.273570 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3019/5910] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:35:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774330581 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:35:06.285288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:06.286299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:06.298406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:06.299265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:06.300470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:06.303300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:06.303977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:06.307599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:06.660015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:06.670599 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d287827-5a07-4236-9252-538d4ade4536 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1273 microversion: 2.1 time: 0.389517 Oct 22 03:35:06.671560 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2892/5911] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:06 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1273 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:06.947366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2130731415", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "04b11963-996f-43ab-9302-650bb8fd9ee2"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:07.021199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] validate_networks() for [('04b11963-996f-43ab-9302-650bb8fd9ee2', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:35:07.701303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:07.701950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:07.724735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:07.725241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:07.725688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:07.726421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:07.726940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:07.727322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:08.788727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:08.799098 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-655790c3-c282-4b5e-9958-cce190569dcf tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 1.107029 Oct 22 03:35:08.803563 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2893/5912] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:07 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:08.979749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86e6cf76-87d5-4cf7-b478-c4ba7b8fd9c4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'create', calling method: .version_select at 0x7f0d1e509b80>, body: {"keypair": {"name": "tempest-keypair-1337102627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECL/iJLFMcdK9tVo/iBKXOzD0Rh8FoFjRiKB9F0MxSI6i8R3u4g8/s3oIJ/ys9yDvNT47jqvnk4WiM621lHpps4tUIVvlu7FAVzIZOq0OPSzH3xonr7fWPA27GWBK7KUg=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:08.983385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:35:08.983959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:35:08.984667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:35:08.985239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:35:08.986172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:35:09.043535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-86e6cf76-87d5-4cf7-b478-c4ba7b8fd9c4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Getting quotas for project 7aab6dcaeb1541729cb8d92b3a361c80. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:35:09.047341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:09.048226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:09.049793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:09.052522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:09.054695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:09.064933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-86e6cf76-87d5-4cf7-b478-c4ba7b8fd9c4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Getting quotas for user da9a6c11ec7640efa8693fadad60259d and project 7aab6dcaeb1541729cb8d92b3a361c80. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:35:09.065909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:09.124806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Getting quotas for project a5cdb330ac5e46b2b3652599fa511078. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:35:09.138978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Getting quotas for user 0452243860054561b2da710d4245c6eb and project a5cdb330ac5e46b2b3652599fa511078. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:35:09.149744 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86e6cf76-87d5-4cf7-b478-c4ba7b8fd9c4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174078 Oct 22 03:35:09.157046 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2894/5913] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:35:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:09.178425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:35:09.181214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:35:09.282296 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfd081e2-7011-4048-8a60-28a8a433bdc8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.332328 Oct 22 03:35:09.285844 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3020/5914] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:35:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:35:09.297888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77288f09-ee78-4a22-9940-5fa57a2a9767 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:09.298837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77288f09-ee78-4a22-9940-5fa57a2a9767 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:09.584130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77288f09-ee78-4a22-9940-5fa57a2a9767 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:09.597970 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77288f09-ee78-4a22-9940-5fa57a2a9767 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1214 microversion: 2.1 time: 0.302242 Oct 22 03:35:09.601330 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2895/5915] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:09 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:09.831722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:09.832393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:09.853917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:09.855750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:09.858258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:09.860181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:09.865388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:09.867284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:10.631962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:10.632597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:10.645810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:10.646318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:10.646795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:10.647512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:10.647951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:10.648425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:10.740046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:10.780855 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ce9449a-491f-4cb8-bea9-ba1d704ed14f tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.952538 Oct 22 03:35:10.783496 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3021/5916] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:09 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:10.802979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:10.812307 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ee9ea3a-5581-480e-b4b6-823ac52bd887 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1210 microversion: 2.1 time: 0.184996 Oct 22 03:35:10.817856 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2896/5917] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:10 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:11.809730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:11.811934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:11.842797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:11.845433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:11.846698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:11.848834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:11.849736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:11.853070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:11.856025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:11.858819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:11.859459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:11.861021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:11.865185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:11.866180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:11.866914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:11.867556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:12.218697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:12.230121 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f866aa1e-5c2d-43a1-8feb-2a1fc7351225 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1272 microversion: 2.1 time: 0.388916 Oct 22 03:35:12.232546 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2897/5918] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:11 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:12.597874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:12.606603 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d28658e5-3736-46c4-b02b-2f9d80b6b9eb tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.801485 Oct 22 03:35:12.607771 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3022/5919] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:11 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:13.262354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:13.263096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:13.265349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:13.282901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:13.283402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:13.292694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:13.293594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:13.294088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:13.296652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:13.632352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:13.634348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:13.645323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:13.645980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:13.646480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:13.647137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:13.647649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:13.649271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:13.731539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:13.753321 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b281b8ee-2228-4db5-aea6-bb5cf3655c71 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1272 microversion: 2.1 time: 0.494446 Oct 22 03:35:13.755740 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2898/5920] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:13 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1272 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:13.834172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-12ef5674-0d91-4d6e-a308-15e26cfba93e req-5494eeb0-763c-44cd-b915-45ecdd6d80f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90a778d-ae50-4295-b338-1e504fec9c05", "tag": "bc572481-5cdc-4787-99b3-51503d3c12f2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:13.854930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-12ef5674-0d91-4d6e-a308-15e26cfba93e req-5494eeb0-763c-44cd-b915-45ecdd6d80f3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:13.855638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-12ef5674-0d91-4d6e-a308-15e26cfba93e req-5494eeb0-763c-44cd-b915-45ecdd6d80f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:13.856077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-12ef5674-0d91-4d6e-a308-15e26cfba93e req-5494eeb0-763c-44cd-b915-45ecdd6d80f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:13.871879 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-12ef5674-0d91-4d6e-a308-15e26cfba93e req-5494eeb0-763c-44cd-b915-45ecdd6d80f3 service nova] Creating event network-changed:bc572481-5cdc-4787-99b3-51503d3c12f2 for instance b90a778d-ae50-4295-b338-1e504fec9c05 on n-h1-862416-2 Oct 22 03:35:13.878191 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-12ef5674-0d91-4d6e-a308-15e26cfba93e req-5494eeb0-763c-44cd-b915-45ecdd6d80f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048418 Oct 22 03:35:13.878799 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2899/5921] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:35:14.005819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:14.014612 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b21462c3-2c03-40b5-8414-7b936f976107 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.387480 Oct 22 03:35:14.015733 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3023/5922] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:13 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:14.782272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:14.783025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:14.790940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:14.791417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:14.792255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:14.792961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:14.793462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:14.793894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:15.041252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:15.042475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:15.052014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:15.052759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:15.053415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:15.054684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:15.055357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:15.056019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:15.115289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:15.129237 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59dc4c34-0ca9-4583-9123-f56f8a143fd8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1272 microversion: 2.1 time: 0.353369 Oct 22 03:35:15.169144 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2900/5923] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:14 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1272 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:15.419650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:15.429536 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-77ffc34e-fab4-408c-99f4-650d2eb8381c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.394734 Oct 22 03:35:15.449673 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3024/5924] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:15 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:16.158697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:16.161197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:16.171899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:16.172781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:16.174874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:16.175872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:16.176757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:16.177656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:16.458145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:16.459563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:16.485343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:16.486111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:16.486569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:16.487353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:16.487812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:16.488270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:17.053351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:17.064607 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0c38bf7-e2d4-4715-b14d-05e5e3b7e567 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.610012 Oct 22 03:35:17.076325 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3025/5925] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:16 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:17.242674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:17.259241 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f016a7a7-fdc2-4e4c-bcf2-593575557991 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1314 microversion: 2.1 time: 1.105197 Oct 22 03:35:17.260548 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2901/5926] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:16 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1314 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:18.099457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:18.101683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:18.113853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:18.114684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:18.115672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:18.116814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:18.117430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:18.118226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:18.288048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:18.288710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:18.296292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:18.297089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:18.297695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:18.298572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:18.299774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:18.300611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:18.806691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:18.814701 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d27c8686-405e-474e-8566-66b88fbe0188 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.724146 Oct 22 03:35:18.832418 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3026/5927] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:18 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:19.028787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:19.037114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-06f4a209-b1ee-4dd7-b4f4-9288f83b36c9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1314 microversion: 2.1 time: 0.757917 Oct 22 03:35:19.038887 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2902/5928] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:18 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:19.437569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1819271124", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3ad5752-73fe-401e-9777-95f0106cdaa8"}], "security_groups": [{"name": "tempest-securitygroup--1227012847"}], "key_name": "tempest-keypair-1337102627", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:19.465217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:19.474165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:19.693590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f50d7a05-9bac-4d45-a1de-d9d2f8983046 req-c0d8b919-14ea-414a-a6ac-b14bae6cdbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264533ef-bebe-4fd6-89e4-adfde5bdba93", "tag": "67c381b8-2fa5-4df8-bc5a-d58761712db8"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:19.720150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:19.728768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f50d7a05-9bac-4d45-a1de-d9d2f8983046 req-c0d8b919-14ea-414a-a6ac-b14bae6cdbe1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:19.734102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f50d7a05-9bac-4d45-a1de-d9d2f8983046 req-c0d8b919-14ea-414a-a6ac-b14bae6cdbe1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:19.738161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f50d7a05-9bac-4d45-a1de-d9d2f8983046 req-c0d8b919-14ea-414a-a6ac-b14bae6cdbe1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:19.775994 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f50d7a05-9bac-4d45-a1de-d9d2f8983046 req-c0d8b919-14ea-414a-a6ac-b14bae6cdbe1 service nova] Creating event network-changed:67c381b8-2fa5-4df8-bc5a-d58761712db8 for instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 on n-h2-862416-2 Oct 22 03:35:19.788976 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f50d7a05-9bac-4d45-a1de-d9d2f8983046 req-c0d8b919-14ea-414a-a6ac-b14bae6cdbe1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100272 Oct 22 03:35:19.790499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2903/5929] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:19.840034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:19.841084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:19.856574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:19.857543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:19.858176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:19.859843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:19.860534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:19.862841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:20.737894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] validate_networks() for [('a3ad5752-73fe-401e-9777-95f0106cdaa8', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:35:21.154227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:21.169820 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0aed5d1c-dd35-48ad-9499-13fa0377e70a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 1.334278 Oct 22 03:35:21.188146 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2904/5930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:19 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:21.194641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:21.195320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:21.207157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:21.207842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:21.215206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:21.215997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:21.216504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:21.220297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:22.140762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:22.159166 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-203bddc8-e362-4269-b2fd-98740c1c53c6 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1314 microversion: 2.1 time: 0.982442 Oct 22 03:35:22.159967 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2905/5931] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:21 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:22.197009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:22.197884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:22.207958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:22.208644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:22.209235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:22.210292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:22.211199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:22.211782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:22.260162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:22.672046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:22.693504 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d4cba192-d6ee-4aa4-a1af-63d53dc3eaf3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.500962 Oct 22 03:35:22.698396 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2906/5932] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:22 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:23.168937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4505b148-7716-46df-8af0-0f6c0f081688 req-17850beb-ecdf-421e-943e-76bba1cabff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90a778d-ae50-4295-b338-1e504fec9c05", "name": "network-vif-plugged", "status": "completed", "tag": "bc572481-5cdc-4787-99b3-51503d3c12f2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:23.222645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4505b148-7716-46df-8af0-0f6c0f081688 req-17850beb-ecdf-421e-943e-76bba1cabff6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:23.223132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4505b148-7716-46df-8af0-0f6c0f081688 req-17850beb-ecdf-421e-943e-76bba1cabff6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:23.227814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4505b148-7716-46df-8af0-0f6c0f081688 req-17850beb-ecdf-421e-943e-76bba1cabff6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:23.333563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:35:23.334029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:35:23.334322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:35:23.334738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:35:23.335153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:35:23.353211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:23.353713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:23.354157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:23.354896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:23.355359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:23.355792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:23.421513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Getting quotas for project 7aab6dcaeb1541729cb8d92b3a361c80. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:35:23.444771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Getting quotas for user da9a6c11ec7640efa8693fadad60259d and project 7aab6dcaeb1541729cb8d92b3a361c80. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:35:23.561251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:35:23.564859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:35:23.827519 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-53328d2b-c7fc-4f08-80c8-1ca69702cd6c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.398982 Oct 22 03:35:23.845243 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3027/5933] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:35:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 4417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:35:23.867542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:23.869008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:23.886283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:23.887182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:23.887920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:23.889542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:23.891238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:23.896743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:24.026071 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4505b148-7716-46df-8af0-0f6c0f081688 req-17850beb-ecdf-421e-943e-76bba1cabff6 service nova] Creating event network-vif-plugged:bc572481-5cdc-4787-99b3-51503d3c12f2 for instance b90a778d-ae50-4295-b338-1e504fec9c05 on n-h1-862416-2 Oct 22 03:35:24.035717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4505b148-7716-46df-8af0-0f6c0f081688 req-17850beb-ecdf-421e-943e-76bba1cabff6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.873560 Oct 22 03:35:24.036926 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2907/5934] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:35:24.060969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:24.061982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:24.071275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:24.072118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:24.072838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:24.074272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:24.074938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:24.075635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:24.510127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:24.521427 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-12b6f95e-5022-4fc5-bcd5-1007cca0b2f3 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.482892 Oct 22 03:35:24.527312 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2908/5935] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:24 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:24.541104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6c029f9-3a9b-4c09-a9c0-0742dbf0e5d6 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:24.541903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6c029f9-3a9b-4c09-a9c0-0742dbf0e5d6 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:24.713388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6c029f9-3a9b-4c09-a9c0-0742dbf0e5d6 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:24.721921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6c029f9-3a9b-4c09-a9c0-0742dbf0e5d6 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1238 microversion: 2.1 time: 0.192482 Oct 22 03:35:24.723407 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2909/5936] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:24 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1238 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:25.147539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:25.166283 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c00804a0-be81-4e99-836b-604437e233b7 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1314 microversion: 2.1 time: 1.315022 Oct 22 03:35:25.168156 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3028/5937] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:23 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1314 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:25.552507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:25.553160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:25.589027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:25.589558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:25.590013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:25.590760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:25.591225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:25.596893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:25.747796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:25.748451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:25.758965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:25.762730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:25.763512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:25.766525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:25.769137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:25.769753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:26.297186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:26.310651 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7a552b0d-2b55-436d-94ae-ef6ab940de48 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1315 microversion: 2.1 time: 0.763627 Oct 22 03:35:26.321995 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2910/5938] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:25 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:26.334629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:26.335509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:26.344908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:26.346689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:26.348966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:26.350038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:26.351201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:26.352084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:26.590243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:26.616092 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-37faaa85-b837-4be1-8a70-5ce7ef37d499 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1290 microversion: 2.1 time: 0.872918 Oct 22 03:35:26.617449 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3029/5939] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:25 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1290 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:26.823482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:26.842805 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e7cd74a8-f1bc-410c-ba14-ba6e1e1b52a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1314 microversion: 2.1 time: 0.519372 Oct 22 03:35:26.843861 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2911/5940] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:26 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:27.338506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:27.342294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:27.369484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:27.370328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:27.371040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:27.372110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:27.375225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:27.375875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:27.642922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:27.643937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:27.655693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:27.672398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:27.673113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:27.675757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:27.676995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:27.681042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:27.683050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:27.853714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:27.870000 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d9ca6270-6329-4ffe-bd7e-6475e26e2d4d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1296 microversion: 2.1 time: 0.232920 Oct 22 03:35:27.887687 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2912/5941] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:27 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1296 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:27.897006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:27.897963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:27.905098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:27.905810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:27.907102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:27.907992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:27.908881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:27.909616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:27.939401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:27.942820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:27.957097 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6274283f-1f14-47ac-8ccc-990f3508784c tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1464 microversion: 2.1 time: 0.623537 Oct 22 03:35:27.958423 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3030/5942] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:27 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1464 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:28.028559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:28.029287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:28.040050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:28.042551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:28.044184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:28.044905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:28.045800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:28.046656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:28.047251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:28.102604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:35:28.293107 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e4cf12c6-8023-41a6-99d8-6cb0be7efb7a tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 204 len: 0 microversion: 2.1 time: 0.267873 Oct 22 03:35:28.294081 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3031/5943] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:35:28 2022] DELETE /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:35:28.314405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:28.316034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:28.334445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:28.334956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:28.336195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:28.337199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:28.338001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:28.339687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:28.749122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:28.761355 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91f8657b-039b-4fa6-b80f-0dc2542c8e4d tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1470 microversion: 2.1 time: 0.454115 Oct 22 03:35:28.761951 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3032/5944] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:28 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1470 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:28.763035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:28.784665 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a382603-8f05-43f1-a7ac-57cf23caa7c2 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1314 microversion: 2.1 time: 0.893997 Oct 22 03:35:28.798786 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2913/5945] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:27 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:28.897133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:28.898765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:28.916604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:28.916923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:28.917521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:28.918491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:28.920330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:28.922424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:29.036191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d1ef012a-be15-42e2-97a8-feba8f38cbbd req-155e6b98-72a4-42ba-9aa3-bc5c8b8f80d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264533ef-bebe-4fd6-89e4-adfde5bdba93", "name": "network-vif-plugged", "status": "completed", "tag": "67c381b8-2fa5-4df8-bc5a-d58761712db8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:29.050260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1ef012a-be15-42e2-97a8-feba8f38cbbd req-155e6b98-72a4-42ba-9aa3-bc5c8b8f80d0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:29.051060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1ef012a-be15-42e2-97a8-feba8f38cbbd req-155e6b98-72a4-42ba-9aa3-bc5c8b8f80d0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:29.051656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1ef012a-be15-42e2-97a8-feba8f38cbbd req-155e6b98-72a4-42ba-9aa3-bc5c8b8f80d0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:29.065716 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d1ef012a-be15-42e2-97a8-feba8f38cbbd req-155e6b98-72a4-42ba-9aa3-bc5c8b8f80d0 service nova] Creating event network-vif-plugged:67c381b8-2fa5-4df8-bc5a-d58761712db8 for instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 on n-h2-862416-2 Oct 22 03:35:29.074573 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d1ef012a-be15-42e2-97a8-feba8f38cbbd req-155e6b98-72a4-42ba-9aa3-bc5c8b8f80d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309075 Oct 22 03:35:29.075921 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3033/5946] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:29.121320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:29.144784 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47e85491-70fc-4676-a587-0fa47ae5dfd0 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1296 microversion: 2.1 time: 0.253008 Oct 22 03:35:29.149245 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2914/5947] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:28 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1296 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:29.792270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:29.792995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:29.804332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:29.805088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:29.805692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:29.808490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:29.809213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:29.809853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:29.812773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:29.813342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:29.830857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:29.831359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:29.831802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:29.832567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:29.833030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:29.833466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:30.485958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:30.497572 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90534d0f-9433-4162-9eb9-d3eb9a6d9d1c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1314 microversion: 2.1 time: 0.688704 Oct 22 03:35:30.518443 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2915/5948] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:29 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:30.524332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:30.525405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:30.532637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:30.533601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:30.534527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:30.536400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:30.537101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:30.537751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:30.565053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:30.579371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08a31aec-d05f-4f5e-8604-4d7dd16d4bf1 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1470 microversion: 2.1 time: 0.791332 Oct 22 03:35:30.597154 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3034/5949] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:29 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1470 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:31.112490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:31.126127 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38d9abc7-b3fe-4c1f-83a6-9a2508cef1a5 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1364 microversion: 2.1 time: 0.605324 Oct 22 03:35:31.128303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2916/5950] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:30 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1364 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:31.528662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:31.530104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:31.543630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:31.544427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:31.545017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:31.545975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:31.547024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:31.547634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:31.605127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:31.606048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:31.615380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:31.616119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:31.616918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:31.627572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:31.628323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:31.630706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:32.112934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:32.152687 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cca9d0d6-29f8-4d56-99a0-d9746c01067b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1498 microversion: 2.1 time: 0.630180 Oct 22 03:35:32.154083 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3035/5951] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:31 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1498 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:32.161461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:32.163202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:32.171962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:32.173314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:32.174313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:32.175938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:32.179363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:32.180064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:32.225787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141c7b023a16433db374bb544038cc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4502179e08241769dfcb48e05be43f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:32.235283 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-87ae1be9-20b7-4b0c-bdee-13ca926e2ba8 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 200 len: 1470 microversion: 2.1 time: 0.634002 Oct 22 03:35:32.241001 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2917/5952] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:31 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 1470 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:32.481449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e19c28a9-9afd-46c0-a55c-3ef90fff2684 req-8bc258d9-4a52-48c9-b696-ce7391035451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90a778d-ae50-4295-b338-1e504fec9c05", "name": "network-vif-deleted", "tag": "bc572481-5cdc-4787-99b3-51503d3c12f2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:32.509244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e19c28a9-9afd-46c0-a55c-3ef90fff2684 req-8bc258d9-4a52-48c9-b696-ce7391035451 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:32.509743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e19c28a9-9afd-46c0-a55c-3ef90fff2684 req-8bc258d9-4a52-48c9-b696-ce7391035451 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:32.510251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e19c28a9-9afd-46c0-a55c-3ef90fff2684 req-8bc258d9-4a52-48c9-b696-ce7391035451 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:32.528532 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e19c28a9-9afd-46c0-a55c-3ef90fff2684 req-8bc258d9-4a52-48c9-b696-ce7391035451 service nova] Creating event network-vif-deleted:bc572481-5cdc-4787-99b3-51503d3c12f2 for instance b90a778d-ae50-4295-b338-1e504fec9c05 on n-h1-862416-2 Oct 22 03:35:32.538848 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e19c28a9-9afd-46c0-a55c-3ef90fff2684 req-8bc258d9-4a52-48c9-b696-ce7391035451 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060945 Oct 22 03:35:32.540495 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2918/5953] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:35:32.884116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:32.884969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:32.895034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:32.896027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:32.896708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:32.898321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:32.898969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:32.899401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:32.936558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:35:33.063796 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9ad659e5-c0e5-448b-8c15-55c8e35b74aa tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "DELETE /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 204 len: 0 microversion: 2.1 time: 0.193508 Oct 22 03:35:33.066029 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2919/5954] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:35:32 2022] DELETE /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:35:33.079470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:33.080527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:33.087928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:33.089125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:33.090009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:33.090981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:33.091674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:33.092348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:33.398397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:33.488085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:33.576386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:33.580339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:33.598164 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2f65d83-046e-4e7f-a066-6df9f7db989c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1364 microversion: 2.1 time: 1.442739 Oct 22 03:35:33.600370 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86e7787a-691a-42e1-9c33-1db2a069e13d tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1504 microversion: 2.1 time: 0.525054 Oct 22 03:35:33.602366 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3036/5956] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:32 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1364 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:33.613008 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2920/5956] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:33 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:33.633035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:33.633679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] [instance: b90a778d-ae50-4295-b338-1e504fec9c05] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:33.650145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:33.650988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:33.652747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:33.654456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:33.672689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:33.674092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:33.708606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] HTTP exception thrown: Instance b90a778d-ae50-4295-b338-1e504fec9c05 could not be found. Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Request method failure captured: Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 HTTP/1.1 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2ThPqTvopi6FT9UwpvbXiZ5FQO3CBZIqgYHy2J40LKMFW4TfzNypEg-F5M69zLMfxmaRoAYuV1LMl7V5h11aXtAUWbTfVu3tzDbaa_hpR0GcPZQWGS6zkDlNoFrdSsaO0JFj34TFiEP-msrc7UMnfncbiuBjPVHSyqL5mxre_FdCBM Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: d4502179e08241769dfcb48e05be43f1 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesNegativeTest-602831238 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d4502179e08241769dfcb48e05be43f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4502179e08241769dfcb48e05be43f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d4502179e08241769dfcb48e05be43f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d4502179e08241769dfcb48e05be43f1"}]}] Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesNegativeTest-602831238 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: d4502179e08241769dfcb48e05be43f1 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesNegativeTest-602831238 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesNegativeTest-602831238-project Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 141c7b023a16433db374bb544038cc70 Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesNegativeTest-602831238-project Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance b90a778d-ae50-4295-b338-1e504fec9c05 could not be found. Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'b90a778d-ae50-4295-b338-1e504fec9c05'} Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90a778d-ae50-4295-b338-1e504fec9c05 could not be found. Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90a778d-ae50-4295-b338-1e504fec9c05 could not be found. Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:35:33.714470 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:35:33.719062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:33.719062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:35:33.719062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:35:33.719062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:35:33.719062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:35:33.719062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90a778d-ae50-4295-b338-1e504fec9c05 could not be found. Oct 22 03:35:33.719062 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:35:33.723570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] Returning 404 to user: Instance b90a778d-ae50-4295-b338-1e504fec9c05 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:35:33.724854 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a4a1ad3-e765-4632-8f21-f5aeb44ca3d9 tempest-VolumesNegativeTest-602831238 tempest-VolumesNegativeTest-602831238-project] 10.222.0.25 "GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05" status: 404 len: 111 microversion: 2.1 time: 0.110880 Oct 22 03:35:33.725623 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3037/5957] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:33 2022] GET /compute/v2.1/servers/b90a778d-ae50-4295-b338-1e504fec9c05 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:35:34.596879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8fdc348a-97d7-4a5b-bbbc-f681db5393b5 req-6f641339-9101-46ce-837d-2e73afcfeaab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade47413-492f-4c40-ab26-695bc9f3728b", "tag": "b2f870c4-98c4-45d2-93ae-3774ed0f3370"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:34.636343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:34.638577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:34.646530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8fdc348a-97d7-4a5b-bbbc-f681db5393b5 req-6f641339-9101-46ce-837d-2e73afcfeaab service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:34.646935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8fdc348a-97d7-4a5b-bbbc-f681db5393b5 req-6f641339-9101-46ce-837d-2e73afcfeaab service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:34.660582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8fdc348a-97d7-4a5b-bbbc-f681db5393b5 req-6f641339-9101-46ce-837d-2e73afcfeaab service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:34.677568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:34.682229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:34.683911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:34.690394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:34.694833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:34.695325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:34.716794 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8fdc348a-97d7-4a5b-bbbc-f681db5393b5 req-6f641339-9101-46ce-837d-2e73afcfeaab service nova] Creating event network-changed:b2f870c4-98c4-45d2-93ae-3774ed0f3370 for instance ade47413-492f-4c40-ab26-695bc9f3728b on n-h1-862416-2 Oct 22 03:35:34.751727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:34.762781 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8fdc348a-97d7-4a5b-bbbc-f681db5393b5 req-6f641339-9101-46ce-837d-2e73afcfeaab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178900 Oct 22 03:35:34.763863 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2921/5958] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:34.786131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:34.787163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:34.804749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:34.805701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:34.806381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:34.812993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:34.815963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:34.817063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:35.386031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:35.394473 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb4778e2-6650-4eec-a462-c10388d05c80 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1364 microversion: 2.1 time: 0.622526 Oct 22 03:35:35.395385 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2922/5959] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:34 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1364 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:35.399981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-681478029", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "874fa192-9f4c-48ec-a8c6-3d187104003f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-189866235", "security_groups": []}, "os:scheduler_hints": {"different_host": ["882c7917-2168-4ac8-9353-c9f7b5dc8f28"]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:35.520950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] validate_networks() for [('874fa192-9f4c-48ec-a8c6-3d187104003f', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:35:36.028064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:36.044746 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a5a4d488-586e-4103-883d-84a89863939b tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1504 microversion: 2.1 time: 1.412524 Oct 22 03:35:36.045667 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3038/5960] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:34 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1504 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:36.422423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:36.426899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:36.443668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:36.446592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:36.448603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:36.450163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:36.453826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:36.454510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:36.991956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:37.010857 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-527a6c22-0e62-4ebd-a334-f2f2f564533c tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1364 microversion: 2.1 time: 0.592109 Oct 22 03:35:37.012101 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3039/5961] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:36 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1364 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:37.076141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:37.076928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:37.085489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:37.087838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:37.088314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:37.090618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:37.091113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:37.091544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:37.329058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:37.348003 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a9e82a5-de92-4891-8174-5fed276cf7d3 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 200 len: 1462 microversion: 2.1 time: 0.275600 Oct 22 03:35:37.359174 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3040/5962] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:37 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 1462 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:38.057687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-66410879-60fe-4474-a0f0-2ecaa026d432 req-0a713c6a-1ff9-4d60-a0d0-3aa8b0c75784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264533ef-bebe-4fd6-89e4-adfde5bdba93", "name": "network-vif-deleted", "tag": "67c381b8-2fa5-4df8-bc5a-d58761712db8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:38.084570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-66410879-60fe-4474-a0f0-2ecaa026d432 req-0a713c6a-1ff9-4d60-a0d0-3aa8b0c75784 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:38.088787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-66410879-60fe-4474-a0f0-2ecaa026d432 req-0a713c6a-1ff9-4d60-a0d0-3aa8b0c75784 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:38.090915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-66410879-60fe-4474-a0f0-2ecaa026d432 req-0a713c6a-1ff9-4d60-a0d0-3aa8b0c75784 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:38.113201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-66410879-60fe-4474-a0f0-2ecaa026d432 req-0a713c6a-1ff9-4d60-a0d0-3aa8b0c75784 service nova] Creating event network-vif-deleted:67c381b8-2fa5-4df8-bc5a-d58761712db8 for instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 on n-h2-862416-2 Oct 22 03:35:38.118783 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-66410879-60fe-4474-a0f0-2ecaa026d432 req-0a713c6a-1ff9-4d60-a0d0-3aa8b0c75784 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294127 Oct 22 03:35:38.120084 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3041/5963] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:35:38.127582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:38.128623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:38.137665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:38.138234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:38.138781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:38.139738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:38.140348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:38.141248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:38.517388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:35:38.519019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:35:38.519687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:35:38.520344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:35:38.521573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:35:38.538128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:38.539482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:38.540303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:38.541652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:38.542653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:38.544676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:38.575142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Getting quotas for project 8dd0dd13b97d40f2a4558707cc18481e. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:35:38.581917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Getting quotas for user 4bbbfdb649d142439a780764226f631c and project 8dd0dd13b97d40f2a4558707cc18481e. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:35:38.634828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:35:38.641871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:35:38.762333 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ca15b11-155e-4a69-a622-c8634834877b tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.365594 Oct 22 03:35:38.764019 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2923/5964] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:35:35 2022] POST /compute/v2.1/servers => generated 361 bytes in 3368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:35:38.770415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:38.771680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 264533ef-bebe-4fd6-89e4-adfde5bdba93] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:38.779950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:38.780803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:38.781653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:38.782708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:38.784067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:38.784918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:38.805875 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] HTTP exception thrown: Instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 could not be found. Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Request method failure captured: Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 HTTP/1.1 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2TndIiCa5LmOkM2l3kHWvJxUc4JxWx9qrP49yP9V31lx6XmOPRSzO3ujagxjE3dKPLuBgkB9iyZfje0RWcKvK6gLdgrDC1ZstR95_X7EPXG5QlW6JLG7UoiIDEVTAq_x46mJmKYV3ZmGZQ4gBsz-Lp8xcPZwBCyUHyA9Zs1gQZGuMI Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a5cdb330ac5e46b2b3652599fa511078 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesActionsTest-1537172769 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cdb330ac5e46b2b3652599fa511078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cdb330ac5e46b2b3652599fa511078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cdb330ac5e46b2b3652599fa511078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cdb330ac5e46b2b3652599fa511078"}]}] Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesActionsTest-1537172769 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a5cdb330ac5e46b2b3652599fa511078 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesActionsTest-1537172769 Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesActionsTest-1537172769-project Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 0452243860054561b2da710d4245c6eb Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesActionsTest-1537172769-project Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 could not be found. Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '264533ef-bebe-4fd6-89e4-adfde5bdba93'} Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 could not be found. Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 could not be found. Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:35:38.810761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:38.815358 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:35:38.815358 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:35:38.815358 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:35:38.815358 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:35:38.815358 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:35:38.815358 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 could not be found. Oct 22 03:35:38.815358 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:35:38.818601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Returning 404 to user: Instance 264533ef-bebe-4fd6-89e4-adfde5bdba93 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:35:38.820152 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9e1eac1-3061-4ad8-b43c-ca38d8ffa0a5 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93" status: 404 len: 111 microversion: 2.1 time: 0.054429 Oct 22 03:35:38.821469 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2924/5965] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:38 2022] GET /compute/v2.1/servers/264533ef-bebe-4fd6-89e4-adfde5bdba93 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:35:38.826592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a675b384-d386-46e9-9579-f0fb843ea666 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:38.828041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a675b384-d386-46e9-9579-f0fb843ea666 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:39.072635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a675b384-d386-46e9-9579-f0fb843ea666 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:39.081989 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a675b384-d386-46e9-9579-f0fb843ea666 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1240 microversion: 2.1 time: 0.259219 Oct 22 03:35:39.086094 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2925/5966] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:38 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1240 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:39.101344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-73341694", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "04b11963-996f-43ab-9302-650bb8fd9ee2"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:39.234802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] validate_networks() for [('04b11963-996f-43ab-9302-650bb8fd9ee2', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:35:39.588596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:39.607652 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-526ed828-af57-4af8-ab8d-91fdbd03bd95 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1364 microversion: 2.1 time: 1.486106 Oct 22 03:35:39.608926 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3042/5967] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:38 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1364 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:40.115674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:40.126523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:40.151774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:40.152902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:40.157756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:40.158832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:40.160707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:40.161741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:40.338193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:35:40.339210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:35:40.339881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:35:40.340666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:35:40.341312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:35:40.363771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:40.364604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:40.365278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:40.366224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:40.367045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:40.368457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:40.390260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Getting quotas for project a5cdb330ac5e46b2b3652599fa511078. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:35:40.394335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:40.399181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Getting quotas for user 0452243860054561b2da710d4245c6eb and project a5cdb330ac5e46b2b3652599fa511078. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:35:40.406529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1824e56b-84c1-425f-b1c7-1928cec8e0f9 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1292 microversion: 2.1 time: 0.294765 Oct 22 03:35:40.423355 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3043/5968] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:40 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1292 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:40.433047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:35:40.435734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:35:40.516634 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43b35285-21b1-44bb-b4fe-01e8d5d32fc9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.428054 Oct 22 03:35:40.523706 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2926/5969] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:35:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:35:40.547049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20253a76-17ed-4d81-9c41-28ebf39030ee tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:40.548453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20253a76-17ed-4d81-9c41-28ebf39030ee tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:40.637235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:40.639763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:40.653093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:40.653867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:40.654531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:40.655924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:40.656743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:40.657520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:40.697752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:40.963950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-20253a76-17ed-4d81-9c41-28ebf39030ee tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:40.985440 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20253a76-17ed-4d81-9c41-28ebf39030ee tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1212 microversion: 2.1 time: 0.446611 Oct 22 03:35:40.989423 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3044/5970] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:40 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1212 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:41.133000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:41.145352 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d9becd5a-8d1c-4de7-875d-63d7fb6fe84f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1364 microversion: 2.1 time: 0.512091 Oct 22 03:35:41.148727 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2927/5971] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:40 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1364 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:41.463766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:41.464803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:41.479621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:41.481836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:41.483794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:41.484889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:41.486135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:41.492884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:41.725585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:41.747387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce20c731-c129-49a5-b5d6-3d875331c4bc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.318239 Oct 22 03:35:41.760648 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3045/5972] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:41 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:42.017209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:42.018544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:42.031744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:42.032705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:42.035147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:42.036288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:42.040067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:42.042765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:42.179718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:42.185506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:42.194520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:42.195373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:42.196449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:42.197763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:42.199532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:42.200600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:42.890761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:42.906922 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-88839528-7c6d-48e2-b612-1beff0832430 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1264 microversion: 2.1 time: 0.894275 Oct 22 03:35:42.908367 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2928/5973] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:42 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1264 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:42.917464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-ad6c4db0-0343-4a47-bfe2-a49161122a6b req-704d6e59-ad09-4466-abf6-40c7d00a595b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade47413-492f-4c40-ab26-695bc9f3728b", "name": "network-vif-plugged", "status": "completed", "tag": "b2f870c4-98c4-45d2-93ae-3774ed0f3370"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:42.942937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ad6c4db0-0343-4a47-bfe2-a49161122a6b req-704d6e59-ad09-4466-abf6-40c7d00a595b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:42.943759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ad6c4db0-0343-4a47-bfe2-a49161122a6b req-704d6e59-ad09-4466-abf6-40c7d00a595b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:42.944843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ad6c4db0-0343-4a47-bfe2-a49161122a6b req-704d6e59-ad09-4466-abf6-40c7d00a595b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:42.972764 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-ad6c4db0-0343-4a47-bfe2-a49161122a6b req-704d6e59-ad09-4466-abf6-40c7d00a595b service nova] Creating event network-vif-plugged:b2f870c4-98c4-45d2-93ae-3774ed0f3370 for instance ade47413-492f-4c40-ab26-695bc9f3728b on n-h1-862416-2 Oct 22 03:35:42.979574 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-ad6c4db0-0343-4a47-bfe2-a49161122a6b req-704d6e59-ad09-4466-abf6-40c7d00a595b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069399 Oct 22 03:35:42.988872 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2929/5974] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:42.992131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:42.995905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:42.996765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:43.013095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:43.013902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:43.015386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:43.016307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:43.020645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:43.022774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:43.026037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-167647cf-a28a-4981-b7de-9ea9fd7a4167 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1364 microversion: 2.1 time: 0.854144 Oct 22 03:35:43.027373 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3046/5975] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:42 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1364 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:43.280184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:43.297264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43adf4ed-8f2a-4e0c-8283-69bc8fe51586 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.304749 Oct 22 03:35:43.299142 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2930/5976] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:42 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:43.932821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:43.933592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:43.947022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:43.947527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:43.954180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:43.955228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:43.955903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:43.956587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:44.054894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:44.055714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:44.073377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:44.073907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:44.074443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:44.075192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:44.075650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:44.076159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:44.628697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:44.637799 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b25653cf-0658-49aa-8779-c18c00bc7ab9 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1270 microversion: 2.1 time: 0.710598 Oct 22 03:35:44.642033 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3047/5977] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:43 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1270 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:44.651981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:44.652637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:44.680694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:44.681265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:44.681900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:44.682825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:44.683451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:44.684066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:44.775800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:44.788942 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f71773bd-0380-488d-b334-72d21eb999b3 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1364 microversion: 2.1 time: 0.739065 Oct 22 03:35:44.789527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2931/5978] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:44 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1364 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:44.821637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:44.836689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:44.848142 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0930b909-e6e4-471d-844d-4566f7314ea5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.197517 Oct 22 03:35:44.851093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3048/5979] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:44 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:45.668967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:45.670510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:45.690019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:45.691066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:45.691704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:45.692488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:45.693136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:45.693728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:45.816935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:45.818116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:45.835280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:45.836515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:45.836823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:45.837958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:45.838638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:45.839232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:45.871075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:45.899487 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-85d716ed-2bc3-4ca0-96cc-adb055ae06a0 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1270 microversion: 2.1 time: 0.231622 Oct 22 03:35:45.900921 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2932/5980] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:45 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:45.947206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:45.949603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:45.969439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:45.974443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:45.976429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:45.982992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:45.983656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:45.984440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:46.424394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:46.441461 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b84eec6e-519b-4aeb-a587-a12bcb9a54b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.535353 Oct 22 03:35:46.456616 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2933/5981] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:45 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:46.555250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:46.564607 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ff55f6af-8941-44a5-bc6a-f477e40ef25d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1548 microversion: 2.1 time: 0.751634 Oct 22 03:35:46.566437 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3049/5982] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:45 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1548 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:46.591226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:46.591890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:46.613622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:46.615301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:46.615892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:46.617939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:46.620850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:46.621609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:46.926050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:46.926678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:46.943770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:46.944599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:46.945235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:46.946144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:46.947376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:46.947982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:47.225676 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f48df338-3554-426c-b61f-1b3a77eea88a tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.638765 Oct 22 03:35:47.227164 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2934/5983] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:35:46 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-interface => generated 284 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:47.478103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:47.478889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:47.485512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:47.486623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:47.486623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:47.487944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:47.488513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:47.489134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:47.573865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:47.587791 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-82db4f25-2015-4cb4-8d79-5182094c3132 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1312 microversion: 2.1 time: 0.663049 Oct 22 03:35:47.589512 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3050/5984] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:46 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1312 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:47.823872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:47.840790 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db8a0b11-fea6-4527-9a64-d96119a985a5 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.369830 Oct 22 03:35:47.858517 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2935/5985] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:47 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:48.617556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:48.618334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:48.634319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:48.634911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:48.635729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:48.636817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:48.637443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:48.638021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:48.867959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:48.869271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:48.876363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:48.877972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:48.878587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:48.879495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:48.880126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:48.880784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:49.123128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:49.161059 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b65cab4c-5ed3-4cb7-ab7f-5a4660669c4f tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.296935 Oct 22 03:35:49.161954 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2936/5986] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:48 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:49.488137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:49.499815 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7d3a1e16-0fe9-4142-97a2-a52ba84cd9b4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1312 microversion: 2.1 time: 0.885688 Oct 22 03:35:49.510592 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3051/5987] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:48 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1312 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:50.185545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:50.186759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:50.195195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:50.195914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:50.196577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:50.197457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:50.198916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:50.199509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:50.381415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:50.403494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-edf5975a-d8f5-4e07-a0a5-d0d6b53063b0 req-7bc723e0-7c9d-410f-9c0f-f68cc0b67a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35cd6534-15d7-4abd-8331-1b2f16900f73", "tag": "2b8e2867-5e4b-41be-a7c1-9291eaa47c5f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:50.426278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-edf5975a-d8f5-4e07-a0a5-d0d6b53063b0 req-7bc723e0-7c9d-410f-9c0f-f68cc0b67a5a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:50.426879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-edf5975a-d8f5-4e07-a0a5-d0d6b53063b0 req-7bc723e0-7c9d-410f-9c0f-f68cc0b67a5a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:50.427395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-edf5975a-d8f5-4e07-a0a5-d0d6b53063b0 req-7bc723e0-7c9d-410f-9c0f-f68cc0b67a5a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:50.427527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=14 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:50.470929 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-edf5975a-d8f5-4e07-a0a5-d0d6b53063b0 req-7bc723e0-7c9d-410f-9c0f-f68cc0b67a5a service nova] Creating event network-changed:2b8e2867-5e4b-41be-a7c1-9291eaa47c5f for instance 35cd6534-15d7-4abd-8331-1b2f16900f73 on n-h1-862416-2 Oct 22 03:35:50.481529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-edf5975a-d8f5-4e07-a0a5-d0d6b53063b0 req-7bc723e0-7c9d-410f-9c0f-f68cc0b67a5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081895 Oct 22 03:35:50.483006 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3052/5988] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:50.555634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:50.556543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:50.567787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:50.568618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:50.569285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:50.570667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:50.571207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:50.571738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:50.661877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:50.718190 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a33dd806-9df0-4c8c-bce1-0a1eff5b76ce tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.535949 Oct 22 03:35:50.746282 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2937/5989] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:50 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:50.983180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:51.242227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:51.252939 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-167d3336-252a-438f-88a0-95ee336b9a9c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1312 microversion: 2.1 time: 0.721609 Oct 22 03:35:51.253911 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3053/5990] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:50 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1312 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:51.763241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:51.764497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:51.773326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:51.774123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:51.774722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:51.775627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:51.776277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:51.776880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:52.045927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:52.057746 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3ccbc6a-70d3-4686-8ad8-17c73dd82f12 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.298439 Oct 22 03:35:52.072889 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2938/5991] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:51 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:52.276475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:52.277941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:52.290189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:52.290952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:52.291569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:52.292485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:52.293100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:52.293689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:52.539430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6b75fefa-4ba0-4698-9e51-4ac24880d1b6 req-f59a28fa-cde1-4b86-aa80-659f4e51de8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f73f946-acdc-4b7a-9959-ddf55db6b808", "tag": "d1a2de7f-c762-4c10-b411-b62a76958698"}, {"name": "network-changed", "server_uuid": "ade47413-492f-4c40-ab26-695bc9f3728b", "tag": "b2f870c4-98c4-45d2-93ae-3774ed0f3370"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:52.562391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6b75fefa-4ba0-4698-9e51-4ac24880d1b6 req-f59a28fa-cde1-4b86-aa80-659f4e51de8c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:52.562875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6b75fefa-4ba0-4698-9e51-4ac24880d1b6 req-f59a28fa-cde1-4b86-aa80-659f4e51de8c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:52.563584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6b75fefa-4ba0-4698-9e51-4ac24880d1b6 req-f59a28fa-cde1-4b86-aa80-659f4e51de8c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:52.591348 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6b75fefa-4ba0-4698-9e51-4ac24880d1b6 req-f59a28fa-cde1-4b86-aa80-659f4e51de8c service nova] Creating event network-changed:d1a2de7f-c762-4c10-b411-b62a76958698 for instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 on n-h2-862416-2 Oct 22 03:35:52.591864 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6b75fefa-4ba0-4698-9e51-4ac24880d1b6 req-f59a28fa-cde1-4b86-aa80-659f4e51de8c service nova] Creating event network-changed:b2f870c4-98c4-45d2-93ae-3774ed0f3370 for instance ade47413-492f-4c40-ab26-695bc9f3728b on n-h1-862416-2 Oct 22 03:35:52.614137 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6b75fefa-4ba0-4698-9e51-4ac24880d1b6 req-f59a28fa-cde1-4b86-aa80-659f4e51de8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079006 Oct 22 03:35:52.614779 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2939/5992] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:52.959731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:52.969087 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-753940ce-0327-4f93-8ded-5d32ceef4d31 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1312 microversion: 2.1 time: 0.697047 Oct 22 03:35:52.975660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3054/5993] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:52 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1312 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:53.090970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:53.094054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:53.121057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:53.122080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:53.122989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:53.124125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:53.125251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:53.127363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:53.802645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:53.831855 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8d07434d-969b-42b7-8836-7c6e00dc5062 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.747645 Oct 22 03:35:53.845274 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2940/5994] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:53 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:54.011271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:54.012808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:54.025994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:54.028709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:54.031531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:54.033224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:54.034168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:54.034801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:54.859095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:54.860446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:54.869594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:54.870350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:54.871061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:54.872383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:54.873051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:54.873752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:55.152528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:55.166368 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-44d21581-c860-4c9f-93f1-0d1ea3aa739d tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.307399 Oct 22 03:35:55.180762 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2941/5995] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:54 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:55.196315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:55.225566 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe4dd203-6ee9-420f-bc19-e263b13fb9c8 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1312 microversion: 2.1 time: 1.218466 Oct 22 03:35:55.252327 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3055/5996] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:53 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1312 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:56.196494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:56.198700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:56.208705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:56.210676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:56.211347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:56.212346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:56.213149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:56.213783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:56.254944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:56.255563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:56.283301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:56.283947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:56.285077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:56.285827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:56.286297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:56.286735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:56.495991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:56.520702 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cb2ff04a-aefe-49f9-87f5-283a89bcddae tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.329408 Oct 22 03:35:56.522416 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2942/5997] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:56 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:56.596772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e6e8df8a-0861-41e3-9877-2557b89ac331 req-7f249350-bb58-4473-a678-62677cabad5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35cd6534-15d7-4abd-8331-1b2f16900f73", "name": "network-vif-plugged", "status": "completed", "tag": "2b8e2867-5e4b-41be-a7c1-9291eaa47c5f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:56.606994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:56.610027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e6e8df8a-0861-41e3-9877-2557b89ac331 req-7f249350-bb58-4473-a678-62677cabad5d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:56.611382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e6e8df8a-0861-41e3-9877-2557b89ac331 req-7f249350-bb58-4473-a678-62677cabad5d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:56.612255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e6e8df8a-0861-41e3-9877-2557b89ac331 req-7f249350-bb58-4473-a678-62677cabad5d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:56.638552 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e6e8df8a-0861-41e3-9877-2557b89ac331 req-7f249350-bb58-4473-a678-62677cabad5d service nova] Creating event network-vif-plugged:2b8e2867-5e4b-41be-a7c1-9291eaa47c5f for instance 35cd6534-15d7-4abd-8331-1b2f16900f73 on n-h1-862416-2 Oct 22 03:35:56.665182 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e6e8df8a-0861-41e3-9877-2557b89ac331 req-7f249350-bb58-4473-a678-62677cabad5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053321 Oct 22 03:35:56.667359 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2943/5998] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:35:56.854337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:56.864800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0ce9c13-5363-4bcb-8e6a-7651a037f8de tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1312 microversion: 2.1 time: 0.614017 Oct 22 03:35:56.883906 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3056/5999] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:56 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1312 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:57.546815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:57.547270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:57.554159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:57.554648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:57.555150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:57.555860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:57.556335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:57.556760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:57.708441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:57.718356 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19dc0db8-0eed-42d6-9dd9-d4b9e7d72f2a tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1298 microversion: 2.1 time: 0.176744 Oct 22 03:35:57.721033 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2944/6000] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:57 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:57.889226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:57.890451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:57.898620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:57.899339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:57.899945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:57.900885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:57.901509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:57.902125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:58.613184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:58.620962 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c80dd0e6-3091-47d8-9b3d-7885404b9fbc tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1312 microversion: 2.1 time: 0.735510 Oct 22 03:35:58.621556 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3057/6001] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:57 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1312 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:58.742894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:58.744133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:58.754503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:58.762441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:58.763155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:58.764139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:58.764980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:58.768240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:58.853293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-fc583cbd-55a0-4824-b11a-daf8381c267b req-0a35e82b-291a-44fb-a548-bbf3a4f3271d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f73f946-acdc-4b7a-9959-ddf55db6b808", "name": "network-vif-plugged", "status": "completed", "tag": "d1a2de7f-c762-4c10-b411-b62a76958698"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:35:58.862750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:58.865027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fc583cbd-55a0-4824-b11a-daf8381c267b req-0a35e82b-291a-44fb-a548-bbf3a4f3271d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:58.865744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fc583cbd-55a0-4824-b11a-daf8381c267b req-0a35e82b-291a-44fb-a548-bbf3a4f3271d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:58.866544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fc583cbd-55a0-4824-b11a-daf8381c267b req-0a35e82b-291a-44fb-a548-bbf3a4f3271d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:58.881738 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-fc583cbd-55a0-4824-b11a-daf8381c267b req-0a35e82b-291a-44fb-a548-bbf3a4f3271d service nova] Creating event network-vif-plugged:d1a2de7f-c762-4c10-b411-b62a76958698 for instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 on n-h2-862416-2 Oct 22 03:35:58.887156 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-fc583cbd-55a0-4824-b11a-daf8381c267b req-0a35e82b-291a-44fb-a548-bbf3a4f3271d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037396 Oct 22 03:35:58.888328 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3058/6002] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:35:59.129438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:59.145238 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79d3e30f-24e2-4037-a414-3eace217bf0c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1470 microversion: 2.1 time: 0.406070 Oct 22 03:35:59.146095 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2945/6003] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:58 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:35:59.170548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:59.171387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:59.188142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:59.189174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:59.189618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:59.190437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:59.190905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:59.191317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:59.475037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:35:59.486800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9344c33-84e6-4aab-a511-5e306056bb04 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1470 microversion: 2.1 time: 0.319069 Oct 22 03:35:59.504474 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3059/6004] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:59 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:59.519962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:59.520629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:59.530693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:59.531524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:59.533476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:59.536840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:59.537344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:59.538002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:59.573823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:35:59.649864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:59.651024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:59.662336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:59.663333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:59.664614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:59.666496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:59.667942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:59.669058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:59.768491 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab7a1d6f-1861-4bd2-8a5e-a18e59550260 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1621 microversion: 2.1 time: 0.257216 Oct 22 03:35:59.768491 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2946/6005] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:59 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1621 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:35:59.791009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:35:59.791629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:35:59.802856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:59.805531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:59.806170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:35:59.812520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:35:59.813218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:35:59.814400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:00.129921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ca58d89-5e16-443c-b712-c6347042ce20 tempest-TestSecurityGroupsBasicOps-2055762936 tempest-TestSecurityGroupsBasicOps-2055762936-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1912 microversion: 2.1 time: 0.342959 Oct 22 03:36:00.132016 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2947/6006] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:59 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1912 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:36:00.141606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:00.170624 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ccbbb811-53f7-4db1-9a13-4a8e65cba647 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1312 microversion: 2.1 time: 0.526100 Oct 22 03:36:00.171758 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3060/6007] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:35:59 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1312 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:00.333005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:00.333777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:00.351211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:00.351738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:00.352323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:00.353359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:00.353979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:00.354923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:00.385531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:36:00.550786 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b28ede9-8cb3-4eca-bc21-8381a5c07a05 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "DELETE /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 204 len: 0 microversion: 2.1 time: 0.222178 Oct 22 03:36:00.551714 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2948/6008] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:36:00 2022] DELETE /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:36:00.561508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:00.562580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:00.585409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:00.586171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:00.589120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:00.590171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:00.591779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:00.592494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:00.875836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:00.899755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-732032d8-5a3b-4679-8278-5b17409ce2cc tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1476 microversion: 2.1 time: 0.343715 Oct 22 03:36:00.920232 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3061/6009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:00 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:01.199392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:01.199801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:01.211787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:01.212342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:01.212914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:01.213566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:01.213974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:01.214409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:01.638765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:01.648758 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d45eae5a-1934-4a89-b731-5d4d2a6bad77 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1495 microversion: 2.1 time: 0.453947 Oct 22 03:36:01.650297 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2949/6010] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:01 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1495 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:01.953220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:01.960255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:02.049470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:02.050784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:02.051381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:02.052320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:02.052927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:02.053513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:02.604588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:02.606028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:02.624955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:02.628025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:02.632123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:02.633639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:02.634064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:02.635043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:02.702386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:36:02.820020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:02.829006 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb2330a0-f506-4bc9-91cb-f0aa42157127 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1476 microversion: 2.1 time: 0.895818 Oct 22 03:36:02.840336 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3062/6011] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:01 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1476 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:02.912360 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a1cb1b3-cece-4e35-99c3-195d667c9c68 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 204 len: 0 microversion: 2.1 time: 0.297957 Oct 22 03:36:02.916596 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2950/6012] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:36:02 2022] DELETE /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:36:02.926477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:02.927382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:02.941860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:02.942370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:02.942821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:02.943552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:02.944021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:02.944480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:03.536645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:03.536645 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a682cea-45f3-442b-b738-56f702c7aa2c tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1501 microversion: 2.1 time: 0.597070 Oct 22 03:36:03.536645 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3063/6013] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:02 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1501 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:03.631713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5dfba98e-06c0-466e-ad65-ede1f26ab50b req-15e8d905-5fc9-4c01-b82a-e5a4d24316e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35cd6534-15d7-4abd-8331-1b2f16900f73", "name": "network-vif-deleted", "tag": "2b8e2867-5e4b-41be-a7c1-9291eaa47c5f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:03.674895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5dfba98e-06c0-466e-ad65-ede1f26ab50b req-15e8d905-5fc9-4c01-b82a-e5a4d24316e0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:03.675422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5dfba98e-06c0-466e-ad65-ede1f26ab50b req-15e8d905-5fc9-4c01-b82a-e5a4d24316e0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:03.685385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5dfba98e-06c0-466e-ad65-ede1f26ab50b req-15e8d905-5fc9-4c01-b82a-e5a4d24316e0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:03.715064 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5dfba98e-06c0-466e-ad65-ede1f26ab50b req-15e8d905-5fc9-4c01-b82a-e5a4d24316e0 service nova] Creating event network-vif-deleted:2b8e2867-5e4b-41be-a7c1-9291eaa47c5f for instance 35cd6534-15d7-4abd-8331-1b2f16900f73 on n-h1-862416-2 Oct 22 03:36:03.736982 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5dfba98e-06c0-466e-ad65-ede1f26ab50b req-15e8d905-5fc9-4c01-b82a-e5a4d24316e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111322 Oct 22 03:36:03.740620 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2951/6014] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:36:03.870972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:03.871587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:03.883635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:03.884133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:03.888339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:03.889428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:03.894211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:03.894993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:03.952709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:03.953422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:03.953813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:03.954979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lazy-loading 'fault' on Instance uuid 35cd6534-15d7-4abd-8331-1b2f16900f73 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:36:04.110108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:04.122165 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90dc2657-88bb-4aa2-bfc6-61d511a95a16 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 200 len: 1330 microversion: 2.1 time: 0.255352 Oct 22 03:36:04.123039 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3064/6015] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:03 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 1330 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:04.548785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:04.550003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:04.564122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:04.565016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:04.565617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:04.571939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:04.572564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:04.573023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:05.149109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:05.149714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 35cd6534-15d7-4abd-8331-1b2f16900f73] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:05.162286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:05.162772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:05.163210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:05.163920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:05.164406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:05.164833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:05.200944 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] HTTP exception thrown: Instance 35cd6534-15d7-4abd-8331-1b2f16900f73 could not be found. Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Request method failure captured: Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 HTTP/1.1 Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2Rrj0QuMQwDfxE6QE1wfgbrZM_VAEbbKeykwaB5DS7ecIC_6j6wvQDQZQr4d4jtmY0NDMO8SxXiHXaSasinCUC9pLDIF0dHnWy9h0Mf5_aN-F3UXn0RwduIqshWGi3nu9APsKdntmNOU8Jhm-KLP6YkfyUVMS5LoS_A6Eoq2OQv3RQ Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 8dd0dd13b97d40f2a4558707cc18481e Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1655180208 Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dd0dd13b97d40f2a4558707cc18481e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dd0dd13b97d40f2a4558707cc18481e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dd0dd13b97d40f2a4558707cc18481e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dd0dd13b97d40f2a4558707cc18481e"}]}] Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1655180208 Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 8dd0dd13b97d40f2a4558707cc18481e Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1655180208 Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestSecurityGroupsBasicOps-1655180208-project Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 4bbbfdb649d142439a780764226f631c Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1655180208-project Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 35cd6534-15d7-4abd-8331-1b2f16900f73 could not be found. Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '35cd6534-15d7-4abd-8331-1b2f16900f73'} Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35cd6534-15d7-4abd-8331-1b2f16900f73 could not be found. Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35cd6534-15d7-4abd-8331-1b2f16900f73 could not be found. Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:05.206826 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35cd6534-15d7-4abd-8331-1b2f16900f73 could not be found. Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Returning 404 to user: Instance 35cd6534-15d7-4abd-8331-1b2f16900f73 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:36:05.211701 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-649481aa-9984-4329-b969-c1a4bf87e319 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73" status: 404 len: 111 microversion: 2.1 time: 0.063226 Oct 22 03:36:05.213326 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3065/6016] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:05 2022] GET /compute/v2.1/servers/35cd6534-15d7-4abd-8331-1b2f16900f73 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:36:05.483361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:05.513454 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f07a12f-18df-424c-8b3f-563642451db4 tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1501 microversion: 2.1 time: 0.968147 Oct 22 03:36:05.521192 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2952/6017] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:04 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1501 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:06.382789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9984ca73-80d8-4772-8684-8847b390d851 req-435ecd71-2527-4dc4-b608-584d6502de19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f73f946-acdc-4b7a-9959-ddf55db6b808", "name": "network-vif-deleted", "tag": "d1a2de7f-c762-4c10-b411-b62a76958698"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:06.400366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9984ca73-80d8-4772-8684-8847b390d851 req-435ecd71-2527-4dc4-b608-584d6502de19 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:06.401147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9984ca73-80d8-4772-8684-8847b390d851 req-435ecd71-2527-4dc4-b608-584d6502de19 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:06.401278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9984ca73-80d8-4772-8684-8847b390d851 req-435ecd71-2527-4dc4-b608-584d6502de19 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:06.433454 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9984ca73-80d8-4772-8684-8847b390d851 req-435ecd71-2527-4dc4-b608-584d6502de19 service nova] Creating event network-vif-deleted:d1a2de7f-c762-4c10-b411-b62a76958698 for instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 on n-h2-862416-2 Oct 22 03:36:06.441927 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9984ca73-80d8-4772-8684-8847b390d851 req-435ecd71-2527-4dc4-b608-584d6502de19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062752 Oct 22 03:36:06.442914 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3066/6018] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:36:06.544730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:06.545408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:06.552620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:06.553113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:06.560512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:06.561380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:06.561866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:06.564772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:06.630698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:06.631443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:06.632100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:06.632847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lazy-loading 'fault' on Instance uuid 5f73f946-acdc-4b7a-9959-ddf55db6b808 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:36:06.859771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0452243860054561b2da710d4245c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cdb330ac5e46b2b3652599fa511078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:06.873968 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b23e80d-d7b2-4a33-950f-03f4231e996a tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 200 len: 1302 microversion: 2.1 time: 0.335045 Oct 22 03:36:06.874906 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2953/6019] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:06 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 1302 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:36:07.900590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:07.901293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] [instance: 5f73f946-acdc-4b7a-9959-ddf55db6b808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:07.926938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:07.929444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:07.935512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:07.936791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:07.938216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:07.941287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:07.980372 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] HTTP exception thrown: Instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 could not be found. Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Request method failure captured: Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 HTTP/1.1 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2TndIiCa5LmOkM2l3kHWvJxUc4JxWx9qrP49yP9V31lx6XmOPRSzO3ujagxjE3dKPLuBgkB9iyZfje0RWcKvK6gLdgrDC1ZstR95_X7EPXG5QlW6JLG7UoiIDEVTAq_x46mJmKYV3ZmGZQ4gBsz-Lp8xcPZwBCyUHyA9Zs1gQZGuMI Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a5cdb330ac5e46b2b3652599fa511078 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesActionsTest-1537172769 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a5cdb330ac5e46b2b3652599fa511078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cdb330ac5e46b2b3652599fa511078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a5cdb330ac5e46b2b3652599fa511078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a5cdb330ac5e46b2b3652599fa511078"}]}] Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesActionsTest-1537172769 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a5cdb330ac5e46b2b3652599fa511078 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesActionsTest-1537172769 Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesActionsTest-1537172769-project Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 0452243860054561b2da710d4245c6eb Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesActionsTest-1537172769-project Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 could not be found. Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '5f73f946-acdc-4b7a-9959-ddf55db6b808'} Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 could not be found. Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 could not be found. Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:36:07.983240 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:07.988691 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:07.988691 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:36:07.988691 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:36:07.988691 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:36:07.988691 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:36:07.988691 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 could not be found. Oct 22 03:36:07.988691 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:36:07.991938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] Returning 404 to user: Instance 5f73f946-acdc-4b7a-9959-ddf55db6b808 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:36:07.995201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b277198e-2f39-40e7-b808-f99c9972711f tempest-VolumesActionsTest-1537172769 tempest-VolumesActionsTest-1537172769-project] 10.222.0.25 "GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808" status: 404 len: 111 microversion: 2.1 time: 0.099849 Oct 22 03:36:07.996687 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3067/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:07 2022] GET /compute/v2.1/servers/5f73f946-acdc-4b7a-9959-ddf55db6b808 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:36:11.533964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f04f29cf-5eb3-4732-8518-5e434c942d19 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'create', calling method: .version_select at 0x7f0d1929da60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-391862357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzg0LlAM0K393Sd1ZCK+ZBRn99EEuqzKdsuK7DaMhtM4GHA+nGvh4Y7C8GdaTXQe1FylS8kFgXrvDeozbcOQEEHNlro1bvWCP1brkBIC3ZDRZJ6rtRfZlvkf4e1S10Ytg=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:11.583119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f04f29cf-5eb3-4732-8518-5e434c942d19 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for project 03e206cc2daf451097f611ac8a89a81f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:36:11.597062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f04f29cf-5eb3-4732-8518-5e434c942d19 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for user 1b27379c40ff401c8480c435a9ff6d09 and project 03e206cc2daf451097f611ac8a89a81f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:36:11.658850 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f04f29cf-5eb3-4732-8518-5e434c942d19 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.130344 Oct 22 03:36:11.660305 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2954/6021] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:36:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:36:18.988602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-78497684", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "96f37ed1-4400-492d-b4fd-da1287cd7ddb"}], "key_name": "tempest-TestNetworkBasicOps-391862357", "security_groups": [{"name": "tempest-secgroup-smoke-1613518497"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:19.045181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=21 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:19.053071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:20.045854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] validate_networks() for [('96f37ed1-4400-492d-b4fd-da1287cd7ddb', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:36:22.596034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:36:22.596693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:36:22.601477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:36:22.601477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:36:22.601870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:36:22.625772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:22.626566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:22.627005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:22.632520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:22.633628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:22.634096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:22.713712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for project 03e206cc2daf451097f611ac8a89a81f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:36:22.730240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for user 1b27379c40ff401c8480c435a9ff6d09 and project 03e206cc2daf451097f611ac8a89a81f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:36:22.772892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:36:22.776676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:36:22.927675 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-073acabd-82aa-44eb-a669-0c3c0e5cc772 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.947787 Oct 22 03:36:22.936282 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3068/6022] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:36:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 3957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:36:22.944655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:22.946205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:22.947065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:22.952788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d631e950-9416-473e-aea0-d9106c269769 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:22.956159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d631e950-9416-473e-aea0-d9106c269769 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:23.722446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d631e950-9416-473e-aea0-d9106c269769 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:23.736331 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d631e950-9416-473e-aea0-d9106c269769 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1246 microversion: 2.1 time: 0.792061 Oct 22 03:36:23.738072 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2955/6023] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:22 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1246 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:24.762939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:24.764197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:24.784702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:24.789693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:24.790371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:24.791755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:24.792414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:24.793057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:24.978238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:24.994465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6cf018b1-6761-4fb2-a3b6-b2dc0aefa440 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1298 microversion: 2.1 time: 0.235349 Oct 22 03:36:24.995218 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3069/6024] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:24 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1298 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:25.462109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:25.467699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:25.511739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:25.514943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:25.515411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:25.519929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:25.522124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:25.522595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:25.608295 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1af05c6f-cd74-4297-b25b-cfc799fe6dbc tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/ips" status: 200 len: 143 microversion: 2.1 time: 0.694092 Oct 22 03:36:25.612871 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2956/6025] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Oct 22 03:36:24 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/ips => generated 143 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:36:26.023277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:26.029248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:26.048050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:26.054162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:26.056686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:26.058066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:26.058793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:26.064448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:26.479703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:26.494789 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfeac1a9-01b5-4298-8136-6701d617d6dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1304 microversion: 2.1 time: 0.475887 Oct 22 03:36:26.497168 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3070/6026] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:26 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1304 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:27.519222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:27.519997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:27.534138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:27.535017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:27.535749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:27.537015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:27.539270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:27.539991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:27.816160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:27.830584 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7b0a31ab-fa7b-4bbd-9ed7-f675390578fc tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1304 microversion: 2.1 time: 0.315451 Oct 22 03:36:27.831181 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2957/6027] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:27 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1304 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:27.996324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:27.996785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:28.009056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:28.010799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:28.013972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:28.016664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:28.017661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:28.021657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:28.045203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-0624b9e1-0794-4c4e-9196-0a5aa6618863 req-75b2bae1-4082-415d-a92c-32cea63bc364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882c7917-2168-4ac8-9353-c9f7b5dc8f28", "tag": "bf5d4e61-2743-4680-ab77-a63d3e89e3f1"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:28.065941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0624b9e1-0794-4c4e-9196-0a5aa6618863 req-75b2bae1-4082-415d-a92c-32cea63bc364 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:28.084684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0624b9e1-0794-4c4e-9196-0a5aa6618863 req-75b2bae1-4082-415d-a92c-32cea63bc364 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:28.085535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-0624b9e1-0794-4c4e-9196-0a5aa6618863 req-75b2bae1-4082-415d-a92c-32cea63bc364 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:28.157466 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-0624b9e1-0794-4c4e-9196-0a5aa6618863 req-75b2bae1-4082-415d-a92c-32cea63bc364 service nova] Creating event network-changed:bf5d4e61-2743-4680-ab77-a63d3e89e3f1 for instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 on n-h2-862416-2 Oct 22 03:36:28.159269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:36:28.179151 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-0624b9e1-0794-4c4e-9196-0a5aa6618863 req-75b2bae1-4082-415d-a92c-32cea63bc364 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139971 Oct 22 03:36:28.182817 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2958/6028] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:36:28.401961 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-469488f6-5e05-45cb-812d-1e76d76706ac tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "DELETE /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 204 len: 0 microversion: 2.1 time: 0.409910 Oct 22 03:36:28.408680 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3071/6029] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:36:27 2022] DELETE /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:36:28.436236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:28.441903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:28.461755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:28.462640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:28.464021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:28.464986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:28.465626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:28.466302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:28.534839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f875d769-d2ad-4990-9c86-97a5ff03154c"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:28.538187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:28.558784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:28.559565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:28.560236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:28.561505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:28.562159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:28.562777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:29.386803 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86cd9df8-8108-45ac-8760-75d9288d6873 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857468 Oct 22 03:36:29.410904 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3072/6030] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:36:28 2022] POST /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments => generated 194 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:36:29.448500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:29.453429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:29.482240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:29.488459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:29.492844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:29.496452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:29.500643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:29.502806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:29.794799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:29.808955 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2511fe8a-9311-476a-adbc-e198d2921c3c tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1767 microversion: 2.1 time: 1.394570 Oct 22 03:36:29.816562 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2959/6031] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:28 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1767 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:30.144646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:30.160454 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc0f7120-5d9e-4be0-bf9c-48b091a4fdf1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1304 microversion: 2.1 time: 0.730453 Oct 22 03:36:30.163921 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3073/6032] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:29 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1304 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:30.837279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:30.838669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:30.857619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:30.858522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:30.859185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:30.861069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:30.861833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:30.862495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:31.189094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:31.190851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:31.208137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:31.209089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:31.209800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:31.211855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:31.212825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:31.213511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:31.566205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:31.574906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d2a4c30e-f80d-4cdb-a956-eafec52f8f84 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 0.390901 Oct 22 03:36:31.585325 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3074/6033] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:31 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:36:32.001010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7565da4d-9f8e-4301-8e2d-a86eebf5a835 req-7ff15f01-11aa-4377-8c95-21eb76c318e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882c7917-2168-4ac8-9353-c9f7b5dc8f28", "name": "network-vif-deleted", "tag": "bf5d4e61-2743-4680-ab77-a63d3e89e3f1"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:32.023277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7565da4d-9f8e-4301-8e2d-a86eebf5a835 req-7ff15f01-11aa-4377-8c95-21eb76c318e1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:32.025954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7565da4d-9f8e-4301-8e2d-a86eebf5a835 req-7ff15f01-11aa-4377-8c95-21eb76c318e1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:32.026433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7565da4d-9f8e-4301-8e2d-a86eebf5a835 req-7ff15f01-11aa-4377-8c95-21eb76c318e1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:32.059920 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7565da4d-9f8e-4301-8e2d-a86eebf5a835 req-7ff15f01-11aa-4377-8c95-21eb76c318e1 service nova] Creating event network-vif-deleted:bf5d4e61-2743-4680-ab77-a63d3e89e3f1 for instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 on n-h2-862416-2 Oct 22 03:36:32.072480 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7565da4d-9f8e-4301-8e2d-a86eebf5a835 req-7ff15f01-11aa-4377-8c95-21eb76c318e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076966 Oct 22 03:36:32.074368 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3075/6034] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:36:32.615190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:32.616051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:32.653705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:32.654256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:32.659536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:32.665755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:32.670518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:32.671282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:32.673737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:32.756302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:33.020789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbbfdb649d142439a780764226f631c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd0dd13b97d40f2a4558707cc18481e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:33.026377 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8bb95dd8-184b-4996-9858-42982a95a203 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 200 len: 1767 microversion: 2.1 time: 2.192850 Oct 22 03:36:33.037314 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2960/6035] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:30 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 1767 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:33.479576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:33.488060 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42dd70b0-224a-46bc-8e09-b7fb8945595b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 0.879222 Oct 22 03:36:33.492166 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3076/6036] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:32 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:34.055168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:34.055829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] [instance: 882c7917-2168-4ac8-9353-c9f7b5dc8f28] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:34.066645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:34.070947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:34.074548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:34.076192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:34.077369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:34.080696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:34.081346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:34.122516 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] HTTP exception thrown: Instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 could not be found. Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Request method failure captured: Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 HTTP/1.1 Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2Rrj0QuMQwDfxE6QE1wfgbrZM_VAEbbKeykwaB5DS7ecIC_6j6wvQDQZQr4d4jtmY0NDMO8SxXiHXaSasinCUC9pLDIF0dHnWy9h0Mf5_aN-F3UXn0RwduIqshWGi3nu9APsKdntmNOU8Jhm-KLP6YkfyUVMS5LoS_A6Eoq2OQv3RQ Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 8dd0dd13b97d40f2a4558707cc18481e Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1655180208 Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dd0dd13b97d40f2a4558707cc18481e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dd0dd13b97d40f2a4558707cc18481e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dd0dd13b97d40f2a4558707cc18481e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dd0dd13b97d40f2a4558707cc18481e"}]}] Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1655180208 Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 8dd0dd13b97d40f2a4558707cc18481e Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1655180208 Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestSecurityGroupsBasicOps-1655180208-project Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4bbbfdb649d142439a780764226f631c Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1655180208-project Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 could not be found. Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '882c7917-2168-4ac8-9353-c9f7b5dc8f28'} Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 could not be found. Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 could not be found. Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:36:34.127820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:36:34.132002 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:36:34.132002 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:36:34.132002 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:36:34.132002 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:36:34.132002 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:36:34.132002 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:36:34.132002 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 could not be found. Oct 22 03:36:34.132002 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:36:34.137718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Returning 404 to user: Instance 882c7917-2168-4ac8-9353-c9f7b5dc8f28 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:36:34.141853 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ada92337-9c4d-455f-bebc-26cd621241b8 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28" status: 404 len: 111 microversion: 2.1 time: 0.089467 Oct 22 03:36:34.152574 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2961/6037] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:34 2022] GET /compute/v2.1/servers/882c7917-2168-4ac8-9353-c9f7b5dc8f28 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:36:34.519241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:34.519847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:34.538379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:34.539126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:34.539759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:34.540672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:34.541278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:34.541858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:35.414595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:35.424847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc56d8c5-c151-4c8c-95fc-13df6f9c6204 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 0.909549 Oct 22 03:36:35.426704 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3077/6038] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:34 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:36.450638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:36.451905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:36.462109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:36.470118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:36.478885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:36.481381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:36.484663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:36.488293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:36.901691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-69d3611b-d101-4448-95ae-45c79f1eecd8 req-0509314d-5ce9-413f-a3d3-4c662e1d56e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2d15b96-d91c-47d6-91ef-e1177a5e77b2", "tag": "7bebec55-56b9-43b4-91bb-9112aad214ce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:36.942257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-69d3611b-d101-4448-95ae-45c79f1eecd8 req-0509314d-5ce9-413f-a3d3-4c662e1d56e7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:36.944763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-69d3611b-d101-4448-95ae-45c79f1eecd8 req-0509314d-5ce9-413f-a3d3-4c662e1d56e7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:36.945782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-69d3611b-d101-4448-95ae-45c79f1eecd8 req-0509314d-5ce9-413f-a3d3-4c662e1d56e7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:36.981393 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-69d3611b-d101-4448-95ae-45c79f1eecd8 req-0509314d-5ce9-413f-a3d3-4c662e1d56e7 service nova] Creating event network-changed:7bebec55-56b9-43b4-91bb-9112aad214ce for instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 on n-h2-862416-2 Oct 22 03:36:37.002677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-69d3611b-d101-4448-95ae-45c79f1eecd8 req-0509314d-5ce9-413f-a3d3-4c662e1d56e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104494 Oct 22 03:36:37.011188 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3078/6039] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:36:37.355342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:37.365691 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bfa747fc-96bf-4141-b7c7-94efd7fec3c0 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 0.919522 Oct 22 03:36:37.382131 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2962/6040] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:36 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:38.395426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:38.396987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:38.421251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:38.423323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:38.425875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:38.427049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:38.436200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:38.436682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:40.209715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:40.222689 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a949fb11-d7ba-4091-a1fa-42e0527fbfe3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 1.833248 Oct 22 03:36:40.242913 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3079/6041] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:38 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:41.249629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:41.250758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:41.257830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:41.258317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:41.258757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:41.259461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:41.259909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:41.279596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:41.796635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:41.814960 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bf668190-0399-4134-8182-206b5c496cb3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 0.568859 Oct 22 03:36:41.820693 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2963/6042] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:41 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:42.841423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:42.841997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:42.864570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:42.865080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:42.865532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:42.866265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:42.866723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:42.867151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:44.406048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:44.424075 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6dad1207-7c19-40a1-86eb-b62ddbc9f450 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 1.587206 Oct 22 03:36:44.426270 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3080/6043] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:42 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:45.456030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:45.458731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:45.491832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:45.492369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:45.492835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:45.493531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:45.501469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:45.502908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:45.980008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:45.992550 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65530af7-e752-47e2-8afb-db1a66fb2f46 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 0.545057 Oct 22 03:36:45.999458 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2964/6044] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:45 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:46.763042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-59dae6bc-4d91-4b2f-b50c-dcbe7a249625 req-05f056b7-7bf0-48f0-8cfe-0938c371caa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d15b96-d91c-47d6-91ef-e1177a5e77b2", "name": "network-vif-plugged", "status": "completed", "tag": "7bebec55-56b9-43b4-91bb-9112aad214ce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:46.806113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-59dae6bc-4d91-4b2f-b50c-dcbe7a249625 req-05f056b7-7bf0-48f0-8cfe-0938c371caa4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:46.808866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-59dae6bc-4d91-4b2f-b50c-dcbe7a249625 req-05f056b7-7bf0-48f0-8cfe-0938c371caa4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:46.810267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-59dae6bc-4d91-4b2f-b50c-dcbe7a249625 req-05f056b7-7bf0-48f0-8cfe-0938c371caa4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:46.812697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:46.817485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:46.827392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:46.828918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:46.829647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:46.830559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:46.831191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:46.832333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:46.849564 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-59dae6bc-4d91-4b2f-b50c-dcbe7a249625 req-05f056b7-7bf0-48f0-8cfe-0938c371caa4 service nova] Creating event network-vif-plugged:7bebec55-56b9-43b4-91bb-9112aad214ce for instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 on n-h2-862416-2 Oct 22 03:36:46.861918 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-59dae6bc-4d91-4b2f-b50c-dcbe7a249625 req-05f056b7-7bf0-48f0-8cfe-0938c371caa4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104492 Oct 22 03:36:46.864704 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3081/6045] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:36:46.872806 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cdb63eb1-dd32-4136-afb9-4f7e4fceb547 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069050 Oct 22 03:36:46.880524 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2965/6046] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:36:46 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:36:46.902990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:46.905920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:46.936150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:46.936999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:46.938204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:46.939120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:46.939748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:46.940455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:46.999583 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11953e5c-9604-4c0a-9fcb-8e81512e9475 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/f875d769-d2ad-4990-9c86-97a5ff03154c" status: 200 len: 194 microversion: 2.1 time: 0.117688 Oct 22 03:36:47.007524 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3082/6047] 10.222.0.25 () {58 vars in 1413 bytes} [Sat Oct 22 03:36:46 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/f875d769-d2ad-4990-9c86-97a5ff03154c => generated 194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:36:47.038209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:47.038892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:47.053629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:47.054502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:47.055119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:47.056001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:47.056650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:47.057356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:47.962364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:47.977378 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9ab8db2-a410-4d3e-9c3e-4e389c0c23dd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1372 microversion: 2.1 time: 0.958418 Oct 22 03:36:47.986800 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2966/6048] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:47 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1372 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:49.011833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:49.012484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:49.026312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:49.028995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:49.029512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:49.030174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:49.033154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:49.034016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:49.087865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:49.868178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd7ad9a7-49cd-49c4-9bfd-98d977dde8e4"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:36:49.871019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:49.887068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:49.889114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:49.889812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:49.894547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:49.895898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:49.896571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:49.899135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:49.908268 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c7d6579-97d1-4db8-bc01-f2a9894fdf4f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1543 microversion: 2.1 time: 0.898439 Oct 22 03:36:49.911897 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3083/6049] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:49 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1543 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:49.941367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:49.946757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:36:49.948932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:36:49.970368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:49.976846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:49.977738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:49.978713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:36:49.979339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:36:49.979940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:36:50.525199 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dce6b245-3251-44b0-a068-6f2126c1d7ec tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "POST /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.661855 Oct 22 03:36:50.526499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2967/6050] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:36:49 2022] POST /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:36:50.694917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:36:50.704431 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7fb768a6-3d8d-447e-a208-0f407a47fdd4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1543 microversion: 2.1 time: 0.767372 Oct 22 03:36:50.727258 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3084/6051] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:36:49 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1543 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:36:52.379149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7cfdcb7-eef9-41b3-a32a-9c2199e29fb6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] Calling method '.version_select at 0x7f0d192fdc10>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:36:52.439711 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7cfdcb7-eef9-41b3-a32a-9c2199e29fb6 tempest-TestSecurityGroupsBasicOps-1655180208 tempest-TestSecurityGroupsBasicOps-1655180208-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-189866235" status: 202 len: 0 microversion: 2.1 time: 0.066185 Oct 22 03:36:52.440564 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2968/6052] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 03:36:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-189866235 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:37:01.035875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3c7389be-ecb6-4ee3-819f-0df38bb1a030 req-ba3613ef-9802-447c-9842-25c46e6ff2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2d15b96-d91c-47d6-91ef-e1177a5e77b2", "tag": "7bebec55-56b9-43b4-91bb-9112aad214ce"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:37:01.055649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:01.057887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=9 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:01.074860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c7389be-ecb6-4ee3-819f-0df38bb1a030 req-ba3613ef-9802-447c-9842-25c46e6ff2f1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:01.075524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c7389be-ecb6-4ee3-819f-0df38bb1a030 req-ba3613ef-9802-447c-9842-25c46e6ff2f1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:01.077562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c7389be-ecb6-4ee3-819f-0df38bb1a030 req-ba3613ef-9802-447c-9842-25c46e6ff2f1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:01.108584 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3c7389be-ecb6-4ee3-819f-0df38bb1a030 req-ba3613ef-9802-447c-9842-25c46e6ff2f1 service nova] Creating event network-changed:7bebec55-56b9-43b4-91bb-9112aad214ce for instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 on n-h2-862416-2 Oct 22 03:37:01.116967 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3c7389be-ecb6-4ee3-819f-0df38bb1a030 req-ba3613ef-9802-447c-9842-25c46e6ff2f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085869 Oct 22 03:37:01.120808 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3085/6053] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:37:08.735728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:08.736751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:08.744485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:08.746739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:08.756856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:08.757624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:08.758263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:08.759212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:08.759860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:08.760531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:08.807922 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-abf9f98f-d7b5-44e2-9620-5d1b1555684f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.074242 Oct 22 03:37:08.809122 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2969/6054] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:37:08 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:37:08.985362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:08.986471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:09.009086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:09.009884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:09.010482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:09.011444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:09.012117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:09.014328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:09.090339 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c9817664-abf0-47c6-91fa-2609be36421e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/f875d769-d2ad-4990-9c86-97a5ff03154c" status: 200 len: 194 microversion: 2.1 time: 0.114354 Oct 22 03:37:09.091327 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3086/6055] 10.222.0.25 () {58 vars in 1413 bytes} [Sat Oct 22 03:37:08 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/f875d769-d2ad-4990-9c86-97a5ff03154c => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:37:09.103917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:09.104881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:09.113413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:09.114308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:09.114997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:09.116281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:09.116950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:09.118249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:09.300994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lazy-loading 'services' on Instance uuid ade47413-492f-4c40-ab26-695bc9f3728b {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:37:09.447144 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f46e7099-94eb-4230-890b-6fbd374775c7 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/f875d769-d2ad-4990-9c86-97a5ff03154c" status: 202 len: 0 microversion: 2.1 time: 0.348173 Oct 22 03:37:09.448389 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2970/6056] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:37:09 2022] DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/f875d769-d2ad-4990-9c86-97a5ff03154c => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:37:20.111396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:20.112167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:20.129802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:20.139869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:20.161735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:20.168442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:20.172844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:20.173931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:20.177750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:20.178746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:20.219721 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-897a3f57-bc87-4db6-b1ab-d9cd0f4b8352 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/bd7ad9a7-49cd-49c4-9bfd-98d977dde8e4" status: 200 len: 194 microversion: 2.1 time: 0.113302 Oct 22 03:37:20.221201 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3087/6057] 10.222.0.25 () {58 vars in 1413 bytes} [Sat Oct 22 03:37:20 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/bd7ad9a7-49cd-49c4-9bfd-98d977dde8e4 => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:37:20.249569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:20.255537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:20.265792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:20.267296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:20.288681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:20.295888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:20.298647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:20.301750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:20.305223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:20.307441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:20.526789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lazy-loading 'services' on Instance uuid ade47413-492f-4c40-ab26-695bc9f3728b {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:37:20.672002 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-48d503de-4c17-4a73-8273-ad4610363077 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/bd7ad9a7-49cd-49c4-9bfd-98d977dde8e4" status: 202 len: 0 microversion: 2.1 time: 0.443006 Oct 22 03:37:20.673989 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2971/6058] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:37:20 2022] DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments/bd7ad9a7-49cd-49c4-9bfd-98d977dde8e4 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:37:24.175615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:37:24.184688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:24.210874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:24.211432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:24.211887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:24.228967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:24.229506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:24.229943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:24.365390 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2852f149-7815-4de7-a467-9ef33e0f2c55 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2/action" status: 200 len: 24562 microversion: 2.1 time: 0.201540 Oct 22 03:37:24.373469 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3088/6059] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:37:24 2022] POST /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2/action => generated 24562 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:37:33.360732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:33.364896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:37:33.371578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:33.380358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:33.397780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:33.399159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:33.399840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:33.400871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:33.407474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:33.408322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:33.586298 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-438a97a6-7e02-4b11-ace6-c5bda01a888e tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.229114 Oct 22 03:37:33.586909 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2972/6060] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:37:33 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments => generated 25 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:37:33.839864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:33.843110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:33.863755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:33.864681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:33.865361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:33.866311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:33.866988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:33.867664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:34.006179 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-362d1424-7e22-426e-a43a-1a61682095a4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.170559 Oct 22 03:37:34.013505 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3089/6061] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 03:37:33 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b/os-volume_attachments => generated 25 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 03:37:34.189412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:34.190915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:34.206412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:34.207248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:34.213682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:34.221624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:34.223965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:34.224704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:34.354795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:37:34.534568 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d6b42e1-49e6-4d92-a8a0-8df8dfb3365d tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 204 len: 0 microversion: 2.1 time: 0.339427 Oct 22 03:37:34.535647 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2973/6062] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:37:34 2022] DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:37:34.546377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:34.547415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:34.570389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:34.574212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:34.578000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:34.584732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:34.587316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:34.588721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:35.268378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:37:35.280769 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e5620da-b2b0-475b-bfe4-2281c04c5a13 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1672 microversion: 2.1 time: 0.737622 Oct 22 03:37:35.282992 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3090/6063] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:37:34 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1672 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:37:36.310383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:36.311588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:36.328008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:36.328887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:36.329342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:36.330926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:36.331999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:36.334343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:37.381824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:37:37.408506 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5d20fa5-8f44-4f03-9c48-cc322554e20f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1672 microversion: 2.1 time: 1.100864 Oct 22 03:37:37.414572 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2974/6064] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:37:36 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1672 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:37:38.441000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:38.441767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:38.481369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:38.481938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:38.482382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:38.492030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:38.496166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:38.499030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:39.716554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:37:39.726692 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd55d707-91fc-4b5c-bb6e-1c54c7d834d4 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1672 microversion: 2.1 time: 1.290146 Oct 22 03:37:39.754048 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3091/6065] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:37:38 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1672 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:37:40.300565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-02d5c81c-6159-452a-9001-5b0bf1abc959 req-01b1dab9-0ac5-484b-9f84-d351e94543cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade47413-492f-4c40-ab26-695bc9f3728b", "name": "network-vif-deleted", "tag": "b2f870c4-98c4-45d2-93ae-3774ed0f3370"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:37:40.325971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-02d5c81c-6159-452a-9001-5b0bf1abc959 req-01b1dab9-0ac5-484b-9f84-d351e94543cc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:40.362641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-02d5c81c-6159-452a-9001-5b0bf1abc959 req-01b1dab9-0ac5-484b-9f84-d351e94543cc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:40.362641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-02d5c81c-6159-452a-9001-5b0bf1abc959 req-01b1dab9-0ac5-484b-9f84-d351e94543cc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:40.382366 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-02d5c81c-6159-452a-9001-5b0bf1abc959 req-01b1dab9-0ac5-484b-9f84-d351e94543cc service nova] Creating event network-vif-deleted:b2f870c4-98c4-45d2-93ae-3774ed0f3370 for instance ade47413-492f-4c40-ab26-695bc9f3728b on n-h1-862416-2 Oct 22 03:37:40.406276 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-02d5c81c-6159-452a-9001-5b0bf1abc959 req-01b1dab9-0ac5-484b-9f84-d351e94543cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106429 Oct 22 03:37:40.409229 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2975/6066] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:37:40.768038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:40.769571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:40.793852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:40.794372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:40.794830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:40.796091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:40.796605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:40.797037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:40.955099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:40.958215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:40.958695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:40.962103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lazy-loading 'fault' on Instance uuid ade47413-492f-4c40-ab26-695bc9f3728b {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:37:41.704991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9a6c11ec7640efa8693fadad60259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aab6dcaeb1541729cb8d92b3a361c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:37:41.715130 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0090f327-2ffc-44e0-a4dc-9e6a8945f644 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 200 len: 1328 microversion: 2.1 time: 0.951839 Oct 22 03:37:41.718735 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3092/6067] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:37:40 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 1328 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:37:42.741323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:42.742836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:37:42.752373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:42.756598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:42.757317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:42.761333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:37:42.762060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:37:42.764840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:37:42.802195 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] HTTP exception thrown: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Request method failure captured: Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b HTTP/1.1 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2QIKhMS66djg1gFwHol-eFD7uxV9jlHr2Dp-UfYy5FxM_0k0Zz_OjPmoiNWTdSkwoICevNWMZdJ_1VJS5hjnDL2z31qZdAC0MtiXeoOK_sf0XBSExwRnHDH7jxT9wVXVBIa6nbmqfgRQkllgV1g5Tn00QiUgKj2ouvCthtzD_bMY4Y Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}] Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: da9a6c11ec7640efa8693fadad60259d Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ade47413-492f-4c40-ab26-695bc9f3728b'} Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:37:42.805044 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Returning 404 to user: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1f95c178-433b-4bfd-b59c-12f434988d2f tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 404 len: 111 microversion: 2.1 time: 0.073137 Oct 22 03:37:42.809997 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2976/6068] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:37:42 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:37:42.818823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af4c3bde-1573-4f15-a78c-c4ec152453fa tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '.version_select at 0x7f0d18c2ce50>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:37:42.824038 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af4c3bde-1573-4f15-a78c-c4ec152453fa tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [a645337b-1e79-45c9-beee-538ed076e062] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 03:37:43.833912 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [None req-af4c3bde-1573-4f15-a78c-c4ec152453fa tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [a645337b-1e79-45c9-beee-538ed076e062] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39952. Oct 22 03:37:43.879602 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af4c3bde-1573-4f15-a78c-c4ec152453fa tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337102627" status: 202 len: 0 microversion: 2.1 time: 1.065583 Oct 22 03:37:43.880487 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3093/6069] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 03:37:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337102627 => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:38:01.177434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1232f8f1-7281-41c0-aaa1-a20a4b17de02 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'create', calling method: .version_select at 0x7f0d192fdb80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1194755811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7R2cDOHAsW8CeYgXxD/2pqyq2lZ5fQrSCDaO2WjgV+Lldnw4qc7K6J5Kj8jYtVAllYHFB+hC3HuXFXScqv64OGsjYnBFNmb7aDFV4bGSI5BleEuS4FczarZru01JbHOA=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:38:01.227742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:01.231319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:01.326003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-1232f8f1-7281-41c0-aaa1-a20a4b17de02 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for project 03e206cc2daf451097f611ac8a89a81f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:38:01.358159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-1232f8f1-7281-41c0-aaa1-a20a4b17de02 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for user 1b27379c40ff401c8480c435a9ff6d09 and project 03e206cc2daf451097f611ac8a89a81f. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:38:01.439190 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1232f8f1-7281-41c0-aaa1-a20a4b17de02 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.276490 Oct 22 03:38:01.454991 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2977/6070] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:38:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:38:04.567791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:04.583563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:04.591981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=36 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:04.593100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:04.595615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:04.596722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:04.597504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:04.599076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:04.602602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:04.603364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:04.633106 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] HTTP exception thrown: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Request method failure captured: Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b HTTP/1.1 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2QIKhMS66djg1gFwHol-eFD7uxV9jlHr2Dp-UfYy5FxM_0k0Zz_OjPmoiNWTdSkwoICevNWMZdJ_1VJS5hjnDL2z31qZdAC0MtiXeoOK_sf0XBSExwRnHDH7jxT9wVXVBIa6nbmqfgRQkllgV1g5Tn00QiUgKj2ouvCthtzD_bMY4Y Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}] Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: da9a6c11ec7640efa8693fadad60259d Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ade47413-492f-4c40-ab26-695bc9f3728b'} Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:38:04.635884 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.644058 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.648005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Returning 404 to user: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:38:04.649916 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6316820d-29f5-497b-bf93-2ca566fd39c9 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 404 len: 111 microversion: 2.1 time: 0.098179 Oct 22 03:38:04.651517 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3094/6071] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:38:04 2022] DELETE /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:38:04.659972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:04.660672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: ade47413-492f-4c40-ab26-695bc9f3728b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:04.680142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:04.685805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:04.686402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:04.687173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:04.687639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:04.688078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:04.741680 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] HTTP exception thrown: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Request method failure captured: Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b HTTP/1.1 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2QIKhMS66djg1gFwHol-eFD7uxV9jlHr2Dp-UfYy5FxM_0k0Zz_OjPmoiNWTdSkwoICevNWMZdJ_1VJS5hjnDL2z31qZdAC0MtiXeoOK_sf0XBSExwRnHDH7jxT9wVXVBIa6nbmqfgRQkllgV1g5Tn00QiUgKj2ouvCthtzD_bMY4Y Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}] Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: da9a6c11ec7640efa8693fadad60259d Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ade47413-492f-4c40-ab26-695bc9f3728b'} Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:38:04.743258 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Returning 404 to user: Instance ade47413-492f-4c40-ab26-695bc9f3728b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c692fec3-40df-4a86-a41c-bf7d220c2470 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b" status: 404 len: 111 microversion: 2.1 time: 0.088740 Oct 22 03:38:04.747333 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2978/6072] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:04 2022] GET /compute/v2.1/servers/ade47413-492f-4c40-ab26-695bc9f3728b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:38:07.534060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-293783298", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "55f41f29-7c37-4d06-b166-c7f47fafb6a4"}], "key_name": "tempest-TestNetworkBasicOps-1194755811", "security_groups": [{"name": "tempest-secgroup-smoke-688813954"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:38:07.903484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] validate_networks() for [('55f41f29-7c37-4d06-b166-c7f47fafb6a4', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:38:09.289543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:38:09.290228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:38:09.290683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:38:09.291202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:38:09.291722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:38:09.313158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:09.313864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:09.314415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:09.315298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:09.315849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:09.316589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:09.393944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for project 03e206cc2daf451097f611ac8a89a81f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:38:09.400792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for user 1b27379c40ff401c8480c435a9ff6d09 and project 03e206cc2daf451097f611ac8a89a81f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:38:09.457977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:38:09.468551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:38:09.604675 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65db20c0-fbd4-4fe1-9f5b-a414f4bf409e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.074461 Oct 22 03:38:09.607381 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3095/6073] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:38:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:38:09.617631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0f51e89-ed86-4f8b-9c2a-301ab1c82885 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:09.618877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0f51e89-ed86-4f8b-9c2a-301ab1c82885 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:10.295801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0f51e89-ed86-4f8b-9c2a-301ab1c82885 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:10.318316 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0f51e89-ed86-4f8b-9c2a-301ab1c82885 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1248 microversion: 2.1 time: 0.693803 Oct 22 03:38:10.338265 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2979/6074] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:09 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1248 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:11.366085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:11.367435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:11.380451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:11.381215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:11.384671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:11.391505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:11.394419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:11.395062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:11.660353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:11.677500 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bea981cd-1c9e-4a34-89eb-699c7a9fd006 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1300 microversion: 2.1 time: 0.316723 Oct 22 03:38:11.679637 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3096/6075] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:11 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1300 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:12.703435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:12.704050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:12.721372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:12.721862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:12.728894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:12.729915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:12.730553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:12.731170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:13.117775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:13.133503 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fc358daa-7594-4ad4-9b4a-df5dcaf15fa4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1306 microversion: 2.1 time: 0.434949 Oct 22 03:38:13.145752 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2980/6076] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:12 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1306 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:13.244588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:13.245089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:13.271320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:13.271873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:13.272350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:13.273541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:13.273641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:13.285699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:13.340247 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] HTTP exception thrown: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Request method failure captured: Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 HTTP/1.1 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2QIKhMS66djg1gFwHol-eFD7uxV9jlHr2Dp-UfYy5FxM_0k0Zz_OjPmoiNWTdSkwoICevNWMZdJ_1VJS5hjnDL2z31qZdAC0MtiXeoOK_sf0XBSExwRnHDH7jxT9wVXVBIa6nbmqfgRQkllgV1g5Tn00QiUgKj2ouvCthtzD_bMY4Y Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}] Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: da9a6c11ec7640efa8693fadad60259d Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '7107260e-38b5-4ece-8d42-3508a91d4e95'} Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:38:13.346231 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.350754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Returning 404 to user: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:38:13.355360 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86f929a2-466d-44ec-bc03-0cc6daf2e928 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 404 len: 111 microversion: 2.1 time: 0.108781 Oct 22 03:38:13.365289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:13.365901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] [instance: 7107260e-38b5-4ece-8d42-3508a91d4e95] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:13.370452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3097/6077] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:38:13 2022] DELETE /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:38:13.383043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:13.383693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:13.384142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:13.385061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:13.385533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:13.385962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:13.438323 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] HTTP exception thrown: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Request method failure captured: Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 HTTP/1.1 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2QIKhMS66djg1gFwHol-eFD7uxV9jlHr2Dp-UfYy5FxM_0k0Zz_OjPmoiNWTdSkwoICevNWMZdJ_1VJS5hjnDL2z31qZdAC0MtiXeoOK_sf0XBSExwRnHDH7jxT9wVXVBIa6nbmqfgRQkllgV1g5Tn00QiUgKj2ouvCthtzD_bMY4Y Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7aab6dcaeb1541729cb8d92b3a361c80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7aab6dcaeb1541729cb8d92b3a361c80"}]}] Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 7aab6dcaeb1541729cb8d92b3a361c80 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-AttachVolumeTestJSON-761491286 Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: da9a6c11ec7640efa8693fadad60259d Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-AttachVolumeTestJSON-761491286-project Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '7107260e-38b5-4ece-8d42-3508a91d4e95'} Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:38:13.456144 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.461216 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:38:13.461216 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:38:13.461216 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:38:13.461216 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:38:13.461216 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:38:13.461216 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. Oct 22 03:38:13.461216 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:38:13.465186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] Returning 404 to user: Instance 7107260e-38b5-4ece-8d42-3508a91d4e95 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:38:13.466777 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9c8d53e-9c4b-45e0-863a-3cdc6e394a33 tempest-AttachVolumeTestJSON-761491286 tempest-AttachVolumeTestJSON-761491286-project] 10.222.0.25 "GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95" status: 404 len: 111 microversion: 2.1 time: 0.105803 Oct 22 03:38:13.485438 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2981/6078] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:13 2022] GET /compute/v2.1/servers/7107260e-38b5-4ece-8d42-3508a91d4e95 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:38:14.173242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:14.173855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:14.184583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:14.185742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:14.186357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:14.187098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:14.187561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:14.188000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:15.292184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:15.316553 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-756df7b0-baa0-4e0d-88cb-7f1f1cdbd3e9 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1306 microversion: 2.1 time: 1.146999 Oct 22 03:38:15.340434 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3098/6079] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:14 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1306 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:16.344035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:16.344780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:16.377094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:16.382799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:16.383922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:16.385713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:16.389958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:16.393943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:16.909867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:16.925278 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c4b67af7-d7ec-4292-9953-2ad6ea640fbb tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1306 microversion: 2.1 time: 0.585174 Oct 22 03:38:16.937975 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2982/6080] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:16 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1306 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:17.954685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:17.955915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:17.963674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:17.964508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:17.982301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:17.983837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:17.991739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:17.992472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:19.338954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:19.424127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:19.625561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:19.656875 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6074f95f-3293-41fc-821e-1c1090c2c018 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 1.701464 Oct 22 03:38:19.658253 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3099/6081] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:17 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:20.686451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:20.687283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:20.704476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:20.709660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:20.710915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:20.712805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:20.717076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:20.719299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:20.720440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:21.529554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:21.548372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e82acb5e-6d6a-4153-98ad-f0f14ff32a90 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 0.868917 Oct 22 03:38:21.549756 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2983/6082] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:20 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:22.577176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:22.578476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:22.586399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:22.593284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:22.595556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:22.596747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:22.600090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:22.600668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:23.528090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-56822eb3-9010-447f-a657-39f6806534ec req-57a6cc00-1555-4add-ae49-f499cf905203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b24d7bc-3acd-4618-be2e-53ff4e3d876e", "tag": "5abfbca1-e9d9-49a5-a2b8-6c2726cac3ae"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:38:23.565481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-56822eb3-9010-447f-a657-39f6806534ec req-57a6cc00-1555-4add-ae49-f499cf905203 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:23.567826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-56822eb3-9010-447f-a657-39f6806534ec req-57a6cc00-1555-4add-ae49-f499cf905203 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:23.569438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-56822eb3-9010-447f-a657-39f6806534ec req-57a6cc00-1555-4add-ae49-f499cf905203 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:23.618899 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-56822eb3-9010-447f-a657-39f6806534ec req-57a6cc00-1555-4add-ae49-f499cf905203 service nova] Creating event network-changed:5abfbca1-e9d9-49a5-a2b8-6c2726cac3ae for instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e on n-h1-862416-2 Oct 22 03:38:23.631734 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-56822eb3-9010-447f-a657-39f6806534ec req-57a6cc00-1555-4add-ae49-f499cf905203 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107513 Oct 22 03:38:23.634061 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2984/6083] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:38:24.726956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:24.739504 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45804cb8-a965-4ef1-b76d-0d739043a7cd tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 2.167074 Oct 22 03:38:24.751391 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3100/6084] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:22 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:25.768395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:25.769120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:25.797850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:25.804856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:25.808486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:25.811407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:25.812730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:25.821062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:27.205452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:27.217667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d618481c-5334-478f-a284-a9a5ec8857ee tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 1.455274 Oct 22 03:38:27.219919 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2985/6085] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:25 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:28.242968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:28.243595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:28.262112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:28.262674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:28.263163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:28.264015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:28.264484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:28.264923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:30.526817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:30.554469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8dd623c9-01dd-4910-9961-9cd7a37e0c35 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 2.312031 Oct 22 03:38:30.572955 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3101/6086] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:28 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:31.580964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:31.581513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:31.585316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:31.607704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:31.608598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:31.612860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:31.613660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:31.614150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:31.616976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:31.622505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=31 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:32.639112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:32.657285 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-da4108a1-80d3-4a53-b3c6-5d4db5949c0b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 1.082076 Oct 22 03:38:32.661399 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2986/6087] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:31 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:38:33.691587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:33.693148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:33.712658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:33.714390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:33.715322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:33.717478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:33.718196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:33.719577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:34.063460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:34.077893 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-88ec1f46-8de4-4042-b352-50b99af6daed tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 0.391663 Oct 22 03:38:34.078532 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3102/6088] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:33 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:35.108911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:35.109544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:35.122380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:35.122895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:35.123338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:35.124068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:35.142003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:35.142482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:36.477780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0efd2363-a108-44ca-8e17-99dd6d25f180 req-d928f3f4-ae52-49ab-a4bd-9e5fa28d2f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b24d7bc-3acd-4618-be2e-53ff4e3d876e", "name": "network-vif-plugged", "status": "completed", "tag": "5abfbca1-e9d9-49a5-a2b8-6c2726cac3ae"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:38:36.503352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:36.512610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0efd2363-a108-44ca-8e17-99dd6d25f180 req-d928f3f4-ae52-49ab-a4bd-9e5fa28d2f6a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:36.522046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0efd2363-a108-44ca-8e17-99dd6d25f180 req-d928f3f4-ae52-49ab-a4bd-9e5fa28d2f6a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:36.523756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0efd2363-a108-44ca-8e17-99dd6d25f180 req-d928f3f4-ae52-49ab-a4bd-9e5fa28d2f6a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:36.555842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=43 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:38:36.593985 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0efd2363-a108-44ca-8e17-99dd6d25f180 req-d928f3f4-ae52-49ab-a4bd-9e5fa28d2f6a service nova] Creating event network-vif-plugged:5abfbca1-e9d9-49a5-a2b8-6c2726cac3ae for instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e on n-h1-862416-2 Oct 22 03:38:36.627574 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0efd2363-a108-44ca-8e17-99dd6d25f180 req-d928f3f4-ae52-49ab-a4bd-9e5fa28d2f6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154016 Oct 22 03:38:36.641063 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3103/6089] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:38:36.721811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:36.747239 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a24c6f8e-060d-4086-90da-8a5d4af16066 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 1.646619 Oct 22 03:38:36.756373 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2987/6090] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:35 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:37.774612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:37.775246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:37.791039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:37.791537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:37.801793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:37.802667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:37.803156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:37.803598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:38.385727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:38.394677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b670cfc-9e2f-410c-87c9-6ceadaa2110d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1373 microversion: 2.1 time: 0.627368 Oct 22 03:38:38.395268 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3104/6091] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:37 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1373 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:39.421066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:39.421944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:39.448904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:39.448904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:39.448904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:39.448904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:39.448904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:39.448904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:40.149503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:40.165309 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5ca3def-242b-4821-985e-ae94958e506c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1545 microversion: 2.1 time: 0.742027 Oct 22 03:38:40.167170 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2988/6092] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:39 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1545 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:38:40.210571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:38:40.211202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:38:40.248676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:40.266784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:40.271821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:40.276181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:38:40.276603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:38:40.277058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:38:40.838018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:38:40.850185 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2fc5c459-4780-4dca-9609-6544cfb9f610 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1545 microversion: 2.1 time: 0.659188 Oct 22 03:38:40.852527 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3105/6093] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:38:40 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1545 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:39:13.561957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:39:13.563360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=17 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:39:13.569165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:13.570311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:13.599553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:13.600915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:13.601369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:13.602108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:13.602572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:13.603004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:13.732245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:39:14.030624 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-902486be-f599-422d-b9f6-d2e0ba20a26f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 204 len: 0 microversion: 2.1 time: 0.469957 Oct 22 03:39:14.031919 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2989/6094] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:39:13 2022] DELETE /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:39:14.041479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:14.042966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:14.047306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:39:14.050961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=13 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:39:14.061424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:14.065158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:14.066085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:14.068476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:14.069288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:14.071128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:14.568320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:39:14.582033 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-56cab901-0f75-4993-8030-0af64f258d80 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1551 microversion: 2.1 time: 0.545653 Oct 22 03:39:14.586366 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3106/6095] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:39:14 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1551 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:39:15.609405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:15.610100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:15.636058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:15.636632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:15.637068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:15.654411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:15.668095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:15.668095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:17.346368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:39:17.361537 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-789d713f-5fe4-42c0-ab84-6a2a229aef28 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1551 microversion: 2.1 time: 1.757505 Oct 22 03:39:17.362389 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2990/6096] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:39:15 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1551 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:39:18.406103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:18.408388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:18.448845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:18.453225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:18.457591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:18.458689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:18.460824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:18.465514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:18.962131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:39:18.986894 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb42a6dd-8f69-4ddc-a36f-7a47622c2c8b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1551 microversion: 2.1 time: 0.588708 Oct 22 03:39:18.992591 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3107/6097] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:39:18 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1551 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:39:20.020077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:20.022668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:20.052717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:20.054849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:20.060084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:20.062123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:20.065827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:20.068934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:20.267205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-96dc69b4-3b8c-4f49-afe0-2fdda6c0da02 req-dde75233-d3bc-4b03-ab38-b6b6af39ef50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b24d7bc-3acd-4618-be2e-53ff4e3d876e", "name": "network-vif-deleted", "tag": "5abfbca1-e9d9-49a5-a2b8-6c2726cac3ae"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:39:20.304652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-96dc69b4-3b8c-4f49-afe0-2fdda6c0da02 req-dde75233-d3bc-4b03-ab38-b6b6af39ef50 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:20.307457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-96dc69b4-3b8c-4f49-afe0-2fdda6c0da02 req-dde75233-d3bc-4b03-ab38-b6b6af39ef50 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:20.307905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-96dc69b4-3b8c-4f49-afe0-2fdda6c0da02 req-dde75233-d3bc-4b03-ab38-b6b6af39ef50 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:20.367631 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-96dc69b4-3b8c-4f49-afe0-2fdda6c0da02 req-dde75233-d3bc-4b03-ab38-b6b6af39ef50 service nova] Creating event network-vif-deleted:5abfbca1-e9d9-49a5-a2b8-6c2726cac3ae for instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e on n-h1-862416-2 Oct 22 03:39:20.381140 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-96dc69b4-3b8c-4f49-afe0-2fdda6c0da02 req-dde75233-d3bc-4b03-ab38-b6b6af39ef50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119260 Oct 22 03:39:20.388392 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3108/6098] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:39:20.399099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:39:20.408295 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6195a15-8779-45c3-bc37-8742cb5a4373 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 200 len: 1484 microversion: 2.1 time: 0.395389 Oct 22 03:39:20.419403 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2991/6099] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:39:20 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 1484 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:39:21.475410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:21.480515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: 1b24d7bc-3acd-4618-be2e-53ff4e3d876e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:21.520396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:21.527285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:21.536872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:21.538157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:21.545432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:21.547679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:21.632585 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] HTTP exception thrown: Instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e could not be found. Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Request method failure captured: Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e HTTP/1.1 Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2UTabsJ2CpJMHQGOIDPPDCXJ7fcohq42-f7ASity5nLbfE0TZJm2tUr8N4YYr6sI3t56YXH46ssJZPnIs3GRCR17A_pn2m1d7PU-q7CDQPpi26oWTHzsMBN1Ws8p0DfbTq1oVmaaTeBn2mV250EPuL4WYM_iLuqsOqjIkUsu7_MlSs Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 03e206cc2daf451097f611ac8a89a81f Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03e206cc2daf451097f611ac8a89a81f"}]}] Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 03e206cc2daf451097f611ac8a89a81f Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestNetworkBasicOps-1365661181-project Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 1b27379c40ff401c8480c435a9ff6d09 Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestNetworkBasicOps-1365661181-project Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e could not be found. Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1b24d7bc-3acd-4618-be2e-53ff4e3d876e'} Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e could not be found. Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e could not be found. Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:39:21.638920 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:39:21.644267 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:39:21.644267 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:39:21.644267 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:39:21.644267 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:39:21.644267 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:39:21.644267 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e could not be found. Oct 22 03:39:21.644267 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:39:21.645540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Returning 404 to user: Instance 1b24d7bc-3acd-4618-be2e-53ff4e3d876e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:39:21.646576 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05705a53-978f-4a1c-8e8e-52b867f151b8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e" status: 404 len: 111 microversion: 2.1 time: 0.203223 Oct 22 03:39:21.647974 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3109/6100] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:39:21 2022] GET /compute/v2.1/servers/1b24d7bc-3acd-4618-be2e-53ff4e3d876e => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:39:22.166816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-254d9d2f-4532-4414-98f1-9da4f0483eaa tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '.version_select at 0x7f0d192fdb80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:22.224304 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-254d9d2f-4532-4414-98f1-9da4f0483eaa tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1194755811" status: 202 len: 0 microversion: 2.1 time: 0.063445 Oct 22 03:39:22.231380 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2992/6101] 10.222.0.25 () {58 vars in 1257 bytes} [Sat Oct 22 03:39:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1194755811 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:39:30.396508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:30.404948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:30.407294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4c70cb5b-68f6-48e3-bb8f-f8a77224c1cb req-baf6c33c-3361-4327-bfc0-8ac10a55ba0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2d15b96-d91c-47d6-91ef-e1177a5e77b2", "tag": "7bebec55-56b9-43b4-91bb-9112aad214ce"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:39:30.425280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:30.439660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:30.440115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:30.440834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:39:30.442971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:30.453681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:30.454324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:30.479423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4c70cb5b-68f6-48e3-bb8f-f8a77224c1cb req-baf6c33c-3361-4327-bfc0-8ac10a55ba0a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:30.481525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4c70cb5b-68f6-48e3-bb8f-f8a77224c1cb req-baf6c33c-3361-4327-bfc0-8ac10a55ba0a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:30.482976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4c70cb5b-68f6-48e3-bb8f-f8a77224c1cb req-baf6c33c-3361-4327-bfc0-8ac10a55ba0a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:30.517372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4c70cb5b-68f6-48e3-bb8f-f8a77224c1cb req-baf6c33c-3361-4327-bfc0-8ac10a55ba0a service nova] Creating event network-changed:7bebec55-56b9-43b4-91bb-9112aad214ce for instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 on n-h2-862416-2 Oct 22 03:39:30.531489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4c70cb5b-68f6-48e3-bb8f-f8a77224c1cb req-baf6c33c-3361-4327-bfc0-8ac10a55ba0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132841 Oct 22 03:39:30.533209 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2993/6102] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:39:30.547609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:39:30.833556 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a746e49-e6de-4fa8-ba0b-43182a2d52d2 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 204 len: 0 microversion: 2.1 time: 0.440932 Oct 22 03:39:30.835886 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3110/6103] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:39:30 2022] DELETE /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:39:30.847136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:30.848264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:30.866981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:30.871865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:30.874483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:30.878543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:30.879507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:30.881250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:31.584759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:39:31.600688 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08426a44-8a72-44a9-ade7-e33e59321a7b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1668 microversion: 2.1 time: 0.758684 Oct 22 03:39:31.623688 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2994/6104] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:39:30 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1668 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:39:32.635574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:32.637896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:32.657064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:32.657323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:32.658578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:32.663634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:32.665300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:32.666237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:33.450636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-92562f7d-3d1b-4508-bfd4-da8c861e0296 req-86ad8e1b-2191-4dc9-9cd0-57665f137058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d15b96-d91c-47d6-91ef-e1177a5e77b2", "name": "network-vif-deleted", "tag": "7bebec55-56b9-43b4-91bb-9112aad214ce"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:39:33.474721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-92562f7d-3d1b-4508-bfd4-da8c861e0296 req-86ad8e1b-2191-4dc9-9cd0-57665f137058 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:33.483103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-92562f7d-3d1b-4508-bfd4-da8c861e0296 req-86ad8e1b-2191-4dc9-9cd0-57665f137058 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:33.484415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-92562f7d-3d1b-4508-bfd4-da8c861e0296 req-86ad8e1b-2191-4dc9-9cd0-57665f137058 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:33.520507 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-92562f7d-3d1b-4508-bfd4-da8c861e0296 req-86ad8e1b-2191-4dc9-9cd0-57665f137058 service nova] Creating event network-vif-deleted:7bebec55-56b9-43b4-91bb-9112aad214ce for instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 on n-h2-862416-2 Oct 22 03:39:33.536989 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-92562f7d-3d1b-4508-bfd4-da8c861e0296 req-86ad8e1b-2191-4dc9-9cd0-57665f137058 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085291 Oct 22 03:39:33.545082 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2995/6105] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:39:34.434592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:39:34.443448 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0a9b1eb9-0ba4-4657-90d9-0837ca61626a tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 200 len: 1668 microversion: 2.1 time: 1.812611 Oct 22 03:39:34.461484 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3111/6106] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:39:32 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 1668 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:39:35.489609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:35.490905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: d2d15b96-d91c-47d6-91ef-e1177a5e77b2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:39:35.512916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:35.515155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:35.517188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:35.519597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:39:35.524197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:39:35.525729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:39:35.584196 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] HTTP exception thrown: Instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 could not be found. Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Request method failure captured: Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 HTTP/1.1 Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2UTabsJ2CpJMHQGOIDPPDCXJ7fcohq42-f7ASity5nLbfE0TZJm2tUr8N4YYr6sI3t56YXH46ssJZPnIs3GRCR17A_pn2m1d7PU-q7CDQPpi26oWTHzsMBN1Ws8p0DfbTq1oVmaaTeBn2mV250EPuL4WYM_iLuqsOqjIkUsu7_MlSs Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 03e206cc2daf451097f611ac8a89a81f Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03e206cc2daf451097f611ac8a89a81f"}]}] Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 03e206cc2daf451097f611ac8a89a81f Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestNetworkBasicOps-1365661181-project Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 1b27379c40ff401c8480c435a9ff6d09 Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestNetworkBasicOps-1365661181-project Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 could not be found. Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd2d15b96-d91c-47d6-91ef-e1177a5e77b2'} Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 could not be found. Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 could not be found. Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:39:35.589557 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:39:35.594264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:39:35.594264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:39:35.594264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:39:35.594264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:39:35.594264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:39:35.594264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 could not be found. Oct 22 03:39:35.594264 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:39:35.594264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Returning 404 to user: Instance d2d15b96-d91c-47d6-91ef-e1177a5e77b2 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:39:35.594846 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5debb055-cbac-45b2-8c5c-9157ee3cae92 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2" status: 404 len: 111 microversion: 2.1 time: 0.116284 Oct 22 03:39:35.595976 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2996/6107] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:39:35 2022] GET /compute/v2.1/servers/d2d15b96-d91c-47d6-91ef-e1177a5e77b2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:39:36.601307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b260a703-645a-47ff-b581-2787b835ea34 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '.version_select at 0x7f0d1aa0f040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:39:36.670055 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b260a703-645a-47ff-b581-2787b835ea34 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-391862357" status: 202 len: 0 microversion: 2.1 time: 0.074163 Oct 22 03:39:36.672074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3112/6108] 10.222.0.25 () {58 vars in 1254 bytes} [Sat Oct 22 03:39:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-391862357 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:40:08.819364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:08.820258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:09.616073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ad88bcf-6427-4667-9be1-cb0990a89bcb tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-720287366", "availability_zone": "foo_zone"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:09.687697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.aggregate [None req-2ad88bcf-6427-4667-9be1-cb0990a89bcb tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Generated uuid d43fbe6e-2de5-4f19-94ac-f035e1248807 for aggregate {{(pid=120582) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 22 03:40:09.780328 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ad88bcf-6427-4667-9be1-cb0990a89bcb tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.974633 Oct 22 03:40:09.781495 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2997/6109] 10.222.0.25 () {60 vars in 1164 bytes} [Sat Oct 22 03:40:08 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:09.795579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b6161ab-90f3-4186-b221-0f1fdd0dc272 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:09.829386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:09.834463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:09.918065 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b6161ab-90f3-4186-b221-0f1fdd0dc272 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.126043 Oct 22 03:40:09.922163 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3113/6110] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:40:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:40:09.937516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8e4459b0-2a48-4021-89f1-f74e0982e421 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:09.950187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e4459b0-2a48-4021-89f1-f74e0982e421 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:09.952403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e4459b0-2a48-4021-89f1-f74e0982e421 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:09.952885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e4459b0-2a48-4021-89f1-f74e0982e421 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:09.955428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e4459b0-2a48-4021-89f1-f74e0982e421 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:09.955908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e4459b0-2a48-4021-89f1-f74e0982e421 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:09.956388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8e4459b0-2a48-4021-89f1-f74e0982e421 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:10.037921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8e4459b0-2a48-4021-89f1-f74e0982e421 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.106045 Oct 22 03:40:10.041448 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2998/6111] 10.222.0.25 () {58 vars in 1176 bytes} [Sat Oct 22 03:40:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:10.054164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b5fdef3-0d8c-4d76-ad26-1bd2cbed2b72 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:10.069887 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b5fdef3-0d8c-4d76-ad26-1bd2cbed2b72 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019597 Oct 22 03:40:10.076577 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3114/6112] 10.222.0.25 () {58 vars in 1143 bytes} [Sat Oct 22 03:40:10 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:10.086813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86517464-2876-40f7-a7c9-ffb86e52776a tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862416-2"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:10.157895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86517464-2876-40f7-a7c9-ffb86e52776a tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:10.158752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86517464-2876-40f7-a7c9-ffb86e52776a tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:10.159439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86517464-2876-40f7-a7c9-ffb86e52776a tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:10.982387 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86517464-2876-40f7-a7c9-ffb86e52776a tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.899513 Oct 22 03:40:10.986578 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 2999/6113] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:40:10 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:40:10.998821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-330fdb56-aba0-499c-ba8f-92a61c44b68c tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:11.017142 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-330fdb56-aba0-499c-ba8f-92a61c44b68c tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.024257 Oct 22 03:40:11.018358 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3115/6114] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:40:10 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:11.031839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2c8bfc84-3e25-489e-bec7-7fdd730c0210 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-647803648", "availability_zone": "foo_zone"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:11.169236 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2c8bfc84-3e25-489e-bec7-7fdd730c0210 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.140088 Oct 22 03:40:11.170522 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3000/6115] 10.222.0.25 () {60 vars in 1173 bytes} [Sat Oct 22 03:40:11 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:11.187614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e09a5aa-f340-478f-89f1-671a4f1358ce tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:11.288461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e09a5aa-f340-478f-89f1-671a4f1358ce tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.110109 Oct 22 03:40:11.300849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82750ce2-d804-45c9-94a2-ab5a3ae30b20 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:11.309912 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3116/6116] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:40:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:11.319879 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82750ce2-d804-45c9-94a2-ab5a3ae30b20 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.022858 Oct 22 03:40:11.327578 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3001/6117] 10.222.0.25 () {58 vars in 1152 bytes} [Sat Oct 22 03:40:11 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:11.339442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b907fe63-7e13-48ee-90ce-06784e3808a0 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862416-2"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:11.379403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b907fe63-7e13-48ee-90ce-06784e3808a0 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:11.379919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b907fe63-7e13-48ee-90ce-06784e3808a0 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:11.380397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b907fe63-7e13-48ee-90ce-06784e3808a0 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:12.215461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b907fe63-7e13-48ee-90ce-06784e3808a0 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.879168 Oct 22 03:40:12.218835 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3117/6118] 10.222.0.25 () {60 vars in 1194 bytes} [Sat Oct 22 03:40:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:40:12.229051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-287e7821-6fa2-40db-a163-5f05718f2a52 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:12.329039 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-287e7821-6fa2-40db-a163-5f05718f2a52 tempest-TestAggregatesBasicOps-68495616 tempest-TestAggregatesBasicOps-68495616-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.104248 Oct 22 03:40:12.329640 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3002/6119] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Oct 22 03:40:12 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 22 03:40:19.192146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dca27ab5-aac4-4abb-b346-fe94c48ce550 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'create', calling method: .version_select at 0x7f0d18c25820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-355678420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9yEHa1jtnH0ACGWr3IxV7WV+4iTfQXOfJz2EMrtpbwPrD5YassMqcinZUn3BWqSS6bNQM2wPouJKLLRriqgFZeIaFV19ohy5rFUFsZDDvskzhUAFnbylr7Clh7xL3rQA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:19.240110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-dca27ab5-aac4-4abb-b346-fe94c48ce550 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for project 03e206cc2daf451097f611ac8a89a81f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:40:19.260700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-dca27ab5-aac4-4abb-b346-fe94c48ce550 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for user 1b27379c40ff401c8480c435a9ff6d09 and project 03e206cc2daf451097f611ac8a89a81f. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:40:19.339747 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dca27ab5-aac4-4abb-b346-fe94c48ce550 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.151594 Oct 22 03:40:19.341779 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3118/6120] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:40:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:40:28.930459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:28.933755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:28.934676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:28.941667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-677653699", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "9302c493-369e-4a3b-bc6d-810ff3d69c7a"}], "key_name": "tempest-TestNetworkBasicOps-355678420", "security_groups": [{"name": "tempest-secgroup-smoke-1965175271"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:29.864303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:29.867190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:29.869182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:29.977718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] validate_networks() for [('9302c493-369e-4a3b-bc6d-810ff3d69c7a', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:40:30.337821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-524290289", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "dfa45942-0b96-4777-8a21-aa0cc559d4e2"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:31.071377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] validate_networks() for [('dfa45942-0b96-4777-8a21-aa0cc559d4e2', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:40:31.324061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:40:31.324631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:40:31.325070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:40:31.325487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:40:31.325911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:40:31.354955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:31.355738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:31.356417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:31.357470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:31.358115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:31.358732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:31.399224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for project 03e206cc2daf451097f611ac8a89a81f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:40:31.417643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Getting quotas for user 1b27379c40ff401c8480c435a9ff6d09 and project 03e206cc2daf451097f611ac8a89a81f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:40:31.440712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:40:31.443120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:40:31.549277 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cf56f415-0948-4b3e-bc6f-a2d11637f34c tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.620904 Oct 22 03:40:31.556535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3003/6121] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:40:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:40:31.562173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3da29886-a09a-4b0d-8749-d39112efdf23 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:31.562982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3da29886-a09a-4b0d-8749-d39112efdf23 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:31.744256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3da29886-a09a-4b0d-8749-d39112efdf23 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:31.758351 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3da29886-a09a-4b0d-8749-d39112efdf23 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1247 microversion: 2.1 time: 0.200351 Oct 22 03:40:31.758860 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3004/6122] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:31 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1247 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:40:32.790159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:32.790159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:32.800072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:32.800776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:32.801088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:32.801829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:32.802328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:32.802727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:33.039383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:33.053421 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e151234a-0321-4d9a-8e82-3df79ad8bf17 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1243 microversion: 2.1 time: 0.274982 Oct 22 03:40:33.054339 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3005/6123] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:32 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1243 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:40:34.078284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:34.079708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:34.089388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:34.092953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:34.097410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:34.098776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:34.099480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:34.100153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:34.397741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:34.406337 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb151cc6-373d-44fb-9980-ed69585e9205 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1305 microversion: 2.1 time: 0.332264 Oct 22 03:40:34.413874 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3006/6124] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:34 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1305 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:34.693403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:40:34.695037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:40:34.695928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:40:34.697510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:40:34.698164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:40:34.719756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:34.720575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:34.721356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:34.722347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:34.723132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:34.723893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:34.756381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Getting quotas for project b9690fc7c29040a3b0320ef5a16e3474. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:40:34.767881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Getting quotas for user 71f6651998a44e598d3a7cf94bff1410 and project b9690fc7c29040a3b0320ef5a16e3474. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:40:34.785057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:40:34.789412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:40:34.908371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-822d9c1e-0c96-49f1-88d0-17a5e5dfa932 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.045514 Oct 22 03:40:34.909321 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3119/6125] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:40:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 5047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:40:34.921973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a4f5527-6f21-4052-8b85-76e03fa4da69 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:34.922781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a4f5527-6f21-4052-8b85-76e03fa4da69 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:35.438670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:35.439631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:35.450745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:35.454717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:35.459680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:35.460837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:35.461650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:35.462953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:35.649111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:35.657947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e76ea15-f322-4a88-9735-a7b8cdef8b6b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1305 microversion: 2.1 time: 0.223148 Oct 22 03:40:35.658554 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3120/6126] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:35 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:40:35.686767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a4f5527-6f21-4052-8b85-76e03fa4da69 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:35.703463 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a4f5527-6f21-4052-8b85-76e03fa4da69 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1213 microversion: 2.1 time: 0.786316 Oct 22 03:40:35.704400 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3007/6127] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:34 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1213 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:36.687940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:36.688935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:36.696880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:36.702008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:36.702522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:36.712605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:36.713749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:36.716754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:36.733596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:36.735175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:36.763019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:36.764573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:36.767280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:36.768395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:36.769043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:36.769655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:36.907510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:36.921027 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ebf0cf4-cb97-4b8d-a219-ac348f656ec7 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1305 microversion: 2.1 time: 0.236969 Oct 22 03:40:36.924564 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3121/6128] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:36 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1305 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:36.986831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:36.995952 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1372f65e-0cb8-4344-8b03-d44dc6777548 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1273 microversion: 2.1 time: 0.266597 Oct 22 03:40:37.003997 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3008/6129] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:36 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:37.944677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:37.945270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:37.961880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:37.963184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:37.963589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:37.964356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:37.964817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:37.965312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:38.030878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:38.030878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:38.038799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:38.039320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:38.039757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:38.041210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:38.042835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:38.042835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:38.323302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:38.335066 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5cf4b04f-da46-4a7a-b738-ddda525adaf5 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1271 microversion: 2.1 time: 0.311990 Oct 22 03:40:38.335927 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3009/6130] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:38 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1271 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:40:39.000032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:39.011680 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e4b9d7e1-c935-4b5f-b334-0bc4d583a445 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 1.070729 Oct 22 03:40:39.015020 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3122/6131] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:37 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:39.374557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:39.375342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:39.390122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:39.390862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:39.392060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:39.395042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:39.396175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:39.398264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:39.936930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:39.947053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ca3e196-0c8e-4554-9b6f-3f80b9421ebb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1271 microversion: 2.1 time: 0.577991 Oct 22 03:40:39.948005 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3010/6132] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:39 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1271 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:40.057175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:40.057925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:40.084474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:40.084700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:40.086627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:40.088128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:40.089285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:40.090524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:40.974735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:40.976279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:40.989819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:40.995805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:40.996528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:40.997819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:40.998946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:40.999549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:41.378437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:41.416860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:41.435054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8ce711d-a58d-41fe-95a6-29af38585f0e tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 1.396554 Oct 22 03:40:41.475781 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3123/6133] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:40 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:42.151810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1969bc51-707a-4585-b6f6-c68cecda8fad req-e2ef815b-af37-45a4-bb74-9d39b17bd498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bc82ea-a675-4ac0-ba28-4d725303c6bb", "tag": "f6327170-72fa-4c5f-9325-91796d3acb21"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:42.176279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1969bc51-707a-4585-b6f6-c68cecda8fad req-e2ef815b-af37-45a4-bb74-9d39b17bd498 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:42.176954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1969bc51-707a-4585-b6f6-c68cecda8fad req-e2ef815b-af37-45a4-bb74-9d39b17bd498 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:42.177567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1969bc51-707a-4585-b6f6-c68cecda8fad req-e2ef815b-af37-45a4-bb74-9d39b17bd498 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:42.206628 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1969bc51-707a-4585-b6f6-c68cecda8fad req-e2ef815b-af37-45a4-bb74-9d39b17bd498 service nova] Creating event network-changed:f6327170-72fa-4c5f-9325-91796d3acb21 for instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb on n-h1-862416-2 Oct 22 03:40:42.232222 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1969bc51-707a-4585-b6f6-c68cecda8fad req-e2ef815b-af37-45a4-bb74-9d39b17bd498 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.360979 Oct 22 03:40:42.233728 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3124/6134] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:42.465811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:42.469090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:42.484080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:42.490204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:42.492734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:42.497301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:42.498122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:42.498773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:42.836021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:42.858981 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-00098046-7c1e-4de0-8da8-49fda6dde4d9 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 1.892581 Oct 22 03:40:42.862354 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3011/6135] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:40 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:43.887786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:43.889038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:43.905251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:43.911184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:43.911657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:43.912454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:43.912928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:43.913366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:44.610583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:44.619843 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8e8be92-4543-46df-a573-d6b4d204206f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 2.164185 Oct 22 03:40:44.633379 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3125/6136] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:42 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:45.236657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:45.258615 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5befebbe-c503-4fc7-ab98-b927898ff4f7 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 1.372386 Oct 22 03:40:45.260062 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3012/6137] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:43 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:40:45.659666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:45.660856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:45.663052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:45.664366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:45.689479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:45.689991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:45.693703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:45.696676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:45.699653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:45.700316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:46.026730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:46.034616 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f8f471d5-fb19-48e9-9fd2-a7d7ceaa4041 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 0.378868 Oct 22 03:40:46.039181 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3126/6138] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:45 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:46.285228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:46.285912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:46.287860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:46.302144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:46.304386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:46.304991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:46.310708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:46.320175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:46.321003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:47.069147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:47.069820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:47.077466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:47.086544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:47.087642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:47.088679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:47.089364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:47.090089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:47.398061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:47.419993 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80589b88-e5df-444f-a279-60d27b8d558f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 1.138714 Oct 22 03:40:47.437440 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3013/6139] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:46 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:47.651921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:47.667445 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ba90048-b6b6-4f26-9d2b-72511b7d6229 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 0.604112 Oct 22 03:40:47.712348 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3127/6140] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:47 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:48.447137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:48.447751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:48.455655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:48.460305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:48.460985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:48.467891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:48.469447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:48.473185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:49.358760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:49.359379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:49.378587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:49.379131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:49.381253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:49.384556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:49.387823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:49.388325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:49.736434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:49.747554 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-60ad5eb6-1e97-4e5e-9285-4b6001b7c792 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 1.052010 Oct 22 03:40:49.770450 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3128/6141] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:48 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:40:49.779445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e46f2aea-7402-488e-b2c0-81f9b90c5599 req-6a06fa9c-d64b-4991-91d3-767c3c4f7e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e24550-0a64-42ca-bf18-46194acaeb15", "tag": "67c2e68d-986d-4d42-83fb-b82e566df8dd"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:49.811252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e46f2aea-7402-488e-b2c0-81f9b90c5599 req-6a06fa9c-d64b-4991-91d3-767c3c4f7e2f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:49.814123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e46f2aea-7402-488e-b2c0-81f9b90c5599 req-6a06fa9c-d64b-4991-91d3-767c3c4f7e2f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:49.814779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e46f2aea-7402-488e-b2c0-81f9b90c5599 req-6a06fa9c-d64b-4991-91d3-767c3c4f7e2f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:49.845847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e46f2aea-7402-488e-b2c0-81f9b90c5599 req-6a06fa9c-d64b-4991-91d3-767c3c4f7e2f service nova] Creating event network-changed:67c2e68d-986d-4d42-83fb-b82e566df8dd for instance 63e24550-0a64-42ca-bf18-46194acaeb15 on n-h2-862416-2 Oct 22 03:40:49.859064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e46f2aea-7402-488e-b2c0-81f9b90c5599 req-6a06fa9c-d64b-4991-91d3-767c3c4f7e2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086243 Oct 22 03:40:49.860579 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3129/6142] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:50.780624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:50.782485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:50.811363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:50.812105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:50.812911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:50.813911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:50.814581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:50.815264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:50.909983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:50.929207 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5cdf571d-4b52-4cd5-acfc-bb7386e52304 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 2.485220 Oct 22 03:40:50.932264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3014/6143] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:48 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:51.147360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:51.160432 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2dba4202-ddcb-4f52-a072-db33ba90b25b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 0.386739 Oct 22 03:40:51.161613 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3130/6144] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:50 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:51.956817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:51.957558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:51.974103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:51.981229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:51.984685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:51.989599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:51.992571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:51.997176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:52.187687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:52.189710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:52.206037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:52.206812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:52.207411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:52.208325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:52.208933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:52.210136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:52.616425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:52.641864 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3584dbe3-610a-4271-b33d-3097059ed2db tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 0.686949 Oct 22 03:40:52.642732 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3015/6145] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:51 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:52.646525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:52.657316 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b945f57-a820-43cd-a75e-4a8de72ef7ec tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 0.475008 Oct 22 03:40:52.660505 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3131/6146] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:52 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:53.675495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:53.681088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:53.685508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:53.686139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:53.705105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:53.705951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:53.706554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:53.707456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:53.708068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:53.709224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:53.714125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:53.718270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:53.719582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:53.723261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:53.724399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:53.729606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:54.278639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:54.299131 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-189c2be7-6c2c-4e9b-946d-49c095439a95 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 0.618627 Oct 22 03:40:54.300330 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3132/6147] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:53 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:40:54.504047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:54.532281 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-21d4e94d-7b64-4113-bb34-5dff028f5df4 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 0.853755 Oct 22 03:40:54.533008 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3016/6148] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:53 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:55.329323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:55.331135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:55.340695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:55.348897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:55.352858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:55.353767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:55.356904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:55.357624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:56.126708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1b43fe35-9a96-4924-b46a-e691b5b038c1 req-2bdcf4b6-f798-4ddd-9e2e-2e011278ba99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bc82ea-a675-4ac0-ba28-4d725303c6bb", "name": "network-vif-plugged", "status": "completed", "tag": "f6327170-72fa-4c5f-9325-91796d3acb21"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:40:56.144292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1b43fe35-9a96-4924-b46a-e691b5b038c1 req-2bdcf4b6-f798-4ddd-9e2e-2e011278ba99 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:56.144815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1b43fe35-9a96-4924-b46a-e691b5b038c1 req-2bdcf4b6-f798-4ddd-9e2e-2e011278ba99 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:56.145409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1b43fe35-9a96-4924-b46a-e691b5b038c1 req-2bdcf4b6-f798-4ddd-9e2e-2e011278ba99 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:56.177575 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1b43fe35-9a96-4924-b46a-e691b5b038c1 req-2bdcf4b6-f798-4ddd-9e2e-2e011278ba99 service nova] Creating event network-vif-plugged:f6327170-72fa-4c5f-9325-91796d3acb21 for instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb on n-h1-862416-2 Oct 22 03:40:56.185884 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1b43fe35-9a96-4924-b46a-e691b5b038c1 req-2bdcf4b6-f798-4ddd-9e2e-2e011278ba99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.836506 Oct 22 03:40:56.188844 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3017/6149] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:40:56.196513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:56.208850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:56.232575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:56.234368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:56.237203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:56.239910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:56.240033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:56.240689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:56.242237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:56.260168 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5db40404-b052-4a69-992d-7ad90fac2c2d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 0.927411 Oct 22 03:40:56.270408 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3133/6150] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:55 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:56.915041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:56.949618 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2f899bb-4e3d-497c-922d-365a40669f17 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 0.756960 Oct 22 03:40:56.952427 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3018/6151] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:56 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:57.288500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:57.289128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:57.299612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:57.303489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:57.303986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:57.304757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:57.305262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:57.305731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:57.875913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:57.914509 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3cf1c2e4-ac96-4ddd-806a-eedbbba372f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1373 microversion: 2.1 time: 0.614121 Oct 22 03:40:57.919175 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3134/6152] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:57 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1373 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:57.983526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:57.984137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:57.993636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:57.994359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:57.995068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:57.995939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:57.996603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:57.997185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:58.542172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:58.556360 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-03050f8d-8ea9-4866-9d24-1d9e97be4f4f tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 0.576686 Oct 22 03:40:58.557951 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3019/6153] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:57 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:58.943916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:58.944970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:58.959131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:58.959340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:58.959793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:58.960547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:58.976601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:58.977776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:59.583487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:59.584799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:59.589239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:59.614120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:59.616853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:59.617512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:59.619292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:59.620488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:59.625043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:59.638438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=83 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:40:59.832033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:40:59.854232 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfad7f05-1278-40c6-b73c-733fdd674dd3 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1544 microversion: 2.1 time: 0.914742 Oct 22 03:40:59.858163 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3135/6154] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:58 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1544 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:40:59.896101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:40:59.897361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:40:59.918000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:59.920259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:59.920991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:59.924257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:40:59.925006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:40:59.928879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:40:59.938976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=91 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:41:00.413476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:00.426709 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb4a18a1-54aa-4509-8d13-8b840239de45 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 0.844092 Oct 22 03:41:00.445202 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3020/6155] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:59 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:00.608784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-3f06af3b-cf03-462f-bacc-925270baf037 req-7fe7a026-d8c8-4bfd-aea5-a5af55c5c500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e24550-0a64-42ca-bf18-46194acaeb15", "name": "network-vif-plugged", "status": "completed", "tag": "67c2e68d-986d-4d42-83fb-b82e566df8dd"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:41:00.679017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3f06af3b-cf03-462f-bacc-925270baf037 req-7fe7a026-d8c8-4bfd-aea5-a5af55c5c500 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:00.686710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3f06af3b-cf03-462f-bacc-925270baf037 req-7fe7a026-d8c8-4bfd-aea5-a5af55c5c500 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:00.687244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-3f06af3b-cf03-462f-bacc-925270baf037 req-7fe7a026-d8c8-4bfd-aea5-a5af55c5c500 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:00.729801 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-3f06af3b-cf03-462f-bacc-925270baf037 req-7fe7a026-d8c8-4bfd-aea5-a5af55c5c500 service nova] Creating event network-vif-plugged:67c2e68d-986d-4d42-83fb-b82e566df8dd for instance 63e24550-0a64-42ca-bf18-46194acaeb15 on n-h2-862416-2 Oct 22 03:41:00.737037 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-3f06af3b-cf03-462f-bacc-925270baf037 req-7fe7a026-d8c8-4bfd-aea5-a5af55c5c500 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132592 Oct 22 03:41:00.738265 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3021/6156] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:41:01.075494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:01.111954 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ddc043e5-1bd2-4498-821d-a529d0ffe582 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1544 microversion: 2.1 time: 1.228046 Oct 22 03:41:01.121093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3136/6157] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:40:59 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1544 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:41:01.453859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:01.455826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:01.471025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:01.471823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:01.472532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:01.482893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:01.484140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:01.484823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:02.061580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:02.076676 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd9d9496-c8c6-4909-8441-c749654b6f18 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1313 microversion: 2.1 time: 0.625521 Oct 22 03:41:02.078146 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3022/6158] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:01 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:03.105438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:03.106663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:03.116110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:41:03.123027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:03.134229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:03.135615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:03.137833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:03.140438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:03.141043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:03.882472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:03.898398 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8fd7df4-0cc8-4695-8ab5-bb929b268e0d tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1496 microversion: 2.1 time: 0.796460 Oct 22 03:41:03.901801 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3137/6159] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:03 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1496 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:07.516353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9407ac52-3f2b-46fc-89d6-3ac744031b4e req-1f44b25b-0969-4267-bf9b-32c0164c3e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bc82ea-a675-4ac0-ba28-4d725303c6bb", "tag": "f6327170-72fa-4c5f-9325-91796d3acb21"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:41:07.549048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9407ac52-3f2b-46fc-89d6-3ac744031b4e req-1f44b25b-0969-4267-bf9b-32c0164c3e8f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:07.550208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9407ac52-3f2b-46fc-89d6-3ac744031b4e req-1f44b25b-0969-4267-bf9b-32c0164c3e8f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:07.556442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9407ac52-3f2b-46fc-89d6-3ac744031b4e req-1f44b25b-0969-4267-bf9b-32c0164c3e8f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:07.640884 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9407ac52-3f2b-46fc-89d6-3ac744031b4e req-1f44b25b-0969-4267-bf9b-32c0164c3e8f service nova] Creating event network-changed:f6327170-72fa-4c5f-9325-91796d3acb21 for instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb on n-h1-862416-2 Oct 22 03:41:07.659950 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9407ac52-3f2b-46fc-89d6-3ac744031b4e req-1f44b25b-0969-4267-bf9b-32c0164c3e8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148532 Oct 22 03:41:07.691567 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3023/6160] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:41:09.275760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:09.277425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:09.286119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:09.286811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:09.287426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:09.288309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:09.288910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:09.290004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:09.329783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:41:09.481668 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ded30f01-f2b2-47d3-8a3f-6ce4e1bd41ab tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "DELETE /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 204 len: 0 microversion: 2.1 time: 0.210200 Oct 22 03:41:09.482276 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3138/6161] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:41:09 2022] DELETE /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:41:09.491759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:09.493096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:09.506375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:09.506902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:09.509189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:09.509908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:09.511110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:09.511774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:09.765850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:09.776303 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e2961af5-e765-4841-a3a0-59b8b290d797 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1502 microversion: 2.1 time: 0.288761 Oct 22 03:41:09.776909 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3024/6162] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:09 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1502 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:10.803015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:10.803743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:10.814682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:10.815186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:10.815630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:10.829053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:10.829782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:10.830450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:11.171941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:11.180385 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-07b9eb6b-79e9-46f8-9323-616de580d784 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1502 microversion: 2.1 time: 0.381802 Oct 22 03:41:11.192879 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3139/6163] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:10 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:11.769218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-40186920-36b2-4b89-adff-27153d7ef026 req-524e1a4c-ebef-42bb-86be-90c04ab92c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e24550-0a64-42ca-bf18-46194acaeb15", "name": "network-vif-deleted", "tag": "67c2e68d-986d-4d42-83fb-b82e566df8dd"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:41:11.781173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-40186920-36b2-4b89-adff-27153d7ef026 req-524e1a4c-ebef-42bb-86be-90c04ab92c4a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:11.781711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-40186920-36b2-4b89-adff-27153d7ef026 req-524e1a4c-ebef-42bb-86be-90c04ab92c4a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:11.782152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-40186920-36b2-4b89-adff-27153d7ef026 req-524e1a4c-ebef-42bb-86be-90c04ab92c4a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:11.815720 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-40186920-36b2-4b89-adff-27153d7ef026 req-524e1a4c-ebef-42bb-86be-90c04ab92c4a service nova] Creating event network-vif-deleted:67c2e68d-986d-4d42-83fb-b82e566df8dd for instance 63e24550-0a64-42ca-bf18-46194acaeb15 on n-h2-862416-2 Oct 22 03:41:11.822592 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-40186920-36b2-4b89-adff-27153d7ef026 req-524e1a4c-ebef-42bb-86be-90c04ab92c4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057173 Oct 22 03:41:11.823508 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3025/6164] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:41:12.207706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:12.209099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:12.223591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:12.224814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:12.225633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:12.227161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:12.230403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:12.231273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:12.282263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:12.282768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:12.283218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:12.283679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lazy-loading 'fault' on Instance uuid 63e24550-0a64-42ca-bf18-46194acaeb15 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:41:12.372053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f6651998a44e598d3a7cf94bff1410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9690fc7c29040a3b0320ef5a16e3474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:12.384451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6da7c968-f281-4638-a068-89850efd48eb tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 200 len: 1303 microversion: 2.1 time: 0.180710 Oct 22 03:41:12.385346 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3140/6165] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:12 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:13.410484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:13.412445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] [instance: 63e24550-0a64-42ca-bf18-46194acaeb15] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:13.429702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:13.431354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:13.431996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:13.433017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:13.433646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:13.434233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:13.466261 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] HTTP exception thrown: Instance 63e24550-0a64-42ca-bf18-46194acaeb15 could not be found. Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Request method failure captured: Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 HTTP/1.1 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2YnOhPXe_yGNfJwe3BDhfNdMllsjdUi9v7nY9pXHi9uQSxDkQmhROERTsoMPppM6wK6rMmITVixJADyrBvqfDRppYpAJ0PyPf99mKljvUBl9OlWMRXfib90KyF3Y96rUX9Hjej7R8_PxxYebtLOD9BgPDAxmTpBJunrQ03iwXK2wvc Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: b9690fc7c29040a3b0320ef5a16e3474 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-VolumesActionsTest-1695797024 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9690fc7c29040a3b0320ef5a16e3474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9690fc7c29040a3b0320ef5a16e3474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9690fc7c29040a3b0320ef5a16e3474"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9690fc7c29040a3b0320ef5a16e3474"}]}] Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-VolumesActionsTest-1695797024 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: b9690fc7c29040a3b0320ef5a16e3474 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-VolumesActionsTest-1695797024 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-VolumesActionsTest-1695797024-project Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 71f6651998a44e598d3a7cf94bff1410 Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-VolumesActionsTest-1695797024-project Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 63e24550-0a64-42ca-bf18-46194acaeb15 could not be found. Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '63e24550-0a64-42ca-bf18-46194acaeb15'} Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e24550-0a64-42ca-bf18-46194acaeb15 could not be found. Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e24550-0a64-42ca-bf18-46194acaeb15 could not be found. Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:41:13.467827 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:13.471775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:41:13.471775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:41:13.471775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:41:13.471775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:41:13.471775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:41:13.471775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e24550-0a64-42ca-bf18-46194acaeb15 could not be found. Oct 22 03:41:13.471775 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:13.478281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] Returning 404 to user: Instance 63e24550-0a64-42ca-bf18-46194acaeb15 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:41:13.481218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5c165201-eb09-4e08-9f75-53e51bfe3382 tempest-VolumesActionsTest-1695797024 tempest-VolumesActionsTest-1695797024-project] 10.222.0.25 "GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15" status: 404 len: 111 microversion: 2.1 time: 0.075784 Oct 22 03:41:13.483147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3026/6166] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:13 2022] GET /compute/v2.1/servers/63e24550-0a64-42ca-bf18-46194acaeb15 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:41:23.562852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:41:23.565228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:23.568071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:41:23.577912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:41:23.609120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:23.609928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:23.610541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:23.611705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:23.612745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:23.613336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:23.715465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e385683-586b-4a11-8119-9d6ea572072b tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb/action" status: 200 len: 24573 microversion: 2.1 time: 0.156922 Oct 22 03:41:23.716608 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3141/6167] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:41:23 2022] POST /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb/action => generated 24573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:41:34.944920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=13 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:41:34.947016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=25 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:41:34.952057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:41:34.956547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:34.971719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:34.972606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:34.974603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:34.975629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:34.976198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:34.982177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:35.092668 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08583508-648f-411b-9af2-174aad742f72 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "POST /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb/action" status: 200 len: 32640 microversion: 2.1 time: 0.150725 Oct 22 03:41:35.093331 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3027/6168] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:41:34 2022] POST /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb/action => generated 32640 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:41:38.254302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:38.255630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:38.271142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-87905d1c-3ee7-4761-a5dc-3b32932844c9 req-7932d637-9c84-4a32-b4dc-8d05a1f3cf89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bc82ea-a675-4ac0-ba28-4d725303c6bb", "tag": "f6327170-72fa-4c5f-9325-91796d3acb21"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:41:38.279753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:41:38.285766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:41:38.315778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:38.316856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:38.324866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-87905d1c-3ee7-4761-a5dc-3b32932844c9 req-7932d637-9c84-4a32-b4dc-8d05a1f3cf89 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:38.327496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:38.328330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-87905d1c-3ee7-4761-a5dc-3b32932844c9 req-7932d637-9c84-4a32-b4dc-8d05a1f3cf89 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:38.329109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-87905d1c-3ee7-4761-a5dc-3b32932844c9 req-7932d637-9c84-4a32-b4dc-8d05a1f3cf89 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:38.330461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:38.334789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:38.338589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:38.350058 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-87905d1c-3ee7-4761-a5dc-3b32932844c9 req-7932d637-9c84-4a32-b4dc-8d05a1f3cf89 service nova] Creating event network-changed:f6327170-72fa-4c5f-9325-91796d3acb21 for instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb on n-h1-862416-2 Oct 22 03:41:38.357047 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-87905d1c-3ee7-4761-a5dc-3b32932844c9 req-7932d637-9c84-4a32-b4dc-8d05a1f3cf89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090647 Oct 22 03:41:38.362825 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3028/6169] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:41:38.388548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:41:38.691815 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d00cc9e6-349e-42dc-bbd9-f1a312670cf4 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 204 len: 0 microversion: 2.1 time: 0.441143 Oct 22 03:41:38.698668 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3142/6170] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:41:38 2022] DELETE /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:41:38.708041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:38.708782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:38.719908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:38.725652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:38.726355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:38.727274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:38.728758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:38.734722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:39.619194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:39.629907 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f71ea79-4f1f-4151-8214-6f542dce44f1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1669 microversion: 2.1 time: 0.926901 Oct 22 03:41:39.644639 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3029/6171] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:38 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1669 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:40.658984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:40.659701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:40.703544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:40.703839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:40.709683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:40.710643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:40.711148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:40.711598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:41.534748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:41.545406 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fdaeb5c2-0ec9-4a15-b7ec-6096a5a5d24d tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1669 microversion: 2.1 time: 0.890781 Oct 22 03:41:41.566264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3143/6172] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:40 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1669 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:42.302509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-37d79447-c186-4b47-8116-7ca35fddf72c req-9134a59e-a654-41af-b2bc-ee830f0894a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bc82ea-a675-4ac0-ba28-4d725303c6bb", "name": "network-vif-deleted", "tag": "f6327170-72fa-4c5f-9325-91796d3acb21"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:41:42.372826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-37d79447-c186-4b47-8116-7ca35fddf72c req-9134a59e-a654-41af-b2bc-ee830f0894a1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:42.373353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-37d79447-c186-4b47-8116-7ca35fddf72c req-9134a59e-a654-41af-b2bc-ee830f0894a1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:42.377478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-37d79447-c186-4b47-8116-7ca35fddf72c req-9134a59e-a654-41af-b2bc-ee830f0894a1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:42.432429 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-37d79447-c186-4b47-8116-7ca35fddf72c req-9134a59e-a654-41af-b2bc-ee830f0894a1 service nova] Creating event network-vif-deleted:f6327170-72fa-4c5f-9325-91796d3acb21 for instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb on n-h1-862416-2 Oct 22 03:41:42.452078 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-37d79447-c186-4b47-8116-7ca35fddf72c req-9134a59e-a654-41af-b2bc-ee830f0894a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155830 Oct 22 03:41:42.462707 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3030/6173] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:41:42.593123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:42.593733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:42.623185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:42.623699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:42.624144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:42.624904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:42.625366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:42.625802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:42.769248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:42.769747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:42.770190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:42.770657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lazy-loading 'fault' on Instance uuid a6bc82ea-a675-4ac0-ba28-4d725303c6bb {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:41:42.923923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b27379c40ff401c8480c435a9ff6d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e206cc2daf451097f611ac8a89a81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:41:42.933694 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3619f67d-b3ef-4c24-b35c-bcf2f44c90e8 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 200 len: 1337 microversion: 2.1 time: 0.344574 Oct 22 03:41:42.936068 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3144/6174] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:42 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 1337 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:41:43.959094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:43.961623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] [instance: a6bc82ea-a675-4ac0-ba28-4d725303c6bb] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:41:43.998745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:43.999297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:43.999746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:44.015333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:41:44.016097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:41:44.016436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:41:44.077672 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] HTTP exception thrown: Instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb could not be found. Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Request method failure captured: Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb HTTP/1.1 Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2UTabsJ2CpJMHQGOIDPPDCXJ7fcohq42-f7ASity5nLbfE0TZJm2tUr8N4YYr6sI3t56YXH46ssJZPnIs3GRCR17A_pn2m1d7PU-q7CDQPpi26oWTHzsMBN1Ws8p0DfbTq1oVmaaTeBn2mV250EPuL4WYM_iLuqsOqjIkUsu7_MlSs Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 03e206cc2daf451097f611ac8a89a81f Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/03e206cc2daf451097f611ac8a89a81f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/03e206cc2daf451097f611ac8a89a81f"}]}] Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 03e206cc2daf451097f611ac8a89a81f Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestNetworkBasicOps-1365661181 Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestNetworkBasicOps-1365661181-project Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 1b27379c40ff401c8480c435a9ff6d09 Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestNetworkBasicOps-1365661181-project Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb could not be found. Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'a6bc82ea-a675-4ac0-ba28-4d725303c6bb'} Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb could not be found. Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb could not be found. Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:41:44.092647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb could not be found. Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Returning 404 to user: Instance a6bc82ea-a675-4ac0-ba28-4d725303c6bb could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:41:44.096335 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ae9c28a0-b25e-484f-b7e6-97f2ac3200e1 tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb" status: 404 len: 111 microversion: 2.1 time: 0.140828 Oct 22 03:41:44.096857 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3031/6175] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:41:43 2022] GET /compute/v2.1/servers/a6bc82ea-a675-4ac0-ba28-4d725303c6bb => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:41:44.568147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c3fdb93-7d11-4870-a512-7436dfb64a3f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] Calling method '.version_select at 0x7f0d18c4fc10>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:41:44.659307 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c3fdb93-7d11-4870-a512-7436dfb64a3f tempest-TestNetworkBasicOps-1365661181 tempest-TestNetworkBasicOps-1365661181-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-355678420" status: 202 len: 0 microversion: 2.1 time: 0.095104 Oct 22 03:41:44.663964 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3145/6176] 10.222.0.25 () {58 vars in 1254 bytes} [Sat Oct 22 03:41:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-355678420 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:42:06.255029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:06.255929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=16 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:06.467685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1892149197", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "71c2c3f4-bdaa-4aeb-a443-cfc2b0731c0f"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:06.546320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] validate_networks() for [('71c2c3f4-bdaa-4aeb-a443-cfc2b0731c0f', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:42:07.740296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:42:07.740899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:42:07.741537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:42:07.741970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:42:07.742385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:42:07.779154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:07.779740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:07.780462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:07.781419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:07.782033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:07.783065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:07.836696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Getting quotas for project 6e21c8cf0e704145bdaf65ad039d6b95. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:42:07.847659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Getting quotas for user 82412d4cfb6242029c8e852ff6418875 and project 6e21c8cf0e704145bdaf65ad039d6b95. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:42:07.883073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:42:07.886156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:42:07.994277 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b92504de-7f42-4240-a0af-f2cd68eeeb86 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.745729 Oct 22 03:42:07.995657 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3032/6177] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:42:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:42:08.005950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:08.006865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:08.010888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3330d4c3-31dd-4cd8-98cd-f4dc8ed5fd7f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:08.011700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3330d4c3-31dd-4cd8-98cd-f4dc8ed5fd7f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:08.164568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3330d4c3-31dd-4cd8-98cd-f4dc8ed5fd7f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:08.174367 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3330d4c3-31dd-4cd8-98cd-f4dc8ed5fd7f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1215 microversion: 2.1 time: 0.171010 Oct 22 03:42:08.175174 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3146/6178] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:08 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:09.204450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59452acf-44db-451f-9b74-c7ad22ebc8d0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:09.205310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59452acf-44db-451f-9b74-c7ad22ebc8d0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:09.353922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59452acf-44db-451f-9b74-c7ad22ebc8d0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:09.372325 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59452acf-44db-451f-9b74-c7ad22ebc8d0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1215 microversion: 2.1 time: 0.173134 Oct 22 03:42:09.380373 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3033/6179] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:09 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:09.791273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e863537-1e8e-4aab-ba77-d7f7679493d4 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Action: 'create', calling method: .version_select at 0x7f0d1993caf0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1927811448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF74zxXSz+6GISKk1+U9FWExuSZV1ojxMR6vKGVzEtZ+PP/QK1WXSEqsm1Z76341Ohy60E8D0+z3RejO1evbOzYq5FwsX9d2w9rV4gINOkBGJXi6NCNL0rHe0p55sn5eNQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:09.825880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-0e863537-1e8e-4aab-ba77-d7f7679493d4 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Getting quotas for project d79910d8977e45889758c7aaaaaf2f9b. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:42:09.842462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-0e863537-1e8e-4aab-ba77-d7f7679493d4 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Getting quotas for user b3187cbaec48439e977229c245672015 and project d79910d8977e45889758c7aaaaaf2f9b. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:42:09.876524 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e863537-1e8e-4aab-ba77-d7f7679493d4 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.088866 Oct 22 03:42:09.878791 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3147/6180] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:42:09 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:42:10.408749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:10.411926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:10.421491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:10.422245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:10.422908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:10.423814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:10.424582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:10.425209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:10.565176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:10.579271 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86c9672e-0c7c-4b4d-84d7-9657163b3d44 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1273 microversion: 2.1 time: 0.179864 Oct 22 03:42:10.582751 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3034/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:10 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:11.611777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:11.612479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:11.623413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:11.624136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:11.625570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:11.626591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:11.627335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:11.628026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:11.892740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:11.903476 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-843edc74-3b9d-45d7-b124-93584792a2b0 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1315 microversion: 2.1 time: 0.297805 Oct 22 03:42:11.908580 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3148/6182] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:11 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:12.361647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1798672845", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c42cd3a0-95f7-4087-bea9-1ad2406a186a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1927811448", "security_groups": [{"name": "tempest-secgroup-smoke-1164925029"}], "networks": [{"uuid": "d06282dc-4ea4-4872-9ab3-9574aa52c3f0"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:12.901010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] validate_networks() for [('d06282dc-4ea4-4872-9ab3-9574aa52c3f0', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:42:12.930761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:12.931451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:12.950548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:12.953565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:12.955546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:12.958346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:12.968652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:12.969664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:13.973258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:42:13.973745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:42:13.974155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:42:13.974574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:42:13.975029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:42:14.000525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:14.001317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:14.001934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:14.003150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:14.003818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:14.004484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:14.046996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Getting quotas for project d79910d8977e45889758c7aaaaaf2f9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:42:14.061936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Getting quotas for user b3187cbaec48439e977229c245672015 and project d79910d8977e45889758c7aaaaaf2f9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:42:14.138119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:14.190910 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be92d080-3d10-4896-bb7a-712b8209a741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1315 microversion: 2.1 time: 1.263254 Oct 22 03:42:14.199530 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3149/6183] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:12 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1315 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:14.343710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:42:14.345879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c42cd3a0-95f7-4087-bea9-1ad2406a186a',volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:42:14.447079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-58776457-bfe6-4d26-b4fc-8596508f0272 req-6e462057-ab52-456f-b531-872d7dbf97e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d72e12f0-4f6b-4944-8b57-aa6faf641ae5", "tag": "6fc20e74-507d-469c-85b8-d6d1e741eb92"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:14.471530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-58776457-bfe6-4d26-b4fc-8596508f0272 req-6e462057-ab52-456f-b531-872d7dbf97e1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:14.475987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-58776457-bfe6-4d26-b4fc-8596508f0272 req-6e462057-ab52-456f-b531-872d7dbf97e1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:14.476769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-58776457-bfe6-4d26-b4fc-8596508f0272 req-6e462057-ab52-456f-b531-872d7dbf97e1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:14.531205 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-58776457-bfe6-4d26-b4fc-8596508f0272 req-6e462057-ab52-456f-b531-872d7dbf97e1 service nova] Creating event network-changed:6fc20e74-507d-469c-85b8-d6d1e741eb92 for instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 on n-h1-862416-2 Oct 22 03:42:14.581862 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-58776457-bfe6-4d26-b4fc-8596508f0272 req-6e462057-ab52-456f-b531-872d7dbf97e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138572 Oct 22 03:42:14.587960 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3150/6184] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:42:14.764968 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73f6b8a9-34ba-459b-8dc8-978624a29301 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.409127 Oct 22 03:42:14.783167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0318ef61-fe00-4f00-a91b-9f7165ae1b0e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:14.784031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0318ef61-fe00-4f00-a91b-9f7165ae1b0e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:14.789104 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3035/6185] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:42:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 2434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:42:14.900257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0318ef61-fe00-4f00-a91b-9f7165ae1b0e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:14.915021 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0318ef61-fe00-4f00-a91b-9f7165ae1b0e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1099 microversion: 2.1 time: 0.136808 Oct 22 03:42:14.917042 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3151/6186] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:14 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1099 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:15.215399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:15.216052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:15.229880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:15.230424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:15.230867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:15.231735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:15.232293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:15.232738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:15.939238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:15.939859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:15.968172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:15.969019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:15.972885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:15.977597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:15.978471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:15.979565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:16.153153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:16.162659 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23b5273a-b51d-448f-bbf8-bf0480650963 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1149 microversion: 2.1 time: 0.227230 Oct 22 03:42:16.173594 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3152/6187] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:15 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1149 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:16.571225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:16.590354 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0acecfcf-e504-4970-ba8d-6fb8969b3cc8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1315 microversion: 2.1 time: 1.371179 Oct 22 03:42:16.591065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3036/6188] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:15 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1315 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:17.194295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:17.195524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:17.211495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:17.212003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:17.218583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:17.219432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:17.219922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:17.220415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:17.380018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:17.389131 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-755e4430-c897-424f-88a6-73dd44ad379e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1215 microversion: 2.1 time: 0.198559 Oct 22 03:42:17.393427 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3153/6189] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:17 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:17.619609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:17.620227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:17.637661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:17.638191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:17.638657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:17.639456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:17.639941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:17.651451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:18.419961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:18.420894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:18.448540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:18.453383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:18.458696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:18.463643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:18.464495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:18.468109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:18.791645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:18.811517 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e734a92-3a9a-4f7b-832d-d184346c4ac0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1215 microversion: 2.1 time: 0.393216 Oct 22 03:42:18.826774 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3154/6190] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:18 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1215 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:19.025595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:19.037388 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c918dc57-a16a-4247-8ec2-e7df32316294 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1315 microversion: 2.1 time: 1.420034 Oct 22 03:42:19.039745 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3037/6191] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:17 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1315 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:19.839563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:19.841058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:19.853998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:19.854501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:19.854949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:19.855679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:19.856184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:19.856650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:20.069875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:20.070363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:20.086158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:20.086695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:20.092831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:20.093408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:20.100451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:20.101051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:20.592802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:20.601658 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1895df1a-b5a4-4c71-9ab0-bc1e64d6d171 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1283 microversion: 2.1 time: 0.766047 Oct 22 03:42:20.602595 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3155/6192] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:19 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1283 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:21.293720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:21.301662 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-96f655d9-8e04-468d-a036-3b8696f7cb13 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1315 microversion: 2.1 time: 1.240204 Oct 22 03:42:21.302289 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3038/6193] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:20 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1315 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:21.629835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:21.630556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:21.649715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:21.650441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:21.651196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:21.652118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:21.656926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:21.657690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:21.998306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:22.011382 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a4e25d2-f274-4423-9744-6f1343648210 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1283 microversion: 2.1 time: 0.385455 Oct 22 03:42:22.016995 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3156/6194] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:21 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1283 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:22.330372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:22.331002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:22.355337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:22.355775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:22.356164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:22.356930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:22.357393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:22.358237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:22.789997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:22.805602 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b50bbd64-8edb-46df-aa8a-b666e12a23b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1315 microversion: 2.1 time: 0.479131 Oct 22 03:42:22.823690 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3039/6195] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:22 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:23.047880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:23.048604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:23.063228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:23.080265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:23.084965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:23.086448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:23.088355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:23.089221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:23.213814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6b3418a3-6139-40bb-bc75-d2207d0d4d88 req-23921aba-40ae-454e-a419-305dda17d32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72e12f0-4f6b-4944-8b57-aa6faf641ae5", "name": "network-vif-plugged", "status": "completed", "tag": "6fc20e74-507d-469c-85b8-d6d1e741eb92"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:23.234182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6b3418a3-6139-40bb-bc75-d2207d0d4d88 req-23921aba-40ae-454e-a419-305dda17d32d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:23.255421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6b3418a3-6139-40bb-bc75-d2207d0d4d88 req-23921aba-40ae-454e-a419-305dda17d32d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:23.256982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6b3418a3-6139-40bb-bc75-d2207d0d4d88 req-23921aba-40ae-454e-a419-305dda17d32d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:23.300681 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6b3418a3-6139-40bb-bc75-d2207d0d4d88 req-23921aba-40ae-454e-a419-305dda17d32d service nova] Creating event network-vif-plugged:6fc20e74-507d-469c-85b8-d6d1e741eb92 for instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 on n-h1-862416-2 Oct 22 03:42:23.355723 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6b3418a3-6139-40bb-bc75-d2207d0d4d88 req-23921aba-40ae-454e-a419-305dda17d32d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150421 Oct 22 03:42:23.362048 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3040/6196] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:42:23.848519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:23.852399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:23.880201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:23.884643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:23.887096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:23.896150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:23.908156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:23.913372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:24.045623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:24.080527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=14 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:24.191776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:24.212567 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-656efadf-906f-4c0a-aedb-c39adf5b4e18 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1283 microversion: 2.1 time: 1.174228 Oct 22 03:42:24.232553 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3157/6197] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:23 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1283 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:24.232553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c4a66f22-9fcf-48e8-84ec-d17c8bcef98c req-399bcae5-a717-42d4-a9d9-36f8aaec9c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ba011b-625c-4199-90c0-2a725e04851e", "tag": "baa11478-ad36-4d95-b9b2-6c65b3c136a9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:24.299102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4a66f22-9fcf-48e8-84ec-d17c8bcef98c req-399bcae5-a717-42d4-a9d9-36f8aaec9c32 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:24.301643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4a66f22-9fcf-48e8-84ec-d17c8bcef98c req-399bcae5-a717-42d4-a9d9-36f8aaec9c32 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:24.323710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4a66f22-9fcf-48e8-84ec-d17c8bcef98c req-399bcae5-a717-42d4-a9d9-36f8aaec9c32 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:24.346094 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c4a66f22-9fcf-48e8-84ec-d17c8bcef98c req-399bcae5-a717-42d4-a9d9-36f8aaec9c32 service nova] Creating event network-changed:baa11478-ad36-4d95-b9b2-6c65b3c136a9 for instance b3ba011b-625c-4199-90c0-2a725e04851e on n-h2-862416-2 Oct 22 03:42:24.354842 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c4a66f22-9fcf-48e8-84ec-d17c8bcef98c req-399bcae5-a717-42d4-a9d9-36f8aaec9c32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133528 Oct 22 03:42:24.355804 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3158/6198] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:42:24.906897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:24.917683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7adf13a7-859b-4236-b66d-e309bad2f7ed tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1315 microversion: 2.1 time: 1.086001 Oct 22 03:42:24.919494 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3041/6199] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:23 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1315 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:25.263632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:25.264942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:25.274268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:25.276706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:25.277382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:25.277931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:25.279181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:25.279714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:25.280242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:25.660160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:25.675212 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba54ee02-62af-42ee-86aa-7d70d86ac5a5 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1283 microversion: 2.1 time: 0.429585 Oct 22 03:42:25.683071 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3159/6200] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:25 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1283 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:25.945935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:25.946833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:25.982084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:25.987385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:25.987877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:25.993139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:25.994098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:26.000360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:26.723514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:26.724771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:26.742283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:26.765053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:26.776640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:26.802492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:26.807208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:26.807734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:27.148158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:27.164875 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9cdf8b6b-97f5-45d8-9ceb-c6796136efed tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1283 microversion: 2.1 time: 0.456028 Oct 22 03:42:27.166145 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3160/6201] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:26 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1283 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:27.799763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:27.817193 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0ae8ca33-b887-49f2-8b18-052216164f61 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1502 microversion: 2.1 time: 1.878964 Oct 22 03:42:27.822018 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3042/6202] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:25 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1502 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:27.844915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:27.846255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:27.863343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:27.864547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:27.868718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:27.869282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:27.870322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:27.870786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:28.192697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:28.194308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:28.217977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:28.221049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:28.222522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:28.227254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:28.228624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:28.229513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:28.390321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:28.406885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b838e33-38ec-4dab-a83e-eed378aced90 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1502 microversion: 2.1 time: 0.566278 Oct 22 03:42:28.408519 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3161/6203] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:27 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:28.438202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:28.438820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:28.449657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:28.453946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:28.455897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:28.457250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:28.457722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:28.462121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:28.536192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lazy-loading 'flavor' on Instance uuid d72e12f0-4f6b-4944-8b57-aa6faf641ae5 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:42:28.734631 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c3fde40-17ec-4bc3-855d-6a5c201ee741 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "POST /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.303453 Oct 22 03:42:28.735724 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3162/6204] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:42:28 2022] POST /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 03:42:28.745889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:28.746600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:28.773623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:28.774536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:28.777589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:28.778570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:28.779307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:28.779928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:28.812972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:28.828437 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad29cd11-0db1-4809-8530-f1288bf2d6a0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1283 microversion: 2.1 time: 0.640692 Oct 22 03:42:28.830910 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3043/6205] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:28 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1283 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:29.535064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:29.544851 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73eff3cd-3415-4267-ba41-f38224a82e05 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1510 microversion: 2.1 time: 0.804161 Oct 22 03:42:29.546955 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3163/6206] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:28 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1510 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:29.856756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:29.863235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:29.889042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:29.889798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:29.892646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:29.896944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:29.897607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:29.901302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:30.286519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:30.329167 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46a42fa7-5d7f-40d8-9d8d-1ba809673ef0 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1283 microversion: 2.1 time: 0.468466 Oct 22 03:42:30.330596 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3044/6207] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:29 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1283 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:30.574076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:30.574733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:30.588501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:30.589506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:30.593670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:30.604462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:30.606138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:30.612812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:30.852418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:30.869257 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95023435-66c1-4652-80a8-a6fe5b73bfa4 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1493 microversion: 2.1 time: 0.298557 Oct 22 03:42:30.872084 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3164/6208] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:30 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1493 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:30.899643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:30.900194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:30.916280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:30.917273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:30.919146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:30.924501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:30.925298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:30.926159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:31.120341 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3aaa965e-94e1-4270-b842-fff19fc4c84d tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "POST /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.222412 Oct 22 03:42:31.120341 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3045/6209] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:42:30 2022] POST /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:42:31.131824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:31.136011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:31.168999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:31.169521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:31.169973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:31.170828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:31.171270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:31.171828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:31.201080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:31.356505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:31.357714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:31.370171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:31.370975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:31.374093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:31.375609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:31.378726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:31.379395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:31.465063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:31.488111 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a69bc4b-8a01-445b-ba1d-7ede116028ef tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1499 microversion: 2.1 time: 0.362397 Oct 22 03:42:31.489207 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3165/6210] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:31 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1499 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:31.780543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:31.791624 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a3ee17e-0720-4ee7-a88a-4ab9b95368fd tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1283 microversion: 2.1 time: 0.440150 Oct 22 03:42:31.805807 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3046/6211] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:31 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1283 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:32.520515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:32.521122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:32.561169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:32.562028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:32.568852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:32.570745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:32.572385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:32.575423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:32.799842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:32.809819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1695d27c-a035-46bc-8772-95be32ed0219 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1499 microversion: 2.1 time: 0.293117 Oct 22 03:42:32.810968 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3166/6212] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:32 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1499 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:32.829399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:32.831294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:32.842391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:32.843313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:32.843995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:32.844978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:32.845770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:32.846414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:33.250611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:33.264112 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-05961be7-7197-42d0-b84f-fafabadc7d90 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.438348 Oct 22 03:42:33.266109 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3047/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:32 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:33.493331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2124374643", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:33.556628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] validate_networks() for None {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:42:33.835089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:33.836582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:33.844099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:33.845177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:33.845899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:33.846839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:33.847498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:33.848187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:34.109494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:42:34.110202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:42:34.110843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:42:34.111819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:42:34.112427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:42:34.124895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:34.125583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:34.126359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:34.127249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:34.127955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:34.140053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:34.152174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:34.161324 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-606ca4c7-6f05-4e3e-896c-4483f3d3e6bf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1499 microversion: 2.1 time: 0.329061 Oct 22 03:42:34.177961 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3048/6214] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:33 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1499 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:34.179460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Getting quotas for project 85851aacd0ea41c5b2d2cae6549c8994. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:42:34.193844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Getting quotas for user 8be7c10d9bfc4ccdaadccd4c4c8244bb and project 85851aacd0ea41c5b2d2cae6549c8994. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:42:34.217970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:42:34.222640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:42:34.301120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:34.301781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:34.325763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:34.326269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:34.326705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:34.327422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:34.327870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:34.328758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:34.329071 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b77c278c-ed35-4a23-a163-9050c7bcdc1c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839308 Oct 22 03:42:34.336404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3167/6215] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:42:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:42:34.343855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86fff13d-7152-40d4-9ad0-2276fe1df05d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:34.349069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86fff13d-7152-40d4-9ad0-2276fe1df05d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:34.434490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-86fff13d-7152-40d4-9ad0-2276fe1df05d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:34.442438 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86fff13d-7152-40d4-9ad0-2276fe1df05d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1214 microversion: 2.1 time: 0.104432 Oct 22 03:42:34.445648 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3168/6216] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:34 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:34.708996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:34.719940 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1e9438cb-12ef-41c2-a235-238fc8b592be tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.426570 Oct 22 03:42:34.741723 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3049/6217] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:34 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:35.189475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:35.190730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:35.199048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.199767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.200452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.201334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.202351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.202714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.475428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:35.476259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:35.490137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.490696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.491129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.492023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.495102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.495816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.523296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:35.529524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:35.562876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9654486a-e71f-4bd6-bc80-9dc7ea2d1153 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1502 microversion: 2.1 time: 0.378534 Oct 22 03:42:35.564764 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3169/6218] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:35 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1502 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:35.594723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:35.595879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:35.614445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.615863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.616808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.617749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.618419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.619063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.633387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:35.646778 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6b61e2a4-9652-429c-9b1e-9a4bd29b9dc4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1266 microversion: 2.1 time: 0.175504 Oct 22 03:42:35.648989 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3050/6219] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:35 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:35.663930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lazy-loading 'flavor' on Instance uuid d72e12f0-4f6b-4944-8b57-aa6faf641ae5 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:42:35.758794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:35.759676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:35.770974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.772643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.774689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.778421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.779138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.782125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.812979 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b61b74b-a72d-4d22-a6fd-9d4147c104cf tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "POST /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.222244 Oct 22 03:42:35.818715 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3170/6220] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:42:35 2022] POST /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:42:35.825484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:35.826753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:35.835221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.835221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.835657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:35.837140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:35.837661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:35.838712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:36.059985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:36.069954 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11fd90aa-2afd-4acd-8502-7decb52de430 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1510 microversion: 2.1 time: 0.249521 Oct 22 03:42:36.080260 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3171/6221] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:35 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:36.681222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:36.681898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:36.699159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:36.700159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:36.702831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:36.703715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:36.704247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:36.704964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:36.734586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:36.749410 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e6787e2-c632-4f15-9346-3bc388570584 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.995618 Oct 22 03:42:36.750020 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3051/6222] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:35 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:37.071771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:37.088420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-112a7540-41ac-4b21-95f1-aec9addf1d29 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1272 microversion: 2.1 time: 0.410671 Oct 22 03:42:37.098005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:37.099098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:37.105056 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3172/6223] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:36 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1272 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:37.116127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:37.119911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:37.122401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:37.126467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:37.127437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:37.127912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:37.128397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:37.587781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:37.607121 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c6f6559-f3ed-448e-8119-8028619b2249 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1493 microversion: 2.1 time: 0.517491 Oct 22 03:42:37.623808 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3052/6224] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:37 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1493 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:37.638525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:37.639127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:37.649351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:37.653213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:37.653679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:37.654454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:37.654928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:37.655369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:37.778168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:37.778837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:37.807646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:37.834013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:37.834013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:37.834013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:37.834013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:37.834013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:37.839405 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0189d04-0102-4a36-87e1-8080a4edc363 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "POST /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.205304 Oct 22 03:42:37.840426 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3173/6225] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:42:37 2022] POST /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:42:37.857341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:37.859503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:37.881504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:37.882276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:37.884184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:37.885690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:37.888002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:37.888727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:38.199723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:38.210756 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efd744b0-c69d-4d46-85e7-534c9ac26ca6 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1499 microversion: 2.1 time: 0.365105 Oct 22 03:42:38.225672 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3174/6226] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:37 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1499 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:38.225672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:38.225672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:38.225672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:38.226205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:38.226589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:38.227213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:38.228090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:38.228581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:38.229022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:38.510882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:38.539918 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e85c41d7-86ba-4f29-a1d8-282bfae90e59 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.759003 Oct 22 03:42:38.540567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:38.542994 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3053/6227] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:37 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:38.554147 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8640ef94-757d-4390-b88f-7e2b13028c52 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.341473 Oct 22 03:42:38.555405 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3175/6228] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:38 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:39.245594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:39.245594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:39.253640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:39.254257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:39.254794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:39.256468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:39.257141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:39.257676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:39.564152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:39.565558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:39.573882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:39.574462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:39.575431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:39.577533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:39.578243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:39.578888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:39.756502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:39.767562 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b715874-5eb9-447a-a33d-33fbc480420c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.207949 Oct 22 03:42:39.784025 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3176/6229] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:39 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:39.785848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:39.790385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:39.791981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:39.798372 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d85694bc-ddcc-4526-8498-d0ab6a442f11 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1499 microversion: 2.1 time: 0.560652 Oct 22 03:42:39.799319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:39.800040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:39.800183 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3054/6230] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:39 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1499 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:39.800799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:39.801524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:39.801983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:39.802459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:39.958810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:39.966981 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f690e6a-2e43-43c7-b96b-7eb6daac055b tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.181385 Oct 22 03:42:39.967583 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3177/6231] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:39 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:40.555244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f8cc3009-99be-42e5-9857-16c8a8b382e0 req-662a1587-8e32-4457-8688-fb65f22fb6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de5c2d9-d634-48b3-b284-fff79cd906dc", "tag": "8a08d310-d2c0-4513-ac96-d9f48f8ede15"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:40.575336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f8cc3009-99be-42e5-9857-16c8a8b382e0 req-662a1587-8e32-4457-8688-fb65f22fb6e6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:40.576052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f8cc3009-99be-42e5-9857-16c8a8b382e0 req-662a1587-8e32-4457-8688-fb65f22fb6e6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:40.576677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f8cc3009-99be-42e5-9857-16c8a8b382e0 req-662a1587-8e32-4457-8688-fb65f22fb6e6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:40.602825 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f8cc3009-99be-42e5-9857-16c8a8b382e0 req-662a1587-8e32-4457-8688-fb65f22fb6e6 service nova] Creating event network-changed:8a08d310-d2c0-4513-ac96-d9f48f8ede15 for instance 0de5c2d9-d634-48b3-b284-fff79cd906dc on n-h1-862416-2 Oct 22 03:42:40.614024 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f8cc3009-99be-42e5-9857-16c8a8b382e0 req-662a1587-8e32-4457-8688-fb65f22fb6e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063152 Oct 22 03:42:40.615246 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3055/6232] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:42:40.793024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:40.794430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:40.813583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:40.814272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:40.815117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:40.817357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:40.817357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:40.817357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:40.824795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:40.826436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:40.836601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:40.838805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:40.840752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:40.841677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:40.845322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:40.847225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:41.055921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:41.066495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91a50ac4-c503-4552-8aa9-89f18fabf03c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.278798 Oct 22 03:42:41.067624 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3178/6233] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:40 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:41.076822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:41.077694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:41.096135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:41.098347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:41.100929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:41.102131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:41.104796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:41.105431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:41.435671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:41.438454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:41.459244 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d7cf70ee-b3e4-4c87-a774-2b33a46555a1 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1502 microversion: 2.1 time: 0.638519 Oct 22 03:42:41.459957 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e716a9f-a4f8-4677-b730-7ed640d1185a tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.390068 Oct 22 03:42:41.461092 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3179/6234] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:41 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:41.466591 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3056/6235] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:40 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1502 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:41.501752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:41.502500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:41.524830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:41.529205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:41.529854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:41.530935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:41.532907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:41.533417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:41.597333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:42:41.648661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:41.867314 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8904447-edd6-49d0-b5f0-41449e8a788f tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 204 len: 0 microversion: 2.1 time: 0.380929 Oct 22 03:42:41.872277 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3180/6236] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:42:41 2022] DELETE /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:42:41.877119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:41.878280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:41.897214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:41.897731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:41.898181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:41.898980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:41.899356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:41.899951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:42.094836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:42.095796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:42.108959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:42.113239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:42.114907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:42.117441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:42.120486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:42.122883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:42.177355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:42.185533 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-78b37548-5c8c-447e-807a-8ed72181107b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1508 microversion: 2.1 time: 0.312244 Oct 22 03:42:42.186212 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3057/6237] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:41 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:42.327429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:42.337408 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-617e29ae-28ad-45a4-ad63-6a0237610a54 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.247605 Oct 22 03:42:42.338336 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3181/6238] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:42 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:42.491289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:42.492164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:42.499697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:42.500542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:42.501561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:42.502060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:42.502755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:42.503407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:42.943610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:42.960085 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04159c31-d9a8-4a01-a6ff-c3cc19552ef4 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.478324 Oct 22 03:42:42.961064 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3058/6239] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:42 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:43.213753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:43.221106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:43.229480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:43.230182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:43.230676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:43.231410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:43.231872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:43.232334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:43.364538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:43.366342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:43.372951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:43.373670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:43.374293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:43.375153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:43.375755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:43.376363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:43.543079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:43.553326 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc19180e-aed9-448c-bcbf-a4d190d508e3 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1508 microversion: 2.1 time: 0.345569 Oct 22 03:42:43.573443 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3182/6240] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:43 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:43.594037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:43.604818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7236bc58-e910-4d76-aa4c-9a49aa4bfd5f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.244281 Oct 22 03:42:43.606652 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3059/6241] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:43 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:43.988746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:43.990367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:44.005610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:44.006334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:44.006794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:44.007546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:44.008009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:44.008472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:44.152529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:44.167553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-bb00db01-99b2-4fc0-a63d-baf49de89538 req-3e36406f-3e4b-426c-a091-b0f7623a7fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ba011b-625c-4199-90c0-2a725e04851e", "name": "network-vif-plugged", "status": "completed", "tag": "baa11478-ad36-4d95-b9b2-6c65b3c136a9"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:44.196794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bb00db01-99b2-4fc0-a63d-baf49de89538 req-3e36406f-3e4b-426c-a091-b0f7623a7fd6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:44.197595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bb00db01-99b2-4fc0-a63d-baf49de89538 req-3e36406f-3e4b-426c-a091-b0f7623a7fd6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:44.198876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bb00db01-99b2-4fc0-a63d-baf49de89538 req-3e36406f-3e4b-426c-a091-b0f7623a7fd6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:44.228125 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-bb00db01-99b2-4fc0-a63d-baf49de89538 req-3e36406f-3e4b-426c-a091-b0f7623a7fd6 service nova] Creating event network-vif-plugged:baa11478-ad36-4d95-b9b2-6c65b3c136a9 for instance b3ba011b-625c-4199-90c0-2a725e04851e on n-h2-862416-2 Oct 22 03:42:44.237101 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-bb00db01-99b2-4fc0-a63d-baf49de89538 req-3e36406f-3e4b-426c-a091-b0f7623a7fd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071800 Oct 22 03:42:44.238727 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3060/6242] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:42:44.326442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:44.335833 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9549e3e5-fd17-4ddf-9fa3-56f0e3dfdf75 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.351765 Oct 22 03:42:44.340544 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3183/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:43 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:44.579779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:44.580531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:44.593541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:44.594748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:44.596831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:44.600657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:44.601421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:44.601997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:44.632335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:44.633647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:44.638624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:44.654136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:44.654925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:44.655561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:44.657770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:44.658484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:44.664012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:45.126742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:45.148258 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-77fb259d-8220-4cf7-bf9f-0b0c6a745397 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1508 microversion: 2.1 time: 0.573443 Oct 22 03:42:45.149415 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3061/6244] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:44 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1508 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:45.221835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:45.248713 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a03d863a-5efc-4235-a29d-a56e8020f5ee tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1271 microversion: 2.1 time: 0.621720 Oct 22 03:42:45.249310 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3184/6245] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:44 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1271 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:45.363613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:45.364416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:45.391290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:45.393880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:45.397082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:45.398276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:45.398990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:45.403468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:45.651664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:45.663988 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-25cb0ced-0105-4678-ae24-7607d9b3ec14 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.304549 Oct 22 03:42:45.695258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3062/6246] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:45 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:45.919194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-22391be2-96ec-4397-9d22-e5ba2935a85d req-9fae0d8d-4577-4c8c-911c-47df42f629b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72e12f0-4f6b-4944-8b57-aa6faf641ae5", "name": "network-vif-deleted", "tag": "6fc20e74-507d-469c-85b8-d6d1e741eb92"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:45.937896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-22391be2-96ec-4397-9d22-e5ba2935a85d req-9fae0d8d-4577-4c8c-911c-47df42f629b2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:45.938183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-22391be2-96ec-4397-9d22-e5ba2935a85d req-9fae0d8d-4577-4c8c-911c-47df42f629b2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:45.939123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-22391be2-96ec-4397-9d22-e5ba2935a85d req-9fae0d8d-4577-4c8c-911c-47df42f629b2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:45.954018 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-22391be2-96ec-4397-9d22-e5ba2935a85d req-9fae0d8d-4577-4c8c-911c-47df42f629b2 service nova] Creating event network-vif-deleted:6fc20e74-507d-469c-85b8-d6d1e741eb92 for instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 on n-h1-862416-2 Oct 22 03:42:45.959946 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-22391be2-96ec-4397-9d22-e5ba2935a85d req-9fae0d8d-4577-4c8c-911c-47df42f629b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043786 Oct 22 03:42:45.961979 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3185/6247] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:42:46.175054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:46.176252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:46.183559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.184296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.185046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:46.185905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.186575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.187156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:46.251858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.252397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.253001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:46.254372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lazy-loading 'fault' on Instance uuid d72e12f0-4f6b-4944-8b57-aa6faf641ae5 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:42:46.276559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:46.277390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:46.303322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.305280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.305739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:46.306493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.306959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.323861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:46.346375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82412d4cfb6242029c8e852ff6418875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e21c8cf0e704145bdaf65ad039d6b95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:46.361732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0115f268-e942-4074-a5df-49ac9705f6b8 tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 200 len: 1305 microversion: 2.1 time: 0.188349 Oct 22 03:42:46.364129 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3063/6248] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:46 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 1305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:46.689408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:46.722646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:46.723555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:46.733041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4368aaf-27ad-4e1a-aeeb-b73757e3d452 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1460 microversion: 2.1 time: 0.462484 Oct 22 03:42:46.736790 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3186/6249] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:46 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1460 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:46.751532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.753479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.759549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:46.761364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.762469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.763173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:46.779031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:46.779890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:46.810265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.810832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.812056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:46.812902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:46.813428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:46.814061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:47.041463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:47.049785 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-16aba15f-4d7d-40bc-8ce2-fdb2f930aa0d tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.332190 Oct 22 03:42:47.050595 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3064/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:46 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:47.150238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:47.158885 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0a3d5ae2-c97b-4212-80a5-5e44caa0b9ef tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1460 microversion: 2.1 time: 0.400515 Oct 22 03:42:47.160085 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3187/6251] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:46 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1460 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:42:47.391539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:47.392708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] [instance: d72e12f0-4f6b-4944-8b57-aa6faf641ae5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:47.423506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:47.424164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:47.426095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:47.427857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:47.430234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:47.430792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:47.468232 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] HTTP exception thrown: Instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 could not be found. Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Request method failure captured: Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 HTTP/1.1 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2aKxgMyt1u598O5vPgf0zh5vVc2ThGH_Sc0uku5in1soX5Mtc-a6DDaJ5Zzt_peg9WOe29dUZedSxqg4dHMgtbce8JsxiOp0huE_23qBh3DU5H6YpDp8YY0QW4oB447gECwaUxhq4mfkBLvzHk4OhqiH3yB5ZbyjT9wE86Q5nPyILw Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 6e21c8cf0e704145bdaf65ad039d6b95 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestServerAdvancedOps-1391089117 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e21c8cf0e704145bdaf65ad039d6b95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21c8cf0e704145bdaf65ad039d6b95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e21c8cf0e704145bdaf65ad039d6b95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e21c8cf0e704145bdaf65ad039d6b95"}]}] Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestServerAdvancedOps-1391089117 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 6e21c8cf0e704145bdaf65ad039d6b95 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestServerAdvancedOps-1391089117 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestServerAdvancedOps-1391089117-project Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 82412d4cfb6242029c8e852ff6418875 Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestServerAdvancedOps-1391089117-project Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 could not be found. Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'd72e12f0-4f6b-4944-8b57-aa6faf641ae5'} Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 could not be found. Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 could not be found. Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:42:47.470148 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:42:47.474157 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:42:47.474157 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:42:47.474157 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:42:47.474157 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:42:47.474157 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:42:47.474157 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 could not be found. Oct 22 03:42:47.474157 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:42:47.475422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] Returning 404 to user: Instance d72e12f0-4f6b-4944-8b57-aa6faf641ae5 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:42:47.476768 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01f3c6e7-88fc-480a-861d-ce2fe1452b3b tempest-TestServerAdvancedOps-1391089117 tempest-TestServerAdvancedOps-1391089117-project] 10.222.0.25 "GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5" status: 404 len: 111 microversion: 2.1 time: 0.090426 Oct 22 03:42:47.477683 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3065/6252] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:47 2022] GET /compute/v2.1/servers/d72e12f0-4f6b-4944-8b57-aa6faf641ae5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:42:48.071664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3b3bd013-b7a8-460d-85a1-4b9557322ebc req-a779b464-4435-4089-b933-4de5d2bd30ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de5c2d9-d634-48b3-b284-fff79cd906dc", "name": "network-vif-plugged", "status": "completed", "tag": "8a08d310-d2c0-4513-ac96-d9f48f8ede15"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:48.076958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:48.077847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:48.096006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3b3bd013-b7a8-460d-85a1-4b9557322ebc req-a779b464-4435-4089-b933-4de5d2bd30ea service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:48.096941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3b3bd013-b7a8-460d-85a1-4b9557322ebc req-a779b464-4435-4089-b933-4de5d2bd30ea service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:48.097383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3b3bd013-b7a8-460d-85a1-4b9557322ebc req-a779b464-4435-4089-b933-4de5d2bd30ea service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:48.122867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:48.125893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:48.128310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:48.129572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:48.132500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:48.133208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:48.135502 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3b3bd013-b7a8-460d-85a1-4b9557322ebc req-a779b464-4435-4089-b933-4de5d2bd30ea service nova] Creating event network-vif-plugged:8a08d310-d2c0-4513-ac96-d9f48f8ede15 for instance 0de5c2d9-d634-48b3-b284-fff79cd906dc on n-h1-862416-2 Oct 22 03:42:48.169754 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3b3bd013-b7a8-460d-85a1-4b9557322ebc req-a779b464-4435-4089-b933-4de5d2bd30ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103170 Oct 22 03:42:48.175774 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3188/6253] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:42:49.038904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:49.053728 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4321ad7-8da3-44ae-ab1e-82f25afe54cf tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.982320 Oct 22 03:42:49.054676 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3066/6254] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:48 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:50.079558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:50.080435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:50.094438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:50.096110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:50.096795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:50.097826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:50.101341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:50.102278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:50.655450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:50.675355 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-62cf0e3d-79ca-4430-a8e4-7ed5e19f1d7c tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1314 microversion: 2.1 time: 0.601481 Oct 22 03:42:50.677614 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3189/6255] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:50 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:51.708862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:42:51.710376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:51.730641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:51.731328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:51.732460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:51.734799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:51.737957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:51.738654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:52.612347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:42:52.636632 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2feef0e4-010b-42b8-8494-5fa9f01dd6e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1463 microversion: 2.1 time: 0.929242 Oct 22 03:42:52.644396 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3067/6256] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:42:51 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1463 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:42:52.706613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bf33c93-ca8a-4dd8-93b0-ec06e342c980", "device": "/dev/sdb"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:52.724579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ce219ec6-08ed-4d56-8a8c-a3bcfe0e48d1 req-e020a791-cc7c-42d4-a327-d7e6bb485e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ba011b-625c-4199-90c0-2a725e04851e", "tag": "baa11478-ad36-4d95-b9b2-6c65b3c136a9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:52.725509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:42:52.741569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:52.743398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:52.744125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:52.745345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:52.746200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:52.746894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:52.760800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ce219ec6-08ed-4d56-8a8c-a3bcfe0e48d1 req-e020a791-cc7c-42d4-a327-d7e6bb485e8b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:52.762296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ce219ec6-08ed-4d56-8a8c-a3bcfe0e48d1 req-e020a791-cc7c-42d4-a327-d7e6bb485e8b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:52.762974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ce219ec6-08ed-4d56-8a8c-a3bcfe0e48d1 req-e020a791-cc7c-42d4-a327-d7e6bb485e8b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:52.793042 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ce219ec6-08ed-4d56-8a8c-a3bcfe0e48d1 req-e020a791-cc7c-42d4-a327-d7e6bb485e8b service nova] Creating event network-changed:baa11478-ad36-4d95-b9b2-6c65b3c136a9 for instance b3ba011b-625c-4199-90c0-2a725e04851e on n-h2-862416-2 Oct 22 03:42:52.804174 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ce219ec6-08ed-4d56-8a8c-a3bcfe0e48d1 req-e020a791-cc7c-42d4-a327-d7e6bb485e8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.729382 Oct 22 03:42:52.805117 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3190/6257] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:42:52.911950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:42:53.342489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cb0bec15-34fb-4445-94af-8ffae0d453e8 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "POST /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675740 Oct 22 03:42:53.343224 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3068/6258] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:42:52 2022] POST /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:42:55.750485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3cd92802-53fa-4c93-8ffd-7e6127c62be0 req-6735982e-5e80-46a1-a8cb-a01ecb943d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ba011b-625c-4199-90c0-2a725e04851e", "tag": "baa11478-ad36-4d95-b9b2-6c65b3c136a9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:55.776876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3cd92802-53fa-4c93-8ffd-7e6127c62be0 req-6735982e-5e80-46a1-a8cb-a01ecb943d3d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:55.777476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3cd92802-53fa-4c93-8ffd-7e6127c62be0 req-6735982e-5e80-46a1-a8cb-a01ecb943d3d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:55.777992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3cd92802-53fa-4c93-8ffd-7e6127c62be0 req-6735982e-5e80-46a1-a8cb-a01ecb943d3d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:55.795438 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3cd92802-53fa-4c93-8ffd-7e6127c62be0 req-6735982e-5e80-46a1-a8cb-a01ecb943d3d service nova] Creating event network-changed:baa11478-ad36-4d95-b9b2-6c65b3c136a9 for instance b3ba011b-625c-4199-90c0-2a725e04851e on n-h2-862416-2 Oct 22 03:42:55.803270 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3cd92802-53fa-4c93-8ffd-7e6127c62be0 req-6735982e-5e80-46a1-a8cb-a01ecb943d3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057098 Oct 22 03:42:55.809056 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3191/6259] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:42:57.844357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a3c14813-64e6-4b91-b553-4d81803b3b59 req-7719df83-c6f5-4352-8bc3-557afb7ed312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ba011b-625c-4199-90c0-2a725e04851e", "tag": "baa11478-ad36-4d95-b9b2-6c65b3c136a9"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:42:57.870796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a3c14813-64e6-4b91-b553-4d81803b3b59 req-7719df83-c6f5-4352-8bc3-557afb7ed312 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:42:57.872801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a3c14813-64e6-4b91-b553-4d81803b3b59 req-7719df83-c6f5-4352-8bc3-557afb7ed312 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:42:57.873603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a3c14813-64e6-4b91-b553-4d81803b3b59 req-7719df83-c6f5-4352-8bc3-557afb7ed312 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:42:57.902174 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a3c14813-64e6-4b91-b553-4d81803b3b59 req-7719df83-c6f5-4352-8bc3-557afb7ed312 service nova] Creating event network-changed:baa11478-ad36-4d95-b9b2-6c65b3c136a9 for instance b3ba011b-625c-4199-90c0-2a725e04851e on n-h2-862416-2 Oct 22 03:42:57.918063 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a3c14813-64e6-4b91-b553-4d81803b3b59 req-7719df83-c6f5-4352-8bc3-557afb7ed312 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078359 Oct 22 03:42:57.918996 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3069/6260] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:43:19.071618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:43:19.072624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:43:19.411928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a136f339-f6c8-42ea-80d9-07db8fe82f87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Action: 'create', calling method: .version_select at 0x7f0d18c3ba60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-318416892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsAFXj1EueWYJpgsBma1Cyus1+XBC2qOBNlF0CHtg8iINe18oQkgAIRE7HEa48YuN1bL/Ny02swTsJAB7aOUsWxDgfn5Na9vrXbRnpj+uch5G4s50f0/TBx6dBqmg9b/A=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:43:19.443698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a136f339-f6c8-42ea-80d9-07db8fe82f87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Getting quotas for project 387dcd4769b64ac08acd26e72a251227. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:43:19.458178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a136f339-f6c8-42ea-80d9-07db8fe82f87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Getting quotas for user 8959cf22b47d41008e4af6078f8c3e26 and project 387dcd4769b64ac08acd26e72a251227. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:43:19.506817 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a136f339-f6c8-42ea-80d9-07db8fe82f87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.436844 Oct 22 03:43:19.508490 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3192/6261] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:43:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:43:22.096440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=37 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:43:22.099088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:43:22.113905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1812005978", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-318416892", "security_groups": [{"name": "tempest-secgroup-smoke-854514137"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "564878e1-df50-4ec6-b4d6-74357a889353"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:43:22.524104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] validate_networks() for [('564878e1-df50-4ec6-b4d6-74357a889353', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:43:23.683980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Getting quotas for project 387dcd4769b64ac08acd26e72a251227. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:43:23.692472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Getting quotas for user 8959cf22b47d41008e4af6078f8c3e26 and project 387dcd4769b64ac08acd26e72a251227. Resources: dict_keys(['metadata_items']) {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:43:23.752314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:43:23.752716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:43:23.753201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:43:23.753681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:43:23.754089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:43:23.812523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:23.818294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:23.822646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:23.824375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:23.825229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:23.825838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:23.946935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Getting quotas for project 387dcd4769b64ac08acd26e72a251227. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:43:23.974692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Getting quotas for user 8959cf22b47d41008e4af6078f8c3e26 and project 387dcd4769b64ac08acd26e72a251227. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:43:24.024653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:43:24.030535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:43:24.170243 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68d17374-a1d7-46a1-9252-89695ad764cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.070596 Oct 22 03:43:24.185181 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3070/6262] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:43:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 2091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:43:24.185361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0b2023df-ce10-482a-9dc0-aff4a56dbe59 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:24.185878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0b2023df-ce10-482a-9dc0-aff4a56dbe59 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:24.367130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0b2023df-ce10-482a-9dc0-aff4a56dbe59 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:24.376071 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0b2023df-ce10-482a-9dc0-aff4a56dbe59 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1302 microversion: 2.1 time: 0.196372 Oct 22 03:43:24.377332 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3193/6263] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:24 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1302 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:25.408325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d23deb3-0455-4be1-9543-9b6f5bf5b1fb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:25.409658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d23deb3-0455-4be1-9543-9b6f5bf5b1fb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:25.699004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d23deb3-0455-4be1-9543-9b6f5bf5b1fb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:25.728600 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d23deb3-0455-4be1-9543-9b6f5bf5b1fb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1302 microversion: 2.1 time: 0.317762 Oct 22 03:43:25.729614 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3071/6264] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:25 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1302 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:26.752903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:26.753522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:26.764017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:26.764563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:26.764988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:26.778691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:26.779843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:26.780271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:26.910007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:26.921114 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-81d710a3-7ecd-43e9-a063-e6757fdffb68 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1354 microversion: 2.1 time: 0.172485 Oct 22 03:43:26.938708 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3194/6265] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:26 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:27.746993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:27.748060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:27.766179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:27.766748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:27.767200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:27.767938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:27.768435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:27.768875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:27.780337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4b286f3c-29a2-4e5f-a055-f939676f35a2 req-05e42a7b-cb50-4d33-a622-0ab3a74753b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ba011b-625c-4199-90c0-2a725e04851e", "tag": "baa11478-ad36-4d95-b9b2-6c65b3c136a9"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:43:27.810722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b286f3c-29a2-4e5f-a055-f939676f35a2 req-05e42a7b-cb50-4d33-a622-0ab3a74753b7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:27.811728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b286f3c-29a2-4e5f-a055-f939676f35a2 req-05e42a7b-cb50-4d33-a622-0ab3a74753b7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:27.812561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b286f3c-29a2-4e5f-a055-f939676f35a2 req-05e42a7b-cb50-4d33-a622-0ab3a74753b7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:27.849716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:43:27.865131 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4b286f3c-29a2-4e5f-a055-f939676f35a2 req-05e42a7b-cb50-4d33-a622-0ab3a74753b7 service nova] Creating event network-changed:baa11478-ad36-4d95-b9b2-6c65b3c136a9 for instance b3ba011b-625c-4199-90c0-2a725e04851e on n-h2-862416-2 Oct 22 03:43:27.896383 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4b286f3c-29a2-4e5f-a055-f939676f35a2 req-05e42a7b-cb50-4d33-a622-0ab3a74753b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121274 Oct 22 03:43:27.901449 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3195/6266] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:43:27.957075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:27.959288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:27.991353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:27.995836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:27.996584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:28.002843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:28.005568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:28.006198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:28.293213 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cd6c3095-8a3b-48cf-bb76-8163591af9c8 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 204 len: 0 microversion: 2.1 time: 0.550620 Oct 22 03:43:28.294429 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3072/6267] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:43:27 2022] DELETE /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:43:28.305750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:28.306789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:28.315121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:28.315711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:28.316423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:28.318355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:28.319096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:28.319933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:28.498666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:28.525005 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74f447e0-0ced-474f-b60c-dcec3d94d3b0 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1360 microversion: 2.1 time: 0.575361 Oct 22 03:43:28.525778 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3196/6268] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:27 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1360 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:29.060788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:29.077527 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-26114067-fbd3-4770-8ddb-5414b18dd60f tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1584 microversion: 2.1 time: 0.777132 Oct 22 03:43:29.084179 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3073/6269] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:28 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1584 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:29.555747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:29.556403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:29.576173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:29.576608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:29.577048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:29.578217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:29.578689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:29.579115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:29.770743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:29.784673 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4af3932c-3ea0-47ad-9949-67bbf710f3ad tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1360 microversion: 2.1 time: 0.231378 Oct 22 03:43:29.787088 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3197/6270] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:29 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1360 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:30.112460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:30.113114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:30.135973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:30.136524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:30.138425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:30.139524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:30.149053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:30.150940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:30.811403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:30.817635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:30.835138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:30.838451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:30.839342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:30.842698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:30.843392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:30.846562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:31.047613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:31.055962 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df203471-04fa-4d58-91d9-30ef2d025a7a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1360 microversion: 2.1 time: 0.248456 Oct 22 03:43:31.090819 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3198/6271] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:30 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1360 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:31.141595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:31.168616 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2932e716-63ee-4af6-a175-6a520e318831 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1584 microversion: 2.1 time: 1.060599 Oct 22 03:43:31.169649 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3074/6272] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:30 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1584 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:32.093338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:32.093945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:32.114045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:32.115002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:32.115332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:32.123269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:32.133243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:32.133987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:32.193986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:32.194673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:32.204350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:32.204848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:32.205285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:32.214782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:32.215281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:32.215732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:32.742890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:32.760432 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9106829-989e-4333-99e6-c055d5f02a61 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1516 microversion: 2.1 time: 0.570326 Oct 22 03:43:32.778486 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3075/6273] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:32 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1516 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:32.820464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-829d226e-3f61-489f-9f71-7280590eaedb req-eb2ed6b6-e645-43db-813d-113c58e8efcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ba011b-625c-4199-90c0-2a725e04851e", "name": "network-vif-deleted", "tag": "baa11478-ad36-4d95-b9b2-6c65b3c136a9"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:43:32.855580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-829d226e-3f61-489f-9f71-7280590eaedb req-eb2ed6b6-e645-43db-813d-113c58e8efcf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:32.856395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-829d226e-3f61-489f-9f71-7280590eaedb req-eb2ed6b6-e645-43db-813d-113c58e8efcf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:32.860583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-829d226e-3f61-489f-9f71-7280590eaedb req-eb2ed6b6-e645-43db-813d-113c58e8efcf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:32.919234 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-829d226e-3f61-489f-9f71-7280590eaedb req-eb2ed6b6-e645-43db-813d-113c58e8efcf service nova] Creating event network-vif-deleted:baa11478-ad36-4d95-b9b2-6c65b3c136a9 for instance b3ba011b-625c-4199-90c0-2a725e04851e on n-h2-862416-2 Oct 22 03:43:32.947354 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-829d226e-3f61-489f-9f71-7280590eaedb req-eb2ed6b6-e645-43db-813d-113c58e8efcf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131130 Oct 22 03:43:32.956171 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3076/6274] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:43:33.793878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:33.794515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:33.812004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:33.817683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:33.818305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:33.821111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:33.821752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:33.822387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:33.916383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:43:34.081098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:34.100407 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2dde6ecf-6ff9-45dc-ac07-790601bdd94a tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1427 microversion: 2.1 time: 2.011123 Oct 22 03:43:34.103666 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3199/6275] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:32 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1427 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:34.128393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:34.139462 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5ecb95f4-e6f7-4b4a-bd7c-3e356868190c tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1398 microversion: 2.1 time: 0.350832 Oct 22 03:43:34.157327 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3077/6276] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:33 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1398 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:43:35.082304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-7d7d3b47-7a78-4871-a5a5-6c44133674fd req-a1a61954-407c-4b6e-9f46-115cc818d649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682", "tag": "9fa76a09-ea97-4fed-a865-ed7d921e689f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:43:35.096083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:43:35.110836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7d7d3b47-7a78-4871-a5a5-6c44133674fd req-a1a61954-407c-4b6e-9f46-115cc818d649 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:35.114217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7d7d3b47-7a78-4871-a5a5-6c44133674fd req-a1a61954-407c-4b6e-9f46-115cc818d649 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:35.115083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-7d7d3b47-7a78-4871-a5a5-6c44133674fd req-a1a61954-407c-4b6e-9f46-115cc818d649 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:35.129546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:35.130233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:35.166425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:35.170748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:35.171467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:35.172450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:35.172927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:35.173357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:35.178430 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-7d7d3b47-7a78-4871-a5a5-6c44133674fd req-a1a61954-407c-4b6e-9f46-115cc818d649 service nova] Creating event network-changed:9fa76a09-ea97-4fed-a865-ed7d921e689f for instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 on n-h1-862416-2 Oct 22 03:43:35.211847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-7d7d3b47-7a78-4871-a5a5-6c44133674fd req-a1a61954-407c-4b6e-9f46-115cc818d649 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132469 Oct 22 03:43:35.218883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3200/6277] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:43:35.266001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:35.266801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:35.293552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:35.293984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:35.294429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:35.295156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:35.304859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:35.305316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:35.541833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:35.559146 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2d028a0f-331f-4201-8637-3cfb62e51c2a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1398 microversion: 2.1 time: 0.336408 Oct 22 03:43:35.572659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3201/6278] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:35 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1398 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:35.703477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:43:35.829968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:35.840507 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62306f4a-c112-4e9b-a46a-b35b9ae5671b tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1427 microversion: 2.1 time: 0.716089 Oct 22 03:43:35.842299 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3078/6279] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:35 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1427 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:43:36.589037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:36.590502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:36.602864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:36.608701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:36.609547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:36.613688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:36.614404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:36.615055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:36.730302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:36.745629 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ddd31f96-45a4-485e-8212-a4d09b3e5b1a tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1398 microversion: 2.1 time: 0.163777 Oct 22 03:43:36.756605 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3202/6280] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:36 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1398 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:36.869344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:36.871419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:36.881139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:36.882146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:36.882812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:36.883912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:36.884579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:36.885866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:37.153187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:37.166898 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-07b6dd6c-99a5-4d95-9421-41e88d5aff14 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1427 microversion: 2.1 time: 0.301929 Oct 22 03:43:37.185333 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3079/6281] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:36 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1427 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:37.772912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:37.773537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:37.787666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:37.788200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:37.788699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:37.789572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:37.789823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:37.790241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:37.946250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:37.960445 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-462fd3e6-409b-4326-8f89-704ea7e5f956 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1398 microversion: 2.1 time: 0.191460 Oct 22 03:43:37.962679 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3203/6282] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:37 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1398 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:38.198392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:38.199655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:38.212564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:38.213353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:38.215340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:38.217908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:38.218591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:38.220467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:38.614942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:38.630104 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a4a104f-fe18-4c11-b926-2d4c7530bb92 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1427 microversion: 2.1 time: 0.435571 Oct 22 03:43:38.649447 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3080/6283] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:38 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1427 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:38.985078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:38.985785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:39.002163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:39.002758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:39.003298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:39.005209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:39.018581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:39.019973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:39.250425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:39.260589 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5404462f-43b4-4128-8d0f-c9cf073482f3 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1398 microversion: 2.1 time: 0.279373 Oct 22 03:43:39.261196 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3204/6284] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:38 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1398 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:39.654862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:39.655656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:39.668563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:39.669069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:39.669522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:39.670246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:39.670712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:39.671143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:39.976683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:39.988543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2c150cfa-32f1-4591-9882-de2ce4f97ed6 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1427 microversion: 2.1 time: 0.337758 Oct 22 03:43:39.991308 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3081/6285] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:39 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1427 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:40.293053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:40.293845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:40.309752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:40.311497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:40.314488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:40.315420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:40.316054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:40.318833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:40.381040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:40.381473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:40.382090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:40.382721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lazy-loading 'fault' on Instance uuid b3ba011b-625c-4199-90c0-2a725e04851e {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:43:40.510749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b93ae16c-94a1-4f41-ab83-2cbcab92fb16 req-029cd47f-faf1-472a-a591-85b737b1d3af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682", "name": "network-vif-plugged", "status": "completed", "tag": "9fa76a09-ea97-4fed-a865-ed7d921e689f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:43:40.534001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b93ae16c-94a1-4f41-ab83-2cbcab92fb16 req-029cd47f-faf1-472a-a591-85b737b1d3af service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:40.534783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b93ae16c-94a1-4f41-ab83-2cbcab92fb16 req-029cd47f-faf1-472a-a591-85b737b1d3af service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:40.535718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b93ae16c-94a1-4f41-ab83-2cbcab92fb16 req-029cd47f-faf1-472a-a591-85b737b1d3af service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:40.563858 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b93ae16c-94a1-4f41-ab83-2cbcab92fb16 req-029cd47f-faf1-472a-a591-85b737b1d3af service nova] Creating event network-vif-plugged:9fa76a09-ea97-4fed-a865-ed7d921e689f for instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 on n-h1-862416-2 Oct 22 03:43:40.578896 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b93ae16c-94a1-4f41-ab83-2cbcab92fb16 req-029cd47f-faf1-472a-a591-85b737b1d3af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071701 Oct 22 03:43:40.580898 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3082/6286] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:43:40.617257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3187cbaec48439e977229c245672015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79910d8977e45889758c7aaaaaf2f9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:40.632024 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-174a0f94-c7ae-4771-8f57-46b45a0d9158 tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 200 len: 1403 microversion: 2.1 time: 0.345141 Oct 22 03:43:40.651709 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3205/6287] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:40 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 1403 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:41.017991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:41.019086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:41.036554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:41.037161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:41.037623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:41.038372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:41.038995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:41.039439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:41.277163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:41.292786 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1282a4bd-e323-459e-8e9d-98a50ffdb944 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1427 microversion: 2.1 time: 0.280197 Oct 22 03:43:41.293652 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3083/6288] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:41 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1427 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:43:41.666989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:41.667692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [instance: b3ba011b-625c-4199-90c0-2a725e04851e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:41.682096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:41.682601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:41.683046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:41.686458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:41.694160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:41.694698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:41.724421 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] HTTP exception thrown: Instance b3ba011b-625c-4199-90c0-2a725e04851e could not be found. Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Request method failure captured: Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e HTTP/1.1 Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2VvOmJnXO-21grbzuGLHzb4it1EQO6U8JQ8gEdd1nR1zZoLll0DksrgMhZ4YW4_4xPQnSS3WxXNiCl0fa0DHzV8LiDiC9FPwqDc_Xpu2HPmYoe9OLA_ovNdkhRpM4O_7_M-rOYPWFuWL7brfZDwFddevFPDJTVveIseiAxmSqr7THY Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: d79910d8977e45889758c7aaaaaf2f9b Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBackupRestore-1589572829 Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d79910d8977e45889758c7aaaaaf2f9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d79910d8977e45889758c7aaaaaf2f9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d79910d8977e45889758c7aaaaaf2f9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d79910d8977e45889758c7aaaaaf2f9b"}]}] Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBackupRestore-1589572829 Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: d79910d8977e45889758c7aaaaaf2f9b Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1589572829 Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBackupRestore-1589572829-project Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: b3187cbaec48439e977229c245672015 Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBackupRestore-1589572829-project Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance b3ba011b-625c-4199-90c0-2a725e04851e could not be found. Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'b3ba011b-625c-4199-90c0-2a725e04851e'} Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ba011b-625c-4199-90c0-2a725e04851e could not be found. Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ba011b-625c-4199-90c0-2a725e04851e could not be found. Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:43:41.726695 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:43:41.731358 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:43:41.731358 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:43:41.731358 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:43:41.731358 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:43:41.731358 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:43:41.731358 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ba011b-625c-4199-90c0-2a725e04851e could not be found. Oct 22 03:43:41.731358 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:43:41.732458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Returning 404 to user: Instance b3ba011b-625c-4199-90c0-2a725e04851e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:43:41.734714 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44a8580d-5d52-4315-9689-f22bb50d1ccf tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e" status: 404 len: 111 microversion: 2.1 time: 0.075978 Oct 22 03:43:41.736725 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3206/6289] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:41 2022] GET /compute/v2.1/servers/b3ba011b-625c-4199-90c0-2a725e04851e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:43:42.023410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-24aeb687-3dbc-4c60-ada2-4e2486edc63e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] Calling method '.version_select at 0x7f0d1e4c6160>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:42.031031 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [None req-24aeb687-3dbc-4c60-ada2-4e2486edc63e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [1980de44-0dcb-4a09-8ed3-655070b2ac1a] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 03:43:42.315802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:42.316804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:42.326857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:42.327749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:42.329328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:42.330625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:42.332780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:42.334186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:42.592280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:42.601850 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb3dcf3e-b8ec-409a-a58e-afd7af86e27f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1607 microversion: 2.1 time: 0.289945 Oct 22 03:43:42.613698 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3207/6290] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:42 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1607 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:43:42.643782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:42.647490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:42.656987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:42.657788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:42.658433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:42.660851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:42.668468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:42.675199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:42.871700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:42.886983 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50db826a-8621-4d05-adea-467c23dc7d87 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1607 microversion: 2.1 time: 0.253780 Oct 22 03:43:42.888347 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3208/6291] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:42 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1607 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:43:42.912107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:43:42.912632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:43:42.925170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:42.926590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:42.927282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:42.928439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:42.930194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:42.930944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:43.041560 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [None req-24aeb687-3dbc-4c60-ada2-4e2486edc63e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] [1980de44-0dcb-4a09-8ed3-655070b2ac1a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49138. Oct 22 03:43:43.087458 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-24aeb687-3dbc-4c60-ada2-4e2486edc63e tempest-TestVolumeBackupRestore-1589572829 tempest-TestVolumeBackupRestore-1589572829-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1927811448" status: 202 len: 0 microversion: 2.1 time: 1.069049 Oct 22 03:43:43.088510 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3084/6292] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 03:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1927811448 => generated 0 bytes in 1071 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:43:43.250254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:43:43.266250 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11605b3d-e04b-456f-a8e5-f1852fa0b0be tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1607 microversion: 2.1 time: 0.357702 Oct 22 03:43:43.267446 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3209/6293] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:43:42 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1607 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:43:48.130076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-94fd62ad-3506-4e1f-9470-f2a3fcf97e34 req-14c1e8d6-c106-4c53-93b7-0f54d1631c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682", "tag": "9fa76a09-ea97-4fed-a865-ed7d921e689f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:43:48.160996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-94fd62ad-3506-4e1f-9470-f2a3fcf97e34 req-14c1e8d6-c106-4c53-93b7-0f54d1631c70 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:43:48.160996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-94fd62ad-3506-4e1f-9470-f2a3fcf97e34 req-14c1e8d6-c106-4c53-93b7-0f54d1631c70 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:43:48.161751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-94fd62ad-3506-4e1f-9470-f2a3fcf97e34 req-14c1e8d6-c106-4c53-93b7-0f54d1631c70 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:43:48.184389 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-94fd62ad-3506-4e1f-9470-f2a3fcf97e34 req-14c1e8d6-c106-4c53-93b7-0f54d1631c70 service nova] Creating event network-changed:9fa76a09-ea97-4fed-a865-ed7d921e689f for instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 on n-h1-862416-2 Oct 22 03:43:48.190551 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-94fd62ad-3506-4e1f-9470-f2a3fcf97e34 req-14c1e8d6-c106-4c53-93b7-0f54d1631c70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065216 Oct 22 03:43:48.192572 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3085/6294] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:44:22.743695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:44:22.744303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:44:22.747185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:44:22.747977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=86 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:44:22.761692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:44:22.762196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:44:22.762634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:44:22.771809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:44:22.772326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:44:22.772934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:44:22.826822 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69f2acdd-6616-441e-adc5-003e8ac6c5bb tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.087333 Oct 22 03:44:22.831107 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3210/6295] 10.222.0.25 () {58 vars in 1293 bytes} [Sat Oct 22 03:44:22 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682/os-server-password => generated 116 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:44:47.765640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:44:47.766795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:44:48.154642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec7bd997-25a0-44a6-91ae-a98ad1a267e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'create', calling method: .version_select at 0x7f0d1e534790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1268715948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2ViAmCpI+Qefoxkz2wgeR4xBn8Zi3GEJJEfTnyeShfH+pO73/RpSGjpWQMfcycicmKdnxDfj5GB1086sO7094d9eleUZi0y3bHgBe4uvTvI6qGocwryWxEX9Z7Uk6LWw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:44:48.191723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ec7bd997-25a0-44a6-91ae-a98ad1a267e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for project f73e2096501b458ca6d9f587c21c6d23. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:44:48.198805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ec7bd997-25a0-44a6-91ae-a98ad1a267e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for user 754cd3eb62c24a1eb25a4d294a063588 and project f73e2096501b458ca6d9f587c21c6d23. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:44:48.240579 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ec7bd997-25a0-44a6-91ae-a98ad1a267e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.485714 Oct 22 03:44:48.241216 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3086/6296] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:44:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:44:51.392983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:44:51.396890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:44:51.411512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:44:51.412579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:44:51.416988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:44:51.419565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:44:51.421573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:44:51.422522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:44:51.424842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:44:51.425693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:44:51.581669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lazy-loading 'services' on Instance uuid 0de5c2d9-d634-48b3-b284-fff79cd906dc {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:44:51.676876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b3124233-06a9-4adf-9276-059465cad4a5 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc/os-volume_attachments/5bf33c93-ca8a-4dd8-93b0-ec06e342c980" status: 202 len: 0 microversion: 2.1 time: 0.294468 Oct 22 03:44:51.677489 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3211/6297] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:44:51 2022] DELETE /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc/os-volume_attachments/5bf33c93-ca8a-4dd8-93b0-ec06e342c980 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:44:58.373520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:44:58.375537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:44:58.381961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-49198884", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "570d8493-02ba-43e8-9df9-1ffca26cfc21"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1268715948", "security_groups": [{"name": "tempest-secgroup-smoke-1731977217"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:44:58.652715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] validate_networks() for [('570d8493-02ba-43e8-9df9-1ffca26cfc21', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:44:59.321948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:44:59.322543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:44:59.323153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:44:59.323683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:44:59.324222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:44:59.339229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:44:59.340432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:44:59.341126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:44:59.342165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:44:59.342842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:44:59.343767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:44:59.369044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for project f73e2096501b458ca6d9f587c21c6d23. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:44:59.379699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for user 754cd3eb62c24a1eb25a4d294a063588 and project f73e2096501b458ca6d9f587c21c6d23. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:44:59.408462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:44:59.411358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:44:59.539807 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a5a6666d-aa38-40d8-94cb-fbd50ed278c9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.167535 Oct 22 03:44:59.543652 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3087/6298] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:44:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:44:59.557583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cce3fd34-350f-4e7b-9857-bb0ca83fe766 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:44:59.558969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cce3fd34-350f-4e7b-9857-bb0ca83fe766 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:44:59.631392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cce3fd34-350f-4e7b-9857-bb0ca83fe766 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:44:59.643590 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cce3fd34-350f-4e7b-9857-bb0ca83fe766 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1265 microversion: 2.1 time: 0.092112 Oct 22 03:44:59.644744 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3212/6299] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:44:59 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:00.671122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:00.675990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:00.703251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:00.704138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:00.704871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:00.705910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:00.706610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:00.707272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:00.731522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:00.732029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:00.746017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:00.747228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:00.748603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:00.750479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:00.751155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:00.753788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:00.831486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:45:00.850505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:00.868997 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9404fc47-8c85-476a-b2e6-a9818a022bf8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1317 microversion: 2.1 time: 0.202564 Oct 22 03:45:00.874551 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3088/6300] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:00 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:01.043994 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc66eaee-cd4d-4db0-ab1b-2d566698b448 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 204 len: 0 microversion: 2.1 time: 0.316185 Oct 22 03:45:01.049436 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3213/6301] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:45:00 2022] DELETE /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:45:01.054780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:01.057804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:01.077743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:01.079217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:01.080985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:01.082652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:01.083989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:01.099943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:01.519329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:01.535045 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f04f896-4651-448f-81c7-52b3baef69f1 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1469 microversion: 2.1 time: 0.484719 Oct 22 03:45:01.537936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3089/6302] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:01 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1469 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:01.901971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:01.904234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:01.914545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:01.915562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:01.916588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:01.917679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:01.918147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:01.918738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:02.029124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:02.041054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7e39da7-09b2-4d14-a028-e08923e74435 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1323 microversion: 2.1 time: 0.143157 Oct 22 03:45:02.043337 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3214/6303] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:01 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1323 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:02.562111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:02.563367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:02.578697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:02.580883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:02.583299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:02.584570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:02.585276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:02.587678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:02.981060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:02.999006 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-778882bf-87ea-4166-a9c0-3d09cb252f57 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1469 microversion: 2.1 time: 0.442013 Oct 22 03:45:03.002695 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3090/6304] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:02 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:03.066110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:03.067354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:03.077396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:03.078481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:03.079107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:03.081577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:03.082248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:03.082863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:03.291853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:03.302397 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de00d7f6-b4bb-4b3e-be1f-c1183c2eaaf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1391 microversion: 2.1 time: 0.241040 Oct 22 03:45:03.316238 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3215/6305] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:03 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:03.675274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-f2e53b93-b838-4c36-8c1d-777dc686c330 req-def8fa47-c914-4196-a98d-a7b8795aac28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de5c2d9-d634-48b3-b284-fff79cd906dc", "name": "network-vif-deleted", "tag": "8a08d310-d2c0-4513-ac96-d9f48f8ede15"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:45:03.696225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f2e53b93-b838-4c36-8c1d-777dc686c330 req-def8fa47-c914-4196-a98d-a7b8795aac28 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:03.697212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f2e53b93-b838-4c36-8c1d-777dc686c330 req-def8fa47-c914-4196-a98d-a7b8795aac28 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:03.697839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-f2e53b93-b838-4c36-8c1d-777dc686c330 req-def8fa47-c914-4196-a98d-a7b8795aac28 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:03.712691 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-f2e53b93-b838-4c36-8c1d-777dc686c330 req-def8fa47-c914-4196-a98d-a7b8795aac28 service nova] Creating event network-vif-deleted:8a08d310-d2c0-4513-ac96-d9f48f8ede15 for instance 0de5c2d9-d634-48b3-b284-fff79cd906dc on n-h1-862416-2 Oct 22 03:45:03.718686 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-f2e53b93-b838-4c36-8c1d-777dc686c330 req-def8fa47-c914-4196-a98d-a7b8795aac28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048138 Oct 22 03:45:03.719952 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3091/6306] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:45:04.028000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:04.028812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:04.036530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:04.046037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:04.046755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:04.048714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:04.049609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:04.050258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:04.125705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:04.127211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:04.128231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:04.129624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lazy-loading 'fault' on Instance uuid 0de5c2d9-d634-48b3-b284-fff79cd906dc {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:45:04.196167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be7c10d9bfc4ccdaadccd4c4c8244bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85851aacd0ea41c5b2d2cae6549c8994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:04.205661 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38f0f7c6-7d14-4b65-85af-69b7262d3306 tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 200 len: 1304 microversion: 2.1 time: 0.182574 Oct 22 03:45:04.206976 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3216/6307] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:04 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:04.332731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:04.335059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:04.344002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:04.351086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:04.352602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:04.354490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:04.354975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:04.359816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:04.576439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:04.589591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2cad4c1d-081b-4929-b30d-53c8dac88698 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1391 microversion: 2.1 time: 0.263494 Oct 22 03:45:04.590478 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3092/6308] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:04 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:05.230822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:05.231654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] [instance: 0de5c2d9-d634-48b3-b284-fff79cd906dc] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:05.238935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:05.239411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:05.239840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:05.240571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:05.243706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:05.243706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:05.263387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] HTTP exception thrown: Instance 0de5c2d9-d634-48b3-b284-fff79cd906dc could not be found. Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Request method failure captured: Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc HTTP/1.1 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2amRflQuoRb012yltN8phYwwErtXsDAxsOQqopBcB3VflpzdFb1LF5J9BZ78ZIc5ZpiEfOO8QqY2DFEOCtmzRbUEU0Bjx4pFQWJRlH_YCNRU1bS7g4wfQ-7lOD9GBEnbzIjFN_w2Z6ibyTNmb5CsM7rZ402JIj5lAl_wyeNrTK6YGI Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 85851aacd0ea41c5b2d2cae6549c8994 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesBackupsTest-1380625376 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_85851aacd0ea41c5b2d2cae6549c8994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85851aacd0ea41c5b2d2cae6549c8994"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/85851aacd0ea41c5b2d2cae6549c8994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85851aacd0ea41c5b2d2cae6549c8994"}]}] Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesBackupsTest-1380625376 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 85851aacd0ea41c5b2d2cae6549c8994 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesBackupsTest-1380625376 Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesBackupsTest-1380625376-project Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8be7c10d9bfc4ccdaadccd4c4c8244bb Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesBackupsTest-1380625376-project Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 0de5c2d9-d634-48b3-b284-fff79cd906dc could not be found. Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '0de5c2d9-d634-48b3-b284-fff79cd906dc'} Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de5c2d9-d634-48b3-b284-fff79cd906dc could not be found. Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de5c2d9-d634-48b3-b284-fff79cd906dc could not be found. Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:45:05.265206 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de5c2d9-d634-48b3-b284-fff79cd906dc could not be found. Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] Returning 404 to user: Instance 0de5c2d9-d634-48b3-b284-fff79cd906dc could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-41983b3e-abd8-4f0b-9a16-17cd709a7f9e tempest-VolumesBackupsTest-1380625376 tempest-VolumesBackupsTest-1380625376-project] 10.222.0.25 "GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc" status: 404 len: 111 microversion: 2.1 time: 0.039915 Oct 22 03:45:05.270148 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3217/6309] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:05 2022] GET /compute/v2.1/servers/0de5c2d9-d634-48b3-b284-fff79cd906dc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:45:05.616312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:05.618810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:05.633073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:05.634095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:05.635008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:05.636273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:05.637294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:05.638128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:05.751966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1e7ac736-2fda-4145-91c8-9dc52698006a req-5c742827-a625-4578-96ab-37b601a4392f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bf53a4-0a03-4c65-a6be-309927058e47", "tag": "9419643d-fffb-41bf-9eba-d4443450a9af"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:45:05.769282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1e7ac736-2fda-4145-91c8-9dc52698006a req-5c742827-a625-4578-96ab-37b601a4392f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:05.771047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1e7ac736-2fda-4145-91c8-9dc52698006a req-5c742827-a625-4578-96ab-37b601a4392f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:05.771746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1e7ac736-2fda-4145-91c8-9dc52698006a req-5c742827-a625-4578-96ab-37b601a4392f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:05.787174 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1e7ac736-2fda-4145-91c8-9dc52698006a req-5c742827-a625-4578-96ab-37b601a4392f service nova] Creating event network-changed:9419643d-fffb-41bf-9eba-d4443450a9af for instance f7bf53a4-0a03-4c65-a6be-309927058e47 on n-h2-862416-2 Oct 22 03:45:05.796165 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1e7ac736-2fda-4145-91c8-9dc52698006a req-5c742827-a625-4578-96ab-37b601a4392f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049187 Oct 22 03:45:05.797518 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3218/6310] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:45:05.840263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:05.853954 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b1a9f585-5c68-4642-beb7-acea0a89d295 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1391 microversion: 2.1 time: 0.242258 Oct 22 03:45:05.857422 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3093/6311] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:05 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:06.880005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:06.880797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:06.896466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:06.899052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:06.899530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:06.900345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:06.900786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:06.901208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:07.133865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:07.144193 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d581bd6e-691a-4639-ac5c-6a5b944a9991 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1391 microversion: 2.1 time: 0.269799 Oct 22 03:45:07.156746 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3219/6312] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:06 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1391 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:08.172088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:08.173465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:08.183028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:08.183817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:08.184527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:08.185595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:08.186319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:08.186982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:08.939193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:08.952484 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a82bb9b-51a5-4c03-af6e-d8b0a1190088 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1391 microversion: 2.1 time: 0.785470 Oct 22 03:45:08.953173 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3094/6313] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:08 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1391 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:09.975780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:09.983009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:09.998667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:45:10.006241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:10.007004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:10.008249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:10.011116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:10.012755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:10.013527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:10.237841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:10.248295 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9a7c9555-e0fa-46ed-aa34-79fae750b397 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1391 microversion: 2.1 time: 0.276426 Oct 22 03:45:10.249223 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3220/6314] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:09 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:10.553232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d033edad-5a78-4640-9d5f-d528a3c4dc76 req-4df09ae8-4441-447d-aa11-9fd3e1cd03e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bf53a4-0a03-4c65-a6be-309927058e47", "name": "network-vif-plugged", "status": "completed", "tag": "9419643d-fffb-41bf-9eba-d4443450a9af"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:45:10.560321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:45:10.561614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:45:10.569934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d033edad-5a78-4640-9d5f-d528a3c4dc76 req-4df09ae8-4441-447d-aa11-9fd3e1cd03e2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:10.570695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d033edad-5a78-4640-9d5f-d528a3c4dc76 req-4df09ae8-4441-447d-aa11-9fd3e1cd03e2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:10.571303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d033edad-5a78-4640-9d5f-d528a3c4dc76 req-4df09ae8-4441-447d-aa11-9fd3e1cd03e2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:10.587859 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d033edad-5a78-4640-9d5f-d528a3c4dc76 req-4df09ae8-4441-447d-aa11-9fd3e1cd03e2 service nova] Creating event network-vif-plugged:9419643d-fffb-41bf-9eba-d4443450a9af for instance f7bf53a4-0a03-4c65-a6be-309927058e47 on n-h2-862416-2 Oct 22 03:45:10.595692 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d033edad-5a78-4640-9d5f-d528a3c4dc76 req-4df09ae8-4441-447d-aa11-9fd3e1cd03e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046841 Oct 22 03:45:10.597300 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3095/6315] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:45:11.274177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:11.274908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:11.284513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:11.285537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:11.286296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:11.287551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:11.288267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:11.288867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:11.536997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:11.549411 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8e12c1ef-2a91-4235-acc5-2391ce1f5293 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1391 microversion: 2.1 time: 0.279021 Oct 22 03:45:11.550021 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3221/6316] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:11 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:12.580828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:12.581587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:12.592002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:12.592525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:12.593179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:12.593894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:12.594513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:12.595247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:12.782141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:12.792737 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d634117-b3ff-4b56-a019-f8b9b756afec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1563 microversion: 2.1 time: 0.219133 Oct 22 03:45:12.794019 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3096/6317] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:12 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:12.815940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:12.817174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:12.824825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:12.825660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:12.826325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:12.827239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:12.828179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:12.828841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:12.981387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:12.989937 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad3bb534-e3ae-44ec-9e10-277e6119cb1c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1563 microversion: 2.1 time: 0.178066 Oct 22 03:45:12.990595 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3222/6318] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:12 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:15.041491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:45:15.042186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:15.047286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cb08b41f-9c62-4439-bca8-e5394868aa00 req-0a8672ad-72ca-4ada-bca9-a90b7842042a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bf53a4-0a03-4c65-a6be-309927058e47", "tag": "9419643d-fffb-41bf-9eba-d4443450a9af"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:45:15.055714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:15.056752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:15.065665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:15.066669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:15.067320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:15.067934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:15.071866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cb08b41f-9c62-4439-bca8-e5394868aa00 req-0a8672ad-72ca-4ada-bca9-a90b7842042a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:15.072634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cb08b41f-9c62-4439-bca8-e5394868aa00 req-0a8672ad-72ca-4ada-bca9-a90b7842042a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:15.076057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cb08b41f-9c62-4439-bca8-e5394868aa00 req-0a8672ad-72ca-4ada-bca9-a90b7842042a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:15.106410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cb08b41f-9c62-4439-bca8-e5394868aa00 req-0a8672ad-72ca-4ada-bca9-a90b7842042a service nova] Creating event network-changed:9419643d-fffb-41bf-9eba-d4443450a9af for instance f7bf53a4-0a03-4c65-a6be-309927058e47 on n-h2-862416-2 Oct 22 03:45:15.125284 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cb08b41f-9c62-4439-bca8-e5394868aa00 req-0a8672ad-72ca-4ada-bca9-a90b7842042a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072783 Oct 22 03:45:15.125284 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3223/6319] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:45:15.338735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:45:15.348114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4fad5c88-143b-4571-9e49-797ffdba4efd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1563 microversion: 2.1 time: 0.310974 Oct 22 03:45:15.353179 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3097/6320] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:45:15 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1563 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:45:47.921046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:45:47.923149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:45:47.928258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:45:47.931104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:45:47.940763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:47.941608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:47.942280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:47.943083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:45:47.943610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:45:47.944142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:45:48.004596 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c7d3e8f0-2498-4c08-900e-9421eb7ab0c1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action" status: 200 len: 24567 microversion: 2.1 time: 0.085544 Oct 22 03:45:48.005406 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3224/6321] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:45:47 2022] POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action => generated 24567 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:46:18.432016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:18.434789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=54 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:18.440279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:18.440905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:18.458203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:18.458737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:18.459842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:18.460105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:18.460697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:18.461136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:18.865664 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4940d36-8f4a-41eb-9885-3d514519fc9e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1833 microversion: 2.1 time: 0.435716 Oct 22 03:46:18.866402 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3098/6322] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:18 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1833 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:18.890763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:18.892079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:18.898415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:18.899085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:18.900105 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:46:18.900311 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 03:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 (ip 10.222.0.25) !!! Oct 22 03:46:18.902029 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:46:18.902323 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 03:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 (ip 10.222.0.25) !!! Oct 22 03:46:18.904496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:18.904919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:18.906035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:18.907004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:18.907481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:18.907902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:19.116171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:19.124910 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0267076-98e5-4843-91c6-7ffecbcfa692 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1682 microversion: 2.1 time: 0.239729 Oct 22 03:46:19.125675 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3225/6323] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:18 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:19.222971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:19.225331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:19.231407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:19.231897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:19.232397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:19.233157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:19.234205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:19.234641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:19.294695 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bc167f64-1859-4d3b-8cc7-da65f103a371 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action" status: 200 len: 32641 microversion: 2.1 time: 0.075542 Oct 22 03:46:19.295341 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3099/6324] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:46:19 2022] POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action => generated 32641 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:46:19.517257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:19.517850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:19.524439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:19.524936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:19.525382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:19.526075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:19.526541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:19.526968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:19.617446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '97c7af06e69c4ea6a1a30c346f64b037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64126d617d374034ad0e57d2876251aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:19.618146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] flavor_id is None. Assuming migration. {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 22 03:46:19.618593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 03:46:19.746134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-294068165", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "6d9866b5-161f-4dfb-8970-b52b84dc45a8"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:19.806894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] validate_networks() for [('6d9866b5-161f-4dfb-8970-b52b84dc45a8', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:46:19.882106 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6bf415c7-5c56-4c91-87ad-9c4db489f8cc tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action" status: 202 len: 0 microversion: 2.1 time: 0.368576 Oct 22 03:46:19.883029 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3226/6325] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:46:19 2022] POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:46:19.892389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:19.893074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:19.901778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:19.902535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:19.903166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:19.904071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:19.904722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:19.905335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:20.169642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:20.179675 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0af90cc8-84ed-437b-8415-897c8cb5ce8f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1691 microversion: 2.1 time: 0.292572 Oct 22 03:46:20.180953 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3227/6326] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:19 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1691 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:20.218708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:46:20.219572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:46:20.220055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:46:20.221003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:46:20.221487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:46:20.230736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:20.231226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:20.231669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:20.232439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:20.233105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:20.233760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:20.252478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Getting quotas for project bb1d24ff0a474bc1bab396ca14c3fa04. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:46:20.257834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Getting quotas for user eab802df5a5d432eb9c95d98d19d2288 and project bb1d24ff0a474bc1bab396ca14c3fa04. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:46:20.270731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:46:20.273241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:46:20.320981 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b07324fd-59da-4f5c-92a5-2c7dac2dcf80 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578847 Oct 22 03:46:20.321711 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3100/6327] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:46:20.334120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0832740f-5d45-4e4c-ba63-e34c2b762c41 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:20.334954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0832740f-5d45-4e4c-ba63-e34c2b762c41 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:20.410447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0832740f-5d45-4e4c-ba63-e34c2b762c41 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:20.418613 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0832740f-5d45-4e4c-ba63-e34c2b762c41 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1218 microversion: 2.1 time: 0.089164 Oct 22 03:46:20.421363 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3228/6328] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:20 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:21.204834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:21.205442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:21.214355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:21.214846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:21.215283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:21.215984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:21.216633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:21.217058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:21.367368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:21.375417 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-af5940e6-a757-4793-9f64-6a9bb5d710bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1691 microversion: 2.1 time: 0.174849 Oct 22 03:46:21.376002 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3101/6329] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:21 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:21.444756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:21.445499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:21.454691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:21.455181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:21.455618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:21.456353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:21.456795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:21.457221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:21.523922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:21.532410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0a16095b-6a8c-463e-8747-03aaa966d205 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1270 microversion: 2.1 time: 0.091413 Oct 22 03:46:21.533046 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3229/6330] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:21 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:22.400764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:22.401374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:22.415541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:22.416837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:22.417296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:22.418190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:22.422165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:22.422813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:22.554916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:22.556430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:22.564371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:22.565187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:22.565885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:22.566667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:22.567254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:22.567802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:22.586592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:22.595552 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-496eae7c-ec01-4719-aaf2-7409fc0c2b99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1691 microversion: 2.1 time: 0.200210 Oct 22 03:46:22.596140 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3102/6331] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:22 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:22.705595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:22.714086 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a04df497-4f98-497e-bbba-1274e813785f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1318 microversion: 2.1 time: 0.163158 Oct 22 03:46:22.730772 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3230/6332] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:22 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:23.618940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:23.620350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:23.628090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:23.628726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:23.629269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:23.630431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:23.630995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:23.631666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:23.738851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:23.740856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:23.751122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:23.755572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:23.756123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:23.757298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:23.760349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:23.761063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:23.873502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:23.904629 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5720405d-34b0-4a9d-b259-f69822f77b17 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1691 microversion: 2.1 time: 0.289470 Oct 22 03:46:23.907523 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3103/6333] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:23 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1691 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:23.962162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:23.975911 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-41c65438-a6e1-476e-b21e-d3cec3681cb4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1318 microversion: 2.1 time: 0.241267 Oct 22 03:46:23.989663 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3231/6334] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:23 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:24.011050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5b282bd2-191c-4ab8-8727-965fc1cf8efc req-d1c3c464-41d7-400c-b117-e9be8620ae46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43cd6b7-6261-406c-a266-ce7dbda9f5fd", "tag": "2c301f2e-c317-417f-ae1d-34e0f8bb215e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:24.020751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5b282bd2-191c-4ab8-8727-965fc1cf8efc req-d1c3c464-41d7-400c-b117-e9be8620ae46 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:24.021490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5b282bd2-191c-4ab8-8727-965fc1cf8efc req-d1c3c464-41d7-400c-b117-e9be8620ae46 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:24.022101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5b282bd2-191c-4ab8-8727-965fc1cf8efc req-d1c3c464-41d7-400c-b117-e9be8620ae46 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:24.038488 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5b282bd2-191c-4ab8-8727-965fc1cf8efc req-d1c3c464-41d7-400c-b117-e9be8620ae46 service nova] Creating event network-changed:2c301f2e-c317-417f-ae1d-34e0f8bb215e for instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd on n-h1-862416-2 Oct 22 03:46:24.043683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5b282bd2-191c-4ab8-8727-965fc1cf8efc req-d1c3c464-41d7-400c-b117-e9be8620ae46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134509 Oct 22 03:46:24.044319 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3104/6335] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:46:24.932249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:24.932817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:24.940305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:24.940790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:24.941227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:24.941918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:24.942372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:24.942795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:25.003444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:25.004514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:25.012347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:25.013112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:25.013848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:25.015188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:25.016070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:25.016596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:25.086471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:25.096537 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d7940f0-9f9d-432e-bf59-93283d738197 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.168381 Oct 22 03:46:25.097356 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3232/6336] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:24 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:25.157873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:25.165594 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fad78240-8f56-43fb-88a3-303fc14881ff tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1318 microversion: 2.1 time: 0.167405 Oct 22 03:46:25.166371 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3105/6337] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:24 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:26.121379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:26.122100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:26.133088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:26.134702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:26.135160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:26.135938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:26.136504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:26.137125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:26.190247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:26.191589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:26.199993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:26.200840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:26.201386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:26.202830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:26.203659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:26.204339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:26.283177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:26.290877 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f3f89151-4d8a-4a91-908a-a9ecd201e7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.173580 Oct 22 03:46:26.291455 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3233/6338] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:26 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:26.345424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:26.352556 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2fbbd713-1359-4244-ae54-9518a26ad448 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1318 microversion: 2.1 time: 0.167298 Oct 22 03:46:26.353316 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3106/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:26 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:27.314038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:27.314676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:27.321545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:27.322024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:27.322456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:27.323140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:27.323590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:27.324018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:27.376312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:27.376928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:27.385135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:27.385883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:27.386685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:27.387635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:27.388396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:27.389199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:27.528151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:27.536371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-62c530b0-e187-4cb4-a41e-901d9f7ff76f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.226180 Oct 22 03:46:27.548783 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3234/6340] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:27 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:27.575689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:27.585848 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ba090ff-5eb5-4ac3-821b-9a9c4ba20ea3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1318 microversion: 2.1 time: 0.213301 Oct 22 03:46:27.586820 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3107/6341] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:27 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:28.561088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:28.561842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:28.569006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:28.569599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:28.570115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:28.570914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:28.571466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:28.571903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:28.609612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:28.610975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:28.619111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:28.619604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:28.620046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:28.620794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:28.621254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:28.621690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:28.719823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:28.729640 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3d9cabc4-d176-4d53-8ed6-9d781343b42c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.172484 Oct 22 03:46:28.730352 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3235/6342] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:28 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:28.765722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:28.773440 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-744ec20a-dd2c-45a3-8724-0bc06c0a7b22 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1318 microversion: 2.1 time: 0.168473 Oct 22 03:46:28.774018 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3108/6343] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:28 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:29.105288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0d274348-3c94-4fb8-86fc-cbc308182d13 req-d7869aac-f7e2-4d2f-a78a-7b5e3875b033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43cd6b7-6261-406c-a266-ce7dbda9f5fd", "name": "network-vif-plugged", "status": "completed", "tag": "2c301f2e-c317-417f-ae1d-34e0f8bb215e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:29.115992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0d274348-3c94-4fb8-86fc-cbc308182d13 req-d7869aac-f7e2-4d2f-a78a-7b5e3875b033 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:29.116517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0d274348-3c94-4fb8-86fc-cbc308182d13 req-d7869aac-f7e2-4d2f-a78a-7b5e3875b033 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:29.116954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0d274348-3c94-4fb8-86fc-cbc308182d13 req-d7869aac-f7e2-4d2f-a78a-7b5e3875b033 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:29.129970 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0d274348-3c94-4fb8-86fc-cbc308182d13 req-d7869aac-f7e2-4d2f-a78a-7b5e3875b033 service nova] Creating event network-vif-plugged:2c301f2e-c317-417f-ae1d-34e0f8bb215e for instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd on n-h1-862416-2 Oct 22 03:46:29.135187 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0d274348-3c94-4fb8-86fc-cbc308182d13 req-d7869aac-f7e2-4d2f-a78a-7b5e3875b033 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112130 Oct 22 03:46:29.135790 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3236/6344] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:46:29.754946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:29.755674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:29.762941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:29.763429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:29.763870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:29.764697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:29.765157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:29.765588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:29.797482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:29.798434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:29.806081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:29.806683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:29.807215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:29.808013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:29.808672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:29.809214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:29.917143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:29.926043 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8696cb85-2214-42e4-8410-82e60bafb906 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.175308 Oct 22 03:46:29.926623 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3109/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:29 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:29.949192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:29.957412 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0a6b2d7e-0905-4885-8413-b29d19085c73 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1318 microversion: 2.1 time: 0.164937 Oct 22 03:46:29.958188 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3237/6346] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:29 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:30.950613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:30.951275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:30.954488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:30.955148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:30.961972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:30.962456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:30.962916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:30.963614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:30.964062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:30.964513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:30.979808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:30.980668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:30.982742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:30.990088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:30.990576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:30.991010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:30.991709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:30.992158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:30.992622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:31.109675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:31.119621 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1f02a2ef-cbdd-4060-b3de-c77dfaa57fad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.172919 Oct 22 03:46:31.120607 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3110/6347] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:30 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:31.140590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:31.148444 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3ffef00f-3f36-4b61-9b03-fb91b24a712d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1507 microversion: 2.1 time: 0.172737 Oct 22 03:46:31.149018 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3238/6348] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:30 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:32.145501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:32.146365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:32.153479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:32.154034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:32.154538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:32.156155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:32.156638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:32.157061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:32.323280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:32.332555 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fe80fce4-e220-47da-bb01-78472ea2ce7e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.190838 Oct 22 03:46:32.334110 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3111/6349] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:32 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:46:33.356558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:33.358556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:33.367465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:33.368252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:33.369250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:33.372357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:33.373288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:33.374711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:33.534566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:33.543813 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90e08d69-9de6-437c-b966-dba5fe587992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.190964 Oct 22 03:46:33.544712 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3239/6350] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:33 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:34.567587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:34.568231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:34.575342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:34.575837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:34.576316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:34.577300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:34.577942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:34.578381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:34.748787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:34.757735 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e37ff19-c3ce-4ce5-ad80-10ad9a3a2610 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.194035 Oct 22 03:46:34.758841 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3112/6351] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:34 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:35.785516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:35.786502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:35.795348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:35.796831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:35.797491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:35.798216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:35.798691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:35.799451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:35.973690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:35.982749 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5daf2563-5044-4e74-900e-f884eceac64b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.203044 Oct 22 03:46:35.985065 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3240/6352] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:35 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:37.011864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:37.012646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:37.020287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:37.021229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:37.021680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:37.022385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:37.023023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:37.023728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:37.204549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:37.212616 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bd75413d-2523-4b9e-bc5d-05cbf4e23553 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.204779 Oct 22 03:46:37.213199 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3113/6353] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:37 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:38.237013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:38.239765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:38.247358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:38.247933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:38.248651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:38.249627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:38.250101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:38.250540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:38.271814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:38.402815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:38.411435 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1cc03c4f-6383-4be5-bffa-8d5d76ff432d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.179088 Oct 22 03:46:38.412026 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3241/6354] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:38 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:39.437354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:39.438160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:39.446274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:39.447023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:39.447636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:39.448556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:39.449166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:39.450586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:39.603984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:39.613954 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9b6f765-c976-4c7f-877d-f2f4bdb40b24 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.182798 Oct 22 03:46:39.616246 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3114/6355] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:39 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:40.637699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:40.638316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:40.646491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:40.647244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:40.647935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:40.648876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:40.649520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:40.650148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:40.813766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:40.832857 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d769718b-63fb-4b0f-ac80-57b674a6148a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1696 microversion: 2.1 time: 0.198903 Oct 22 03:46:40.840054 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3242/6356] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:40 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:41.430170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d77c8f45-094e-4366-892e-76203b76fb36 req-f4a9e2ee-e873-4705-a874-2f94d6a3cdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bf53a4-0a03-4c65-a6be-309927058e47", "name": "network-vif-unplugged", "status": "completed", "tag": "9419643d-fffb-41bf-9eba-d4443450a9af"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:41.443012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d77c8f45-094e-4366-892e-76203b76fb36 req-f4a9e2ee-e873-4705-a874-2f94d6a3cdb1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:41.443944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d77c8f45-094e-4366-892e-76203b76fb36 req-f4a9e2ee-e873-4705-a874-2f94d6a3cdb1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:41.444618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d77c8f45-094e-4366-892e-76203b76fb36 req-f4a9e2ee-e873-4705-a874-2f94d6a3cdb1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:41.459842 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d77c8f45-094e-4366-892e-76203b76fb36 req-f4a9e2ee-e873-4705-a874-2f94d6a3cdb1 service nova] Creating event network-vif-unplugged:9419643d-fffb-41bf-9eba-d4443450a9af for instance f7bf53a4-0a03-4c65-a6be-309927058e47 on n-h1-862416-2 Oct 22 03:46:41.466086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-d77c8f45-094e-4366-892e-76203b76fb36 req-f4a9e2ee-e873-4705-a874-2f94d6a3cdb1 service nova] Instance f7bf53a4-0a03-4c65-a6be-309927058e47 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:46:41.481914 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d77c8f45-094e-4366-892e-76203b76fb36 req-f4a9e2ee-e873-4705-a874-2f94d6a3cdb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056762 Oct 22 03:46:41.482986 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3115/6357] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:46:41.863323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:41.864578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:41.872402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:41.873092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:41.874392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:41.875364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:41.876000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:41.876634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:42.055769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:42.065378 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1036ee8-5ec2-4585-b13c-eea7b9ba1cf1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1695 microversion: 2.1 time: 0.206248 Oct 22 03:46:42.067042 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3243/6358] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:41 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:43.091374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:43.093008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:43.099991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:43.100521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:43.100967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:43.101703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:43.102166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:43.102602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:43.125972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:43.254274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:43.262889 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c7e99b2-e06c-411c-9367-fc72c4cb24ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1693 microversion: 2.1 time: 0.176970 Oct 22 03:46:43.263483 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3116/6359] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:43 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:43.504407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-276c3685-0368-4054-b93a-dd19d701db4f req-2cc2c071-6986-423c-91e9-cf780a262605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bf53a4-0a03-4c65-a6be-309927058e47", "tag": "9419643d-fffb-41bf-9eba-d4443450a9af"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:43.514742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-276c3685-0368-4054-b93a-dd19d701db4f req-2cc2c071-6986-423c-91e9-cf780a262605 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:43.515602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-276c3685-0368-4054-b93a-dd19d701db4f req-2cc2c071-6986-423c-91e9-cf780a262605 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:43.515981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-276c3685-0368-4054-b93a-dd19d701db4f req-2cc2c071-6986-423c-91e9-cf780a262605 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:43.528169 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-276c3685-0368-4054-b93a-dd19d701db4f req-2cc2c071-6986-423c-91e9-cf780a262605 service nova] Creating event network-changed:9419643d-fffb-41bf-9eba-d4443450a9af for instance f7bf53a4-0a03-4c65-a6be-309927058e47 on n-h1-862416-2 Oct 22 03:46:43.534605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-276c3685-0368-4054-b93a-dd19d701db4f req-2cc2c071-6986-423c-91e9-cf780a262605 service nova] Instance f7bf53a4-0a03-4c65-a6be-309927058e47 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:46:43.546113 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-276c3685-0368-4054-b93a-dd19d701db4f req-2cc2c071-6986-423c-91e9-cf780a262605 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046759 Oct 22 03:46:43.546869 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3244/6360] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:46:44.290680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:44.292421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:44.312423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:44.312944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:44.313808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:44.315540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:44.317960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:44.318619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:44.582183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:44.595937 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-df6e76f3-06ca-4f85-9622-478c8c4c45d1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1690 microversion: 2.1 time: 0.309933 Oct 22 03:46:44.597802 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3117/6361] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:44 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1690 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:44.621617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:44.622973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:44.631254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:44.632129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:44.632694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:44.633685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:44.634602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:44.636060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:44.706466 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d34fbeb-dc50-47ce-8f2a-5b4171668e89 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action" status: 204 len: 0 microversion: 2.1 time: 0.088836 Oct 22 03:46:44.708002 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3245/6362] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:46:44 2022] POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:46:44.715797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:44.716456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:44.729865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:44.730824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:44.731511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:44.748944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:44.750044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:44.750709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:45.417797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:45.431323 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a929682-198b-4020-a990-5ea61ad59309 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1690 microversion: 2.1 time: 0.719087 Oct 22 03:46:45.432523 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3118/6363] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:44 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1690 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:46.463717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:46.464511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:46.474719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:46.475698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:46.478728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:46.479347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:46.480116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:46.480532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:46.680803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:46.690840 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bd789bc9-e94d-47ae-a0ac-95c3cf3738b2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1690 microversion: 2.1 time: 0.235030 Oct 22 03:46:46.692791 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3246/6364] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:46 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:47.165002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a977336e-48f0-4418-8b32-c0235aa7052e req-fab3d3a6-1982-4f62-bd3a-db0c9d6f0cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bf53a4-0a03-4c65-a6be-309927058e47", "name": "network-vif-plugged", "status": "completed", "tag": "9419643d-fffb-41bf-9eba-d4443450a9af"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:47.176906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a977336e-48f0-4418-8b32-c0235aa7052e req-fab3d3a6-1982-4f62-bd3a-db0c9d6f0cf5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:47.177605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a977336e-48f0-4418-8b32-c0235aa7052e req-fab3d3a6-1982-4f62-bd3a-db0c9d6f0cf5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:47.178300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a977336e-48f0-4418-8b32-c0235aa7052e req-fab3d3a6-1982-4f62-bd3a-db0c9d6f0cf5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:47.191035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a977336e-48f0-4418-8b32-c0235aa7052e req-fab3d3a6-1982-4f62-bd3a-db0c9d6f0cf5 service nova] Creating event network-vif-plugged:9419643d-fffb-41bf-9eba-d4443450a9af for instance f7bf53a4-0a03-4c65-a6be-309927058e47 on n-h1-862416-2 Oct 22 03:46:47.196727 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a977336e-48f0-4418-8b32-c0235aa7052e req-fab3d3a6-1982-4f62-bd3a-db0c9d6f0cf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035355 Oct 22 03:46:47.197878 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3119/6365] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:46:47.717559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:46:47.720115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:47.727108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:47.727663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:47.728100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:47.728834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:47.729283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:47.729952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:47.879280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:46:47.889458 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55357989-1d0f-427d-b992-0ff0038d8ea0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1682 microversion: 2.1 time: 0.175126 Oct 22 03:46:47.889847 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3247/6366] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:46:47 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:46:48.712626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec85c91d-2a31-4d52-9dc4-b1120d0687d5", "device": "/dev/sdb"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:46:48.715326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:46:48.717758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:46:48.724933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:48.725559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:48.726126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:48.726906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:46:48.727473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:46:48.727979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:46:48.985170 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e5dfb4c-6a7e-40fb-a45f-d535848aba91 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "POST /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277607 Oct 22 03:46:48.986008 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3120/6367] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:46:48 2022] POST /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:47:10.120866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:10.123689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:10.126382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=50 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:10.127110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:10.133130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:10.133641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:10.134091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:10.134838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:10.135487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:10.137139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:10.202223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2dc2cf1f-0a2c-493e-8a44-fe134648398a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action" status: 200 len: 24572 microversion: 2.1 time: 0.085334 Oct 22 03:47:10.202965 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3248/6368] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:47:10 2022] POST /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47/action => generated 24572 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:47:15.123173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:15.124504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:15.127727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:15.128554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:15.136224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:15.136924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:15.137447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:15.138250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:15.138899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:15.139526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:15.245859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lazy-loading 'services' on Instance uuid d43cd6b7-6261-406c-a266-ce7dbda9f5fd {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:47:15.329177 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-574ef7f0-c50e-44f3-a7dd-5309cef0cc43 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd/os-volume_attachments/ec85c91d-2a31-4d52-9dc4-b1120d0687d5" status: 202 len: 0 microversion: 2.1 time: 0.210244 Oct 22 03:47:15.333627 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3121/6369] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:47:15 2022] DELETE /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd/os-volume_attachments/ec85c91d-2a31-4d52-9dc4-b1120d0687d5 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:47:16.488838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:16.489545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:16.497045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:16.497534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:16.497976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:16.498717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:16.499139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:16.499570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:16.634387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-536c0413-6866-4c84-9f38-9cee1e08f462 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1833 microversion: 2.1 time: 0.149862 Oct 22 03:47:16.635075 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3249/6370] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:16 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1833 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:17.529042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:17.530527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:17.533325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4c6e6a0f-faa0-47f9-99d1-f2e4d96c72b7 req-c28ce4ea-b13a-4382-945c-61b89736c6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bf53a4-0a03-4c65-a6be-309927058e47", "tag": "9419643d-fffb-41bf-9eba-d4443450a9af"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:17.543856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:17.546217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:17.547013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:17.548177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:17.549057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:17.555006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:17.563273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4c6e6a0f-faa0-47f9-99d1-f2e4d96c72b7 req-c28ce4ea-b13a-4382-945c-61b89736c6c6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:17.566515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4c6e6a0f-faa0-47f9-99d1-f2e4d96c72b7 req-c28ce4ea-b13a-4382-945c-61b89736c6c6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:17.568935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4c6e6a0f-faa0-47f9-99d1-f2e4d96c72b7 req-c28ce4ea-b13a-4382-945c-61b89736c6c6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:17.600499 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4c6e6a0f-faa0-47f9-99d1-f2e4d96c72b7 req-c28ce4ea-b13a-4382-945c-61b89736c6c6 service nova] Creating event network-changed:9419643d-fffb-41bf-9eba-d4443450a9af for instance f7bf53a4-0a03-4c65-a6be-309927058e47 on n-h1-862416-2 Oct 22 03:47:17.613511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:47:17.615826 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4c6e6a0f-faa0-47f9-99d1-f2e4d96c72b7 req-c28ce4ea-b13a-4382-945c-61b89736c6c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088599 Oct 22 03:47:17.618377 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3250/6371] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:47:17.754702 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2bc2d9dd-eda8-4488-a33e-05080c0d9424 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 204 len: 0 microversion: 2.1 time: 0.230132 Oct 22 03:47:17.757621 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3122/6372] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:47:17 2022] DELETE /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:47:17.768715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:17.769528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:17.786966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:17.788789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:17.790044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:17.791745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:17.792444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:17.793250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:17.965847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:17.975468 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe1da3d0-fe33-4302-9288-a4fc62180646 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1688 microversion: 2.1 time: 0.213022 Oct 22 03:47:17.976655 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3251/6373] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:17 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:19.000313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:19.001113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:19.007840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:19.008387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:19.008831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:19.009536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:19.009994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:19.010454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:19.244573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:19.253439 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fb6ab497-18fe-45e5-90d1-3f45af44e436 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1688 microversion: 2.1 time: 0.257690 Oct 22 03:47:19.254348 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3123/6374] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:18 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1688 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:19.826002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b2a77f9f-58bd-4288-980b-c46304c42c36 req-83324b41-a85d-46d6-8439-3fda1a8d457e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bf53a4-0a03-4c65-a6be-309927058e47", "name": "network-vif-deleted", "tag": "9419643d-fffb-41bf-9eba-d4443450a9af"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:19.838329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b2a77f9f-58bd-4288-980b-c46304c42c36 req-83324b41-a85d-46d6-8439-3fda1a8d457e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:19.839074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b2a77f9f-58bd-4288-980b-c46304c42c36 req-83324b41-a85d-46d6-8439-3fda1a8d457e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:19.839736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b2a77f9f-58bd-4288-980b-c46304c42c36 req-83324b41-a85d-46d6-8439-3fda1a8d457e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:19.858453 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b2a77f9f-58bd-4288-980b-c46304c42c36 req-83324b41-a85d-46d6-8439-3fda1a8d457e service nova] Creating event network-vif-deleted:9419643d-fffb-41bf-9eba-d4443450a9af for instance f7bf53a4-0a03-4c65-a6be-309927058e47 on n-h1-862416-2 Oct 22 03:47:19.863502 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b2a77f9f-58bd-4288-980b-c46304c42c36 req-83324b41-a85d-46d6-8439-3fda1a8d457e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050162 Oct 22 03:47:19.864143 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3252/6375] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:47:20.276741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:20.277346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:20.285046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:20.285526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:20.285984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:20.286660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:20.287108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:20.287532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:20.318914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:20.319462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:20.319907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:20.320467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lazy-loading 'fault' on Instance uuid f7bf53a4-0a03-4c65-a6be-309927058e47 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:47:20.362755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:20.370726 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-99f5718d-deb0-48da-90fd-ea391697a787 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 200 len: 1355 microversion: 2.1 time: 0.097846 Oct 22 03:47:20.371572 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3124/6376] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:20 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 1355 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:21.395690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:21.396321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: f7bf53a4-0a03-4c65-a6be-309927058e47] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:21.402534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:21.403015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:21.403455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:21.404146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:21.405436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:21.405873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:21.419213 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] HTTP exception thrown: Instance f7bf53a4-0a03-4c65-a6be-309927058e47 could not be found. Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Request method failure captured: Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 HTTP/1.1 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2cuhsqeIjxZRi8SYlVM2YAHKWF908XmT0FuqmGR_L4W9OH0DVS6J-6-4DQBAHeUYH9qZx6kksVB3TAAqd1NlyYBvJLfYErPtU6joZfwY40hpzy6-8IeuUE7fYhuFP1m381kmKeryIRqkoJQK11VP6EdDXSGvwQC-0XfXiowIBCbCvU Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f73e2096501b458ca6d9f587c21c6d23 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f73e2096501b458ca6d9f587c21c6d23"}]}] Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f73e2096501b458ca6d9f587c21c6d23 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestNetworkAdvancedServerOps-1799870770-project Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 754cd3eb62c24a1eb25a4d294a063588 Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1799870770-project Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f7bf53a4-0a03-4c65-a6be-309927058e47 could not be found. Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f7bf53a4-0a03-4c65-a6be-309927058e47'} Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7bf53a4-0a03-4c65-a6be-309927058e47 could not be found. Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7bf53a4-0a03-4c65-a6be-309927058e47 could not be found. Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:21.421662 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7bf53a4-0a03-4c65-a6be-309927058e47 could not be found. Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Returning 404 to user: Instance f7bf53a4-0a03-4c65-a6be-309927058e47 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef4d908d-8174-478e-8af3-146dabd2da43 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47" status: 404 len: 111 microversion: 2.1 time: 0.032769 Oct 22 03:47:21.426652 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3253/6377] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:21 2022] GET /compute/v2.1/servers/f7bf53a4-0a03-4c65-a6be-309927058e47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:47:21.945141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:21.946216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:21.954384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:21.955113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:21.955547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:21.956487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:21.957117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:21.957707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:21.989818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:47:22.072842 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a05aa105-7829-416d-8c49-b8e8238bf76e tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 204 len: 0 microversion: 2.1 time: 0.132165 Oct 22 03:47:22.078219 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3125/6378] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:47:21 2022] DELETE /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:47:22.083572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:22.084723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:22.090929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:22.091489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:22.092536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:22.093629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:22.094295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:22.094927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:22.242229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:22.253583 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc58d910-8005-4f1d-8fa6-2873a2ff2da9 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1513 microversion: 2.1 time: 0.175175 Oct 22 03:47:22.254166 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3254/6379] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:22 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:23.277771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:23.279102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:23.287321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:23.288064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:23.289134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:23.290238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:23.290982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:23.291577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:23.709520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:23.720435 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-751722c1-1145-44f9-bf55-8ec2f50a23db tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1513 microversion: 2.1 time: 0.445446 Oct 22 03:47:23.739224 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3126/6380] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:23 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1513 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:24.747092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:24.748395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:24.762754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:24.763265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:24.763711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:24.764801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:24.765271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:24.765716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:24.871433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:24.875169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-61ad0b85-fa27-4148-9d8e-838ec5248226 req-2390a5b1-f12d-4c4b-93c1-315d0db4328c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43cd6b7-6261-406c-a266-ce7dbda9f5fd", "name": "network-vif-deleted", "tag": "2c301f2e-c317-417f-ae1d-34e0f8bb215e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:24.883954 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5ad3794-eccc-4107-a162-0d63f9563287 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 200 len: 1471 microversion: 2.1 time: 0.140462 Oct 22 03:47:24.900643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-61ad0b85-fa27-4148-9d8e-838ec5248226 req-2390a5b1-f12d-4c4b-93c1-315d0db4328c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:24.903333 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3255/6381] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:24 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:24.905155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-61ad0b85-fa27-4148-9d8e-838ec5248226 req-2390a5b1-f12d-4c4b-93c1-315d0db4328c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:24.905618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-61ad0b85-fa27-4148-9d8e-838ec5248226 req-2390a5b1-f12d-4c4b-93c1-315d0db4328c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:24.921949 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-61ad0b85-fa27-4148-9d8e-838ec5248226 req-2390a5b1-f12d-4c4b-93c1-315d0db4328c service nova] Creating event network-vif-deleted:2c301f2e-c317-417f-ae1d-34e0f8bb215e for instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd on n-h1-862416-2 Oct 22 03:47:24.942858 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-61ad0b85-fa27-4148-9d8e-838ec5248226 req-2390a5b1-f12d-4c4b-93c1-315d0db4328c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073107 Oct 22 03:47:24.944054 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3127/6382] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:47:25.909899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:25.910509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: d43cd6b7-6261-406c-a266-ce7dbda9f5fd] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:25.919914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:25.921082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:25.921513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:25.922403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:25.922675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:25.923108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:25.941753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] HTTP exception thrown: Instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd could not be found. Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Request method failure captured: Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd HTTP/1.1 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2dQoF_p9ciqW0x1cWBZjVAfyFTYjFiRzCEfbZvRDs4RwpmLnDU3tRp1Alse_SEC4ZHKniqgXJYoZOPAzNWC_Bz0JCpeWzsY4U4YS8TtJc8R2gX3xjcIg3ueDFUsXK_6Vyo8ZKXq4wPsTPu37XaXbZanpe3FLry1TfU4oZdzG8Bx62k Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bb1d24ff0a474bc1bab396ca14c3fa04 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1933511794 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb1d24ff0a474bc1bab396ca14c3fa04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb1d24ff0a474bc1bab396ca14c3fa04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb1d24ff0a474bc1bab396ca14c3fa04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb1d24ff0a474bc1bab396ca14c3fa04"}]}] Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesSnapshotTestJSON-1933511794 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bb1d24ff0a474bc1bab396ca14c3fa04 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1933511794 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesSnapshotTestJSON-1933511794-project Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: eab802df5a5d432eb9c95d98d19d2288 Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesSnapshotTestJSON-1933511794-project Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd could not be found. Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd43cd6b7-6261-406c-a266-ce7dbda9f5fd'} Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd could not be found. Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd could not be found. Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:47:25.943418 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd could not be found. Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Returning 404 to user: Instance d43cd6b7-6261-406c-a266-ce7dbda9f5fd could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9164979e-58c0-4366-91e5-a90dda3f4159 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd" status: 404 len: 111 microversion: 2.1 time: 0.039109 Oct 22 03:47:25.951635 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3256/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:25 2022] GET /compute/v2.1/servers/d43cd6b7-6261-406c-a266-ce7dbda9f5fd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:47:25.956690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9594b73e-b3a7-4fb0-919d-a466ecd176b7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '.version_select at 0x7f0d19aa7b80>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:25.988980 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9594b73e-b3a7-4fb0-919d-a466ecd176b7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1268715948" status: 202 len: 0 microversion: 2.1 time: 0.045562 Oct 22 03:47:25.991077 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3128/6384] 10.222.0.25 () {58 vars in 1284 bytes} [Sat Oct 22 03:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1268715948 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:47:26.022098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b55c22f0-8a0a-4a50-8351-578c3378272c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'create', calling method: .version_select at 0x7f0d18c3b310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-92378966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5hAREdzRC87bHqhLSsfgeV5Dv2Zoaiqv+OuzUU99ozmoQv7ORrFnlaJWMIE+HUQjx08UgKnFwyjZM/7WS5O2qIkbzazV2eORTdv+KZqXtGFOOPUuUno+JXK3j+zhqpbw=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:26.040706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b55c22f0-8a0a-4a50-8351-578c3378272c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for project f73e2096501b458ca6d9f587c21c6d23. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:47:26.046775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-b55c22f0-8a0a-4a50-8351-578c3378272c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for user 754cd3eb62c24a1eb25a4d294a063588 and project f73e2096501b458ca6d9f587c21c6d23. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:47:26.078152 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b55c22f0-8a0a-4a50-8351-578c3378272c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.060168 Oct 22 03:47:26.079139 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3257/6385] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:47:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:47:33.135004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1640501870", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "6d9866b5-161f-4dfb-8970-b52b84dc45a8"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:33.212506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] validate_networks() for [('6d9866b5-161f-4dfb-8970-b52b84dc45a8', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:47:33.268979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1428619537", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "3a801ce0-c790-4058-ba9c-f32b2bed870b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-92378966", "security_groups": [{"name": "tempest-secgroup-smoke-1343710010"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:33.433885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] validate_networks() for [('3a801ce0-c790-4058-ba9c-f32b2bed870b', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:47:33.877630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:47:33.878316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:47:33.878989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:47:33.879578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:47:33.880169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:47:33.892891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:33.893707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:33.894323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:33.895262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:33.895896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:33.896534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:33.957296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Getting quotas for project bb1d24ff0a474bc1bab396ca14c3fa04. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:47:33.964713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Getting quotas for user eab802df5a5d432eb9c95d98d19d2288 and project bb1d24ff0a474bc1bab396ca14c3fa04. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:47:33.982399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:47:33.985737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:47:34.056438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:47:34.057135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:47:34.057816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:47:34.058640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:47:34.059300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:47:34.068926 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ebd6fec-2787-459a-81fa-3180ad76a126 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938549 Oct 22 03:47:34.072331 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3129/6386] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:47:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:47:34.075577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:34.080831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:34.082559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:34.083980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da988a51-77c5-4e39-a0ec-162846f80488 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:34.085176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:34.085843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:34.087258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:34.087437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-da988a51-77c5-4e39-a0ec-162846f80488 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:34.149283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for project f73e2096501b458ca6d9f587c21c6d23. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:47:34.174505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for user 754cd3eb62c24a1eb25a4d294a063588 and project f73e2096501b458ca6d9f587c21c6d23. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:47:34.212312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:47:34.214918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:47:34.222114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-da988a51-77c5-4e39-a0ec-162846f80488 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:34.244906 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-da988a51-77c5-4e39-a0ec-162846f80488 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1219 microversion: 2.1 time: 0.164026 Oct 22 03:47:34.245858 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3130/6387] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:34 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:34.306407 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40b6729a-1c56-40db-b439-fa482de73b18 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.043603 Oct 22 03:47:34.307386 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3258/6388] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:47:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 22 03:47:34.325478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a35499f5-850a-4bae-b5cd-69b6e6f62568 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:34.328383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a35499f5-850a-4bae-b5cd-69b6e6f62568 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:34.450384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a35499f5-850a-4bae-b5cd-69b6e6f62568 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:34.458540 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a35499f5-850a-4bae-b5cd-69b6e6f62568 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1265 microversion: 2.1 time: 0.142899 Oct 22 03:47:34.474533 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3131/6389] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:34 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:35.269611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:35.270319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:35.277917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:35.278343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:35.278893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:35.279616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:35.281317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:35.281778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:35.362544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:35.372819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-acefbe70-5777-495d-a4d5-50b389e900c4 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1271 microversion: 2.1 time: 0.107402 Oct 22 03:47:35.373425 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3259/6390] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:35 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:35.490974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:35.492082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:35.500782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:35.501523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:35.502172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:35.503085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:35.503714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:35.504351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:35.586870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:35.598873 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-75f7fca5-3d92-4557-b146-4375b43169c5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1261 microversion: 2.1 time: 0.117573 Oct 22 03:47:35.600194 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3132/6391] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:35 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1261 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:36.401623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:36.402889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:36.413598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:36.417603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:36.421308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:36.422093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:36.422567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:36.422999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:36.520283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:36.529947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc93f570-5b13-49ad-95df-0788690e62bf tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1277 microversion: 2.1 time: 0.132981 Oct 22 03:47:36.532867 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3260/6392] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:36 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:36.629563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:36.630173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:36.637448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:36.638173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:36.638800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:36.640759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:36.642885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:36.643536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:36.739945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:36.750065 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17918e1c-7ae7-4691-9ec0-f9c7536c2928 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1323 microversion: 2.1 time: 0.124240 Oct 22 03:47:36.751173 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3133/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:36 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1323 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:37.557758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:37.558498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:37.580285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:37.581852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:37.582676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:37.583662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:37.584691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:37.585425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:37.783745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:37.785131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:37.787934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:37.793424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:37.794171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:37.794841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:37.797571 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c3a779e-235e-4d46-bb22-61406ff0698f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1319 microversion: 2.1 time: 0.244644 Oct 22 03:47:37.799958 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3261/6394] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:37 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:37.813751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:37.814441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:37.815139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:38.430491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:38.439369 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5d2c601-c458-459f-8988-b69552dfccaf tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.665305 Oct 22 03:47:38.440103 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3134/6395] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:37 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:38.783274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2ffdf013-2abb-48e9-9432-627a8579eaa9 req-f6c3f034-617d-4bce-a837-008d8efe6963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3346291e-40c7-45bf-9673-fafb4aae1a52", "tag": "607ed970-0cb7-46a3-b9a1-4011d99f1520"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:38.795149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2ffdf013-2abb-48e9-9432-627a8579eaa9 req-f6c3f034-617d-4bce-a837-008d8efe6963 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:38.795778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2ffdf013-2abb-48e9-9432-627a8579eaa9 req-f6c3f034-617d-4bce-a837-008d8efe6963 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:38.796227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2ffdf013-2abb-48e9-9432-627a8579eaa9 req-f6c3f034-617d-4bce-a837-008d8efe6963 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:38.807728 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2ffdf013-2abb-48e9-9432-627a8579eaa9 req-f6c3f034-617d-4bce-a837-008d8efe6963 service nova] Creating event network-changed:607ed970-0cb7-46a3-b9a1-4011d99f1520 for instance 3346291e-40c7-45bf-9673-fafb4aae1a52 on n-h2-862416-2 Oct 22 03:47:38.812903 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2ffdf013-2abb-48e9-9432-627a8579eaa9 req-f6c3f034-617d-4bce-a837-008d8efe6963 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034160 Oct 22 03:47:38.813516 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3262/6396] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:47:38.822083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:38.823320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:38.831087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:38.831583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:38.832023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:38.833147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:38.833610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:38.834047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:39.223705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:39.232075 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c02aed19-4040-4a45-8fb4-b053502f3f9f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1319 microversion: 2.1 time: 0.413782 Oct 22 03:47:39.232822 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3135/6397] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:38 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:47:39.463431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:39.464134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:39.478098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:39.478790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:39.479429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:39.479951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:39.480444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:39.480867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:39.647674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:39.658291 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d06317b4-64ef-4617-bd00-48eb057ddd45 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.199033 Oct 22 03:47:39.658884 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3263/6398] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:39 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:40.257679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:40.258296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:40.266016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:40.266501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:40.266943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:40.267644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:40.268100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:40.268580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:40.408341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:40.416058 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ec4b637-0919-45d6-b01e-2382d02a5372 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1319 microversion: 2.1 time: 0.162369 Oct 22 03:47:40.416670 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3136/6399] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:40 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:40.681409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:40.682029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:40.684798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:40.691281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:40.691786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:40.692228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:40.692932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:40.693392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:40.693818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:40.697003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=65 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:40.833781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:40.842386 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a97006c5-5bdc-418e-907c-389defba5aca tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.164816 Oct 22 03:47:40.844875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d5d9a2e5-d319-4a9c-872c-c2ba0f7790fa req-551ebf20-32c9-4f5e-96ba-863a4bfdd9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:40.846961 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3264/6400] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:40 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:47:40.854657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d5d9a2e5-d319-4a9c-872c-c2ba0f7790fa req-551ebf20-32c9-4f5e-96ba-863a4bfdd9b1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:40.855135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d5d9a2e5-d319-4a9c-872c-c2ba0f7790fa req-551ebf20-32c9-4f5e-96ba-863a4bfdd9b1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:40.855565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d5d9a2e5-d319-4a9c-872c-c2ba0f7790fa req-551ebf20-32c9-4f5e-96ba-863a4bfdd9b1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:40.870303 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d5d9a2e5-d319-4a9c-872c-c2ba0f7790fa req-551ebf20-32c9-4f5e-96ba-863a4bfdd9b1 service nova] Creating event network-changed:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h2-862416-2 Oct 22 03:47:40.876379 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d5d9a2e5-d319-4a9c-872c-c2ba0f7790fa req-551ebf20-32c9-4f5e-96ba-863a4bfdd9b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035897 Oct 22 03:47:40.877307 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3137/6401] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:47:41.439974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:41.440662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:41.447279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:41.447780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:41.448222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:41.449076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:41.449721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:41.450158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:41.599289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:41.607283 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-101075c8-1dc2-4b73-a0db-c90f74ff550b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1319 microversion: 2.1 time: 0.173249 Oct 22 03:47:41.607870 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3265/6402] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:41 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:47:41.867280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:41.867993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:41.879128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:41.879907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:41.880580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:41.881872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:41.882571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:41.883019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:41.887500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:42.305514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:42.313943 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6b35867-05b1-4069-b264-832869ae3840 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.452361 Oct 22 03:47:42.314527 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3138/6403] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:41 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:42.634602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:42.635391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:42.651623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:42.652226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:42.652771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:42.653550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:42.654122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:42.654630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:43.162681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:43.172411 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bf57f2f7-a2a1-4a6d-9850-c2cb8c3d5be8 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1319 microversion: 2.1 time: 0.541543 Oct 22 03:47:43.173087 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3266/6404] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:42 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:43.338449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:43.339218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:43.347667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:43.347942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:43.348383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:43.349149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:43.349611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:43.350047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:43.485446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:43.493542 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-65aa3420-252b-44df-9839-405ae5d7f034 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.159201 Oct 22 03:47:43.494122 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3139/6405] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:43 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:44.196496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:44.197111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:44.199752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:44.200442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:44.207611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:44.208094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:44.208558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:44.209249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:44.209701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:44.210123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:44.341917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:44.351052 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c79ac51d-5e96-4bdb-b0cc-2041c7f92181 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1319 microversion: 2.1 time: 0.158322 Oct 22 03:47:44.351648 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3267/6406] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:44 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:44.516478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:44.517231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:44.519215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:44.520921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:44.527134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:44.527626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:44.528073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:44.528810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:44.529271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:44.529704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:44.676687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:44.684534 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-979589d7-e54d-4bf6-b42d-d40bf56a4020 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.172137 Oct 22 03:47:44.685118 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3140/6407] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:44 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:45.204389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-588e1a76-7e38-4b40-b9e2-8c8635288f98 req-cbd182fc-7f28-4fe3-9409-9e07a9eca6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3346291e-40c7-45bf-9673-fafb4aae1a52", "name": "network-vif-plugged", "status": "completed", "tag": "607ed970-0cb7-46a3-b9a1-4011d99f1520"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:45.215893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-588e1a76-7e38-4b40-b9e2-8c8635288f98 req-cbd182fc-7f28-4fe3-9409-9e07a9eca6c8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:45.216637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-588e1a76-7e38-4b40-b9e2-8c8635288f98 req-cbd182fc-7f28-4fe3-9409-9e07a9eca6c8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:45.217267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-588e1a76-7e38-4b40-b9e2-8c8635288f98 req-cbd182fc-7f28-4fe3-9409-9e07a9eca6c8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:45.229354 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-588e1a76-7e38-4b40-b9e2-8c8635288f98 req-cbd182fc-7f28-4fe3-9409-9e07a9eca6c8 service nova] Creating event network-vif-plugged:607ed970-0cb7-46a3-b9a1-4011d99f1520 for instance 3346291e-40c7-45bf-9673-fafb4aae1a52 on n-h2-862416-2 Oct 22 03:47:45.235919 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-588e1a76-7e38-4b40-b9e2-8c8635288f98 req-cbd182fc-7f28-4fe3-9409-9e07a9eca6c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036920 Oct 22 03:47:45.236730 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3268/6408] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:47:45.375294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:45.375899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:45.377990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:47:45.383065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:45.383546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:45.384249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:45.385482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:45.385940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:45.386404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:45.528316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:45.536538 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2de466cc-5d01-496e-8293-d7255bebc384 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1319 microversion: 2.1 time: 0.166012 Oct 22 03:47:45.537122 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3141/6409] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:45 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:45.710210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:45.711174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:45.718721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:45.719346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:45.719889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:45.720914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:45.721484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:45.722008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:45.864434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:45.872491 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-918e2023-87e0-444e-96d0-0fa11efd0754 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.166893 Oct 22 03:47:45.873132 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3269/6410] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:45 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:46.560113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:46.560745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:46.567718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:46.568197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:46.568667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:46.569358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:46.569811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:46.570237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:46.712965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:46.723946 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1e945dda-bbf2-41fc-b78d-68af8d43264b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1319 microversion: 2.1 time: 0.167140 Oct 22 03:47:46.724788 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3142/6411] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:46 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:46.895296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:46.895937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:46.902856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:46.903433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:46.903817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:46.904547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:46.905106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:46.905534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:47.049540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:47.067064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-70f45447-31a8-46c3-9d73-bf4736725b91 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.174483 Oct 22 03:47:47.069190 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3270/6412] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:46 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:47.747005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:47.747895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:47.755812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:47.756560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:47.756966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:47.757704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:47.758157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:47.758595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:47.897657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:47.907074 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-95f8ab7a-1139-4341-b9ee-85b0c8aed77f tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1508 microversion: 2.1 time: 0.163965 Oct 22 03:47:47.907662 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3143/6413] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:47 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:47.930245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cbb941c-2a0b-4579-b06d-03d0aec2b625", "device": "/dev/sdb"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:47.932661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:47.939913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:47.940453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:47.940892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:47.941588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:47.942041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:47.942469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:48.090231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:48.090847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:48.098440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:48.098931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:48.099370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:48.100082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:48.100600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:48.101035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:48.225140 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e2d1a336-0d3e-4112-9a52-03adda2e5ab3 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "POST /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298725 Oct 22 03:47:48.226197 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3271/6414] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 03:47:47 2022] POST /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:47:48.270098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:48.279861 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-00799d76-d2b3-4242-ac1d-bcbc08777ff1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.193799 Oct 22 03:47:48.281099 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3144/6415] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:48 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:47:49.215521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-34975ba8-8186-4946-93fe-b394db8a86a4 req-4e827e93-eedd-46a6-a0ae-675eba577743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "name": "network-vif-plugged", "status": "completed", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:49.231580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-34975ba8-8186-4946-93fe-b394db8a86a4 req-4e827e93-eedd-46a6-a0ae-675eba577743 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:49.232421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-34975ba8-8186-4946-93fe-b394db8a86a4 req-4e827e93-eedd-46a6-a0ae-675eba577743 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:49.234302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-34975ba8-8186-4946-93fe-b394db8a86a4 req-4e827e93-eedd-46a6-a0ae-675eba577743 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:49.251451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-34975ba8-8186-4946-93fe-b394db8a86a4 req-4e827e93-eedd-46a6-a0ae-675eba577743 service nova] Creating event network-vif-plugged:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h2-862416-2 Oct 22 03:47:49.257220 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-34975ba8-8186-4946-93fe-b394db8a86a4 req-4e827e93-eedd-46a6-a0ae-675eba577743 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045979 Oct 22 03:47:49.258885 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3272/6416] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:47:49.309824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:49.311017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:49.326321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:49.329048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:49.330335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:49.333739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:49.334409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:49.335075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:49.573955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:49.583747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-73bade22-2e93-4a42-a4a1-e1050a343b1d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.284485 Oct 22 03:47:49.584389 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3145/6417] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:49 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:50.616168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:50.617582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:50.636295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:50.637262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:50.637963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:50.638805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:50.640244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:50.640980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:50.844316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:50.853575 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b757c4f-e02c-4de4-a837-ea339627f74c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1391 microversion: 2.1 time: 0.250264 Oct 22 03:47:50.854425 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3273/6418] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:50 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1391 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:51.878076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:51.878779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:51.886070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:51.886564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:51.887010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:51.887725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:51.888187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:51.888649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:52.040054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:52.049665 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-76aec692-3606-4eca-b64c-f0dff1b37cf2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1563 microversion: 2.1 time: 0.175422 Oct 22 03:47:52.050260 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3146/6419] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:51 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:52.072024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:52.073263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:52.083099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:52.083775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:52.084457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:52.085359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:52.085983 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:52.087012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:52.246295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:52.261585 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f2b43fc-2b20-41ee-803c-457c9a17f3e8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1563 microversion: 2.1 time: 0.193653 Oct 22 03:47:52.262954 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3274/6420] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:52 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:47:54.041742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:47:54.042378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:47:54.052618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:54.053308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:54.054553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:54.055316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:54.056362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:54.056960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:54.145496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-88c938fa-b3ed-44ca-91b8-8b631a9a0b86 req-e5024863-4ff8-4101-9644-39443dfda35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:47:54.157341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-88c938fa-b3ed-44ca-91b8-8b631a9a0b86 req-e5024863-4ff8-4101-9644-39443dfda35e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:47:54.157952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-88c938fa-b3ed-44ca-91b8-8b631a9a0b86 req-e5024863-4ff8-4101-9644-39443dfda35e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:47:54.158458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-88c938fa-b3ed-44ca-91b8-8b631a9a0b86 req-e5024863-4ff8-4101-9644-39443dfda35e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:47:54.189989 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-88c938fa-b3ed-44ca-91b8-8b631a9a0b86 req-e5024863-4ff8-4101-9644-39443dfda35e service nova] Creating event network-changed:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h2-862416-2 Oct 22 03:47:54.196479 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-88c938fa-b3ed-44ca-91b8-8b631a9a0b86 req-e5024863-4ff8-4101-9644-39443dfda35e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151357 Oct 22 03:47:54.197345 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3275/6421] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:47:54.295036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:47:54.303744 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90c91839-3d83-454a-ac6f-8d2a1c23c571 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1563 microversion: 2.1 time: 0.267809 Oct 22 03:47:54.304895 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3147/6422] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:47:54 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1563 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:48:11.011894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=23 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:48:11.012676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:48:11.018495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:11.019097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:11.027279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:11.027781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:11.028253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:11.028974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:11.029435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:11.029871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:11.112330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lazy-loading 'services' on Instance uuid 3346291e-40c7-45bf-9673-fafb4aae1a52 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:48:11.184161 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-484ddf34-ce01-4581-9bb6-7549b551428d tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52/os-volume_attachments/4cbb941c-2a0b-4579-b06d-03d0aec2b625" status: 202 len: 0 microversion: 2.1 time: 0.174425 Oct 22 03:48:11.184841 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3276/6423] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 03:48:11 2022] DELETE /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52/os-volume_attachments/4cbb941c-2a0b-4579-b06d-03d0aec2b625 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:48:16.385584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:16.386217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:16.388947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=13 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:48:16.389613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=58 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:48:16.396234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:16.396730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:16.397170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:16.397879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:16.398336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:16.398765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:16.425677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:48:16.510804 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3cb67da-0252-4522-8cbc-eb6fb66f747a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 204 len: 0 microversion: 2.1 time: 0.128732 Oct 22 03:48:16.511773 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3148/6424] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:48:16 2022] DELETE /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:48:16.522124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:16.523096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:16.529492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:16.529986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:16.530959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:16.531840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:16.532320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:16.532816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:16.672929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:16.680893 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2f0a260c-f889-4073-97b6-15d91af79536 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1514 microversion: 2.1 time: 0.164370 Oct 22 03:48:16.681476 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3277/6425] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:16 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:48:17.705721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:17.706421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:17.713264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:17.713740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:17.714172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:17.714898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:17.715396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:17.715822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:17.851558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:17.859611 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ae8633cb-0c9b-4857-bb8c-8fb40a2586d2 tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1514 microversion: 2.1 time: 0.158670 Oct 22 03:48:17.860404 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3149/6426] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:17 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:48:18.829151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2b0a2c33-d6dc-4c41-8dde-1fdd2fc4dbcb req-3d4f2477-bc25-478a-ba8c-c40bd4ff3ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3346291e-40c7-45bf-9673-fafb4aae1a52", "name": "network-vif-deleted", "tag": "607ed970-0cb7-46a3-b9a1-4011d99f1520"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:48:18.839215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2b0a2c33-d6dc-4c41-8dde-1fdd2fc4dbcb req-3d4f2477-bc25-478a-ba8c-c40bd4ff3ccb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:18.839698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2b0a2c33-d6dc-4c41-8dde-1fdd2fc4dbcb req-3d4f2477-bc25-478a-ba8c-c40bd4ff3ccb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:18.842051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2b0a2c33-d6dc-4c41-8dde-1fdd2fc4dbcb req-3d4f2477-bc25-478a-ba8c-c40bd4ff3ccb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:18.856876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2b0a2c33-d6dc-4c41-8dde-1fdd2fc4dbcb req-3d4f2477-bc25-478a-ba8c-c40bd4ff3ccb service nova] Creating event network-vif-deleted:607ed970-0cb7-46a3-b9a1-4011d99f1520 for instance 3346291e-40c7-45bf-9673-fafb4aae1a52 on n-h2-862416-2 Oct 22 03:48:18.862476 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2b0a2c33-d6dc-4c41-8dde-1fdd2fc4dbcb req-3d4f2477-bc25-478a-ba8c-c40bd4ff3ccb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037098 Oct 22 03:48:18.863087 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3278/6427] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:48:18.887275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:18.887991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:18.895722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:18.896343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:18.896853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:18.897634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:18.898158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:18.898794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:18.970215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab802df5a5d432eb9c95d98d19d2288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb1d24ff0a474bc1bab396ca14c3fa04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:18.979546 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5181a78-657a-4a43-a5fa-df6a784e633a tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 200 len: 1304 microversion: 2.1 time: 0.096189 Oct 22 03:48:18.979963 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3150/6428] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:18 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:48:20.004273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:20.005042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] [instance: 3346291e-40c7-45bf-9673-fafb4aae1a52] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:20.012081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:20.012589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:20.013058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:20.013705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:20.014152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:20.014574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:20.030833 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] HTTP exception thrown: Instance 3346291e-40c7-45bf-9673-fafb4aae1a52 could not be found. Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Request method failure captured: Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 HTTP/1.1 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2dQoF_p9ciqW0x1cWBZjVAfyFTYjFiRzCEfbZvRDs4RwpmLnDU3tRp1Alse_SEC4ZHKniqgXJYoZOPAzNWC_Bz0JCpeWzsY4U4YS8TtJc8R2gX3xjcIg3ueDFUsXK_6Vyo8ZKXq4wPsTPu37XaXbZanpe3FLry1TfU4oZdzG8Bx62k Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: bb1d24ff0a474bc1bab396ca14c3fa04 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1933511794 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb1d24ff0a474bc1bab396ca14c3fa04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb1d24ff0a474bc1bab396ca14c3fa04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb1d24ff0a474bc1bab396ca14c3fa04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb1d24ff0a474bc1bab396ca14c3fa04"}]}] Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-VolumesSnapshotTestJSON-1933511794 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: bb1d24ff0a474bc1bab396ca14c3fa04 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1933511794 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-VolumesSnapshotTestJSON-1933511794-project Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: eab802df5a5d432eb9c95d98d19d2288 Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-VolumesSnapshotTestJSON-1933511794-project Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 3346291e-40c7-45bf-9673-fafb4aae1a52 could not be found. Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '3346291e-40c7-45bf-9673-fafb4aae1a52'} Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3346291e-40c7-45bf-9673-fafb4aae1a52 could not be found. Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3346291e-40c7-45bf-9673-fafb4aae1a52 could not be found. Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:48:20.032604 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3346291e-40c7-45bf-9673-fafb4aae1a52 could not be found. Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] Returning 404 to user: Instance 3346291e-40c7-45bf-9673-fafb4aae1a52 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfbb2f59-94b5-42bc-947a-1d8a723ab77b tempest-VolumesSnapshotTestJSON-1933511794 tempest-VolumesSnapshotTestJSON-1933511794-project] 10.222.0.25 "GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52" status: 404 len: 111 microversion: 2.1 time: 0.034672 Oct 22 03:48:20.038256 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3279/6429] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:19 2022] GET /compute/v2.1/servers/3346291e-40c7-45bf-9673-fafb4aae1a52 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:48:26.844384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:26.844384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:26.847993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:26.848766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:26.849226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:26.850183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:26.850785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:26.851380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:26.882061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:48:26.976456 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a4be354-45a5-498a-a248-8a70926444e3 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 204 len: 0 microversion: 2.1 time: 0.276672 Oct 22 03:48:26.979571 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3151/6430] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:48:26 2022] DELETE /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:48:26.988188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:26.988990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:26.998020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:26.998706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:26.999222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:27.001062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:27.001737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:27.002248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:27.180274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:27.202905 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0dcbd9ae-1493-4a88-834a-fe699f88db8d tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1731 microversion: 2.1 time: 0.219551 Oct 22 03:48:27.216870 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3280/6431] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:26 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:48:27.665995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:48:27.669902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:27.676022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:27.676757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:27.677405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:27.678316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:27.678948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:27.679459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:27.738761 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9273b87-8120-44f2-af23-f1efa4c0d7eb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action" status: 200 len: 24561 microversion: 2.1 time: 0.078412 Oct 22 03:48:27.739467 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3152/6432] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:48:27 2022] POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action => generated 24561 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:48:28.228726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:28.253588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:28.289345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:28.291671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:28.292620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:28.293347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:28.293841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:28.294648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:28.470971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:28.481413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dfab6544-c4e7-4958-ab51-27db0333062f tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1731 microversion: 2.1 time: 0.256747 Oct 22 03:48:28.481998 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3281/6433] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:28 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:48:29.521247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:29.526714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:29.539325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:29.540047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:29.541060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:29.542556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:29.549872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:29.550366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:29.666414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6e61ba90-efc8-4bc2-874b-460c2b5aa47a req-3cdfccaf-23b3-4a93-ae4d-9c204751c6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682", "name": "network-vif-deleted", "tag": "9fa76a09-ea97-4fed-a865-ed7d921e689f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:48:29.688052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6e61ba90-efc8-4bc2-874b-460c2b5aa47a req-3cdfccaf-23b3-4a93-ae4d-9c204751c6db service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:29.693000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6e61ba90-efc8-4bc2-874b-460c2b5aa47a req-3cdfccaf-23b3-4a93-ae4d-9c204751c6db service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:29.697050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6e61ba90-efc8-4bc2-874b-460c2b5aa47a req-3cdfccaf-23b3-4a93-ae4d-9c204751c6db service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:29.721594 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6e61ba90-efc8-4bc2-874b-460c2b5aa47a req-3cdfccaf-23b3-4a93-ae4d-9c204751c6db service nova] Creating event network-vif-deleted:9fa76a09-ea97-4fed-a865-ed7d921e689f for instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 on n-h1-862416-2 Oct 22 03:48:29.731150 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6e61ba90-efc8-4bc2-874b-460c2b5aa47a req-3cdfccaf-23b3-4a93-ae4d-9c204751c6db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070630 Oct 22 03:48:29.734889 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3282/6434] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:48:29.735786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8959cf22b47d41008e4af6078f8c3e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387dcd4769b64ac08acd26e72a251227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:29.755254 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-07d858e3-9a5c-485a-9d4e-d1a9e32603a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 200 len: 1664 microversion: 2.1 time: 0.248025 Oct 22 03:48:29.761589 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3153/6435] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:29 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 1664 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:48:30.780325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:30.782431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:30.800541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:30.801058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:30.801512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:30.804440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:30.805099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:30.805410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:30.820830 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] HTTP exception thrown: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Request method failure captured: Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 HTTP/1.1 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2bKvdGb_Z0s_JMlYuj6u18fEWSqwGGpkNvILlVeLLxDuW5sCk2qijye2o3s4_xRKcRpP8Q5hhZBiOjM7PdfOPQhPgnlFNcTZlVKsjcY-ZcrecKrdD_y2t3V-pT0PBYwomg8AP5XFo0PMf-Vo6KlhBqsQJrE-ewfi1ouzqUzYI4z544 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 387dcd4769b64ac08acd26e72a251227 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_387dcd4769b64ac08acd26e72a251227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/387dcd4769b64ac08acd26e72a251227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/387dcd4769b64ac08acd26e72a251227"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/387dcd4769b64ac08acd26e72a251227"}]}] Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 387dcd4769b64ac08acd26e72a251227 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestServerBasicOps-1686947455-project Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8959cf22b47d41008e4af6078f8c3e26 Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestServerBasicOps-1686947455-project Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682'} Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:48:30.824349 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:30.829912 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:30.829912 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:48:30.829912 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:48:30.829912 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:48:30.829912 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:48:30.829912 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:30.829912 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:30.832137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Returning 404 to user: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:48:30.833210 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3442688f-e0a4-46fc-ada2-281167d898cf tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 404 len: 111 microversion: 2.1 time: 0.057993 Oct 22 03:48:30.833961 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3283/6436] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:30 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:48:31.521944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:31.523185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:31.534825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:31.535340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:31.535793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:31.536553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:31.537020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:31.537456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:31.556632 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] HTTP exception thrown: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Request method failure captured: Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 HTTP/1.1 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2bKvdGb_Z0s_JMlYuj6u18fEWSqwGGpkNvILlVeLLxDuW5sCk2qijye2o3s4_xRKcRpP8Q5hhZBiOjM7PdfOPQhPgnlFNcTZlVKsjcY-ZcrecKrdD_y2t3V-pT0PBYwomg8AP5XFo0PMf-Vo6KlhBqsQJrE-ewfi1ouzqUzYI4z544 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 387dcd4769b64ac08acd26e72a251227 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_387dcd4769b64ac08acd26e72a251227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/387dcd4769b64ac08acd26e72a251227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/387dcd4769b64ac08acd26e72a251227"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/387dcd4769b64ac08acd26e72a251227"}]}] Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 387dcd4769b64ac08acd26e72a251227 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestServerBasicOps-1686947455-project Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8959cf22b47d41008e4af6078f8c3e26 Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestServerBasicOps-1686947455-project Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682'} Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:48:31.558341 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Returning 404 to user: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e69045ef-ecf8-42ed-b762-311a2b6282a5 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 404 len: 111 microversion: 2.1 time: 0.041858 Oct 22 03:48:31.567898 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3154/6437] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:48:31 2022] DELETE /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:48:31.569788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:31.570408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] [instance: 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:31.577328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:31.577328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:31.578727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:31.578727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:31.579688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:31.579688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:31.595772 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] HTTP exception thrown: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Request method failure captured: Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 HTTP/1.1 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2bKvdGb_Z0s_JMlYuj6u18fEWSqwGGpkNvILlVeLLxDuW5sCk2qijye2o3s4_xRKcRpP8Q5hhZBiOjM7PdfOPQhPgnlFNcTZlVKsjcY-ZcrecKrdD_y2t3V-pT0PBYwomg8AP5XFo0PMf-Vo6KlhBqsQJrE-ewfi1ouzqUzYI4z544 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 387dcd4769b64ac08acd26e72a251227 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_387dcd4769b64ac08acd26e72a251227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/387dcd4769b64ac08acd26e72a251227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/387dcd4769b64ac08acd26e72a251227"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/387dcd4769b64ac08acd26e72a251227"}]}] Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 387dcd4769b64ac08acd26e72a251227 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestServerBasicOps-1686947455 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestServerBasicOps-1686947455-project Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8959cf22b47d41008e4af6078f8c3e26 Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestServerBasicOps-1686947455-project Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682'} Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:48:31.596538 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.601187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:48:31.601187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:48:31.601187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:48:31.601187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:48:31.601187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:48:31.601187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. Oct 22 03:48:31.601187 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:48:31.603098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Returning 404 to user: Instance 1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:48:31.603563 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5fa092f0-b599-416d-acae-94235c3d8b80 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682" status: 404 len: 111 microversion: 2.1 time: 0.038146 Oct 22 03:48:31.604656 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3284/6438] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:31 2022] GET /compute/v2.1/servers/1fc9dcb3-7c9b-45d0-bbd4-3ae2d339e682 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:48:31.837379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e56b303-053a-4d74-b038-14847323b346 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] Calling method '.version_select at 0x7f0d19649790>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:31.915257 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e56b303-053a-4d74-b038-14847323b346 tempest-TestServerBasicOps-1686947455 tempest-TestServerBasicOps-1686947455-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-318416892" status: 202 len: 0 microversion: 2.1 time: 0.092344 Oct 22 03:48:31.916443 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3155/6439] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 03:48:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-318416892 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:48:58.183220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:58.183827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:58.194159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=18 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:48:58.195315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:48:58.197034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:58.197649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:58.198088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:58.198796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:58.199244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:58.199854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:58.364097 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5bdd6ce2-1d3f-49f2-adfa-56b393f0f0a0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1832 microversion: 2.1 time: 0.184331 Oct 22 03:48:58.365065 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3285/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:58 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1832 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:48:58.387343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:48:58.388845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:48:58.394505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:58.395106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:58.410210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:58.410702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:58.412116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:58.412914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:58.413601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:58.413876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:58.553702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:58.561767 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-599e2586-974b-4d9c-9a0d-d51e5424a12b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1681 microversion: 2.1 time: 0.176313 Oct 22 03:48:58.562432 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3156/6441] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:58 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:48:58.658846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:48:58.661190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:58.683362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:58.683956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:58.684567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:58.685354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:58.685887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:58.686393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:58.756455 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4381193b-d680-48a2-9531-7d5263efdb39 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action" status: 200 len: 32639 microversion: 2.1 time: 0.101943 Oct 22 03:48:58.758153 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3286/6442] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:48:58 2022] POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action => generated 32639 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:48:58.944425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:48:58.945528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:58.952755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:58.954698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:58.956008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:58.956944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:58.957730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:58.958849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:59.006116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '97c7af06e69c4ea6a1a30c346f64b037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64126d617d374034ad0e57d2876251aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:59.007127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] flavor_id is None. Assuming migration. {{(pid=120582) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 22 03:48:59.008153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120582) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 03:48:59.257591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-52164735-9bbb-44d4-a4b2-0c1474746003 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action" status: 202 len: 0 microversion: 2.1 time: 0.317351 Oct 22 03:48:59.261709 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3157/6443] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:48:58 2022] POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:48:59.268257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:48:59.275298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:48:59.286056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:59.291410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:59.293489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:59.294415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:48:59.294891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:48:59.295380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:48:59.510449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:48:59.520818 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e21ff70-0468-47e2-a7ab-c703797719d3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1690 microversion: 2.1 time: 0.257699 Oct 22 03:48:59.522062 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3287/6444] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:48:59 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1690 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:00.545827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:00.547795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:00.555275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:00.556240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:00.556917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:00.557873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:00.558564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:00.559381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:00.733470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:00.745745 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dfb76ada-9a5b-4d6b-9c77-6c2316aa68f6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1690 microversion: 2.1 time: 0.204591 Oct 22 03:49:00.746689 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3158/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:00 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1690 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:49:01.770009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:01.770636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:01.781619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:01.782222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:01.783353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:01.784783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:01.785259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:01.786050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:02.018853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:02.033215 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f84e198d-ffa7-4e10-ad24-f72fc9d98c4c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1690 microversion: 2.1 time: 0.264545 Oct 22 03:49:02.034516 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3288/6446] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:01 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1690 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:03.065151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:03.066069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:03.073115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:03.074394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:03.074932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:03.075780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:03.076367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:03.076897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:03.225427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:03.233676 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b9cbcd5-3332-44b2-8309-2b2a505b3004 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.173253 Oct 22 03:49:03.235289 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3159/6447] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:03 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:49:04.258694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:04.259415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:04.267324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:04.267938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:04.268480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:04.269256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:04.269780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:04.270280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:04.454224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:04.464378 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1d496160-0cf0-4cb7-977b-6ff0b11c1395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.209687 Oct 22 03:49:04.465617 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3289/6448] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:04 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:05.495088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:05.495946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:05.504297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:05.505054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:05.505719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:05.506529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:05.507083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:05.507898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:05.677074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:05.685550 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-218559d0-3598-4750-85e1-8402a4803369 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.195303 Oct 22 03:49:05.686728 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3160/6449] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:05 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:06.710164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:06.710764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:06.717615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:06.719179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:06.719701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:06.720431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:06.720898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:06.721319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:06.857555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:06.866952 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c97d6e37-f060-4e02-83bf-e53f596d7fc6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.160731 Oct 22 03:49:06.867795 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3290/6450] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:06 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:07.892023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:07.892702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:07.900031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:07.900623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:07.901056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:07.901759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:07.902218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:07.902655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:08.068492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:08.077486 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c984167-0818-44a9-bd0e-f83a726f4c5c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.190643 Oct 22 03:49:08.078645 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3161/6451] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:07 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:09.103076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:09.103687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:09.112037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:09.112556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:09.112996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:09.113706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:09.114157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:09.114584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:09.272798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:09.283554 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8c9e442-969c-44ac-9eae-fc1f35744206 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.184454 Oct 22 03:49:09.284672 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3291/6452] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:09 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:10.313872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:10.315678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:10.326893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:10.329949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:10.330759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:10.331800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:10.333010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:10.333657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:10.674959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:10.685024 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a28fd83-ed10-4c58-befa-7faa65371c5e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.379590 Oct 22 03:49:10.686171 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3162/6453] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:10 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:11.710813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:11.711886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:11.720139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:11.720662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:11.721708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:11.721861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:11.722297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:11.722723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:11.863514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:11.871651 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-92585787-4758-4bdf-b57b-b30789f7312d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.165432 Oct 22 03:49:11.872543 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3292/6454] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:11 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:12.897875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:12.898663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:12.906104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:12.906824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:12.907261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:12.908013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:12.908612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:12.909074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:13.084753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:13.097502 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cf0fcbe0-2122-4b9d-9e75-1d9aebceff2a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1695 microversion: 2.1 time: 0.203944 Oct 22 03:49:13.098139 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3163/6455] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:12 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1695 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:14.139889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:14.142201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:14.150474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:14.151362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:14.152054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:14.153052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:14.153789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:14.154740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:14.551617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:14.570006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-21a03a4c-8948-4df5-a300-3269ad7ff30c req-c84edd20-bebe-406b-9ad6-51d4c92fe2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "name": "network-vif-unplugged", "status": "completed", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:14.589998 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0f77297-5c23-4099-aecb-609f4faf7345 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1694 microversion: 2.1 time: 0.461319 Oct 22 03:49:14.591184 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3293/6456] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:14 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1694 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:14.592641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-21a03a4c-8948-4df5-a300-3269ad7ff30c req-c84edd20-bebe-406b-9ad6-51d4c92fe2dd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:14.593315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-21a03a4c-8948-4df5-a300-3269ad7ff30c req-c84edd20-bebe-406b-9ad6-51d4c92fe2dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:14.594493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-21a03a4c-8948-4df5-a300-3269ad7ff30c req-c84edd20-bebe-406b-9ad6-51d4c92fe2dd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:14.611643 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-21a03a4c-8948-4df5-a300-3269ad7ff30c req-c84edd20-bebe-406b-9ad6-51d4c92fe2dd service nova] Creating event network-vif-unplugged:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h1-862416-2 Oct 22 03:49:14.622368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-21a03a4c-8948-4df5-a300-3269ad7ff30c req-c84edd20-bebe-406b-9ad6-51d4c92fe2dd service nova] Instance 7c739deb-1753-45fc-9802-b54d965a39e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:49:14.642157 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-21a03a4c-8948-4df5-a300-3269ad7ff30c req-c84edd20-bebe-406b-9ad6-51d4c92fe2dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075406 Oct 22 03:49:14.643017 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3164/6457] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:49:15.620780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:15.621580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:15.637931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:15.638558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:15.654593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:15.662421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:15.663100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:15.674241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:16.092907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:16.114337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1be952d7-e74e-4b6e-8adc-2547599fd4d5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1694 microversion: 2.1 time: 0.499261 Oct 22 03:49:16.118457 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3294/6458] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:15 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1694 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:16.677850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fbee16d0-4ab1-4621-b926-4bf0bc3e8900 req-193ae10a-ab41-4f63-8e1d-e6b5cfa1bdd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:16.709037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fbee16d0-4ab1-4621-b926-4bf0bc3e8900 req-193ae10a-ab41-4f63-8e1d-e6b5cfa1bdd2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:16.709530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fbee16d0-4ab1-4621-b926-4bf0bc3e8900 req-193ae10a-ab41-4f63-8e1d-e6b5cfa1bdd2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:16.709966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fbee16d0-4ab1-4621-b926-4bf0bc3e8900 req-193ae10a-ab41-4f63-8e1d-e6b5cfa1bdd2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:16.747640 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fbee16d0-4ab1-4621-b926-4bf0bc3e8900 req-193ae10a-ab41-4f63-8e1d-e6b5cfa1bdd2 service nova] Creating event network-changed:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h1-862416-2 Oct 22 03:49:16.761074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-fbee16d0-4ab1-4621-b926-4bf0bc3e8900 req-193ae10a-ab41-4f63-8e1d-e6b5cfa1bdd2 service nova] Instance 7c739deb-1753-45fc-9802-b54d965a39e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:49:16.787505 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fbee16d0-4ab1-4621-b926-4bf0bc3e8900 req-193ae10a-ab41-4f63-8e1d-e6b5cfa1bdd2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113661 Oct 22 03:49:16.791780 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3165/6459] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:49:17.148897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:17.151549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:17.178919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:17.181053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:17.182946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:17.185356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:17.185842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:17.189057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:17.765343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:17.784559 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe2571d3-96a4-482d-9853-12253a863603 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1692 microversion: 2.1 time: 0.645843 Oct 22 03:49:17.785943 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3295/6460] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:17 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1692 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:18.817272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:18.817719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:18.826603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:18.827997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:18.829146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:18.830055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:18.830790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:18.831279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:18.992149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:19.000412 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84bc3617-43ae-43e9-99ee-93308bc4de9e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1689 microversion: 2.1 time: 0.190200 Oct 22 03:49:19.001180 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3166/6461] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:18 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:19.024669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:19.025697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:19.034852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:19.035925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:19.036559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:19.037554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:19.038187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:19.038779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:19.236244 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0e50009-074b-4bec-a1d6-d60b042cca28 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action" status: 202 len: 0 microversion: 2.1 time: 0.215046 Oct 22 03:49:19.237984 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3296/6462] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:49:19 2022] POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:49:19.257065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:19.262312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:19.276122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:19.277395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:19.279173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:19.280078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:19.293227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:19.293900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:19.606700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:19.625824 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e90b85b6-304a-473c-bbab-308f9baa9229 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1688 microversion: 2.1 time: 0.381445 Oct 22 03:49:19.630158 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3167/6463] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:19 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1688 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:20.667297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:20.668845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:20.696915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:20.699264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:20.700025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:20.702844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:20.704566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:20.705258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:20.924036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:20.932834 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8effcb74-a410-432f-9ce2-95665e16f81a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1688 microversion: 2.1 time: 0.272858 Oct 22 03:49:20.933536 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3297/6464] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:20 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1688 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:21.956928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:21.958286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:21.966158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:21.967001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:21.968061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:21.970075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:21.971676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:21.972331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:22.221849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-322f2795-2c13-4f7a-8a1a-3ef64168f853 req-ecfa316c-7a9a-4d15-ad61-f10770e20453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "name": "network-vif-plugged", "status": "completed", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:22.240608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-322f2795-2c13-4f7a-8a1a-3ef64168f853 req-ecfa316c-7a9a-4d15-ad61-f10770e20453 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:22.241092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-322f2795-2c13-4f7a-8a1a-3ef64168f853 req-ecfa316c-7a9a-4d15-ad61-f10770e20453 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:22.241639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-322f2795-2c13-4f7a-8a1a-3ef64168f853 req-ecfa316c-7a9a-4d15-ad61-f10770e20453 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:22.274235 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-322f2795-2c13-4f7a-8a1a-3ef64168f853 req-ecfa316c-7a9a-4d15-ad61-f10770e20453 service nova] Creating event network-vif-plugged:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h1-862416-2 Oct 22 03:49:22.282759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:22.292258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-322f2795-2c13-4f7a-8a1a-3ef64168f853 req-ecfa316c-7a9a-4d15-ad61-f10770e20453 service nova] Instance 7c739deb-1753-45fc-9802-b54d965a39e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:49:22.296647 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d443ad0-9ad5-4890-84ea-79ffb9d0bc53 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1688 microversion: 2.1 time: 0.344299 Oct 22 03:49:22.301818 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3168/6465] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:21 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1688 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:22.305387 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-322f2795-2c13-4f7a-8a1a-3ef64168f853 req-ecfa316c-7a9a-4d15-ad61-f10770e20453 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087463 Oct 22 03:49:22.319468 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3298/6466] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:49:23.340571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:23.342406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:23.361627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:23.364122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:23.364980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:23.366683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:23.367509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:23.368614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:23.984618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:23.993668 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7fef05a6-2b76-4d65-9eab-16d02578d7cc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1688 microversion: 2.1 time: 0.670696 Oct 22 03:49:24.018341 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3169/6467] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:23 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1688 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:24.426136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f5473e18-3c5a-434e-a34c-cab8c4dcdddc req-a1626443-c7fe-4937-963a-b635d2a74413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "name": "network-vif-unplugged", "status": "completed", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:24.449155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5473e18-3c5a-434e-a34c-cab8c4dcdddc req-a1626443-c7fe-4937-963a-b635d2a74413 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:24.449635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5473e18-3c5a-434e-a34c-cab8c4dcdddc req-a1626443-c7fe-4937-963a-b635d2a74413 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:24.450065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5473e18-3c5a-434e-a34c-cab8c4dcdddc req-a1626443-c7fe-4937-963a-b635d2a74413 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:24.486786 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f5473e18-3c5a-434e-a34c-cab8c4dcdddc req-a1626443-c7fe-4937-963a-b635d2a74413 service nova] Creating event network-vif-unplugged:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h2-862416-2 Oct 22 03:49:24.502614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-f5473e18-3c5a-434e-a34c-cab8c4dcdddc req-a1626443-c7fe-4937-963a-b635d2a74413 service nova] Instance 7c739deb-1753-45fc-9802-b54d965a39e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:49:24.523990 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f5473e18-3c5a-434e-a34c-cab8c4dcdddc req-a1626443-c7fe-4937-963a-b635d2a74413 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104837 Oct 22 03:49:24.529396 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3299/6468] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:49:25.019140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:25.019912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:25.034586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:25.039082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:25.039930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:25.040909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:25.042965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:25.047161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:25.445801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:25.454475 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cf8c2cca-0278-4952-8dcb-e689ba03689c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1688 microversion: 2.1 time: 0.439708 Oct 22 03:49:25.459774 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3170/6469] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:25 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1688 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:26.483460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:26.484116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:26.491988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:26.492456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:26.492899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:26.493860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:26.494501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:26.495112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:26.522309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:26.578816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8860364-fe7f-442c-9103-72f47675dfaa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:26.581039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8860364-fe7f-442c-9103-72f47675dfaa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:26.581777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8860364-fe7f-442c-9103-72f47675dfaa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:26.583593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8860364-fe7f-442c-9103-72f47675dfaa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:26.586167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8860364-fe7f-442c-9103-72f47675dfaa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:26.587166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8860364-fe7f-442c-9103-72f47675dfaa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:26.587847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a8860364-fe7f-442c-9103-72f47675dfaa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:26.619579 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8860364-fe7f-442c-9103-72f47675dfaa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.207524 Oct 22 03:49:26.620846 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3300/6470] 10.222.0.25 () {58 vars in 1185 bytes} [Sat Oct 22 03:49:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:49:26.627073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3a4c2a3e-54bc-4ecf-af8a-437263b76d4d req-70119976-9d60-4b08-86fa-4bef8adc1ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:26.637323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a4c2a3e-54bc-4ecf-af8a-437263b76d4d req-70119976-9d60-4b08-86fa-4bef8adc1ab4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:26.637708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a4c2a3e-54bc-4ecf-af8a-437263b76d4d req-70119976-9d60-4b08-86fa-4bef8adc1ab4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:26.638127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3a4c2a3e-54bc-4ecf-af8a-437263b76d4d req-70119976-9d60-4b08-86fa-4bef8adc1ab4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:26.667420 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3a4c2a3e-54bc-4ecf-af8a-437263b76d4d req-70119976-9d60-4b08-86fa-4bef8adc1ab4 service nova] Creating event network-changed:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h2-862416-2 Oct 22 03:49:26.677314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:26.680406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-3a4c2a3e-54bc-4ecf-af8a-437263b76d4d req-70119976-9d60-4b08-86fa-4bef8adc1ab4 service nova] Instance 7c739deb-1753-45fc-9802-b54d965a39e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 03:49:26.687102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:26.695580 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3a4c2a3e-54bc-4ecf-af8a-437263b76d4d req-70119976-9d60-4b08-86fa-4bef8adc1ab4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073281 Oct 22 03:49:26.696531 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3301/6471] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:49:26.697835 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08c1b49e-e6fa-4613-b167-ca78b631f6e4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1688 microversion: 2.1 time: 0.218665 Oct 22 03:49:26.701032 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3171/6472] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:26 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:49:26.752614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1731054713", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "availability_zone": "nova:n-h1-862416-2", "networks": [{"uuid": "abfeeeac-10c0-4ebf-a3ee-a1b7e8a969de"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:26.827441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] validate_networks() for [('abfeeeac-10c0-4ebf-a3ee-a1b7e8a969de', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:49:27.410857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:49:27.411286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:49:27.411762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:49:27.412172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:49:27.412606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:49:27.424146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:27.424672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:27.425110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:27.425832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:27.426286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:27.426710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:27.461022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Getting quotas for project 5ec1ebab6b174655a7bec6c123ad8648. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:49:27.467031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Getting quotas for user ee93bbbd22e640c999dea8d0a40017e6 and project 5ec1ebab6b174655a7bec6c123ad8648. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:49:27.487583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:49:27.490936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:49:27.561340 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fbea8105-1c77-4090-a49a-ce8832c69a9b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813921 Oct 22 03:49:27.562204 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3302/6473] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:49:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:49:27.573879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fbcefd91-7143-425b-bbaa-394f202e6a8c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:27.574598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fbcefd91-7143-425b-bbaa-394f202e6a8c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:27.677071 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fbcefd91-7143-425b-bbaa-394f202e6a8c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1329 microversion: 2.1 time: 0.107419 Oct 22 03:49:27.677977 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3172/6474] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:27 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:27.728337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:27.728956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:27.739266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:27.740871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:27.742083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:27.743253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:27.743883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:27.744633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:27.980624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:27.995665 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7e3b42fb-c061-4a05-9c26-a94d1097ea70 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1688 microversion: 2.1 time: 0.271086 Oct 22 03:49:28.001297 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3303/6475] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:27 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1688 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:28.705620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:28.706942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:28.711007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=39 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:28.716814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:28.717311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:28.717941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:28.718884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:28.719538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:28.719965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:28.791805 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f96310db-a101-4cd5-a5f5-9859bcae7de3 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1416 microversion: 2.1 time: 0.091556 Oct 22 03:49:28.792653 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3173/6476] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:28 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1416 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:29.023419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:29.024521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:29.043435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:29.052548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:29.053321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:29.054198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:29.055417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:29.056086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:29.056751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:29.232998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:29.242854 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8bbb0680-9b7d-441e-a84d-09427870af92 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1688 microversion: 2.1 time: 0.223695 Oct 22 03:49:29.262775 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3304/6477] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:29 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1688 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:29.815130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:29.815755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:29.832006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:29.832536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:29.832981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:29.833704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:29.834353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:29.834976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:29.971790 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3e4fe23-9461-4a75-bc06-8f90ae1d6b7a tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1422 microversion: 2.1 time: 0.160545 Oct 22 03:49:29.972992 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3174/6478] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:29 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1422 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:30.271669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:30.272427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:30.286422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:30.289380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:30.289590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:30.293040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:30.293572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:30.294013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:30.605450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:49:30.619830 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96ffba97-6d82-4c8c-b03f-6a6f1a9c18a8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1681 microversion: 2.1 time: 0.352930 Oct 22 03:49:30.620722 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3305/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:30 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:30.999607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:31.001973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:31.017940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:31.018615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:31.019068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:31.019850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:31.020367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:31.020939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:31.208058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a248ef29-6e92-4997-b499-9c1f5e9b8987 req-e78806df-fb5f-45d6-8096-c55e12749064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc58e7a-61ba-414f-b945-b468e87a0368", "tag": "10daf20c-6ed5-4754-bda2-6bdc76180fda"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:31.218139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a248ef29-6e92-4997-b499-9c1f5e9b8987 req-e78806df-fb5f-45d6-8096-c55e12749064 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:31.220389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a248ef29-6e92-4997-b499-9c1f5e9b8987 req-e78806df-fb5f-45d6-8096-c55e12749064 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:31.221144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a248ef29-6e92-4997-b499-9c1f5e9b8987 req-e78806df-fb5f-45d6-8096-c55e12749064 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:31.237190 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a248ef29-6e92-4997-b499-9c1f5e9b8987 req-e78806df-fb5f-45d6-8096-c55e12749064 service nova] Creating event network-changed:10daf20c-6ed5-4754-bda2-6bdc76180fda for instance 0fc58e7a-61ba-414f-b945-b468e87a0368 on n-h1-862416-2 Oct 22 03:49:31.244141 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a248ef29-6e92-4997-b499-9c1f5e9b8987 req-e78806df-fb5f-45d6-8096-c55e12749064 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040761 Oct 22 03:49:31.245533 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3306/6480] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:49:31.320958 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-22ff8ef0-32d1-4cbe-9630-1f9fbf138d54 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1464 microversion: 2.1 time: 0.327807 Oct 22 03:49:31.324781 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3175/6481] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:30 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:31.692224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c4ae4c2a-3395-47af-9c72-1dd9694da13d req-438e2a67-4086-4e2d-9ca8-a164d06627f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "name": "network-vif-plugged", "status": "completed", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:31.705458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4ae4c2a-3395-47af-9c72-1dd9694da13d req-438e2a67-4086-4e2d-9ca8-a164d06627f7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:31.706413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4ae4c2a-3395-47af-9c72-1dd9694da13d req-438e2a67-4086-4e2d-9ca8-a164d06627f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:31.707093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4ae4c2a-3395-47af-9c72-1dd9694da13d req-438e2a67-4086-4e2d-9ca8-a164d06627f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:31.723092 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c4ae4c2a-3395-47af-9c72-1dd9694da13d req-438e2a67-4086-4e2d-9ca8-a164d06627f7 service nova] Creating event network-vif-plugged:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h2-862416-2 Oct 22 03:49:31.738080 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c4ae4c2a-3395-47af-9c72-1dd9694da13d req-438e2a67-4086-4e2d-9ca8-a164d06627f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051901 Oct 22 03:49:31.739061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3307/6482] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:49:32.344752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:32.345342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:32.352718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:32.353199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:32.353641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:32.354336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:32.354789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:32.355219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:32.487138 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c58c3694-ab3b-4af9-a101-6b71086a5836 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1464 microversion: 2.1 time: 0.146558 Oct 22 03:49:32.487682 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3176/6483] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:32 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:33.511999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:33.512759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:33.520053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:33.520589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:33.521031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:33.521741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:33.522199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:33.522900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:33.661030 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e8dad82-df24-4a34-97db-448376d31d15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1464 microversion: 2.1 time: 0.153987 Oct 22 03:49:33.661626 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3308/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:33 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:34.683846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:34.684509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:34.691569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:34.692047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:34.692510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:34.693201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:34.693653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:34.694079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:34.826619 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a1a078ea-3b35-4c67-933d-b4f85feaec96 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1464 microversion: 2.1 time: 0.146523 Oct 22 03:49:34.827193 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3177/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:34 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:35.849594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:35.850521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:35.857207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:35.857697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:35.858135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:35.858835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:35.859292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:35.860723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:35.999445 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b2c3d346-5338-445f-86ae-fdb79e6fca67 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1464 microversion: 2.1 time: 0.153541 Oct 22 03:49:35.999957 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3309/6486] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:35 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:37.022206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:37.022770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:37.029784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:37.030274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:37.030717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:37.031481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:37.031949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:37.032420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:37.164850 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d92db210-48cb-4937-80c2-d2385b7fc638 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1464 microversion: 2.1 time: 0.146474 Oct 22 03:49:37.165443 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3178/6487] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:37 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:37.864572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c8d51ea5-3802-4671-b4ed-570a269b74cb req-5ef01af2-c6a1-46a4-a4dd-98d3747e2dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc58e7a-61ba-414f-b945-b468e87a0368", "name": "network-vif-plugged", "status": "completed", "tag": "10daf20c-6ed5-4754-bda2-6bdc76180fda"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:37.871730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:37.872679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:37.882052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c8d51ea5-3802-4671-b4ed-570a269b74cb req-5ef01af2-c6a1-46a4-a4dd-98d3747e2dc3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:37.882588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c8d51ea5-3802-4671-b4ed-570a269b74cb req-5ef01af2-c6a1-46a4-a4dd-98d3747e2dc3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:37.883026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c8d51ea5-3802-4671-b4ed-570a269b74cb req-5ef01af2-c6a1-46a4-a4dd-98d3747e2dc3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:37.896980 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c8d51ea5-3802-4671-b4ed-570a269b74cb req-5ef01af2-c6a1-46a4-a4dd-98d3747e2dc3 service nova] Creating event network-vif-plugged:10daf20c-6ed5-4754-bda2-6bdc76180fda for instance 0fc58e7a-61ba-414f-b945-b468e87a0368 on n-h1-862416-2 Oct 22 03:49:37.902274 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c8d51ea5-3802-4671-b4ed-570a269b74cb req-5ef01af2-c6a1-46a4-a4dd-98d3747e2dc3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042409 Oct 22 03:49:37.902967 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3310/6488] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:49:38.189410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:38.190038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:38.191924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:38.198644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:38.199112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:38.199549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:38.200357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:38.200812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:38.201238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:38.362757 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-338eea25-04a3-4ab3-b505-eec62727a113 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1464 microversion: 2.1 time: 0.177528 Oct 22 03:49:38.363337 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3179/6489] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:38 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:39.387535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:39.388154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:39.395875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:39.396407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:39.396850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:39.397551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:39.398011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:39.398443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:39.539991 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1353ee1a-128c-426c-813a-891207d04b15 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1649 microversion: 2.1 time: 0.156782 Oct 22 03:49:39.540693 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3311/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:39 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1649 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:39.561985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:39.562634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:39.569756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:39.570245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:39.570687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:39.571388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:39.572034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:39.572496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:39.977310 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-22e30d61-c4c5-41d0-a985-f59705613683 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1649 microversion: 2.1 time: 0.418942 Oct 22 03:49:39.978237 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3180/6491] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:39 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1649 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:40.001040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:40.001661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:40.008191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:40.008728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:40.009167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:40.009879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:40.010315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:40.010736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:40.154732 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b364c51-fa2d-4658-8c4a-2c05a56157c1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1649 microversion: 2.1 time: 0.157815 Oct 22 03:49:40.155315 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3312/6492] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:39 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1649 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:40.218211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-73814004", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "availability_zone": "nova:n-h2-862416-2", "networks": [{"uuid": "abfeeeac-10c0-4ebf-a3ee-a1b7e8a969de"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:40.280890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] validate_networks() for [('abfeeeac-10c0-4ebf-a3ee-a1b7e8a969de', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:49:40.679326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:49:40.679881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:49:40.680230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:49:40.680676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:49:40.681094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:49:40.691057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:40.691670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:40.692116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:40.692896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:40.693363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:40.693792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:40.712407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Getting quotas for project 5ec1ebab6b174655a7bec6c123ad8648. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:49:40.717744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Getting quotas for user ee93bbbd22e640c999dea8d0a40017e6 and project 5ec1ebab6b174655a7bec6c123ad8648. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:49:40.731493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:49:40.733840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:49:40.783728 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28d3ebd6-49d7-4821-87f3-4ccc9a0bd3d5 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569368 Oct 22 03:49:40.784905 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3181/6493] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:49:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:49:40.796230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e2c4b7d-2a58-49cc-be27-c95ef7bfb0ea tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:40.797779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e2c4b7d-2a58-49cc-be27-c95ef7bfb0ea tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:40.864423 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e2c4b7d-2a58-49cc-be27-c95ef7bfb0ea tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1327 microversion: 2.1 time: 0.071891 Oct 22 03:49:40.865097 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3313/6494] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:40 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1327 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:41.889304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:41.889918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:41.900265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:41.900962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:41.902516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:41.902516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:41.902722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:41.903112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:41.998742 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98cd02fc-59bf-4341-be9a-a5762e7ab605 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1432 microversion: 2.1 time: 0.114399 Oct 22 03:49:41.999335 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3182/6495] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:41 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1432 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:43.022312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:43.023039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:43.035363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:43.035865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:43.036582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:43.037987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:43.038463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:43.038950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:43.187362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fe03ddaa-9ca3-48d8-8dcb-3ef68abf4931 req-b8ea28b9-68ab-4534-8b54-acc2e9aac62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01b79a9-4da9-4b87-8cf9-81d5b66bddd7", "tag": "e935ee06-38c8-47ab-87a1-2f6070ba0c8d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:43.195705 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-46eb6cb5-8a25-4621-b60d-02b218784514 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1462 microversion: 2.1 time: 0.176970 Oct 22 03:49:43.197306 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3314/6496] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:43 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1462 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:43.219495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fe03ddaa-9ca3-48d8-8dcb-3ef68abf4931 req-b8ea28b9-68ab-4534-8b54-acc2e9aac62c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:43.220380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fe03ddaa-9ca3-48d8-8dcb-3ef68abf4931 req-b8ea28b9-68ab-4534-8b54-acc2e9aac62c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:43.221623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fe03ddaa-9ca3-48d8-8dcb-3ef68abf4931 req-b8ea28b9-68ab-4534-8b54-acc2e9aac62c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:43.236558 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fe03ddaa-9ca3-48d8-8dcb-3ef68abf4931 req-b8ea28b9-68ab-4534-8b54-acc2e9aac62c service nova] Creating event network-changed:e935ee06-38c8-47ab-87a1-2f6070ba0c8d for instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 on n-h2-862416-2 Oct 22 03:49:43.244527 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fe03ddaa-9ca3-48d8-8dcb-3ef68abf4931 req-b8ea28b9-68ab-4534-8b54-acc2e9aac62c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060629 Oct 22 03:49:43.245233 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3183/6497] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:49:44.225127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:44.225804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:44.234061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:44.235785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:44.236258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:44.237119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:44.237635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:44.238126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:44.377373 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c06e86ad-7687-4ab4-ad61-de4e678b6f92 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1462 microversion: 2.1 time: 0.155976 Oct 22 03:49:44.377998 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3315/6498] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:44 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1462 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:45.401672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:45.402315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:45.409261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:45.409747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:45.410185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:45.410883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:45.411343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:45.411772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:45.543219 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68c79089-9bbe-49e1-ac69-d64cd8ba27e1 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1462 microversion: 2.1 time: 0.146643 Oct 22 03:49:45.543810 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3184/6499] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:45 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1462 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:46.566325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:46.566985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:46.573960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:46.574467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:46.574891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:46.575592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:46.576055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:46.576521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:46.708258 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ba4faa4-a3f2-4452-ad86-6e9c6968253b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1462 microversion: 2.1 time: 0.145720 Oct 22 03:49:46.708860 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3316/6500] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:46 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1462 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:47.731349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:47.732031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:47.742842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:47.743431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:47.744198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:47.745026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:47.745565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:47.746070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:47.886056 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c486e7ea-7970-416e-b8a1-be284b298940 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1462 microversion: 2.1 time: 0.158773 Oct 22 03:49:47.893189 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3185/6501] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:47 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1462 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:48.909381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:48.910010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:48.916964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:48.917641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:48.918077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:48.918769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:48.919219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:48.919641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:49.067595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86a1d790-b0d6-40db-8acf-db18982f601f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1462 microversion: 2.1 time: 0.163112 Oct 22 03:49:49.068558 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3317/6502] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:48 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1462 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:49.778598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-475f3173-329f-4dbb-abf3-fa6a75968cdd req-3086adbc-d6c5-4572-b928-7c3d1b14cef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01b79a9-4da9-4b87-8cf9-81d5b66bddd7", "name": "network-vif-plugged", "status": "completed", "tag": "e935ee06-38c8-47ab-87a1-2f6070ba0c8d"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:49.789312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-475f3173-329f-4dbb-abf3-fa6a75968cdd req-3086adbc-d6c5-4572-b928-7c3d1b14cef7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:49.789794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-475f3173-329f-4dbb-abf3-fa6a75968cdd req-3086adbc-d6c5-4572-b928-7c3d1b14cef7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:49.790233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-475f3173-329f-4dbb-abf3-fa6a75968cdd req-3086adbc-d6c5-4572-b928-7c3d1b14cef7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:49.802109 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-475f3173-329f-4dbb-abf3-fa6a75968cdd req-3086adbc-d6c5-4572-b928-7c3d1b14cef7 service nova] Creating event network-vif-plugged:e935ee06-38c8-47ab-87a1-2f6070ba0c8d for instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 on n-h2-862416-2 Oct 22 03:49:49.807330 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-475f3173-329f-4dbb-abf3-fa6a75968cdd req-3086adbc-d6c5-4572-b928-7c3d1b14cef7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033077 Oct 22 03:49:49.807960 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3186/6503] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:49:50.090297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:50.090911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:50.098326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:50.098856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:50.099294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:50.100005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:50.100488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:50.100917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:50.232228 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb87c8a4-5f2a-460a-8159-8b8697f19402 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1462 microversion: 2.1 time: 0.145604 Oct 22 03:49:50.232811 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3318/6504] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:50 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1462 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:51.254963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:51.256035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:51.262061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:51.262893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:51.270786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:51.271660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:51.272384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:51.273311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:51.273967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:51.274596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:51.443797 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b329e9b5-c6b0-4a9a-9071-dd98bc316ad8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1462 microversion: 2.1 time: 0.189767 Oct 22 03:49:51.451063 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3187/6505] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:51 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1462 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:52.471522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:52.477999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:52.478679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:52.486918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:52.487414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:52.487854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:52.488591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:52.489052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:52.489484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:52.659401 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f834b0e-3e2b-42c1-bd11-e5b69b702061 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1646 microversion: 2.1 time: 0.188658 Oct 22 03:49:52.659977 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3319/6506] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:52 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1646 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:49:52.682728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:52.683483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:52.691066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:52.691679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:52.692259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:52.693045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:52.693580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:52.694081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:52.823677 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3499dbfd-f512-4169-9715-e4eeb920e25f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1646 microversion: 2.1 time: 0.145035 Oct 22 03:49:52.824577 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3188/6507] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:52 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1646 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:52.847861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:52.848501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:52.854540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:52.855020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:52.855461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:52.856143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:52.856637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:52.857057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:52.980643 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9bce870-fb00-4241-af41-19cd74d3b06c tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1646 microversion: 2.1 time: 0.137692 Oct 22 03:49:52.981222 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3320/6508] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:52 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1646 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:53.002894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:53.003397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:53.009356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:53.009844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:53.010292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:53.010984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:53.011458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:53.011875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:53.037841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:49:53.083031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:53.114768 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba5a513e-2058-403f-8162-dec5d3eb9c7f tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 204 len: 0 microversion: 2.1 time: 0.115354 Oct 22 03:49:53.115846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3189/6509] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:49:52 2022] DELETE /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:49:53.125694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:53.126351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:53.132634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:53.133121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:53.133635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:53.134333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:53.134788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:53.135216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:53.264941 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-caff2f0a-cfdd-4291-8e6a-c2f518895377 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1652 microversion: 2.1 time: 0.143488 Oct 22 03:49:53.265524 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3321/6510] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:53 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1652 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:54.289176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:54.289866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:54.296883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:54.298177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:54.298640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:54.299348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:54.299814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:54.300277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:54.431367 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20308b26-b9ac-4112-81c1-88934f031a5e tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1652 microversion: 2.1 time: 0.146285 Oct 22 03:49:54.431949 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3190/6511] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:54 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1652 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:54.982992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-85df75ec-5b64-44d2-87a1-3d11279cd42b req-65662b65-caf2-43f4-8ebd-8cc4ffbf5101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01b79a9-4da9-4b87-8cf9-81d5b66bddd7", "name": "network-vif-deleted", "tag": "e935ee06-38c8-47ab-87a1-2f6070ba0c8d"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:54.995893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-85df75ec-5b64-44d2-87a1-3d11279cd42b req-65662b65-caf2-43f4-8ebd-8cc4ffbf5101 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:54.996696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-85df75ec-5b64-44d2-87a1-3d11279cd42b req-65662b65-caf2-43f4-8ebd-8cc4ffbf5101 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:54.997300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-85df75ec-5b64-44d2-87a1-3d11279cd42b req-65662b65-caf2-43f4-8ebd-8cc4ffbf5101 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:55.002928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:55.012960 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-85df75ec-5b64-44d2-87a1-3d11279cd42b req-65662b65-caf2-43f4-8ebd-8cc4ffbf5101 service nova] Creating event network-vif-deleted:e935ee06-38c8-47ab-87a1-2f6070ba0c8d for instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 on n-h2-862416-2 Oct 22 03:49:55.018959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-85df75ec-5b64-44d2-87a1-3d11279cd42b req-65662b65-caf2-43f4-8ebd-8cc4ffbf5101 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040192 Oct 22 03:49:55.019578 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3322/6512] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:49:55.456197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:55.457014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:55.464541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:55.465379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:55.465921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:55.466722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:55.467308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:55.467837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:55.509421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:55.510036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:55.510502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:55.510955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lazy-loading 'fault' on Instance uuid b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:49:55.578196 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0636c784-a33c-4736-aae9-d070c437129b tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 200 len: 1452 microversion: 2.1 time: 0.126998 Oct 22 03:49:55.579256 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3191/6513] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:55 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:56.603864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:56.604485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: b01b79a9-4da9-4b87-8cf9-81d5b66bddd7] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:56.611299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:56.611779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:56.612227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:56.612925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:56.613377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:56.613799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:56.627868 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] HTTP exception thrown: Instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 could not be found. Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Request method failure captured: Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 HTTP/1.1 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2hGDhXV73CIvaPrYeeh4h-0viyz-orLoG5GTUqKyU2C9kQQOcepADtJC6eSgqqyJ5a9nVD6FuIpXM06fVYYk1Hdj2Svjo_DrWPOA4cCr8WphvnfM19TvP6QbeMdPQSRjupwTn-IqlLYKZ5943gwTYP80sX3lhg8bd6mxQ-bQjWEbxM Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5ec1ebab6b174655a7bec6c123ad8648 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestServerMultinode-362201356 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ec1ebab6b174655a7bec6c123ad8648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ec1ebab6b174655a7bec6c123ad8648"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ec1ebab6b174655a7bec6c123ad8648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ec1ebab6b174655a7bec6c123ad8648"}]}] Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestServerMultinode-362201356 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5ec1ebab6b174655a7bec6c123ad8648 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestServerMultinode-362201356 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestServerMultinode-362201356-project-admin Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: ee93bbbd22e640c999dea8d0a40017e6 Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestServerMultinode-362201356-project-admin Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 could not be found. Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'b01b79a9-4da9-4b87-8cf9-81d5b66bddd7'} Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 could not be found. Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 could not be found. Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:49:56.629523 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 could not be found. Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Returning 404 to user: Instance b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23c39a62-647d-4cb6-8e21-59351a21d873 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7" status: 404 len: 111 microversion: 2.1 time: 0.032142 Oct 22 03:49:56.638863 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3323/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:56 2022] GET /compute/v2.1/servers/b01b79a9-4da9-4b87-8cf9-81d5b66bddd7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:49:56.642281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:56.642782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:56.650340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:56.650823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:56.651261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:56.651964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:56.652450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:56.652877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:56.678870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:49:56.761657 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-744c1432-0284-4af9-b24b-f6b91eb97155 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 204 len: 0 microversion: 2.1 time: 0.125443 Oct 22 03:49:56.762254 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3192/6515] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:49:56 2022] DELETE /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:49:56.771870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:56.772658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:56.778777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:56.779273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:56.779715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:56.780493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:56.780957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:56.781389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:56.918408 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0d1b7ea-f76b-41a6-bdce-6721d454f029 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1655 microversion: 2.1 time: 0.150463 Oct 22 03:49:56.919024 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3324/6516] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:56 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:57.943216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:57.944584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:57.961757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:57.962370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:57.962812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:57.963528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:57.963983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:57.964439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:58.113404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-540c99d8-65e4-4411-a01e-4c8c05c2ac43 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1655 microversion: 2.1 time: 0.174504 Oct 22 03:49:58.113985 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3193/6517] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:57 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1655 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:49:58.793536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c91e74dd-9773-4af3-b7e0-b5f256bb7790 req-bcfc6526-e7fd-4f58-b973-12effb2b51bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc58e7a-61ba-414f-b945-b468e87a0368", "name": "network-vif-deleted", "tag": "10daf20c-6ed5-4754-bda2-6bdc76180fda"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:49:58.829524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c91e74dd-9773-4af3-b7e0-b5f256bb7790 req-bcfc6526-e7fd-4f58-b973-12effb2b51bd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:58.830351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c91e74dd-9773-4af3-b7e0-b5f256bb7790 req-bcfc6526-e7fd-4f58-b973-12effb2b51bd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:58.831101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c91e74dd-9773-4af3-b7e0-b5f256bb7790 req-bcfc6526-e7fd-4f58-b973-12effb2b51bd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:59.138902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:49:59.139718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:49:59.143402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:49:59.152804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:59.153378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:59.153922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:59.154784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:59.155310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:59.155840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:59.160027 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c91e74dd-9773-4af3-b7e0-b5f256bb7790 req-bcfc6526-e7fd-4f58-b973-12effb2b51bd service nova] Creating event network-vif-deleted:10daf20c-6ed5-4754-bda2-6bdc76180fda for instance 0fc58e7a-61ba-414f-b945-b468e87a0368 on n-h1-862416-2 Oct 22 03:49:59.165442 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c91e74dd-9773-4af3-b7e0-b5f256bb7790 req-bcfc6526-e7fd-4f58-b973-12effb2b51bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376567 Oct 22 03:49:59.165951 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3325/6518] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:49:59.192883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:49:59.193246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:49:59.193694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:49:59.194198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lazy-loading 'fault' on Instance uuid 0fc58e7a-61ba-414f-b945-b468e87a0368 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:49:59.247784 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff14d0f4-4167-46ab-b70a-fcfb6ed886a8 tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 200 len: 1454 microversion: 2.1 time: 0.112663 Oct 22 03:49:59.248393 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3194/6519] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:49:59 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:00.272630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:00.274107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] [instance: 0fc58e7a-61ba-414f-b945-b468e87a0368] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:00.278163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=46 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:00.282669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:00.283158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:00.283635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:00.284487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:00.284925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:00.285360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:00.300044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] HTTP exception thrown: Instance 0fc58e7a-61ba-414f-b945-b468e87a0368 could not be found. Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Request method failure captured: Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 HTTP/1.1 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2hGDhXV73CIvaPrYeeh4h-0viyz-orLoG5GTUqKyU2C9kQQOcepADtJC6eSgqqyJ5a9nVD6FuIpXM06fVYYk1Hdj2Svjo_DrWPOA4cCr8WphvnfM19TvP6QbeMdPQSRjupwTn-IqlLYKZ5943gwTYP80sX3lhg8bd6mxQ-bQjWEbxM Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5ec1ebab6b174655a7bec6c123ad8648 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestServerMultinode-362201356 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ec1ebab6b174655a7bec6c123ad8648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ec1ebab6b174655a7bec6c123ad8648"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ec1ebab6b174655a7bec6c123ad8648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ec1ebab6b174655a7bec6c123ad8648"}]}] Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestServerMultinode-362201356 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5ec1ebab6b174655a7bec6c123ad8648 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestServerMultinode-362201356 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestServerMultinode-362201356-project-admin Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: ee93bbbd22e640c999dea8d0a40017e6 Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestServerMultinode-362201356-project-admin Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 0fc58e7a-61ba-414f-b945-b468e87a0368 could not be found. Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '0fc58e7a-61ba-414f-b945-b468e87a0368'} Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc58e7a-61ba-414f-b945-b468e87a0368 could not be found. Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc58e7a-61ba-414f-b945-b468e87a0368 could not be found. Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:50:00.302046 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:00.307548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:00.307548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:50:00.307548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:50:00.307548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:50:00.307548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:50:00.307548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc58e7a-61ba-414f-b945-b468e87a0368 could not be found. Oct 22 03:50:00.307548 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:00.309021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] Returning 404 to user: Instance 0fc58e7a-61ba-414f-b945-b468e87a0368 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:50:00.310159 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-99106f1a-ec07-41c7-95da-ac874646befa tempest-TestServerMultinode-362201356 tempest-TestServerMultinode-362201356-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368" status: 404 len: 111 microversion: 2.1 time: 0.042132 Oct 22 03:50:00.310862 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3326/6520] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:00 2022] GET /compute/v2.1/servers/0fc58e7a-61ba-414f-b945-b468e87a0368 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:50:03.260785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:03.264286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:03.284960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:03.285682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:03.286322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:03.287567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:03.289020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:03.289649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:03.354403 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3f7da26f-e4ff-43fc-9286-63668e2da5bd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action" status: 200 len: 63029 microversion: 2.1 time: 0.465153 Oct 22 03:50:03.366156 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3195/6521] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:50:02 2022] POST /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4/action => generated 63029 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:50:14.680658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1965712215", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "be070c35-a3e3-43ad-b3cf-e63e9633c301", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7175b844-9cdb-45d6-b4f9-304c2c700bec"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:14.692138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:14.693015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=13 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:14.744636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] validate_networks() for [('7175b844-9cdb-45d6-b4f9-304c2c700bec', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:50:15.175825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:50:15.176268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:50:15.176750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:50:15.177162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:50:15.177591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:50:15.187730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:15.188156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:15.188621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:15.189350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:15.189807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:15.190235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:15.208818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:50:15.214574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:50:15.280281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:50:15.283064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be070c35-a3e3-43ad-b3cf-e63e9633c301',volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:50:15.427086 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f928bdf-89ee-4d9f-beca-814282fbff38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750226 Oct 22 03:50:15.428351 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3327/6522] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:50:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:50:15.441716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c91d4659-cee5-451b-9aa1-f2363dc90ab9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:15.442536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c91d4659-cee5-451b-9aa1-f2363dc90ab9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:15.447321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:15.456108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:15.527327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c91d4659-cee5-451b-9aa1-f2363dc90ab9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:15.543765 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c91d4659-cee5-451b-9aa1-f2363dc90ab9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1057 microversion: 2.1 time: 0.108195 Oct 22 03:50:15.544543 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3196/6523] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:15 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1057 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:16.569481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:16.570109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:16.578272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:16.578799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:16.579978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:16.580745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:16.581367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:16.581809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:16.668123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:16.678069 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d70351b7-357a-445b-b9fd-8e044a422d9a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1155 microversion: 2.1 time: 0.112554 Oct 22 03:50:16.679016 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3328/6524] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:16 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1155 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:17.705396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:17.706053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:17.715474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:17.716255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:17.717483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:17.718227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:17.718839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:17.719527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:17.997782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:18.017422 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b7075415-c467-479d-aa7f-223776b0b6d5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1215 microversion: 2.1 time: 0.318795 Oct 22 03:50:18.018674 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3197/6525] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:17 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:18.242284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-57f7c0a7-db23-4b9d-b50b-3b62f9365b67 req-4db7fbd9-4ead-4eb1-b64d-a143b851dc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f5f8244-ae62-491f-9a58-e5273f360c77", "tag": "0b234295-f424-4fa9-96d1-8ad4ab306da3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:18.273704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57f7c0a7-db23-4b9d-b50b-3b62f9365b67 req-4db7fbd9-4ead-4eb1-b64d-a143b851dc84 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:18.274441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57f7c0a7-db23-4b9d-b50b-3b62f9365b67 req-4db7fbd9-4ead-4eb1-b64d-a143b851dc84 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:18.275017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-57f7c0a7-db23-4b9d-b50b-3b62f9365b67 req-4db7fbd9-4ead-4eb1-b64d-a143b851dc84 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:18.288184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-57f7c0a7-db23-4b9d-b50b-3b62f9365b67 req-4db7fbd9-4ead-4eb1-b64d-a143b851dc84 service nova] Creating event network-changed:0b234295-f424-4fa9-96d1-8ad4ab306da3 for instance 3f5f8244-ae62-491f-9a58-e5273f360c77 on n-h1-862416-2 Oct 22 03:50:18.293335 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-57f7c0a7-db23-4b9d-b50b-3b62f9365b67 req-4db7fbd9-4ead-4eb1-b64d-a143b851dc84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057305 Oct 22 03:50:18.294323 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3329/6526] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:50:19.044192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:19.045266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:19.052526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:19.053296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:19.053841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:19.054625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:19.055349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:19.055860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:19.289185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:19.299317 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a5478f10-ec49-4fc7-a077-e3fa425d51f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1215 microversion: 2.1 time: 0.259067 Oct 22 03:50:19.300092 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3198/6527] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:19 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1215 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:20.324482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:20.325089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:20.332021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:20.332570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:20.333015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:20.333724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:20.334187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:20.334619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:20.472528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:20.480744 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-777bc68b-8d9f-4804-be68-436322e0f02c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1215 microversion: 2.1 time: 0.161483 Oct 22 03:50:20.481330 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3330/6528] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:20 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:21.504993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:21.505596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:21.512689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:21.513180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:21.513622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:21.514338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:21.514923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:21.515359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:21.659313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:21.667098 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e7e838c-3e6b-4a41-b892-aedb29c6a0d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1215 microversion: 2.1 time: 0.166863 Oct 22 03:50:21.667675 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3199/6529] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:21 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:22.691622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:22.692253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:22.699062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:22.699551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:22.699993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:22.700721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:22.701179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:22.701613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:22.831383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:22.839098 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4c327d8-a358-40d1-9ecb-36f99436071e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.152095 Oct 22 03:50:22.839658 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3331/6530] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:22 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:23.863811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:23.864462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:23.871732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:23.872229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:23.872672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:23.873367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:23.873815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:23.874269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:24.005795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:24.013510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2b6d79e-7354-46fa-a307-b89d5927206b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.154772 Oct 22 03:50:24.014087 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3200/6531] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:23 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:25.036623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:25.037234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:25.043932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:25.044451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:25.044892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:25.045586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:25.046051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:25.046478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:25.180865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:25.189079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7d613aab-df0e-4a94-8e00-88ae911eae17 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.155913 Oct 22 03:50:25.189765 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3332/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:25 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:26.059814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:26.211506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:26.212314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:26.214179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:26.214856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:26.221735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:26.222231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:26.222670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:26.223380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:26.223846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:26.224303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:26.238415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:26.239035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:26.245051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:26.245845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:26.246286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:26.246981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:26.247433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:26.247859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:26.359453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:26.368068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87d7b0f8-1c57-489f-beda-d303b524206e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.160423 Oct 22 03:50:26.368778 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3333/6533] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:26 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:26.382509 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19af49d4-3f1b-4055-8ed2-60b0668db891 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1832 microversion: 2.1 time: 0.327972 Oct 22 03:50:26.383085 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3201/6534] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:26 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1832 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:27.250483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:27.250986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:27.253505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-96cca8d2-3076-4c5c-bcce-95fc80c5d6b2 req-24004328-0dc7-4615-afad-f58648991797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:27.259315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:27.259812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:27.260281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:27.261004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:27.261468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:27.261906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:27.265172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96cca8d2-3076-4c5c-bcce-95fc80c5d6b2 req-24004328-0dc7-4615-afad-f58648991797 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:27.267954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96cca8d2-3076-4c5c-bcce-95fc80c5d6b2 req-24004328-0dc7-4615-afad-f58648991797 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:27.267954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96cca8d2-3076-4c5c-bcce-95fc80c5d6b2 req-24004328-0dc7-4615-afad-f58648991797 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:27.280192 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-96cca8d2-3076-4c5c-bcce-95fc80c5d6b2 req-24004328-0dc7-4615-afad-f58648991797 service nova] Creating event network-changed:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h2-862416-2 Oct 22 03:50:27.286520 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-96cca8d2-3076-4c5c-bcce-95fc80c5d6b2 req-24004328-0dc7-4615-afad-f58648991797 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037082 Oct 22 03:50:27.287498 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3202/6535] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:50:27.289203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:50:27.383998 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de448ea0-ae8d-4031-8218-4e2d49e9e5bc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 204 len: 0 microversion: 2.1 time: 0.136836 Oct 22 03:50:27.389171 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3334/6536] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:50:27 2022] DELETE /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:50:27.394486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:27.395418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:27.396224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:27.396934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:27.403176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:27.403815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:27.403924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:27.404288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:27.404830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:27.405134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:27.405592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:27.405807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:27.407256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:27.407424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:27.408394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:27.409010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:27.573228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:27.584038 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a6aad243-fcd6-411a-b558-299c386461b8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1687 microversion: 2.1 time: 0.192868 Oct 22 03:50:27.585171 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3335/6537] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:27 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:27.595467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:27.603533 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0841c2eb-099b-4d93-957d-110b1a7eba67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.214381 Oct 22 03:50:27.604134 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3203/6538] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:27 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:28.608375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:28.608994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:28.616548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:28.617036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:28.617515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:28.618253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:28.618711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:28.619140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:28.627714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:28.629040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:28.637606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:28.638501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:28.639350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:28.640393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:28.641279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:28.642506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:28.784418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:28.786403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:28.792461 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82024bfe-4822-4ef5-aa08-c05875e6d50c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.169179 Oct 22 03:50:28.793060 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3204/6539] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:28 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:28.794278 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-033ae166-6016-4fc4-b488-c0ca49a40b7d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 200 len: 1687 microversion: 2.1 time: 0.190021 Oct 22 03:50:28.794845 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3336/6540] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:28 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:29.267876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-be54acef-831a-4507-8718-8f593343c784 req-f21da21a-bb7a-4e87-a077-bd72767392e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c739deb-1753-45fc-9802-b54d965a39e4", "name": "network-vif-deleted", "tag": "b525068f-db17-4b4d-ad1c-038ea32ea59f"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:29.277726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be54acef-831a-4507-8718-8f593343c784 req-f21da21a-bb7a-4e87-a077-bd72767392e7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:29.278286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be54acef-831a-4507-8718-8f593343c784 req-f21da21a-bb7a-4e87-a077-bd72767392e7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:29.278725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-be54acef-831a-4507-8718-8f593343c784 req-f21da21a-bb7a-4e87-a077-bd72767392e7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:29.291181 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-be54acef-831a-4507-8718-8f593343c784 req-f21da21a-bb7a-4e87-a077-bd72767392e7 service nova] Creating event network-vif-deleted:b525068f-db17-4b4d-ad1c-038ea32ea59f for instance 7c739deb-1753-45fc-9802-b54d965a39e4 on n-h2-862416-2 Oct 22 03:50:29.295861 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-be54acef-831a-4507-8718-8f593343c784 req-f21da21a-bb7a-4e87-a077-bd72767392e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Oct 22 03:50:29.296507 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3205/6541] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:50:29.816865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:29.817407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:29.819436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:29.820141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 7c739deb-1753-45fc-9802-b54d965a39e4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:29.824720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:29.825168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:29.825613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:29.826322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:29.826453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:29.826814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:29.826924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:29.827248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:29.827371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:29.828077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:29.828566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:29.829002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:29.842490 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] HTTP exception thrown: Instance 7c739deb-1753-45fc-9802-b54d965a39e4 could not be found. Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Request method failure captured: Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 HTTP/1.1 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2cuhsqeIjxZRi8SYlVM2YAHKWF908XmT0FuqmGR_L4W9OH0DVS6J-6-4DQBAHeUYH9qZx6kksVB3TAAqd1NlyYBvJLfYErPtU6joZfwY40hpzy6-8IeuUE7fYhuFP1m381kmKeryIRqkoJQK11VP6EdDXSGvwQC-0XfXiowIBCbCvU Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f73e2096501b458ca6d9f587c21c6d23 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f73e2096501b458ca6d9f587c21c6d23"}]}] Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f73e2096501b458ca6d9f587c21c6d23 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestNetworkAdvancedServerOps-1799870770-project Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 754cd3eb62c24a1eb25a4d294a063588 Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1799870770-project Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 7c739deb-1753-45fc-9802-b54d965a39e4 could not be found. Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '7c739deb-1753-45fc-9802-b54d965a39e4'} Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c739deb-1753-45fc-9802-b54d965a39e4 could not be found. Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c739deb-1753-45fc-9802-b54d965a39e4 could not be found. Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:50:29.844147 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c739deb-1753-45fc-9802-b54d965a39e4 could not be found. Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Returning 404 to user: Instance 7c739deb-1753-45fc-9802-b54d965a39e4 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4858091-2b9b-4fe2-8994-5ce1229efc9a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4" status: 404 len: 111 microversion: 2.1 time: 0.031920 Oct 22 03:50:29.852593 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3206/6542] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:29 2022] GET /compute/v2.1/servers/7c739deb-1753-45fc-9802-b54d965a39e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 03:50:30.083021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:30.091779 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35ca3f5e-e0bd-486b-a6db-56d3b42ee592 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.278936 Oct 22 03:50:30.092522 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3337/6543] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:29 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:31.116885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:31.118182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:31.125713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:31.126769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:31.127414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:31.128372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:31.129027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:31.129672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:31.270707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:31.278959 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f08ce14a-5984-4ec7-a2f7-b94998eb6278 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.165688 Oct 22 03:50:31.279539 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3207/6544] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:31 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:32.283769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9d683983-37d1-4999-b843-fb5369101b99 req-2a0504d3-b4c9-4e62-a5d5-8f285f4746de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5f8244-ae62-491f-9a58-e5273f360c77", "name": "network-vif-plugged", "status": "completed", "tag": "0b234295-f424-4fa9-96d1-8ad4ab306da3"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:32.306844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:32.309278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:32.313139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9d683983-37d1-4999-b843-fb5369101b99 req-2a0504d3-b4c9-4e62-a5d5-8f285f4746de service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:32.313694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9d683983-37d1-4999-b843-fb5369101b99 req-2a0504d3-b4c9-4e62-a5d5-8f285f4746de service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:32.314140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9d683983-37d1-4999-b843-fb5369101b99 req-2a0504d3-b4c9-4e62-a5d5-8f285f4746de service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:32.323536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:32.324364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:32.325214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:32.326160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:32.326827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:32.327558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:32.342776 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9d683983-37d1-4999-b843-fb5369101b99 req-2a0504d3-b4c9-4e62-a5d5-8f285f4746de service nova] Creating event network-vif-plugged:0b234295-f424-4fa9-96d1-8ad4ab306da3 for instance 3f5f8244-ae62-491f-9a58-e5273f360c77 on n-h1-862416-2 Oct 22 03:50:32.356772 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9d683983-37d1-4999-b843-fb5369101b99 req-2a0504d3-b4c9-4e62-a5d5-8f285f4746de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080502 Oct 22 03:50:32.357891 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3338/6545] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:50:32.597081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:32.608613 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4a5ed28d-c5ce-4081-912d-45c20c075abf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.308669 Oct 22 03:50:32.610373 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3208/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:32 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:33.327824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-55c35e57-c20d-4ceb-aa96-ab9d4e42b537 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '.version_select at 0x7f0d1993c940>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:33.350488 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-55c35e57-c20d-4ceb-aa96-ab9d4e42b537 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-92378966" status: 202 len: 0 microversion: 2.1 time: 0.026849 Oct 22 03:50:33.351681 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3339/6547] 10.222.0.25 () {58 vars in 1278 bytes} [Sat Oct 22 03:50:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-92378966 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:50:33.389162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eff72d89-c193-4022-9048-2d006c02fda0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'create', calling method: .version_select at 0x7f0d1a3c8700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1643815071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG69ZyHQugVv4bQkJ8jW8I01ONzlRPIjhley1bPwsw12c9aa/M6d8Xy7UhkfFWY9jDrPSzuwIqBCq7qedfd2YU3gv5onQrrYfQ68McPu4WffwhvhiR/Zgl2LMdQ9B/X5vA=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:33.405671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-eff72d89-c193-4022-9048-2d006c02fda0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for project f73e2096501b458ca6d9f587c21c6d23. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:50:33.414243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-eff72d89-c193-4022-9048-2d006c02fda0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for user 754cd3eb62c24a1eb25a4d294a063588 and project f73e2096501b458ca6d9f587c21c6d23. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:50:33.442580 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eff72d89-c193-4022-9048-2d006c02fda0 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057356 Oct 22 03:50:33.443637 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3209/6548] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:50:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:50:33.635093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:33.636360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:33.647498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:33.648033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:33.648585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:33.649225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:33.649683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:33.650116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:33.831410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:33.840232 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e20ced11-7d5c-4629-9023-d0258007c6f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1203 microversion: 2.1 time: 0.209409 Oct 22 03:50:33.841136 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3340/6549] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:33 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1203 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:34.865709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:34.867264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:34.874340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:34.874871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:34.875317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:34.876141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:34.876860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:34.877378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.009474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:35.017485 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35928df8-4f62-499f-9fed-224c737ce124 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1389 microversion: 2.1 time: 0.157352 Oct 22 03:50:35.018073 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3210/6550] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:34 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:35.040753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:35.041459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:35.048483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:35.049050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:35.049572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.050463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:35.050995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:35.051501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.264330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:35.272463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a27f0fc8-3ebe-4468-8286-342241a8a431 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1389 microversion: 2.1 time: 0.235543 Oct 22 03:50:35.273061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3341/6551] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:35 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1389 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:35.294753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:35.295449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:35.302517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:35.303059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:35.303568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.304387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:35.304918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:35.305413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.451636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:35.460089 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee60b71d-497a-46a5-b503-28ce1362a56b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1389 microversion: 2.1 time: 0.169157 Oct 22 03:50:35.460721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3211/6552] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:35 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:35.482876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:35.483384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:35.490208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:35.490706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:35.491153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.491870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:35.492365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:35.492802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.519687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:50:35.603528 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d96343e-df68-4d81-b15f-c6986c425a50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 204 len: 0 microversion: 2.1 time: 0.124203 Oct 22 03:50:35.604437 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3342/6553] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:50:35 2022] DELETE /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:50:35.613573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:35.614435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:35.620475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:35.621214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:35.621653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.622354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:35.622808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:35.623236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:35.762070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:35.770217 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b82f8221-051d-42fd-bbc1-fe3e7aa8fca1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1395 microversion: 2.1 time: 0.161520 Oct 22 03:50:35.770706 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3212/6554] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:35 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:36.795804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:36.797209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:36.805178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:36.805911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:36.806527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:36.807240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:36.807851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:36.808463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:36.813922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:37.035689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:37.047526 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6594df6b-0b29-425b-8421-283fec04faef tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1395 microversion: 2.1 time: 0.255729 Oct 22 03:50:37.049123 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3343/6555] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:36 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1395 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:37.748462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-ec81dd88-4d82-4c29-81e9-445fb2f2e443 req-48050ac8-0d21-43f6-a069-b7dadcb28beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5f8244-ae62-491f-9a58-e5273f360c77", "name": "network-vif-deleted", "tag": "0b234295-f424-4fa9-96d1-8ad4ab306da3"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:37.761257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ec81dd88-4d82-4c29-81e9-445fb2f2e443 req-48050ac8-0d21-43f6-a069-b7dadcb28beb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:37.761997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ec81dd88-4d82-4c29-81e9-445fb2f2e443 req-48050ac8-0d21-43f6-a069-b7dadcb28beb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:37.762604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ec81dd88-4d82-4c29-81e9-445fb2f2e443 req-48050ac8-0d21-43f6-a069-b7dadcb28beb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:37.779007 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-ec81dd88-4d82-4c29-81e9-445fb2f2e443 req-48050ac8-0d21-43f6-a069-b7dadcb28beb service nova] Creating event network-vif-deleted:0b234295-f424-4fa9-96d1-8ad4ab306da3 for instance 3f5f8244-ae62-491f-9a58-e5273f360c77 on n-h1-862416-2 Oct 22 03:50:37.789575 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-ec81dd88-4d82-4c29-81e9-445fb2f2e443 req-48050ac8-0d21-43f6-a069-b7dadcb28beb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045109 Oct 22 03:50:37.790213 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3213/6556] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:50:38.080753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:38.082892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:38.098487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:38.100004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:38.101123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:38.102531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:38.105034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:38.107676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:38.259372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:38.300548 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a9ef1f9d-e889-4027-8a5a-a2bdebbb891d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1188 microversion: 2.1 time: 0.230280 Oct 22 03:50:38.302768 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3344/6557] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:38 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1188 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:39.330288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:39.330998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:39.351296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:39.352715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:39.353386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:39.354463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:39.355134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:39.355942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:39.477341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:39.489396 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-44c1edc4-fd4f-432e-9dd9-c2736c8a1ad1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1188 microversion: 2.1 time: 0.164840 Oct 22 03:50:39.493112 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3214/6558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:39 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1188 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:40.139896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-777332628", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "5180f13b-5db9-4239-bac8-246d62c24421"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1643815071", "security_groups": [{"name": "tempest-secgroup-smoke-2082546572"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:40.281953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] validate_networks() for [('5180f13b-5db9-4239-bac8-246d62c24421', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:50:40.522416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:40.523603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:40.544686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:40.547798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:40.548569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:40.550937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:40.551591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:40.552237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:40.677239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:40.688766 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e1b8f60e-5894-41cf-9729-bd9e011d1e87 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1188 microversion: 2.1 time: 0.175465 Oct 22 03:50:40.712848 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3215/6559] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:40 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1188 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:40.760781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:50:40.762096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:50:40.763075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:50:40.763921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:50:40.764588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:50:40.776679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:40.777309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:40.777819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:40.778834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:40.779484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:40.780111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:40.807711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for project f73e2096501b458ca6d9f587c21c6d23. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:50:40.814088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for user 754cd3eb62c24a1eb25a4d294a063588 and project f73e2096501b458ca6d9f587c21c6d23. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:50:40.828559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:50:40.832157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:50:40.895867 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe694688-3a21-4895-8750-967365f57bdc tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.761469 Oct 22 03:50:40.896920 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3345/6560] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:50:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:50:40.908286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5055f3f4-5554-47fa-9151-ad636ef60a25 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:40.909176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5055f3f4-5554-47fa-9151-ad636ef60a25 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:41.008534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5055f3f4-5554-47fa-9151-ad636ef60a25 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:41.016532 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5055f3f4-5554-47fa-9151-ad636ef60a25 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1266 microversion: 2.1 time: 0.112374 Oct 22 03:50:41.017427 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3216/6561] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:40 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:41.714758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:41.716052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:41.723325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:41.723947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:41.724669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:41.725582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:41.726572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:41.726572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:41.804746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:41.812763 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dc54456e-3763-47a4-bba5-856b95d0347a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1188 microversion: 2.1 time: 0.102750 Oct 22 03:50:41.814582 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3346/6562] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:41 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:42.039644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:42.040641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:42.051895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:42.052426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:42.052901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:42.053629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:42.054088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:42.054523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:42.128155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:42.135959 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ecf52d1f-942d-4121-989f-8a370c328f2e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1318 microversion: 2.1 time: 0.100217 Oct 22 03:50:42.138237 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3217/6563] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:42 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:42.837152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:42.837784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:42.845742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:42.846786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:42.847391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:42.848327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:42.850291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:42.850973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:42.936947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:42.945656 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27cc3274-a7f6-4f01-b9ac-6cfd416763e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 200 len: 1188 microversion: 2.1 time: 0.112778 Oct 22 03:50:42.961531 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3347/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:42 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 1188 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:43.162358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:43.164751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:43.172159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:43.172770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:43.173818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:43.175269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:43.181547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:43.181996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:43.186757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:43.518305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:43.543390 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-47843afb-f182-4976-bfd9-30034e5cf351 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1392 microversion: 2.1 time: 0.385864 Oct 22 03:50:43.557917 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3218/6565] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:43 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1392 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:43.972586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:43.973290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 3f5f8244-ae62-491f-9a58-e5273f360c77] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:43.981557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:43.982679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:43.983124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:43.983835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:43.984321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:43.984756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:43.998856 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 3f5f8244-ae62-491f-9a58-e5273f360c77 could not be found. Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 HTTP/1.1 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 3f5f8244-ae62-491f-9a58-e5273f360c77 could not be found. Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '3f5f8244-ae62-491f-9a58-e5273f360c77'} Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5f8244-ae62-491f-9a58-e5273f360c77 could not be found. Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5f8244-ae62-491f-9a58-e5273f360c77 could not be found. Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:50:44.000584 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5f8244-ae62-491f-9a58-e5273f360c77 could not be found. Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 3f5f8244-ae62-491f-9a58-e5273f360c77 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f3427495-1bf7-4d89-a83c-c70b21252490 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77" status: 404 len: 111 microversion: 2.1 time: 0.036010 Oct 22 03:50:44.005110 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3348/6566] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:43 2022] GET /compute/v2.1/servers/3f5f8244-ae62-491f-9a58-e5273f360c77 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:50:44.223192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6cffff74-1447-482b-a042-558445663927 req-647e5e8a-a42d-4780-8017-5c730302b7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b360535-0c6e-4e4d-9d2b-218be0a0882d", "tag": "c99e9967-6979-4260-8a70-e31820c113ad"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:44.241771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6cffff74-1447-482b-a042-558445663927 req-647e5e8a-a42d-4780-8017-5c730302b7fa service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:44.242256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6cffff74-1447-482b-a042-558445663927 req-647e5e8a-a42d-4780-8017-5c730302b7fa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:44.242877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6cffff74-1447-482b-a042-558445663927 req-647e5e8a-a42d-4780-8017-5c730302b7fa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:44.257264 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6cffff74-1447-482b-a042-558445663927 req-647e5e8a-a42d-4780-8017-5c730302b7fa service nova] Creating event network-changed:c99e9967-6979-4260-8a70-e31820c113ad for instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d on n-h2-862416-2 Oct 22 03:50:44.262430 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6cffff74-1447-482b-a042-558445663927 req-647e5e8a-a42d-4780-8017-5c730302b7fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043176 Oct 22 03:50:44.263284 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3219/6567] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:50:44.571321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:44.571937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:44.578425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:44.578922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:44.579558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:44.580497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:44.580968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:44.581406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:44.723479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:44.731304 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9be3de47-5d75-4cb3-8d11-76e2e42782ee tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1392 microversion: 2.1 time: 0.164207 Oct 22 03:50:44.731879 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3349/6568] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:44 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:45.756236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:45.756908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:45.759803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:45.765202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:45.765696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:45.766136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:45.766966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:45.767668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:45.767849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:45.906704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:45.914622 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4dbbebe-6572-4065-b77d-f6cefa460744 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1392 microversion: 2.1 time: 0.163409 Oct 22 03:50:45.915202 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3220/6569] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:45 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:46.938474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:46.940082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:46.943420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:50:46.949580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:46.950642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:46.951257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:46.952249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:46.952724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:46.953261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:47.102373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:47.110629 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ffc9a349-2a78-4d53-b9a7-a80e0be3c68a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1392 microversion: 2.1 time: 0.176064 Oct 22 03:50:47.111325 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3350/6570] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:46 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:48.136321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:48.137781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:48.145971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:48.146460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:48.146902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:48.148664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:48.149301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:48.149743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:48.293540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:48.305062 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3df7d373-fc32-40d8-aecd-b8b888eb120d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1392 microversion: 2.1 time: 0.174290 Oct 22 03:50:48.305673 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3221/6571] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:48 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:48.972087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1661874915", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6c0ae843-28b9-41ba-ba43-c048c597a58c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7175b844-9cdb-45d6-b4f9-304c2c700bec"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:49.034090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] validate_networks() for [('7175b844-9cdb-45d6-b4f9-304c2c700bec', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:50:49.327054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:49.340588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:49.348233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:49.348751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:49.349192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:49.350152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:49.350611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:49.351038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:49.401679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:50:49.402139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:50:49.402634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:50:49.403052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:50:49.403474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:50:49.413245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:49.413740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:49.414176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:49.415054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:49.415512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:49.415973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:49.433393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:50:49.439190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:50:49.488355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:49.495963 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3db94675-d0d6-4df6-9af2-750f456083ad tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1392 microversion: 2.1 time: 0.172971 Oct 22 03:50:49.496832 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3222/6572] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:49 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:49.503427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:50:49.505397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c0ae843-28b9-41ba-ba43-c048c597a58c',volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:50:49.630629 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4638e5bf-80e7-45d7-9d6b-0af2444ad1ed tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663515 Oct 22 03:50:49.631279 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3351/6573] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:50:49.644351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-23b39dac-9db4-4db3-8d8e-96a4bac0187e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:49.644961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-23b39dac-9db4-4db3-8d8e-96a4bac0187e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:49.699714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-23b39dac-9db4-4db3-8d8e-96a4bac0187e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:49.707322 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-23b39dac-9db4-4db3-8d8e-96a4bac0187e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1057 microversion: 2.1 time: 0.068197 Oct 22 03:50:49.707905 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3223/6574] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:49 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1057 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:50.076378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0f87e881-606a-4e79-9575-2dddfc7d6780 req-039e8158-c36d-429e-b8c2-99a67b8be43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b360535-0c6e-4e4d-9d2b-218be0a0882d", "name": "network-vif-plugged", "status": "completed", "tag": "c99e9967-6979-4260-8a70-e31820c113ad"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:50.089448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0f87e881-606a-4e79-9575-2dddfc7d6780 req-039e8158-c36d-429e-b8c2-99a67b8be43f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:50.090384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0f87e881-606a-4e79-9575-2dddfc7d6780 req-039e8158-c36d-429e-b8c2-99a67b8be43f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:50.090882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0f87e881-606a-4e79-9575-2dddfc7d6780 req-039e8158-c36d-429e-b8c2-99a67b8be43f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:50.106993 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0f87e881-606a-4e79-9575-2dddfc7d6780 req-039e8158-c36d-429e-b8c2-99a67b8be43f service nova] Creating event network-vif-plugged:c99e9967-6979-4260-8a70-e31820c113ad for instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d on n-h2-862416-2 Oct 22 03:50:50.113316 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0f87e881-606a-4e79-9575-2dddfc7d6780 req-039e8158-c36d-429e-b8c2-99a67b8be43f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040859 Oct 22 03:50:50.113949 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3352/6575] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:50:50.519780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:50.520425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:50.527849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:50.528350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:50.528787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:50.529469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:50.530020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:50.530452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:50.669454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:50.678462 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-00ecaa65-e210-4f47-9feb-61e523f60ede tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1392 microversion: 2.1 time: 0.163351 Oct 22 03:50:50.679134 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3224/6576] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:50 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:50.731568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:50.732191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:50.739435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:50.740598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:50.741188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:50.742092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:50.742709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:50.743297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:50.813698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:50.822120 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef63e5b3-a4e2-44c3-a2a6-3c16152337fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1173 microversion: 2.1 time: 0.094984 Oct 22 03:50:50.823199 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3353/6577] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:50 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1173 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:51.705816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:51.706455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:51.714317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:51.714810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:51.715254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:51.715964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:51.716470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:51.716991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:51.847401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:51.848016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:51.855568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:51.855995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:51.856470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:51.857222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:51.857683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:51.858291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:51.932433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:51.942569 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ec9151d-6e0e-4e7f-8f18-854bc68e1d60 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1565 microversion: 2.1 time: 0.240798 Oct 22 03:50:51.943711 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3225/6578] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:51 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1565 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:51.966642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:51.967264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:51.977461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:51.978242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:51.978851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:51.979738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:51.980385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:51.980973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:52.007082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:52.015557 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec7fda71-f05f-4880-882f-c6fa6ae32050 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1215 microversion: 2.1 time: 0.172780 Oct 22 03:50:52.016599 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3354/6579] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:51 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:52.226980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:52.238314 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a61dc67-4ee7-4359-bd5a-9f35389e5753 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1565 microversion: 2.1 time: 0.275799 Oct 22 03:50:52.239162 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3226/6580] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:51 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1565 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:50:52.607871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-fd843577-6132-4550-a7c5-62a9435cb73e req-d7b3a97b-3051-4fbe-8ba9-0c379c59decf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d297ef8f-1001-492d-9014-61c237f41808", "tag": "ffc12003-204b-44a5-906c-e2d59d43022c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:52.620610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fd843577-6132-4550-a7c5-62a9435cb73e req-d7b3a97b-3051-4fbe-8ba9-0c379c59decf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:52.621506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fd843577-6132-4550-a7c5-62a9435cb73e req-d7b3a97b-3051-4fbe-8ba9-0c379c59decf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:52.622033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fd843577-6132-4550-a7c5-62a9435cb73e req-d7b3a97b-3051-4fbe-8ba9-0c379c59decf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:52.634921 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-fd843577-6132-4550-a7c5-62a9435cb73e req-d7b3a97b-3051-4fbe-8ba9-0c379c59decf service nova] Creating event network-changed:ffc12003-204b-44a5-906c-e2d59d43022c for instance d297ef8f-1001-492d-9014-61c237f41808 on n-h1-862416-2 Oct 22 03:50:52.641427 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-fd843577-6132-4550-a7c5-62a9435cb73e req-d7b3a97b-3051-4fbe-8ba9-0c379c59decf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052558 Oct 22 03:50:52.643318 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3355/6581] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:50:53.039492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:53.040108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:53.046765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:53.047252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:53.047694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:53.049186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:53.049620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:53.050053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:53.649353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:53.659290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59cfc04f-a985-4fc7-8857-6604aca3f549 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1215 microversion: 2.1 time: 0.623595 Oct 22 03:50:53.661339 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3227/6582] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:53 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1215 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:54.689991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:54.691381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:54.699770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:54.700573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:54.701398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:54.703413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:54.704043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:54.705757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:54.870724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:54.879495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b61d3d5f-302a-412a-990b-acf39ab129a0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1215 microversion: 2.1 time: 0.194705 Oct 22 03:50:54.881390 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3356/6583] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:54 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:55.501631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:55.502965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:55.506234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a0c906ff-423a-4dc4-bb74-0f3502f01803 req-49543bec-7d78-4a67-8c2d-81b7efff246c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b360535-0c6e-4e4d-9d2b-218be0a0882d", "tag": "c99e9967-6979-4260-8a70-e31820c113ad"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:50:55.511548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:55.512274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:55.512901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:55.513779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:55.514392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:55.515121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:55.515918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a0c906ff-423a-4dc4-bb74-0f3502f01803 req-49543bec-7d78-4a67-8c2d-81b7efff246c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:55.516598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a0c906ff-423a-4dc4-bb74-0f3502f01803 req-49543bec-7d78-4a67-8c2d-81b7efff246c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:55.518406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a0c906ff-423a-4dc4-bb74-0f3502f01803 req-49543bec-7d78-4a67-8c2d-81b7efff246c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:55.530851 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a0c906ff-423a-4dc4-bb74-0f3502f01803 req-49543bec-7d78-4a67-8c2d-81b7efff246c service nova] Creating event network-changed:c99e9967-6979-4260-8a70-e31820c113ad for instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d on n-h2-862416-2 Oct 22 03:50:55.537072 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a0c906ff-423a-4dc4-bb74-0f3502f01803 req-49543bec-7d78-4a67-8c2d-81b7efff246c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 Oct 22 03:50:55.538323 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3357/6584] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:50:55.756724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:55.765570 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1efceaac-c664-421d-83e3-7116e0d92544 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1565 microversion: 2.1 time: 0.268204 Oct 22 03:50:55.766597 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3228/6585] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:55 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1565 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:55.904606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:55.905890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:55.912455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:55.912879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:55.913316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:55.914213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:55.914829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:55.915264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:56.085485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:56.098153 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-addcc636-b5fd-4ef6-a68f-62d65194e557 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1215 microversion: 2.1 time: 0.198775 Oct 22 03:50:56.098798 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3358/6586] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:55 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:57.121858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:57.122441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:57.129967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:57.130447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:57.130882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:57.131571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:57.132028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:57.132484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:57.263922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:57.271803 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4bc7c30e-878a-467c-bc84-41539c20b346 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.154186 Oct 22 03:50:57.272410 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3229/6587] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:57 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:58.294926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:58.295547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:58.303490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:58.303984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:58.304465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:58.305169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:58.305631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:58.306066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:58.438869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:58.446766 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6cc7feb9-3c99-4dfd-b15a-f9997d2b2324 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.155694 Oct 22 03:50:58.447347 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3359/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:58 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:50:59.471422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:50:59.472045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:50:59.479079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:59.479569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:59.480010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:59.480747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:50:59.481208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:50:59.481641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:50:59.613257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:50:59.620880 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8c6f1d7-e3c4-4cb4-b5fa-c1c490edf8fa tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.154194 Oct 22 03:50:59.621700 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3230/6589] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:50:59 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:00.646466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:00.647077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:00.649986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:00.650647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:00.656376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:00.656862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:00.657296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:00.658233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:00.658751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:00.659178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:00.790491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:00.798188 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5cf8ce20-2fba-4330-8c27-097c8bbd4aa2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.156509 Oct 22 03:51:00.799306 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3360/6590] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:00 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:01.821760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:01.822303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:01.824135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:01.831037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:01.831876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:01.832355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:01.833060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:01.833517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:01.833947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:01.964894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:01.972930 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d08626b-f029-4cd8-902f-f2bdca21f7f3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.155251 Oct 22 03:51:01.973499 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3231/6591] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:01 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:02.995966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:02.996858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:03.003925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:03.004520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:03.004966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:03.005656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:03.006116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:03.006541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:03.139354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:03.147770 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce414e48-731d-443d-ae6d-46b068fabcbb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.155765 Oct 22 03:51:03.148377 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3361/6592] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:02 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:04.171071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:04.171721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:04.179758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:04.180257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:04.180707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:04.181444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:04.181900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:04.182336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:04.312572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:04.321119 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-87fa1ac4-ccae-473e-ba81-7497159e3cdd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.154067 Oct 22 03:51:04.321701 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3232/6593] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:04 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:05.346216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:05.346751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:05.353184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:05.353673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:05.354114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:05.354811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:05.355268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:05.355698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:05.486538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:05.494206 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e69d19f-0791-4295-9373-743ebc071018 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.152920 Oct 22 03:51:05.494780 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3362/6594] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:05 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:06.292028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-93d6bbde-836a-44bb-abd7-8bba811fda34 req-4fea98ee-b557-4eda-b6f1-39de8106e65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d297ef8f-1001-492d-9014-61c237f41808", "name": "network-vif-plugged", "status": "completed", "tag": "ffc12003-204b-44a5-906c-e2d59d43022c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:51:06.303965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93d6bbde-836a-44bb-abd7-8bba811fda34 req-4fea98ee-b557-4eda-b6f1-39de8106e65c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:06.304481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93d6bbde-836a-44bb-abd7-8bba811fda34 req-4fea98ee-b557-4eda-b6f1-39de8106e65c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:06.305103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-93d6bbde-836a-44bb-abd7-8bba811fda34 req-4fea98ee-b557-4eda-b6f1-39de8106e65c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:06.317363 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-93d6bbde-836a-44bb-abd7-8bba811fda34 req-4fea98ee-b557-4eda-b6f1-39de8106e65c service nova] Creating event network-vif-plugged:ffc12003-204b-44a5-906c-e2d59d43022c for instance d297ef8f-1001-492d-9014-61c237f41808 on n-h1-862416-2 Oct 22 03:51:06.322512 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-93d6bbde-836a-44bb-abd7-8bba811fda34 req-4fea98ee-b557-4eda-b6f1-39de8106e65c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034123 Oct 22 03:51:06.323158 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3233/6595] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:51:06.517906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:06.518492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:06.525277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:06.525763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:06.526198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:06.527103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:06.527563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:06.527988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:06.667683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:06.671118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:06.677075 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2951f233-242f-4901-8b22-8a098db9b4dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1203 microversion: 2.1 time: 0.163086 Oct 22 03:51:06.677675 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3363/6596] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:06 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:07.702085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:07.702959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:07.709687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:07.710175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:07.710616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:07.711353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:07.711806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:07.712257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:07.850415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:07.858163 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dcc15b47-4f20-4eec-b9f2-f32adc46efcc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1390 microversion: 2.1 time: 0.161184 Oct 22 03:51:07.858740 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3234/6597] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:07 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:51:07.881449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:07.882064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:07.888898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:07.889386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:07.889828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:07.890525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:07.890989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:07.891421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:08.020137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:08.027934 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-826d16c9-656e-4fab-a013-3339f4be4c50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1390 microversion: 2.1 time: 0.150535 Oct 22 03:51:08.028562 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3364/6598] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:07 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:08.050938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:08.051488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:08.057412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:08.057902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:08.058346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:08.059048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:08.059503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:08.059936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:08.190300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:08.198089 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d278a7a5-f0f4-4f52-96c0-4fc591449daf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1390 microversion: 2.1 time: 0.151684 Oct 22 03:51:08.198676 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3235/6599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:08 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:08.220556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:08.221301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:08.227481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:08.227988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:08.228458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:08.229151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:08.229612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:08.230045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:08.255455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:51:08.331999 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a77af610-6f28-492d-a8d1-a56e45084a78 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 204 len: 0 microversion: 2.1 time: 0.114807 Oct 22 03:51:08.332676 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3365/6600] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:51:08 2022] DELETE /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:51:08.341191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:08.341801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:08.347851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:08.348385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:08.348825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:08.349521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:08.349992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:08.350443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:08.479973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:08.488382 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef94cd2c-fb50-4764-82e5-a41e22c43c56 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1396 microversion: 2.1 time: 0.151108 Oct 22 03:51:08.488961 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3236/6601] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:08 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1396 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:09.514143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:09.514853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:09.521593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:09.522077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:09.522523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:09.523260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:09.523714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:09.524193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:09.656066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:09.664438 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c76cc93d-9cdf-4a07-b410-5fece8482209 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1396 microversion: 2.1 time: 0.154775 Oct 22 03:51:09.665013 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3366/6602] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:09 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:10.379528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-59f6cc5c-b652-4d06-86cd-30ccceccf987 req-29b3da71-89e2-455f-b872-c5c42bc79c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d297ef8f-1001-492d-9014-61c237f41808", "name": "network-vif-deleted", "tag": "ffc12003-204b-44a5-906c-e2d59d43022c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:51:10.397169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-59f6cc5c-b652-4d06-86cd-30ccceccf987 req-29b3da71-89e2-455f-b872-c5c42bc79c71 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:10.397751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-59f6cc5c-b652-4d06-86cd-30ccceccf987 req-29b3da71-89e2-455f-b872-c5c42bc79c71 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:10.398406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-59f6cc5c-b652-4d06-86cd-30ccceccf987 req-29b3da71-89e2-455f-b872-c5c42bc79c71 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:10.402985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=100 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:10.414178 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-59f6cc5c-b652-4d06-86cd-30ccceccf987 req-29b3da71-89e2-455f-b872-c5c42bc79c71 service nova] Creating event network-vif-deleted:ffc12003-204b-44a5-906c-e2d59d43022c for instance d297ef8f-1001-492d-9014-61c237f41808 on n-h1-862416-2 Oct 22 03:51:10.419517 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-59f6cc5c-b652-4d06-86cd-30ccceccf987 req-29b3da71-89e2-455f-b872-c5c42bc79c71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044009 Oct 22 03:51:10.420133 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3237/6603] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:51:10.688039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:10.688692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:10.695805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:10.696339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:10.696782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:10.697482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:10.697947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:10.698376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:10.768462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:10.776402 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d9f44972-b54f-4394-b13b-b37259d625cc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1188 microversion: 2.1 time: 0.092326 Oct 22 03:51:10.776987 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3367/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:10 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:11.801914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:11.802525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:11.809203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:11.809684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:11.810113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:11.810806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:11.811256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:11.811675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:11.875848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:11.884063 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7f48007-a1d1-45c1-b870-6c5b0c1d12dc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1188 microversion: 2.1 time: 0.087779 Oct 22 03:51:11.884812 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3238/6605] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:11 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:12.907352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:12.908389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:12.915118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:12.915683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:12.916122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:12.916851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:12.917303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:12.917730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:12.979582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:12.991733 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4e3f26c9-30f4-4fb7-bb88-25126661ff5a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1188 microversion: 2.1 time: 0.088324 Oct 22 03:51:12.992355 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3368/6606] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:12 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:14.015464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:14.016075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:14.023800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:14.024322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:14.024763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:14.025461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:14.025917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:14.026347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:14.090878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:14.098977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e130c62b-cea8-4755-b5b2-8bf927219749 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 200 len: 1188 microversion: 2.1 time: 0.087922 Oct 22 03:51:14.099553 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3239/6607] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:14 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:15.122644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:15.123261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: d297ef8f-1001-492d-9014-61c237f41808] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:15.130592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:15.131084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:15.131530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:15.132466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:15.132945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:15.133385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:15.147682 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance d297ef8f-1001-492d-9014-61c237f41808 could not be found. Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 HTTP/1.1 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance d297ef8f-1001-492d-9014-61c237f41808 could not be found. Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'd297ef8f-1001-492d-9014-61c237f41808'} Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d297ef8f-1001-492d-9014-61c237f41808 could not be found. Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d297ef8f-1001-492d-9014-61c237f41808 could not be found. Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:51:15.149471 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d297ef8f-1001-492d-9014-61c237f41808 could not be found. Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance d297ef8f-1001-492d-9014-61c237f41808 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-76afdab0-9ca7-4dfc-8685-27ad2a9524bb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808" status: 404 len: 111 microversion: 2.1 time: 0.032601 Oct 22 03:51:15.153137 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3369/6608] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:15 2022] GET /compute/v2.1/servers/d297ef8f-1001-492d-9014-61c237f41808 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:51:27.057481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:51:27.059666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:27.062284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=41 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:27.062944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:27.069647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:27.070121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:27.070557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:27.071255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:27.071708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:27.072795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:27.125591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18662176-0a56-4be0-ade0-4aa990bc4a31 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d/action" status: 200 len: 24570 microversion: 2.1 time: 0.072006 Oct 22 03:51:27.126534 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3240/6609] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:51:27 2022] POST /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 03:51:36.123706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1632044342", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "68f5acbd-2964-4ac7-ba5d-b5dc2033b29c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7175b844-9cdb-45d6-b4f9-304c2c700bec"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:51:36.134173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:36.134997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:36.274251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] validate_networks() for [('7175b844-9cdb-45d6-b4f9-304c2c700bec', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:51:36.693840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:51:36.694271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:51:36.694759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:51:36.695179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:51:36.695599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:51:36.704518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:36.705007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:36.705449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:36.706188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:36.706652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:36.707084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:36.725150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:51:36.730465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:51:36.743482 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:51:36.745575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='68f5acbd-2964-4ac7-ba5d-b5dc2033b29c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:51:36.823294 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-15a5050e-97f9-4600-b256-aae2e58669ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703819 Oct 22 03:51:36.824101 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3370/6610] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:51:36.836370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5d5721b7-c669-4389-8406-9fff80a1e996 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:36.837472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5d5721b7-c669-4389-8406-9fff80a1e996 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:36.954658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5d5721b7-c669-4389-8406-9fff80a1e996 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:36.964555 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5d5721b7-c669-4389-8406-9fff80a1e996 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1057 microversion: 2.1 time: 0.132898 Oct 22 03:51:36.965166 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3241/6611] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:36 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1057 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:37.989721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:37.990925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:37.998101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:37.998588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:37.999031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:37.999762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:38.000473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:38.001089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:38.067365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:38.076306 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ccba7d54-a6ac-4e82-9a05-f1d4c13e5a64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1127 microversion: 2.1 time: 0.091608 Oct 22 03:51:38.077350 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3371/6612] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:37 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1127 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:39.103397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:39.104180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:39.116163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:39.119996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:39.120595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:39.121281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:39.122012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:39.122464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:39.123306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:39.398338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:39.412576 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c936ab2-2fac-4e32-a198-6eb1c546b962 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.316474 Oct 22 03:51:39.413591 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3242/6613] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:39 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:39.637779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-666e1a2f-b9f1-4bcd-bc79-809c13d4f3da req-817ddaa6-c6ee-4289-96a8-b17f70489b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b02dc4-f6e5-46c2-b267-8a6b8197fa01", "tag": "05d3607c-22b7-4cc4-9e5e-07b77fea72e8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:51:39.658494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-666e1a2f-b9f1-4bcd-bc79-809c13d4f3da req-817ddaa6-c6ee-4289-96a8-b17f70489b42 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:39.659057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-666e1a2f-b9f1-4bcd-bc79-809c13d4f3da req-817ddaa6-c6ee-4289-96a8-b17f70489b42 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:39.659547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-666e1a2f-b9f1-4bcd-bc79-809c13d4f3da req-817ddaa6-c6ee-4289-96a8-b17f70489b42 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:39.672162 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-666e1a2f-b9f1-4bcd-bc79-809c13d4f3da req-817ddaa6-c6ee-4289-96a8-b17f70489b42 service nova] Creating event network-changed:05d3607c-22b7-4cc4-9e5e-07b77fea72e8 for instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 on n-h1-862416-2 Oct 22 03:51:39.677586 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-666e1a2f-b9f1-4bcd-bc79-809c13d4f3da req-817ddaa6-c6ee-4289-96a8-b17f70489b42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121920 Oct 22 03:51:39.678210 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3372/6614] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:51:40.437742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:40.438966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:40.452050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:40.453266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:40.453713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:40.454442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:40.454901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:40.455331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:40.689239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:40.697322 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f61d613-0dac-4980-88ab-24c6527871b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.264224 Oct 22 03:51:40.697911 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3243/6615] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:40 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:41.723483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:41.724295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:41.732333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:41.732675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:41.733117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:41.733818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:41.734647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:41.735137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:41.906506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:41.916876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b49c6729-d0e8-44ee-b616-cf0cda096466 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.198121 Oct 22 03:51:41.917738 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3373/6616] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:41 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:42.947788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:42.948496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:42.956050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:42.956600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:42.957123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:42.957751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:42.959727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:42.959727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:43.184566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:43.193063 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1e05ddcd-57fd-4452-a17d-b6565f58134f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.250645 Oct 22 03:51:43.202657 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3244/6617] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:42 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:44.229522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:44.230780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:44.238508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:44.239041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:44.239493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:44.240795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:44.241367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:44.241805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:44.410564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:44.418937 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8f014e65-c6f6-498a-9cd1-7f53438c5134 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.193800 Oct 22 03:51:44.419517 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3374/6618] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:44 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:45.449193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:45.449193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:45.455024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:45.455551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:45.455987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:45.456726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:45.457220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:45.457615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:45.615904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:45.624057 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-33406d32-5cfd-4911-b4ab-495a74b01a06 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.184987 Oct 22 03:51:45.624692 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3245/6619] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:45 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:46.649116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:46.649730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:46.656617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:46.657106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:46.657544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:46.658239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:46.658698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:46.659125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:46.715047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:46.736886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:46.791118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:46.799518 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7405f2cf-1999-4e93-91fe-ed96fd44a8d3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.154727 Oct 22 03:51:46.800119 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3375/6620] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:46 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:47.824046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:47.824707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:47.827366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:47.833334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:47.834134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:47.834484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:47.835199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:47.835663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:47.836095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:47.973060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:47.981111 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9436e058-5590-4503-81f8-5e50df5bb78c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.161114 Oct 22 03:51:47.981637 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3246/6621] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:47 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:49.005250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:49.006727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:49.013669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:49.014160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:49.014608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:49.015316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:49.015777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:49.016278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:49.155985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:49.166037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7d018b90-072a-4002-8382-8e076bb835c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.164809 Oct 22 03:51:49.166635 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3376/6622] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:48 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:50.189635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:50.190259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:50.197644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:50.198119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:50.198548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:50.199240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:50.199686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:50.200111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:50.337095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:50.344989 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f2156ad-2d66-4262-830c-a8080f88068d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.159321 Oct 22 03:51:50.345560 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3247/6623] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:50 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:51.369150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:51.369680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:51.377077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:51.377582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:51.378027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:51.378760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:51.379220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:51.379652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:51.511714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:51.519653 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-162a74f3-e9de-4055-be6e-ffb01211197b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1169 microversion: 2.1 time: 0.155243 Oct 22 03:51:51.520254 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3377/6624] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:51 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:52.544534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:52.545176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:52.551131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:52.551613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:52.552053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:52.552958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:52.553419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:52.553849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:52.691094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:52.699454 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-14b9fe51-3abf-4b63-bc6f-24dcb3c0e551 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1215 microversion: 2.1 time: 0.160117 Oct 22 03:51:52.700035 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3248/6625] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:52 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:53.722826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:53.723428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:53.730375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:53.730801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:53.731243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:53.731936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:53.732431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:53.732864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:53.866845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:53.874927 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91650503-d6cb-4544-855c-ea2c26829543 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.156035 Oct 22 03:51:53.875504 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3378/6626] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:53 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:54.899555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:54.900161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:54.906952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:54.907462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:54.907898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:54.908634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:54.909088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:54.909517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:55.040323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:55.048037 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-57d718e8-73da-406f-a954-14ca8e9166e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.153142 Oct 22 03:51:55.048639 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3249/6627] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:54 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:56.071855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:56.072485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:56.079318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:56.079799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:56.080255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:56.080944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:56.081397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:56.081818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:56.211144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:56.218838 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c9c6d008-d489-4228-b3f2-f3489eb66704 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.151426 Oct 22 03:51:56.219416 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3379/6628] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:56 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:57.242439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:57.243051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:57.245910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=23 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:51:57.251600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:57.252088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:57.252564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:57.253266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:57.253726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:57.254161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:57.385641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:57.394409 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a6270b36-c478-4f58-b580-a4054d8d1b39 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.155905 Oct 22 03:51:57.394986 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3250/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:57 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:57.505157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:57.506748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:57.513665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:57.514147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:57.514581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:57.515267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:57.515721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:57.516148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:57.651130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:57.658835 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fd66cbf2-d772-4ae9-b9fe-55530279a614 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1683 microversion: 2.1 time: 0.157572 Oct 22 03:51:57.659418 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3380/6630] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:57 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:57.762575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:51:57.764895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:57.771373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:57.771983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:57.772550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:57.773260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:57.773721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:57.774153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:57.822591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bde21a85-ebcf-412d-b82a-261193360b62 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d/action" status: 200 len: 32639 microversion: 2.1 time: 0.064025 Oct 22 03:51:57.823246 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3251/6631] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:51:57 2022] POST /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d/action => generated 32639 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:51:58.047819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:58.048481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:58.055369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:58.055853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:58.056327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:58.057023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:58.057484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:58.057908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:58.190410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7832a354-a522-4096-b25b-0062ca16115e tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1834 microversion: 2.1 time: 0.146332 Oct 22 03:51:58.190993 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3381/6632] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:58 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1834 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:58.222360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:51:58.225105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:58.232271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:58.232759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:58.233202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:58.233900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:58.234357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:58.234786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:58.260894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lazy-loading 'flavor' on Instance uuid 1b360535-0c6e-4e4d-9d2b-218be0a0882d {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:51:58.274337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Going to try to live migrate instance to another host {{(pid=120582) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 22 03:51:58.418103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:58.418850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:58.424860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:58.425447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:58.425971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:58.426735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:58.427783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:58.428789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:58.562347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:58.570998 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69d8d194-24df-4f0f-8bd3-962b2c5c2ac8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.156931 Oct 22 03:51:58.571661 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3382/6633] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:58 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:51:59.594857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:59.595467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:59.602372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:59.602853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:59.603292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:59.603984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:59.604466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:59.604894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:59.737042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:59.745740 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-780bca0f-580f-4db4-b611-b38c68626e2b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.154642 Oct 22 03:51:59.760231 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3383/6634] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:59 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:51:59.806725 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ef99f26-2ba4-4ad8-8511-6f2fa75542b0 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d/action" status: 202 len: 0 microversion: 2.1 time: 1.588457 Oct 22 03:51:59.807430 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3252/6635] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:51:58 2022] POST /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d/action => generated 0 bytes in 1590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:51:59.817426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:51:59.818354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:51:59.824605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:59.825143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:59.825746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:59.826635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:51:59.827224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:51:59.827843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:51:59.972638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:51:59.980766 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0370c0cb-0229-4c29-97be-cda554e1d113 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1693 microversion: 2.1 time: 0.168199 Oct 22 03:51:59.981680 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3384/6636] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:51:59 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:00.771704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:00.772348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:00.779438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:00.780147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:00.780764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:00.781633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:00.782247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:00.782826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:01.006797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:01.007414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:01.014273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:01.014761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:01.015200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:01.015892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:01.016515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:01.016967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:01.016967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:01.024591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c732d0c-ba2f-4d98-9be6-c12dd12ed82f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.257127 Oct 22 03:52:01.025540 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3253/6637] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:00 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:01.156477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:01.165019 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7414fa3a-7d2f-4153-933b-1d318405c9ec tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1693 microversion: 2.1 time: 0.163370 Oct 22 03:52:01.165685 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3385/6638] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:01 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:01.582685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-85c78bb0-8ba4-4d47-b097-79e3ae6cf0b6 req-b2f2856f-7158-4f5e-ae68-a17a7134c7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b360535-0c6e-4e4d-9d2b-218be0a0882d", "name": "network-vif-unplugged", "status": "completed", "tag": "c99e9967-6979-4260-8a70-e31820c113ad"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:01.603648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-85c78bb0-8ba4-4d47-b097-79e3ae6cf0b6 req-b2f2856f-7158-4f5e-ae68-a17a7134c7f4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:01.604133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-85c78bb0-8ba4-4d47-b097-79e3ae6cf0b6 req-b2f2856f-7158-4f5e-ae68-a17a7134c7f4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:01.604607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-85c78bb0-8ba4-4d47-b097-79e3ae6cf0b6 req-b2f2856f-7158-4f5e-ae68-a17a7134c7f4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:01.615043 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-85c78bb0-8ba4-4d47-b097-79e3ae6cf0b6 req-b2f2856f-7158-4f5e-ae68-a17a7134c7f4 service nova] Creating event network-vif-unplugged:c99e9967-6979-4260-8a70-e31820c113ad for instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d on n-h2-862416-2 Oct 22 03:52:01.620047 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-85c78bb0-8ba4-4d47-b097-79e3ae6cf0b6 req-b2f2856f-7158-4f5e-ae68-a17a7134c7f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041545 Oct 22 03:52:01.620690 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3254/6639] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:02.048976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:02.049618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:02.057044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:02.057528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:02.057971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:02.058679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:02.059159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:02.059565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:02.190629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:02.191426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:02.198888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:02.199136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:02.199521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:02.200026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:02.200832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:02.201360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:02.201876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:02.207297 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-05607444-9298-49df-ab5e-b8333d28749a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.162221 Oct 22 03:52:02.207882 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3386/6640] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:02 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:02.345468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:02.353645 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b87c265e-aec4-41d3-96e4-3052ef813d8d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1693 microversion: 2.1 time: 0.168093 Oct 22 03:52:02.354231 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3255/6641] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:02 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:02.534153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-cb6e6ae4-1110-4072-a9f4-6bb4584ec616 req-0e6b4809-3483-482b-b70e-82dd2ce79faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b02dc4-f6e5-46c2-b267-8a6b8197fa01", "name": "network-vif-plugged", "status": "completed", "tag": "05d3607c-22b7-4cc4-9e5e-07b77fea72e8"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:02.545083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cb6e6ae4-1110-4072-a9f4-6bb4584ec616 req-0e6b4809-3483-482b-b70e-82dd2ce79faa service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:02.545562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cb6e6ae4-1110-4072-a9f4-6bb4584ec616 req-0e6b4809-3483-482b-b70e-82dd2ce79faa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:02.545992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-cb6e6ae4-1110-4072-a9f4-6bb4584ec616 req-0e6b4809-3483-482b-b70e-82dd2ce79faa service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:02.557633 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-cb6e6ae4-1110-4072-a9f4-6bb4584ec616 req-0e6b4809-3483-482b-b70e-82dd2ce79faa service nova] Creating event network-vif-plugged:05d3607c-22b7-4cc4-9e5e-07b77fea72e8 for instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 on n-h1-862416-2 Oct 22 03:52:02.562746 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-cb6e6ae4-1110-4072-a9f4-6bb4584ec616 req-0e6b4809-3483-482b-b70e-82dd2ce79faa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099368 Oct 22 03:52:02.563380 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3387/6642] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:03.231460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:03.232079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:03.239235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:03.239780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:03.240385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:03.240948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:03.241407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:03.241838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:03.375087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:03.378749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:03.379478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:03.383346 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aef8deac-24cb-4117-bd15-7c4ec0090485 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1203 microversion: 2.1 time: 0.156073 Oct 22 03:52:03.383922 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3256/6643] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:03 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:03.387829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:03.388344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:03.388782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:03.389479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:03.389935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:03.390356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:03.410729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=100 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:03.528042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:03.535990 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5aa6ae85-1c35-4f1f-964e-17e8c4895c4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1693 microversion: 2.1 time: 0.161478 Oct 22 03:52:03.536622 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3388/6644] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:03 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:03.655366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9f317fe1-a6f0-4319-ae90-815c665ee598 req-a7fcabcc-7d8c-4572-b701-45941955cb47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b360535-0c6e-4e4d-9d2b-218be0a0882d", "tag": "c99e9967-6979-4260-8a70-e31820c113ad"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:03.665120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9f317fe1-a6f0-4319-ae90-815c665ee598 req-a7fcabcc-7d8c-4572-b701-45941955cb47 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:03.665595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9f317fe1-a6f0-4319-ae90-815c665ee598 req-a7fcabcc-7d8c-4572-b701-45941955cb47 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:03.666022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9f317fe1-a6f0-4319-ae90-815c665ee598 req-a7fcabcc-7d8c-4572-b701-45941955cb47 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:03.676918 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9f317fe1-a6f0-4319-ae90-815c665ee598 req-a7fcabcc-7d8c-4572-b701-45941955cb47 service nova] Creating event network-changed:c99e9967-6979-4260-8a70-e31820c113ad for instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d on n-h2-862416-2 Oct 22 03:52:03.682742 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9f317fe1-a6f0-4319-ae90-815c665ee598 req-a7fcabcc-7d8c-4572-b701-45941955cb47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031048 Oct 22 03:52:03.683413 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3257/6645] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:04.406489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:04.407097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:04.414605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.415092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.415532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.416247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.416704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.417130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.549044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:04.557604 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7366ea01-3026-4d40-b7d9-0df7cfd1fbcf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1389 microversion: 2.1 time: 0.155274 Oct 22 03:52:04.558189 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3389/6646] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:04 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:04.561556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:04.562264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:04.569139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.569621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.570061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.570764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.571224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.571657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.580147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:04.580788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:04.586771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.587252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.587694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.588421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.588882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.589336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.591304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:04.712552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:04.720284 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-80674911-90e7-4555-a5c7-b3e7d0cf042d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1693 microversion: 2.1 time: 0.163926 Oct 22 03:52:04.721062 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3258/6647] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:04 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:04.721468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:04.729984 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ca2f706-557c-4993-b355-eb3aca07813e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1389 microversion: 2.1 time: 0.153704 Oct 22 03:52:04.730503 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3390/6648] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:04 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:04.751775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:04.752432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:04.759046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.759538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.759980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.760709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.761166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.761627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.894701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:04.903291 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9207f50c-a727-4475-928f-344f4df1e3b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1389 microversion: 2.1 time: 0.155541 Oct 22 03:52:04.903905 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3259/6649] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:04 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:04.982782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:04.983223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:04.989201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.989729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.990408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:04.991066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:04.991529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:04.991959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:05.017282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:52:05.092172 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ec2a108-aa9a-43a5-a449-cd7fe0357b81 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 204 len: 0 microversion: 2.1 time: 0.113070 Oct 22 03:52:05.092792 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3391/6650] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:52:04 2022] DELETE /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:52:05.102251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:05.102872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:05.108943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:05.109426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:05.109867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:05.110569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:05.111028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:05.111460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:05.241045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:05.248957 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad13a016-f705-4a70-9363-40def2133505 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1395 microversion: 2.1 time: 0.151518 Oct 22 03:52:05.249524 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3260/6651] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:05 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1395 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:05.745038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:05.745827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:05.753130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:05.753624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:05.754070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:05.754779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:05.755252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:05.756172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:05.897881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:05.905761 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5101d949-9791-472d-986a-43de10010992 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1693 microversion: 2.1 time: 0.165103 Oct 22 03:52:05.906338 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3392/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:05 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:06.272999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:06.273601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:06.280314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:06.280791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:06.281224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:06.281911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:06.282360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:06.282780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:06.415502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:06.423563 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-55e0e6ac-ed71-46ec-9361-ca12ad1f98e9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1395 microversion: 2.1 time: 0.154969 Oct 22 03:52:06.424147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3261/6653] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:06 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1395 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:06.930720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:06.931333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:06.934456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:06.939673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:06.940157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:06.940629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:06.941333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:06.941788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:06.942215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:07.080394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:07.088306 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0ad29085-1ed5-4597-b429-f996dcdea741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1693 microversion: 2.1 time: 0.162271 Oct 22 03:52:07.088896 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3393/6654] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:06 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:07.284549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b464309e-fde5-4998-a8d1-0bc12c91f89d req-aba562f1-22d7-44f6-9bc6-06cdcdd9b091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b02dc4-f6e5-46c2-b267-8a6b8197fa01", "name": "network-vif-deleted", "tag": "05d3607c-22b7-4cc4-9e5e-07b77fea72e8"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:07.298718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b464309e-fde5-4998-a8d1-0bc12c91f89d req-aba562f1-22d7-44f6-9bc6-06cdcdd9b091 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:07.299610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b464309e-fde5-4998-a8d1-0bc12c91f89d req-aba562f1-22d7-44f6-9bc6-06cdcdd9b091 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:07.300189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b464309e-fde5-4998-a8d1-0bc12c91f89d req-aba562f1-22d7-44f6-9bc6-06cdcdd9b091 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:07.316580 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b464309e-fde5-4998-a8d1-0bc12c91f89d req-aba562f1-22d7-44f6-9bc6-06cdcdd9b091 service nova] Creating event network-vif-deleted:05d3607c-22b7-4cc4-9e5e-07b77fea72e8 for instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 on n-h1-862416-2 Oct 22 03:52:07.322655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b464309e-fde5-4998-a8d1-0bc12c91f89d req-aba562f1-22d7-44f6-9bc6-06cdcdd9b091 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042903 Oct 22 03:52:07.323273 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3262/6655] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:07.450441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:07.451294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:07.458251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:07.458764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:07.459206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:07.461320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:07.461960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:07.462444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:07.535120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:07.544058 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9dd3352b-709f-4b0c-9a2a-9aed905cf767 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1188 microversion: 2.1 time: 0.099768 Oct 22 03:52:07.549986 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3394/6656] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:07 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:08.114325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:08.115066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:08.122334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:08.122839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:08.123282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:08.124283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:08.124946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:08.125536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:08.345846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:08.353915 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac2bac30-a212-45d4-89a9-ede2224021ff tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1693 microversion: 2.1 time: 0.243988 Oct 22 03:52:08.368434 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3263/6657] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:08 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1693 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:08.567050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:08.567794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:08.575130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:08.575618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:08.576056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:08.576961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:08.577455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:08.577885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:08.644980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:08.654203 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9c3787df-8096-4e01-9203-b1df627a23c0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1188 microversion: 2.1 time: 0.091096 Oct 22 03:52:08.655131 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3395/6658] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:08 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:09.379252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:09.379763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:09.387361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:09.388310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:09.388826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:09.389600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:09.390155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:09.390651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:09.552030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:09.560455 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-715c31b5-cb12-476e-adca-df7205a21493 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1683 microversion: 2.1 time: 0.185229 Oct 22 03:52:09.561111 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3264/6659] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:09 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:09.583566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:09.584179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:09.591692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:09.592182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:09.592664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:09.593372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:09.593829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:09.594260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:09.679025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:09.679638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:09.686173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:09.686963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:09.687592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:09.688358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:09.688818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:09.689247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:09.744772 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3437484a-9df9-42f0-b5de-780f040837d5 tempest-TestNetworkAdvancedServerOps-1749980255 tempest-TestNetworkAdvancedServerOps-1749980255-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1834 microversion: 2.1 time: 0.164791 Oct 22 03:52:09.745962 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3396/6660] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:09 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1834 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:09.765851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:09.769797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:09.771094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:09.777673 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-82a8bbf0-067d-4803-b6e5-670d0197ce74 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1188 microversion: 2.1 time: 0.103345 Oct 22 03:52:09.778735 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3265/6661] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:09 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:09.780432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:09.781118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:09.782018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:09.782915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:09.783389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:09.783820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:09.935234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:09.943197 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-85bb5132-3a44-481a-bc64-229a1be1bceb tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1683 microversion: 2.1 time: 0.177495 Oct 22 03:52:09.944381 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3397/6662] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:09 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:10.042505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:10.044656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:10.050702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:10.051181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:10.051616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:10.052345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:10.052799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:10.053486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:10.112463 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f508d96c-3661-4db8-ab5b-95be2896f0d4 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d/action" status: 200 len: 38512 microversion: 2.1 time: 0.074360 Oct 22 03:52:10.113368 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3266/6663] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:52:10 2022] POST /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d/action => generated 38512 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:52:10.805427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:10.805956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:10.812929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:10.813552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:10.814098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:10.814928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:10.815493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:10.816032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:10.894686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:10.903789 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aea43c93-7829-4404-8d40-73152a0ba4a3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1188 microversion: 2.1 time: 0.103454 Oct 22 03:52:10.904695 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3398/6664] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:10 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:11.422508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:11.423239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:11.431601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:11.432402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:11.433168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:11.434026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:11.434824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:11.434940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-19386fbe-5eff-4942-ba1e-5bd4ffbeb5af req-0eeff6ff-ad47-4989-9c28-bb67dc8896d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b360535-0c6e-4e4d-9d2b-218be0a0882d", "tag": "c99e9967-6979-4260-8a70-e31820c113ad"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:11.435521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:11.448288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-19386fbe-5eff-4942-ba1e-5bd4ffbeb5af req-0eeff6ff-ad47-4989-9c28-bb67dc8896d4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:11.448288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-19386fbe-5eff-4942-ba1e-5bd4ffbeb5af req-0eeff6ff-ad47-4989-9c28-bb67dc8896d4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:11.448288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-19386fbe-5eff-4942-ba1e-5bd4ffbeb5af req-0eeff6ff-ad47-4989-9c28-bb67dc8896d4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:11.462753 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-19386fbe-5eff-4942-ba1e-5bd4ffbeb5af req-0eeff6ff-ad47-4989-9c28-bb67dc8896d4 service nova] Creating event network-changed:c99e9967-6979-4260-8a70-e31820c113ad for instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d on n-h1-862416-2 Oct 22 03:52:11.465944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:52:11.469314 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-19386fbe-5eff-4942-ba1e-5bd4ffbeb5af req-0eeff6ff-ad47-4989-9c28-bb67dc8896d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039284 Oct 22 03:52:11.478311 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3399/6665] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:11.580525 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c9c6aff6-2529-4409-8711-f16958c51690 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 204 len: 0 microversion: 2.1 time: 0.161772 Oct 22 03:52:11.581485 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3267/6666] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:52:11 2022] DELETE /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:52:11.591223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:11.592229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:11.605352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:11.606156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:11.606790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:11.607834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:11.608497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:11.609088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:11.763159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:11.772441 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-865c0d33-9007-47b4-83da-bc6ae5d1da4e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1689 microversion: 2.1 time: 0.185450 Oct 22 03:52:11.773042 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3400/6667] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:11 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:11.928587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:11.929301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:11.937509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:11.938005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:11.938496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:11.939209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:11.939660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:11.940080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:11.979276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:11.979854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:11.980408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:11.980959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lazy-loading 'fault' on Instance uuid 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:52:12.051151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:12.060570 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3a18cba2-72a8-44a5-adb9-e5e382f3ebf6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 200 len: 1193 microversion: 2.1 time: 0.136894 Oct 22 03:52:12.061371 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3268/6668] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:11 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 1193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:12.798960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:12.800673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:12.808576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:12.809179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:12.809721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:12.810755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:12.811370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:12.811892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:12.972736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:12.982383 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7fce72cd-235c-4ac3-b7fc-8f814e1bef8a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 200 len: 1571 microversion: 2.1 time: 0.187888 Oct 22 03:52:13.000472 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3401/6669] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:12 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 1571 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:13.043588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4d25c70e-2305-41de-8779-7f0fd0f22e67 req-ac65d379-6eae-44c6-a7fb-26805ecf8b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b360535-0c6e-4e4d-9d2b-218be0a0882d", "name": "network-vif-deleted", "tag": "c99e9967-6979-4260-8a70-e31820c113ad"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:13.056973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4d25c70e-2305-41de-8779-7f0fd0f22e67 req-ac65d379-6eae-44c6-a7fb-26805ecf8b59 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:13.057448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4d25c70e-2305-41de-8779-7f0fd0f22e67 req-ac65d379-6eae-44c6-a7fb-26805ecf8b59 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:13.057888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4d25c70e-2305-41de-8779-7f0fd0f22e67 req-ac65d379-6eae-44c6-a7fb-26805ecf8b59 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:13.072857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4d25c70e-2305-41de-8779-7f0fd0f22e67 req-ac65d379-6eae-44c6-a7fb-26805ecf8b59 service nova] Creating event network-vif-deleted:c99e9967-6979-4260-8a70-e31820c113ad for instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d on n-h1-862416-2 Oct 22 03:52:13.080332 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4d25c70e-2305-41de-8779-7f0fd0f22e67 req-ac65d379-6eae-44c6-a7fb-26805ecf8b59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040200 Oct 22 03:52:13.081107 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3269/6670] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:13.087577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:13.088948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:13.095884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:13.096567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:13.097192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:13.098089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:13.098711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:13.099342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:13.117204 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 HTTP/1.1 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '67b02dc4-f6e5-46c2-b267-8a6b8197fa01'} Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:52:13.119210 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:13.123577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:13.123577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:52:13.123577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:52:13.123577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:52:13.123577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:52:13.123577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:13.123577 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:13.126057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:52:13.127227 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-61feabd5-ffca-46d1-93b2-0133e4642173 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 404 len: 111 microversion: 2.1 time: 0.047305 Oct 22 03:52:13.127821 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3402/6671] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:13 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:52:14.010233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:14.010823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: 1b360535-0c6e-4e4d-9d2b-218be0a0882d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:14.017971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:14.018471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:14.018903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:14.019612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:14.020073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:14.020538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:14.034839 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] HTTP exception thrown: Instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d could not be found. Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Request method failure captured: Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d HTTP/1.1 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2cuhsqeIjxZRi8SYlVM2YAHKWF908XmT0FuqmGR_L4W9OH0DVS6J-6-4DQBAHeUYH9qZx6kksVB3TAAqd1NlyYBvJLfYErPtU6joZfwY40hpzy6-8IeuUE7fYhuFP1m381kmKeryIRqkoJQK11VP6EdDXSGvwQC-0XfXiowIBCbCvU Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: f73e2096501b458ca6d9f587c21c6d23 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f73e2096501b458ca6d9f587c21c6d23"}]}] Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: f73e2096501b458ca6d9f587c21c6d23 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestNetworkAdvancedServerOps-1799870770-project Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 754cd3eb62c24a1eb25a4d294a063588 Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1799870770-project Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d could not be found. Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1b360535-0c6e-4e4d-9d2b-218be0a0882d'} Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d could not be found. Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d could not be found. Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:14.036516 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d could not be found. Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Returning 404 to user: Instance 1b360535-0c6e-4e4d-9d2b-218be0a0882d could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e359c45-5455-4558-a1e3-630282f4c290 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d" status: 404 len: 111 microversion: 2.1 time: 0.032625 Oct 22 03:52:14.045065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3270/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:14 2022] GET /compute/v2.1/servers/1b360535-0c6e-4e4d-9d2b-218be0a0882d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:52:15.298785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:15.299881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:15.315874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:15.316818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:15.317255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:15.317982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:15.318443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:15.323240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:15.358486 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 HTTP/1.1 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '67b02dc4-f6e5-46c2-b267-8a6b8197fa01'} Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:52:15.360111 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a0317526-fe3a-41a3-b1b8-31d8f83dfe89 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 404 len: 111 microversion: 2.1 time: 0.067684 Oct 22 03:52:15.363802 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3403/6673] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:52:15 2022] DELETE /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:52:15.370522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:15.371844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 67b02dc4-f6e5-46c2-b267-8a6b8197fa01] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:15.380116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:15.383521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:15.386306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:15.387902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:15.390402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:15.391032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:15.430765 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 HTTP/1.1 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '67b02dc4-f6e5-46c2-b267-8a6b8197fa01'} Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:52:15.432604 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.436130 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:52:15.436130 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:52:15.436130 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:52:15.436130 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:52:15.436130 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:52:15.436130 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. Oct 22 03:52:15.436130 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:52:15.438029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 67b02dc4-f6e5-46c2-b267-8a6b8197fa01 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:52:15.439077 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9ccde3c6-a17e-468e-82a8-c6b86360d1ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01" status: 404 len: 111 microversion: 2.1 time: 0.072469 Oct 22 03:52:15.445424 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3271/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:15 2022] GET /compute/v2.1/servers/67b02dc4-f6e5-46c2-b267-8a6b8197fa01 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:52:17.760292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2c48f4f-7c5b-46f6-beb5-0229c6c0fad6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '.version_select at 0x7f0d1a9dc040>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:17.804862 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2c48f4f-7c5b-46f6-beb5-0229c6c0fad6 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1643815071" status: 202 len: 0 microversion: 2.1 time: 0.049816 Oct 22 03:52:17.805481 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3404/6675] 10.222.0.25 () {58 vars in 1284 bytes} [Sat Oct 22 03:52:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1643815071 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:52:17.836365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef57cd77-3595-4d01-8bf4-0ad25fda6ff3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'create', calling method: .version_select at 0x7f0d1a5b3280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-801545323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKscPxujrFc0uB+WpWcvAokD78HGpWzMcaqiUkCTsqdVqI8SFmLjdNBnn7LuubhkzXdKc+Gx5j8W1EUjfdEaKdRZNS2ONsLsR8GFjOX/sGXikYZKAO2HhbvfAd0D8+89CQ=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:17.853690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ef57cd77-3595-4d01-8bf4-0ad25fda6ff3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for project f73e2096501b458ca6d9f587c21c6d23. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:52:17.859673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-ef57cd77-3595-4d01-8bf4-0ad25fda6ff3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for user 754cd3eb62c24a1eb25a4d294a063588 and project f73e2096501b458ca6d9f587c21c6d23. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:52:17.888408 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef57cd77-3595-4d01-8bf4-0ad25fda6ff3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056788 Oct 22 03:52:17.889024 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3272/6676] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:52:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:24.185121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1074802101", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "539307f9-4384-4848-907e-6975071916d9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-801545323", "security_groups": [{"name": "tempest-secgroup-smoke-1958235460"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:24.344365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] validate_networks() for [('539307f9-4384-4848-907e-6975071916d9', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:52:24.843658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:52:24.844084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:52:24.844599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:52:24.845007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:52:24.845458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:52:24.860095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:24.860959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:24.861557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:24.862508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:24.863119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:24.863543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:24.899264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for project f73e2096501b458ca6d9f587c21c6d23. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:52:24.905740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Getting quotas for user 754cd3eb62c24a1eb25a4d294a063588 and project f73e2096501b458ca6d9f587c21c6d23. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:52:24.924933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:52:24.927273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:52:24.982222 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87a55436-0d4e-4899-88d9-f9531062578b tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.801575 Oct 22 03:52:24.983143 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3405/6677] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:52:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:52:24.994804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f475f42-5328-470e-ba36-5f205987b9cd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:24.996019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f475f42-5328-470e-ba36-5f205987b9cd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:25.070404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f475f42-5328-470e-ba36-5f205987b9cd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:25.079716 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f475f42-5328-470e-ba36-5f205987b9cd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1266 microversion: 2.1 time: 0.089226 Oct 22 03:52:25.101350 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3273/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:24 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:26.108936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:26.110277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:26.119496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:26.120303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:26.121165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:26.122147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:26.122866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:26.124311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:26.240271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:26.260654 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b51b4495-1c8f-45af-acc2-4f10cddf54fe tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1326 microversion: 2.1 time: 0.148019 Oct 22 03:52:26.261928 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3406/6679] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:26 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:27.286923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:27.289001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:27.292001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:27.293735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:27.304998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:27.305869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:27.306613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:27.307949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:27.308651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:27.309485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:27.554882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:27.567304 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9ead5ad5-32c7-4f07-af1a-90da55f95f99 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1392 microversion: 2.1 time: 0.283092 Oct 22 03:52:27.585587 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3274/6680] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:27 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1392 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:27.941029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1970be2b-22dd-4ad5-87e3-d13a4567810e req-c719fe36-2473-4201-a17f-4ce3cbaf50c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b7e16b-66fa-4176-be45-c364b21c0e0e", "tag": "34cdaf05-0d88-474e-8a9c-75c42dd0892c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:27.953972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1970be2b-22dd-4ad5-87e3-d13a4567810e req-c719fe36-2473-4201-a17f-4ce3cbaf50c1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:27.954575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1970be2b-22dd-4ad5-87e3-d13a4567810e req-c719fe36-2473-4201-a17f-4ce3cbaf50c1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:27.955422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1970be2b-22dd-4ad5-87e3-d13a4567810e req-c719fe36-2473-4201-a17f-4ce3cbaf50c1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:27.960907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:27.970570 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1970be2b-22dd-4ad5-87e3-d13a4567810e req-c719fe36-2473-4201-a17f-4ce3cbaf50c1 service nova] Creating event network-changed:34cdaf05-0d88-474e-8a9c-75c42dd0892c for instance a6b7e16b-66fa-4176-be45-c364b21c0e0e on n-h2-862416-2 Oct 22 03:52:27.977614 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1970be2b-22dd-4ad5-87e3-d13a4567810e req-c719fe36-2473-4201-a17f-4ce3cbaf50c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041186 Oct 22 03:52:27.978591 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3407/6681] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:28.593588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:28.594180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:28.601791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:28.602319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:28.602762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:28.603465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:28.603917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:28.604467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:28.772420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:28.781276 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5b26ca7-b78c-4e0b-b5c3-d82f5c0ad79e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1392 microversion: 2.1 time: 0.192993 Oct 22 03:52:28.781862 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3275/6682] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:28 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:29.812268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:29.812890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:29.820241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:29.820743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:29.821195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:29.821900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:29.822360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:29.822797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:29.971911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:29.979904 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d4f8fa50-75d0-4425-a555-b4ddf5074810 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1392 microversion: 2.1 time: 0.173288 Oct 22 03:52:29.980537 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3408/6683] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:29 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:31.004413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:31.005669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:31.013566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:31.019658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:31.023136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:31.025950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:31.027798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:31.028284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:31.259171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:31.267267 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-71167aa3-1cb3-4dce-aee0-f6aeb1f03b98 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1392 microversion: 2.1 time: 0.266670 Oct 22 03:52:31.267791 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3276/6684] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:30 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1392 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:32.291044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:32.291727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:32.298610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:32.299096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:32.299537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:32.300245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:32.300705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:32.301127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:32.438264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:32.446790 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cfe5b9fc-fb4d-4084-815c-61b5522a6a94 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1392 microversion: 2.1 time: 0.160420 Oct 22 03:52:32.447375 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3409/6685] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:32 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:33.470001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:33.470810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:33.478043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:33.478641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:33.479151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:33.480037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:33.480597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:33.481094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:33.621924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:33.629982 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32330b3a-6c9b-4005-b1ff-f528c565934f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1392 microversion: 2.1 time: 0.164035 Oct 22 03:52:33.630640 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3277/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:33 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:34.643483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0428d3f7-c3ad-4f10-833c-f8806eaaec52 req-240dcf66-0c47-4f62-a40a-b77f8b3f613c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7e16b-66fa-4176-be45-c364b21c0e0e", "name": "network-vif-plugged", "status": "completed", "tag": "34cdaf05-0d88-474e-8a9c-75c42dd0892c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:34.655071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:34.656499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:34.669981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0428d3f7-c3ad-4f10-833c-f8806eaaec52 req-240dcf66-0c47-4f62-a40a-b77f8b3f613c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:34.670462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0428d3f7-c3ad-4f10-833c-f8806eaaec52 req-240dcf66-0c47-4f62-a40a-b77f8b3f613c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:34.670897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0428d3f7-c3ad-4f10-833c-f8806eaaec52 req-240dcf66-0c47-4f62-a40a-b77f8b3f613c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:34.677499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:34.677796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:34.678391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:34.679457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:34.679749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:34.680181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:34.692999 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0428d3f7-c3ad-4f10-833c-f8806eaaec52 req-240dcf66-0c47-4f62-a40a-b77f8b3f613c service nova] Creating event network-vif-plugged:34cdaf05-0d88-474e-8a9c-75c42dd0892c for instance a6b7e16b-66fa-4176-be45-c364b21c0e0e on n-h2-862416-2 Oct 22 03:52:34.699956 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0428d3f7-c3ad-4f10-833c-f8806eaaec52 req-240dcf66-0c47-4f62-a40a-b77f8b3f613c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061996 Oct 22 03:52:34.701144 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3410/6687] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:52:34.870742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:34.878895 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2f644e2b-8a28-494f-9ba9-04e1f3b332f1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1392 microversion: 2.1 time: 0.228181 Oct 22 03:52:34.879580 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3278/6688] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:34 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:35.903687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:35.904410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:35.906370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:35.907338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:35.914170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:35.914656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:35.915092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:35.915821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:35.916293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:35.916755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:36.063967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:36.076325 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-68b9e855-8dda-482c-945e-c9c4e6c86741 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1392 microversion: 2.1 time: 0.176750 Oct 22 03:52:36.076928 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3411/6689] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:35 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:37.099575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:37.101082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:37.102671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:37.109281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:37.109804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:37.110248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:37.110952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:37.111410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:37.112252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:37.248458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:37.256597 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cae2b5da-2c8b-4a20-852b-83a5bced2272 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1564 microversion: 2.1 time: 0.161159 Oct 22 03:52:37.257357 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3279/6690] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:37 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:37.278595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:37.279327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:37.282038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:37.288878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:37.289368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:37.289814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:37.290525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:37.290988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:37.291434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:37.437268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:37.446643 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e0dbbb7-8f1c-45d1-8a8a-3eb51e52e11e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1564 microversion: 2.1 time: 0.171908 Oct 22 03:52:37.447254 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3412/6691] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:37 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:38.616058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-397807686", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ff3e1a66-b119-4f97-ace2-d4048868dc74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7175b844-9cdb-45d6-b4f9-304c2c700bec"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:38.682187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] validate_networks() for [('7175b844-9cdb-45d6-b4f9-304c2c700bec', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:52:39.284695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:39.285712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:39.293511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:39.294318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:39.294833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:39.295619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:39.296164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:39.296723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:39.416156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:52:39.416861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:52:39.417453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:52:39.417968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:52:39.418487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:52:39.427446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:39.428115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:39.429225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:39.430073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:39.430653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:39.431180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:39.443496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:39.450538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:52:39.452696 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8ec2223d-71fe-4e4e-83eb-164469e7108e tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1564 microversion: 2.1 time: 0.172055 Oct 22 03:52:39.453488 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3413/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:39 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:52:39.457584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:52:39.458581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-2c881b02-9737-4856-80ae-bdba4adda02d req-c5adc31a-e399-4f86-a5b8-24ba699c93f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b7e16b-66fa-4176-be45-c364b21c0e0e", "tag": "34cdaf05-0d88-474e-8a9c-75c42dd0892c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:39.468949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2c881b02-9737-4856-80ae-bdba4adda02d req-c5adc31a-e399-4f86-a5b8-24ba699c93f5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:39.469695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2c881b02-9737-4856-80ae-bdba4adda02d req-c5adc31a-e399-4f86-a5b8-24ba699c93f5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:39.470298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-2c881b02-9737-4856-80ae-bdba4adda02d req-c5adc31a-e399-4f86-a5b8-24ba699c93f5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:39.484833 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-2c881b02-9737-4856-80ae-bdba4adda02d req-c5adc31a-e399-4f86-a5b8-24ba699c93f5 service nova] Creating event network-changed:34cdaf05-0d88-474e-8a9c-75c42dd0892c for instance a6b7e16b-66fa-4176-be45-c364b21c0e0e on n-h2-862416-2 Oct 22 03:52:39.490385 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-2c881b02-9737-4856-80ae-bdba4adda02d req-c5adc31a-e399-4f86-a5b8-24ba699c93f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035600 Oct 22 03:52:39.491513 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3414/6693] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:39.528413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:52:39.530846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff3e1a66-b119-4f97-ace2-d4048868dc74',volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:52:39.675147 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-71857098-1497-4a6a-b6eb-9792f8b3ad43 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063710 Oct 22 03:52:39.675800 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3280/6694] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:52:39.687931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a9ff3a7-7ed5-4615-afec-98461bbc1b58 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:39.688660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a9ff3a7-7ed5-4615-afec-98461bbc1b58 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:39.754823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2a9ff3a7-7ed5-4615-afec-98461bbc1b58 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:39.765200 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a9ff3a7-7ed5-4615-afec-98461bbc1b58 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1070 microversion: 2.1 time: 0.081439 Oct 22 03:52:39.765810 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3415/6695] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:39 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1070 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:40.789279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:40.790312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:40.797444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:40.798116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:40.798556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:40.799265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:40.799747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:40.800169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:40.871873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:40.880495 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7793eed8-077e-4661-9e69-31887cc04d38 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1168 microversion: 2.1 time: 0.097247 Oct 22 03:52:40.881755 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3281/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:40 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1168 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:41.908264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:41.909516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:41.918678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:41.919452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:41.919911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:41.920817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:41.921310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:41.921748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:42.065461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:42.073908 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-452300da-088d-482e-bc0e-e32cab7ca1fb tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1228 microversion: 2.1 time: 0.169557 Oct 22 03:52:42.074430 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3416/6697] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:41 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1228 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:42.623442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-4143c0dc-1de8-4f47-9546-764ae1af8e6d req-8c2631d9-bb04-4f3e-8384-5a76d851f9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee92ced-f179-4814-965e-5302a7068211", "tag": "416b47f1-8485-4ff1-bfa5-4af26e4b0cf6"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:42.635501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4143c0dc-1de8-4f47-9546-764ae1af8e6d req-8c2631d9-bb04-4f3e-8384-5a76d851f9b9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:42.635887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4143c0dc-1de8-4f47-9546-764ae1af8e6d req-8c2631d9-bb04-4f3e-8384-5a76d851f9b9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:42.636369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-4143c0dc-1de8-4f47-9546-764ae1af8e6d req-8c2631d9-bb04-4f3e-8384-5a76d851f9b9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:42.654651 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-4143c0dc-1de8-4f47-9546-764ae1af8e6d req-8c2631d9-bb04-4f3e-8384-5a76d851f9b9 service nova] Creating event network-changed:416b47f1-8485-4ff1-bfa5-4af26e4b0cf6 for instance 9ee92ced-f179-4814-965e-5302a7068211 on n-h1-862416-2 Oct 22 03:52:42.660639 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-4143c0dc-1de8-4f47-9546-764ae1af8e6d req-8c2631d9-bb04-4f3e-8384-5a76d851f9b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041749 Oct 22 03:52:42.661602 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3282/6698] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:52:43.097753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:43.098538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:43.106382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:43.106986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:43.107495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:43.108466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:43.109660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:43.110160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:43.253775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:43.264630 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8329dc64-5df6-4a94-84d2-bfc60907654f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1228 microversion: 2.1 time: 0.170719 Oct 22 03:52:43.265863 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3417/6699] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:43 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1228 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:44.289708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:44.290334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:44.296522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:44.297004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:44.297443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:44.298143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:44.298610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:44.299026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:44.432263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:44.440240 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e641f928-e939-4595-a4e1-6c3ba6eafd57 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1228 microversion: 2.1 time: 0.156477 Oct 22 03:52:44.440837 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3283/6700] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:44 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1228 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:45.463394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:45.464007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:45.471270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:45.472069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:45.472626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:45.473341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:45.473797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:45.474221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:45.608244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:45.616843 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6982e347-5210-463a-9c33-079247f8da9e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1228 microversion: 2.1 time: 0.157686 Oct 22 03:52:45.617538 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3418/6701] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:45 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1228 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:46.640999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:46.641546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:46.649383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:46.649871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:46.650310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:46.651041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:46.651497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:46.651926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:46.781331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:46.789702 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dfd963b4-bad9-469d-a559-d71e992aafae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.152674 Oct 22 03:52:46.790285 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3284/6702] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:46 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:47.813020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:47.813554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:47.820647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:47.821141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:47.821588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:47.822284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:47.822776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:47.823206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:47.953635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:47.962087 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2563b0a9-931a-4c14-8a39-9566677e6519 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.153145 Oct 22 03:52:47.962668 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3419/6703] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:47 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:48.985750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:48.986364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:48.993684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:48.994165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:48.994603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:48.995292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:48.995742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:48.996162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:49.132324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:49.140123 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f4f1e48-b9fb-41d3-933b-e5ea7d27b37d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.158458 Oct 22 03:52:49.140731 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3285/6704] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:48 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:50.163621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:50.164884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:50.167712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:50.173600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:50.174115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:50.174557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:50.175264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:50.175724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:50.176155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:50.313816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:50.321818 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50058d55-17cb-4488-be19-0cd130e1d20e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.162194 Oct 22 03:52:50.322413 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3420/6705] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:50 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:51.345227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:51.345832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:51.347765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:51.348454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:51.355326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:51.355810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:51.356345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:51.357047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:51.357504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:51.357929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:51.487983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:51.495768 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d21ba63a-6994-477c-8925-3768051986f7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.154433 Oct 22 03:52:51.496373 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3286/6706] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:51 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:52.518858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:52.519475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:52.526940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:52.527429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:52.527874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:52.528606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:52.529070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:52.529510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:52.658133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:52.666551 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-64305b67-2918-4278-9f8d-fff996b9856d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.151635 Oct 22 03:52:52.667142 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3421/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:52 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:53.689069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:53.689680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:53.696644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:53.697122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:53.697556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:53.698245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:53.698701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:53.699124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:53.831961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:53.840271 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d0dd7e8-7461-47e1-b38c-fe69a87c726f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.155058 Oct 22 03:52:53.840847 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3287/6708] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:53 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:54.863988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:54.864628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:54.871253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:54.871731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:54.872164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:54.872899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:54.873333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:54.873756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:55.009427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:55.017093 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0c2d03ef-cd71-445e-9152-1b66abc7bd1c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.157240 Oct 22 03:52:55.017678 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3422/6709] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:54 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:56.040241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:56.040871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:56.047650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:56.048130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:56.048600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:56.049289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:56.049745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:56.050174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:56.178923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:56.186640 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a25e77a5-068e-4ada-883f-ac3e25b3329b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.150415 Oct 22 03:52:56.187220 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3288/6710] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:56 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:56.656317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c5266a5f-2378-472d-9e35-0d36d31e7356 req-f23fb6a2-2bae-4e30-b13e-9a41b817c04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee92ced-f179-4814-965e-5302a7068211", "name": "network-vif-plugged", "status": "completed", "tag": "416b47f1-8485-4ff1-bfa5-4af26e4b0cf6"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:56.668453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c5266a5f-2378-472d-9e35-0d36d31e7356 req-f23fb6a2-2bae-4e30-b13e-9a41b817c04f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:56.668947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c5266a5f-2378-472d-9e35-0d36d31e7356 req-f23fb6a2-2bae-4e30-b13e-9a41b817c04f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:56.669386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c5266a5f-2378-472d-9e35-0d36d31e7356 req-f23fb6a2-2bae-4e30-b13e-9a41b817c04f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:56.680726 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c5266a5f-2378-472d-9e35-0d36d31e7356 req-f23fb6a2-2bae-4e30-b13e-9a41b817c04f service nova] Creating event network-vif-plugged:416b47f1-8485-4ff1-bfa5-4af26e4b0cf6 for instance 9ee92ced-f179-4814-965e-5302a7068211 on n-h1-862416-2 Oct 22 03:52:56.685721 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c5266a5f-2378-472d-9e35-0d36d31e7356 req-f23fb6a2-2bae-4e30-b13e-9a41b817c04f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Oct 22 03:52:56.686487 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3423/6711] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:52:57.208669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:57.209281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:57.216153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:57.216665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:57.217106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:57.217796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:57.218253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:57.218685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:57.352476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:57.360113 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9da2c49-0af1-416b-bc23-5681411c6891 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1216 microversion: 2.1 time: 0.155342 Oct 22 03:52:57.360718 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3289/6712] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:57 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:58.384729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:58.385443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:58.392414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:58.392973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:58.393411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:58.394118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:58.394569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:58.394996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:58.527985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:58.535876 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a6f1b1b-d64b-4911-8ff9-0cdd34b52598 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1402 microversion: 2.1 time: 0.156602 Oct 22 03:52:58.536490 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3424/6713] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:58 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:58.558629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:52:58.559257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:58.561988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:58.567222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:58.567695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:58.568126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:58.568850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:58.569299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:58.569721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:58.573295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=89 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:58.700685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:52:58.708413 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-719f93cd-4c73-49fe-b52b-6ac7da7644b4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1402 microversion: 2.1 time: 0.153731 Oct 22 03:52:58.708987 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3290/6714] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:52:58 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1402 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:52:58.731397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2008006526"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:52:58.733783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:52:58.740003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:58.740551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:58.740998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:58.741709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:52:58.742302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:52:58.742895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:52:58.839095 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.compute.api [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Attempting to quiesce instance before volume snapshot. Oct 22 03:52:58.885830 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.compute.api [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 22 03:52:58.955030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Creating snapshot from volume ff3e1a66-b119-4f97-ace2-d4048868dc74. {{(pid=120581) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 22 03:52:59.098922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:52:59.788234 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-12b5fb10-4333-4b5e-a62f-647a98a7931d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211/action" status: 202 len: 0 microversion: 2.1 time: 1.060729 Oct 22 03:52:59.789799 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3425/6715] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:52:58 2022] POST /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211/action => generated 0 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 03:53:00.944237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1478097789", "imageRef": "b18edcf4-5542-4625-b2a6-9fbe7bc8b468", "flavorRef": "452", "networks": [{"uuid": "7175b844-9cdb-45d6-b4f9-304c2c700bec"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:53:01.000764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] validate_networks() for [('7175b844-9cdb-45d6-b4f9-304c2c700bec', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:53:01.375969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:53:01.376442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:53:01.376923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:53:01.377332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:53:01.377750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:53:01.386790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:01.387202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:01.387638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:01.388410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:01.388866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:01.389295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:01.409969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:53:01.415992 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:53:01.428294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:53:01.431128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f28efa92-59e8-4794-a516-efb5121c2265',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:53:01.511435 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a3a6124-ee38-4e68-b8c6-18e0a5bb7605 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571136 Oct 22 03:53:01.512422 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3291/6716] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:53:01.525881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-832c8c10-8e53-4855-b19d-a1f1aa52de4a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:01.526735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-832c8c10-8e53-4855-b19d-a1f1aa52de4a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:01.581086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-832c8c10-8e53-4855-b19d-a1f1aa52de4a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:01.589270 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-832c8c10-8e53-4855-b19d-a1f1aa52de4a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1230 microversion: 2.1 time: 0.069580 Oct 22 03:53:01.589856 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3426/6717] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:01 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1230 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:53:02.614395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:02.615084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:02.622485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:02.623057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:02.623571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:02.624390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:02.624943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:02.625691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:02.699224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:02.707400 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-949c24c6-6a58-4666-b83b-a42e6449050c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1290 microversion: 2.1 time: 0.098030 Oct 22 03:53:02.708846 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3292/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:02 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:03.735632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:03.736398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:03.743900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:03.744699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:03.745346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:03.746087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:03.746733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:03.747189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:03.918253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:03.926282 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34726cd3-6187-46f3-8a2f-bf4ce22fbf3a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.196287 Oct 22 03:53:03.928394 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3427/6719] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:03 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:04.074417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-75f0cb4d-476b-455d-b56d-9e3cc553133f req-7dc01136-c71f-4b79-8ef9-0e25621d296a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e59b004-5052-4ae4-9d0f-5ccd21df0949", "tag": "260aa914-0937-465b-bb34-78f78761f0ed"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:53:04.089385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-75f0cb4d-476b-455d-b56d-9e3cc553133f req-7dc01136-c71f-4b79-8ef9-0e25621d296a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:04.089872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-75f0cb4d-476b-455d-b56d-9e3cc553133f req-7dc01136-c71f-4b79-8ef9-0e25621d296a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:04.090308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-75f0cb4d-476b-455d-b56d-9e3cc553133f req-7dc01136-c71f-4b79-8ef9-0e25621d296a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:04.101763 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-75f0cb4d-476b-455d-b56d-9e3cc553133f req-7dc01136-c71f-4b79-8ef9-0e25621d296a service nova] Creating event network-changed:260aa914-0937-465b-bb34-78f78761f0ed for instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 on n-h2-862416-2 Oct 22 03:53:04.107092 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-75f0cb4d-476b-455d-b56d-9e3cc553133f req-7dc01136-c71f-4b79-8ef9-0e25621d296a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037019 Oct 22 03:53:04.108311 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3293/6720] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:53:04.951251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:04.952541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:04.959501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:04.960076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:04.960580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:04.962052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:04.962528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:04.962979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:05.110187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:05.118262 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e75df08-aa27-4e12-b3d3-1ba5959e3453 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.171020 Oct 22 03:53:05.118850 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3428/6721] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:04 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:06.143134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:06.144564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:06.153270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:06.153945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:06.154557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:06.155435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:06.156043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:06.156708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:06.326278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:06.334873 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5aec9024-2647-4f49-a79d-b8fd06a9a537 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.196601 Oct 22 03:53:06.335446 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3294/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:06 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:07.360955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:07.361637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:07.368372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=38 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:07.371563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:07.372368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:07.372834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:07.373859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:07.374532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:07.374993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:07.594870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:07.609335 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-631a4169-aa64-4655-832b-f22bb2573c20 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.253359 Oct 22 03:53:07.611455 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3429/6723] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:07 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:53:08.649102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:08.649893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:08.658010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:08.658904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:08.659360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:08.660259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:08.660725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:08.661189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:08.829608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:08.843905 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0159fe98-8140-47ee-b9d8-32dfa859eecd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.200476 Oct 22 03:53:08.845149 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3295/6724] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:08 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:09.879327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:09.880000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:09.889287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:09.889873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:09.890479 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:09.891287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:09.891765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:09.892429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:10.037886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:10.047715 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ac8f13a9-f067-4ffb-b267-8cab4a895d12 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.173420 Oct 22 03:53:10.048679 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3430/6725] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:09 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:10.806292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:53:10.808691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:10.815395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:10.815936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:10.816402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:10.817123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:10.817572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:10.818026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:10.870380 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9789837-93ad-4f4b-961b-6f3d6d7ed5be tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e/action" status: 200 len: 24574 microversion: 2.1 time: 0.068008 Oct 22 03:53:10.871088 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3296/6726] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:53:10 2022] POST /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:53:11.072184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:11.072795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:11.079598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:11.080102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:11.080594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:11.081309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:11.081785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:11.082234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:11.211861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:11.219569 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1052875-046c-4944-88b6-c22fc28ec999 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.152088 Oct 22 03:53:11.220147 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3431/6727] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:11 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:12.243340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:12.244037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:12.246491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:12.247294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:12.254456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:12.254905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:12.255343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:12.256057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:12.256570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:12.256997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:12.401515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:12.409755 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-075435a7-b808-4357-9809-e6c8afcc23c6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.170842 Oct 22 03:53:12.410310 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3297/6728] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:12 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:13.432461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:13.433092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:13.434975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:13.441222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:13.441732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:13.442190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:13.442905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:13.443379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:13.444288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:13.826103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:13.834232 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08398a26-f39d-4cd9-b503-8c5a900b3b92 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.405938 Oct 22 03:53:13.834840 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3432/6729] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:13 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:14.859374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:14.859899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:14.868228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:14.868719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:14.869230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:14.870038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:14.870540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:14.870970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:15.005126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:15.013102 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5b87d91-3f33-4b95-bd61-0d167b232793 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.158226 Oct 22 03:53:15.013691 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3298/6730] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:14 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:16.037432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:16.038130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:16.045378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:16.045973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:16.046523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:16.047294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:16.047852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:16.048373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:16.190132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:16.199807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57a9e2dd-e936-4992-b566-ef2f0f13a590 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1342 microversion: 2.1 time: 0.166707 Oct 22 03:53:16.200612 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3433/6731] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:16 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:17.224547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:17.225062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:17.232621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:17.233177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:17.233609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:17.234301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:17.234751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:17.235173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:17.371544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:17.380943 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a461113e-e224-42a6-8990-4e02725a07fd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1388 microversion: 2.1 time: 0.160428 Oct 22 03:53:17.381563 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3299/6732] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:17 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1388 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:18.405521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:18.406195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:18.413096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:18.413597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:18.414054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:18.414762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:18.415241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:18.415689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:18.553467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:18.561807 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e949c4db-93e9-4c70-b17c-e0602765f14b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.160269 Oct 22 03:53:18.562386 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3434/6733] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:18 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:19.586510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:19.587457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:19.593874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:19.594357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:19.594798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:19.595488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:19.595941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:19.596399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:19.730229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:19.737979 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a25c6399-1bbb-4090-be2c-6eaf9e2c18e8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.156138 Oct 22 03:53:19.738528 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3300/6734] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:19 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:20.761732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:20.762363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:20.769464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:20.769996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:20.770452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:20.771189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:20.771663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:20.772108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:20.904265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:20.912419 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7a67835-67d8-4e27-a3b5-635069b418ec tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.155274 Oct 22 03:53:20.913001 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3435/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:20 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:21.936309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:21.936981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:21.944844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:21.945396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:21.945836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:21.946541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:21.947766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:21.948239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:22.081031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:22.089429 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a12e4033-ad4f-4e96-a55b-a7b0771a04db tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.158225 Oct 22 03:53:22.090042 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3301/6736] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:21 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:23.111895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:23.112542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:23.119805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:23.120376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:23.120877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:23.121660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:23.122198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:23.122639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:23.268252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:23.277989 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6feb4293-ddea-4a82-9d8e-2e9169f34e2a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.170007 Oct 22 03:53:23.278819 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3436/6737] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:23 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:24.302704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:24.303332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:24.311190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:24.311718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:24.312169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:24.312894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:24.313352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:24.313794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:24.454519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:24.464067 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a0207124-1d0f-4c1d-8ec7-af150b22fb8d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.164902 Oct 22 03:53:24.464972 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3302/6738] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:24 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:25.491079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:25.491703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:25.498698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:25.499196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:25.499693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:25.504818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:25.505799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:25.506251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:25.637813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:25.645611 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-be2ef2ce-a74e-4c39-907d-ca40e906745a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.158566 Oct 22 03:53:25.646195 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3437/6739] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:25 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:26.669725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:26.670543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:26.677228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:26.677707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:26.678151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:26.678849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:26.679304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:26.679728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:26.827902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:26.837458 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-92d113fe-9928-4dea-8bb0-50caa0c1564e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.172127 Oct 22 03:53:26.839601 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3303/6740] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:26 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:27.863481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:27.864345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:27.873520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:27.874201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:27.874700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:27.875697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:27.876679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:27.877177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:28.034301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:28.042827 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1ea6ece4-0c7d-49ef-addd-8cf91767e855 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.183590 Oct 22 03:53:28.043636 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3438/6741] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:27 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:28.892082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-96330151-6b17-4413-9b6f-2bd447ee82c8 req-7a68e6a2-14c1-4658-9842-d66ec52d9bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e59b004-5052-4ae4-9d0f-5ccd21df0949", "name": "network-vif-plugged", "status": "completed", "tag": "260aa914-0937-465b-bb34-78f78761f0ed"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:53:28.898778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:28.906321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96330151-6b17-4413-9b6f-2bd447ee82c8 req-7a68e6a2-14c1-4658-9842-d66ec52d9bf3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:28.906904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96330151-6b17-4413-9b6f-2bd447ee82c8 req-7a68e6a2-14c1-4658-9842-d66ec52d9bf3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:28.907510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-96330151-6b17-4413-9b6f-2bd447ee82c8 req-7a68e6a2-14c1-4658-9842-d66ec52d9bf3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:28.913109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=74 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:28.922709 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-96330151-6b17-4413-9b6f-2bd447ee82c8 req-7a68e6a2-14c1-4658-9842-d66ec52d9bf3 service nova] Creating event network-vif-plugged:260aa914-0937-465b-bb34-78f78761f0ed for instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 on n-h2-862416-2 Oct 22 03:53:28.928508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-96330151-6b17-4413-9b6f-2bd447ee82c8 req-7a68e6a2-14c1-4658-9842-d66ec52d9bf3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040808 Oct 22 03:53:28.929736 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3304/6742] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:53:29.068960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:29.069745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:29.077865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:29.078511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:29.079044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:29.079887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:29.080411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:29.080866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:29.222751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:29.225028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:29.232608 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65f798da-663a-4257-9b91-fb6f5ccab0f8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.167672 Oct 22 03:53:29.233373 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3439/6743] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:29 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:30.259610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:30.260631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:30.270213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:30.270788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:30.271489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:30.272233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:30.272933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:30.273380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:30.420633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:30.429056 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-83e945a8-e26f-4902-bb37-bd0cac1051c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1376 microversion: 2.1 time: 0.175484 Oct 22 03:53:30.439300 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3305/6744] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:30 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:31.455699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:31.456307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:31.463531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:31.464031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:31.464587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:31.465311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:31.465806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:31.466225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:31.611412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:31.619606 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c2576409-0d2b-47c8-babf-26dfc8e2f19f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1563 microversion: 2.1 time: 0.169118 Oct 22 03:53:31.620195 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3440/6745] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:31 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:31.643204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:31.643811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:31.651037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:31.651517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:31.651956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:31.652754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:31.653215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:31.653694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:31.785485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:31.793472 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-15b83be7-01d4-4f46-9142-dfd7b8595479 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1563 microversion: 2.1 time: 0.154292 Oct 22 03:53:31.794096 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3306/6746] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:31 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:31.873865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:31.875079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:31.881739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:31.882313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:31.882771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:31.883486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:31.884018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:31.884596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:31.913142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:53:31.993307 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f12d590b-2bed-4adb-90a1-51a17ad5d927 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 204 len: 0 microversion: 2.1 time: 0.122986 Oct 22 03:53:31.994061 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3441/6747] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:53:31 2022] DELETE /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:53:32.004348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:32.004961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:32.011307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:32.011781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:32.012238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:32.012959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:32.013409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:32.013836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:32.156221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:32.164418 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-55e60b99-4df4-4539-9475-8ef3f28909df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1569 microversion: 2.1 time: 0.164270 Oct 22 03:53:32.164993 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3307/6748] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:31 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:33.191273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:33.191991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:33.198897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:33.199396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:33.199879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:33.200655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:33.201129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:33.201580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:33.337619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:33.345506 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bff71d73-1c1e-4425-b488-c8e42568d518 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1569 microversion: 2.1 time: 0.158871 Oct 22 03:53:33.346093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3442/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:33 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:34.368901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:34.369616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:34.396764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:34.397392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:34.403463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:34.404311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:34.405149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:34.405791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:34.463157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4d6def76-2434-4cd3-ac57-83d6898237a9 req-a35ec1eb-beeb-4fd5-aedf-c3db7e9a5e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e59b004-5052-4ae4-9d0f-5ccd21df0949", "name": "network-vif-deleted", "tag": "260aa914-0937-465b-bb34-78f78761f0ed"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:53:34.497538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4d6def76-2434-4cd3-ac57-83d6898237a9 req-a35ec1eb-beeb-4fd5-aedf-c3db7e9a5e88 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:34.498475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4d6def76-2434-4cd3-ac57-83d6898237a9 req-a35ec1eb-beeb-4fd5-aedf-c3db7e9a5e88 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:34.499164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4d6def76-2434-4cd3-ac57-83d6898237a9 req-a35ec1eb-beeb-4fd5-aedf-c3db7e9a5e88 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:34.502259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:34.516477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4d6def76-2434-4cd3-ac57-83d6898237a9 req-a35ec1eb-beeb-4fd5-aedf-c3db7e9a5e88 service nova] Creating event network-vif-deleted:260aa914-0937-465b-bb34-78f78761f0ed for instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 on n-h2-862416-2 Oct 22 03:53:34.520552 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e0afc2c-1eff-44e1-9c7c-7e6a39438f36 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1527 microversion: 2.1 time: 0.155435 Oct 22 03:53:34.524233 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4d6def76-2434-4cd3-ac57-83d6898237a9 req-a35ec1eb-beeb-4fd5-aedf-c3db7e9a5e88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064738 Oct 22 03:53:34.525507 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3443/6750] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:53:34.530075 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3308/6751] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:34 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:35.547535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:35.548254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:35.555456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:35.555951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:35.556434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:35.557141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:35.557605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:35.558045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:35.625614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:35.633866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1b75999-79e3-4dc5-9b49-1ff387a7b99f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1361 microversion: 2.1 time: 0.090618 Oct 22 03:53:35.634449 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3444/6752] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:35 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:36.658474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:36.659087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:36.665978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:36.666452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:36.666918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:36.667605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:36.668058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:36.668526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:36.731528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:36.739648 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ca165419-e53b-4f86-8d00-0c31693d9a30 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1361 microversion: 2.1 time: 0.085195 Oct 22 03:53:36.740236 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3309/6753] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:36 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1361 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:37.764365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:37.764993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:37.768154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:37.774994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:37.775503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:37.775955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:37.776736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:37.777208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:37.777649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:37.847606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:37.855700 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-68fd271e-f83f-4b68-af0e-d4f7951afd8e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1361 microversion: 2.1 time: 0.095976 Oct 22 03:53:37.856306 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3445/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:37 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:38.879515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:38.880259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:38.888332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:38.888822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:38.889382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:38.890230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:38.890682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:38.891104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:38.924707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:38.925191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:38.925801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:38.926321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lazy-loading 'fault' on Instance uuid 1e59b004-5052-4ae4-9d0f-5ccd21df0949 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:53:38.967671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:38.976425 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9bb0b851-268b-417d-a3ae-0e08d3389f64 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 200 len: 1366 microversion: 2.1 time: 0.101188 Oct 22 03:53:38.977055 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3310/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:38 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:40.002264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:40.003602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:40.011483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:40.011979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:40.012465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:40.013207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:40.013673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:40.014109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:40.028866 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 HTTP/1.1 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1e59b004-5052-4ae4-9d0f-5ccd21df0949'} Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:40.030606 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c854e881-0e48-4aee-987c-dd6283ea187c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 404 len: 111 microversion: 2.1 time: 0.035019 Oct 22 03:53:40.035765 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3446/6756] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:39 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:53:44.347177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:44.347672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:44.354499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:44.354986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:44.355426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:44.356118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:44.356597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:44.357030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:44.385367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:53:44.458828 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-de0e6355-18d6-484c-abfc-6aaad4707694 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 204 len: 0 microversion: 2.1 time: 0.115177 Oct 22 03:53:44.459458 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3311/6757] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:53:44 2022] DELETE /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:53:44.469462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:44.470155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:44.478109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:44.478606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:44.479058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:44.479773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:44.480294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:44.480735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:44.613602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:44.621372 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e60db22a-4ca3-4600-be93-ab05aa586c4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1408 microversion: 2.1 time: 0.157605 Oct 22 03:53:44.621943 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3447/6758] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:44 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:53:45.646194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:45.646898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:45.654456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:45.654943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:45.655384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:45.656083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:45.656572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:45.657491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:45.793160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:45.801382 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f19b01e1-0647-4342-95b9-ae0338a480ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1408 microversion: 2.1 time: 0.159472 Oct 22 03:53:45.801965 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3312/6759] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:45 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:46.683934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-49249b83-c04e-4a37-9f2c-85aa9d41c3c8 req-5babe8d1-b780-490a-87de-f72a281b329c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee92ced-f179-4814-965e-5302a7068211", "name": "network-vif-deleted", "tag": "416b47f1-8485-4ff1-bfa5-4af26e4b0cf6"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:53:46.705306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-49249b83-c04e-4a37-9f2c-85aa9d41c3c8 req-5babe8d1-b780-490a-87de-f72a281b329c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:46.706157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-49249b83-c04e-4a37-9f2c-85aa9d41c3c8 req-5babe8d1-b780-490a-87de-f72a281b329c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:46.707167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-49249b83-c04e-4a37-9f2c-85aa9d41c3c8 req-5babe8d1-b780-490a-87de-f72a281b329c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:46.727072 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-49249b83-c04e-4a37-9f2c-85aa9d41c3c8 req-5babe8d1-b780-490a-87de-f72a281b329c service nova] Creating event network-vif-deleted:416b47f1-8485-4ff1-bfa5-4af26e4b0cf6 for instance 9ee92ced-f179-4814-965e-5302a7068211 on n-h1-862416-2 Oct 22 03:53:46.734897 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-49249b83-c04e-4a37-9f2c-85aa9d41c3c8 req-5babe8d1-b780-490a-87de-f72a281b329c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055424 Oct 22 03:53:46.736119 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3448/6760] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:53:46.825610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:46.826607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:46.834234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:46.834667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:46.835103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:46.835801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:46.836279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:46.836711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:46.904524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:46.912665 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4892e8e7-3e17-4d88-a4fa-d17736bf3d6d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1201 microversion: 2.1 time: 0.090937 Oct 22 03:53:46.913241 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3313/6761] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:46 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:47.937174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:47.937917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:47.944949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:47.945443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:47.945892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:47.946591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:47.947054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:47.947487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:48.012782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:48.021168 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f5fa39de-f929-4a51-9db7-d94d4d5e6240 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1201 microversion: 2.1 time: 0.089827 Oct 22 03:53:48.021764 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3449/6762] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:47 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:49.044375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:49.044892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:49.052183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:49.052708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:49.053150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:49.053882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:49.054362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:49.054794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:49.123123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:49.131931 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-855a008b-b162-488d-a6fe-09afc553e6c2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1201 microversion: 2.1 time: 0.091465 Oct 22 03:53:49.132549 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3314/6763] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:49 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:49.869424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:53:49.872318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:49.880563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:49.881078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:49.881533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:49.882255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:49.882721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:49.883159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:49.965203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:53:49.965637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:53:49.966121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:53:49.966539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:53:49.966969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:53:50.030522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:50.037102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:50.037608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:50.038061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:50.038782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:50.039250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:50.039693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:50.067982 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eabd6ce9-57bc-49af-8c55-a7ddfd301ff9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e/action" status: 202 len: 1138 microversion: 2.1 time: 0.202493 Oct 22 03:53:50.068668 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3450/6764] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:53:49 2022] POST /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e/action => generated 1138 bytes in 204 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 22 03:53:50.087981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:50.088626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:50.096199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:50.096701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:50.097146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:50.097840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:50.098295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:50.098723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:50.155502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:50.156036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:50.162833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:50.163086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:50.163540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:50.164280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:50.164759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:50.165195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:50.234656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:50.238790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:50.243926 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ca8f2440-cd09-4b89-a024-58b87803d8e1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1201 microversion: 2.1 time: 0.092615 Oct 22 03:53:50.244736 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3451/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:50 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:53:50.252425 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ec2f5b63-29be-49e0-ba26-f2ff6dc0b5e3 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.168386 Oct 22 03:53:50.253474 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3315/6766] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:50 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:51.267565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:51.268230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:51.276290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:51.277451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:51.277601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:51.278051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:51.278641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:51.279610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:51.280289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:51.280891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:51.286081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:51.287174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:51.287811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:51.288843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:51.289608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:51.290240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:51.329408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:51.330160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:51.330650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:51.331097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lazy-loading 'fault' on Instance uuid 9ee92ced-f179-4814-965e-5302a7068211 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:53:51.387686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:51.399068 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35d15535-9db8-447b-a83f-eff0d8da43fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 200 len: 1206 microversion: 2.1 time: 0.135972 Oct 22 03:53:51.399678 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3452/6767] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:51 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 1206 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:51.462003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:51.471922 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-499ac224-8089-4abf-950f-8e484a07f395 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.199347 Oct 22 03:53:51.472579 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3316/6768] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:51 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:52.424699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:52.425329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:52.432334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:52.432847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:52.433304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:52.434027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:52.434501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:52.434942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:52.449715 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 HTTP/1.1 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9ee92ced-f179-4814-965e-5302a7068211'} Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:52.451550 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48eafa3a-0105-4a18-94e9-1de30f4d6d52 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 404 len: 111 microversion: 2.1 time: 0.033180 Oct 22 03:53:52.459828 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3453/6769] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:52 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:53:52.495557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:52.496568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:52.504019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:52.504640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:52.505173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:52.505968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:52.506515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:52.507029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:52.646955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:52.655493 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c19fa8b-920c-488f-a9e0-a7f4ccff814f tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.164477 Oct 22 03:53:52.656101 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3317/6770] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:52 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:53.554782 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:53.555320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:53.562586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:53.564229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:53.564804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:53.565525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:53.566036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:53.566495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:53.581847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 HTTP/1.1 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1e59b004-5052-4ae4-9d0f-5ccd21df0949'} Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:53:53.583448 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1291011c-5030-4b66-8d59-22e34214c9a7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 404 len: 111 microversion: 2.1 time: 0.034480 Oct 22 03:53:53.587381 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3454/6771] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:53:53 2022] DELETE /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:53:53.593792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:53.594731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 1e59b004-5052-4ae4-9d0f-5ccd21df0949] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:53.602068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:53.602563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:53.603007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:53.603715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:53.604176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:53.604631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:53.619251 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 HTTP/1.1 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1e59b004-5052-4ae4-9d0f-5ccd21df0949'} Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:53.620959 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 1e59b004-5052-4ae4-9d0f-5ccd21df0949 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba2bc1fe-2a6d-4185-bfd5-228501068e95 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949" status: 404 len: 111 microversion: 2.1 time: 0.032613 Oct 22 03:53:53.630007 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3318/6772] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:53 2022] GET /compute/v2.1/servers/1e59b004-5052-4ae4-9d0f-5ccd21df0949 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:53:53.680539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:53.681180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:53.687515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:53.688091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:53.689055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:53.689418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:53.689900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:53.690353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:53.842580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:53.845757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:53.853436 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a312b0e9-5266-4f92-a423-8e1e7ca4b9fd tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.176873 Oct 22 03:53:53.853963 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3455/6773] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:53 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:54.089474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:54.089980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:54.096989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:54.097478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:54.097952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:54.098662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:54.099117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:54.099572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:54.113180 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 HTTP/1.1 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '9ee92ced-f179-4814-965e-5302a7068211'} Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:53:54.114714 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d8869cc4-17da-45f1-85d1-8eeb6458d7b9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 404 len: 111 microversion: 2.1 time: 0.030488 Oct 22 03:53:54.118820 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3319/6774] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:53:54 2022] DELETE /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:53:54.126166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:54.127249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9ee92ced-f179-4814-965e-5302a7068211] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:54.133997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:54.134540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:54.135014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:54.135724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:54.136185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:54.136680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:54.152250 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 HTTP/1.1 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9ee92ced-f179-4814-965e-5302a7068211'} Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:53:54.153894 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 9ee92ced-f179-4814-965e-5302a7068211 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d1370cb6-f496-4155-b38c-676c9e70ed04 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211" status: 404 len: 111 microversion: 2.1 time: 0.034421 Oct 22 03:53:54.162362 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3456/6775] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:54 2022] GET /compute/v2.1/servers/9ee92ced-f179-4814-965e-5302a7068211 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:53:54.233319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-313be7fb-eb23-4149-854d-67b50923ebb3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: .version_select at 0x7f0d1e4b3280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1847453664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtKe4kcZmIG4/+DmTVFW/CoUviZUIaYxvINd4jbZVyYHTz1vfSvZGRMCiR5zo/RP1n8jgZIryDMFNfmDinyi7EiMorpO6kGGC/1S4ZRNlbfpZJ3Z3fqH1ywnxyOXBKm/w=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:53:54.249240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-313be7fb-eb23-4149-854d-67b50923ebb3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:53:54.255161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-313be7fb-eb23-4149-854d-67b50923ebb3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:53:54.278964 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-313be7fb-eb23-4149-854d-67b50923ebb3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.049531 Oct 22 03:53:54.279559 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3320/6776] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 03:53:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:53:54.877803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:54.878427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:54.885423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:54.885926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:54.886389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:54.887106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:54.887584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:54.888063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:55.028859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:55.037748 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eff31b82-0d4c-46ad-aa6c-8299dd197305 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.164711 Oct 22 03:53:55.038549 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3457/6777] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:54 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:56.064617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:56.065173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:56.072488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:56.073090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:56.073604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:56.074385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:56.074919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:56.075371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:56.216354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:56.218672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:53:56.226177 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-78e6da0c-0c89-4b81-9ebb-5c648899150a tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.167692 Oct 22 03:53:56.226758 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3321/6778] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:56 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:57.249881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:57.250720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:57.258694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:57.259200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:57.259655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:57.260407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:57.260886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:57.261341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:57.402667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:57.411159 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f878a6b8-9503-48ff-9482-e3e9e2868f54 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.165195 Oct 22 03:53:57.418491 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3458/6779] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:57 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:58.434725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:58.435409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:58.443800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:58.444322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:58.444767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:58.445477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:58.445937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:58.446366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:58.586508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:58.596147 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2d904bd-9851-4ad2-8ac9-33c7c8f118f2 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.166070 Oct 22 03:53:58.608953 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3322/6780] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:58 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:53:59.620932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:53:59.621558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:53:59.630478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:59.630981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:59.631435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:59.632151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:53:59.632648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:53:59.633090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:53:59.777527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:53:59.786214 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-09efed28-8efa-4394-8a1b-98a0ca1547e7 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.169016 Oct 22 03:53:59.786812 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3459/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:53:59 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:00.811018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:00.811556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:00.814463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:00.820079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:00.820614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:00.821056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:00.821782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:00.822516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:00.822956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:00.972581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:00.980478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04d8e98b-b373-42f1-94f8-f4a62e3309d9 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.173449 Oct 22 03:54:00.981056 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3323/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:00 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:02.005696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:02.006323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:02.012434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:02.012931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:02.013649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:02.014364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:02.014821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:02.015262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:02.163566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:02.171375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cded1b86-1b35-47d8-b5ce-b6efcfe54ce8 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1692 microversion: 2.1 time: 0.171497 Oct 22 03:54:02.171964 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3460/6783] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:01 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:03.195654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:03.196350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:03.203284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:03.203775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:03.204281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:03.205014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:03.205472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:03.205900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:03.341844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:03.350293 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f67dbf9b-9b45-47f9-9346-c7d1b19d3957 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1698 microversion: 2.1 time: 0.158523 Oct 22 03:54:03.350869 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3324/6784] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:03 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:04.374746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:04.375370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:04.382268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:04.382763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:04.383211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:04.383914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:04.384408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:04.384850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:04.522052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:04.530041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f26f3d9-c6dd-450a-9a42-d703052510db tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1698 microversion: 2.1 time: 0.159406 Oct 22 03:54:04.530696 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3461/6785] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:04 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:05.554681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:05.555304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:05.558117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:05.564744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:05.565235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:05.565675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:05.566388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:05.566843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:05.567272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:05.708829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:05.716904 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-31d5b6ac-4ab9-43bb-82be-1d3e29f31ae1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1698 microversion: 2.1 time: 0.166165 Oct 22 03:54:05.717505 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3325/6786] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:05 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:06.740949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:06.742000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:06.748674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:06.749182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:06.749635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:06.750362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:06.750946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:06.751737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:06.912868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:06.925482 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-dfce8243-f707-45be-92c1-7fe0e187270d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1683 microversion: 2.1 time: 0.188788 Oct 22 03:54:06.926412 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3462/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:06 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:54:07.151158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1c6377c5-6bab-42a9-aaab-4cef2356a5dd req-48df83d9-8757-4969-a9ca-f5e1ed46d539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7e16b-66fa-4176-be45-c364b21c0e0e", "name": "network-vif-unplugged", "status": "completed", "tag": "34cdaf05-0d88-474e-8a9c-75c42dd0892c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:54:07.170925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1c6377c5-6bab-42a9-aaab-4cef2356a5dd req-48df83d9-8757-4969-a9ca-f5e1ed46d539 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:07.171871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1c6377c5-6bab-42a9-aaab-4cef2356a5dd req-48df83d9-8757-4969-a9ca-f5e1ed46d539 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:07.173478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1c6377c5-6bab-42a9-aaab-4cef2356a5dd req-48df83d9-8757-4969-a9ca-f5e1ed46d539 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:07.196506 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1c6377c5-6bab-42a9-aaab-4cef2356a5dd req-48df83d9-8757-4969-a9ca-f5e1ed46d539 service nova] Creating event network-vif-unplugged:34cdaf05-0d88-474e-8a9c-75c42dd0892c for instance a6b7e16b-66fa-4176-be45-c364b21c0e0e on n-h2-862416-2 Oct 22 03:54:07.201595 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1c6377c5-6bab-42a9-aaab-4cef2356a5dd req-48df83d9-8757-4969-a9ca-f5e1ed46d539 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056179 Oct 22 03:54:07.202293 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3326/6788] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:54:09.218726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-07e75a23-1743-4989-9345-d7b093b5b905 req-e3a48105-6d17-4c6d-bc20-c09dbf7ecebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7e16b-66fa-4176-be45-c364b21c0e0e", "name": "network-vif-plugged", "status": "completed", "tag": "34cdaf05-0d88-474e-8a9c-75c42dd0892c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:54:09.225249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=42 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:09.231077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-07e75a23-1743-4989-9345-d7b093b5b905 req-e3a48105-6d17-4c6d-bc20-c09dbf7ecebb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:09.231582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-07e75a23-1743-4989-9345-d7b093b5b905 req-e3a48105-6d17-4c6d-bc20-c09dbf7ecebb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:09.232037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-07e75a23-1743-4989-9345-d7b093b5b905 req-e3a48105-6d17-4c6d-bc20-c09dbf7ecebb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:09.244329 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-07e75a23-1743-4989-9345-d7b093b5b905 req-e3a48105-6d17-4c6d-bc20-c09dbf7ecebb service nova] Creating event network-vif-plugged:34cdaf05-0d88-474e-8a9c-75c42dd0892c for instance a6b7e16b-66fa-4176-be45-c364b21c0e0e on n-h2-862416-2 Oct 22 03:54:09.249451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-07e75a23-1743-4989-9345-d7b093b5b905 req-e3a48105-6d17-4c6d-bc20-c09dbf7ecebb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034624 Oct 22 03:54:09.250212 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3463/6789] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:54:10.558341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2065800651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1847453664", "security_groups": [{"name": "tempest-secgroup-smoke-620824907"}], "block_device_mapping_v2": [{"uuid": "06847162-e8bc-4548-bf4f-e4de68d7e214", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7175b844-9cdb-45d6-b4f9-304c2c700bec"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:54:10.671471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] validate_networks() for [('7175b844-9cdb-45d6-b4f9-304c2c700bec', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:54:11.037282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:54:11.037707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:54:11.038187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:54:11.038599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:54:11.039012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:54:11.048663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:11.049816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:11.050342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:11.051195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:11.051716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:11.052241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:11.069931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:54:11.075104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:54:11.132743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:54:11.135029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06847162-e8bc-4548-bf4f-e4de68d7e214',volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:54:11.265744 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3182148-a52a-4ff4-b4b8-abf5b1718fb1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712508 Oct 22 03:54:11.266411 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3327/6790] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:54:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:54:11.279186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cab3d854-c9b0-4447-a330-319b031b40dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:11.280018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cab3d854-c9b0-4447-a330-319b031b40dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:11.339023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cab3d854-c9b0-4447-a330-319b031b40dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:11.346684 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cab3d854-c9b0-4447-a330-319b031b40dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1095 microversion: 2.1 time: 0.072815 Oct 22 03:54:11.347260 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3464/6791] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:11 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:12.369874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:12.370408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:12.378975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:12.379460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:12.379891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:12.380684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:12.381135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:12.381556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:12.461132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:12.474855 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3fac4f57-6632-4f5e-95c5-1199c6ed22e3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1193 microversion: 2.1 time: 0.109105 Oct 22 03:54:12.476533 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3328/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:12 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:13.498783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:13.500042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:13.510179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:13.510914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:13.511366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:13.512086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:13.512586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:13.513027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:13.663197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:13.671828 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9abc4c89-3de8-429b-9cd1-c6774d8fb5b0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1278 microversion: 2.1 time: 0.176884 Oct 22 03:54:13.672441 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3465/6793] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:13 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:13.920943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6f7bb6bc-59f6-4730-9bdd-0697c38d285f req-f5ebc66d-1fd2-4f5a-9fde-bc3d493f2c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a", "tag": "d9d8e3c1-a866-4fb0-8f78-018d151a8e0c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:54:13.933765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f7bb6bc-59f6-4730-9bdd-0697c38d285f req-f5ebc66d-1fd2-4f5a-9fde-bc3d493f2c68 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:13.934438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f7bb6bc-59f6-4730-9bdd-0697c38d285f req-f5ebc66d-1fd2-4f5a-9fde-bc3d493f2c68 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:13.935069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f7bb6bc-59f6-4730-9bdd-0697c38d285f req-f5ebc66d-1fd2-4f5a-9fde-bc3d493f2c68 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:13.958593 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6f7bb6bc-59f6-4730-9bdd-0697c38d285f req-f5ebc66d-1fd2-4f5a-9fde-bc3d493f2c68 service nova] Creating event network-changed:d9d8e3c1-a866-4fb0-8f78-018d151a8e0c for instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a on n-h1-862416-2 Oct 22 03:54:13.966136 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6f7bb6bc-59f6-4730-9bdd-0697c38d285f req-f5ebc66d-1fd2-4f5a-9fde-bc3d493f2c68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049360 Oct 22 03:54:13.967299 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3329/6794] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:54:14.696109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:14.697517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:14.705276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:14.705783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:14.706241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:14.707043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:14.707518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:14.707964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:14.856569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:14.866625 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b746eecf-2f16-4504-acbe-3aaed6e72dd2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1278 microversion: 2.1 time: 0.174279 Oct 22 03:54:14.867255 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3466/6795] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:14 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:15.892975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:15.893665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:15.900367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:15.900850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:15.901284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:15.901973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:15.902420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:15.902841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:16.046564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:16.067479 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c2623ec-c145-46ee-8239-98e9181d99c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1278 microversion: 2.1 time: 0.180043 Oct 22 03:54:16.068264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3330/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:15 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:17.090579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:17.091206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:17.098991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:17.099500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:17.099964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:17.100714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:17.101194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:17.101643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:17.244000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:17.253573 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d095b1e-6241-49d3-9c75-d622f24dcb28 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1278 microversion: 2.1 time: 0.166860 Oct 22 03:54:17.264487 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3467/6797] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:17 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:18.279308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:18.279922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:18.287854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:18.288540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:18.289323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:18.290106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:18.290827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:18.291333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:18.428381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:18.436326 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b002dc43-7a63-40dd-a3d6-3a2871052f0b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.160926 Oct 22 03:54:18.436895 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3331/6798] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:18 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:54:19.459976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:19.460626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:19.466610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:19.467107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:19.467566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:19.468300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:19.468780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:19.469226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:19.600918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:19.608597 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-27b0c29d-705a-4bda-ae43-f791fcb62b23 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.153574 Oct 22 03:54:19.609176 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3468/6799] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:19 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:20.631508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:20.632133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:20.639171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:20.639666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:20.640108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:20.640853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:20.641314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:20.641745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:20.782874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:20.791423 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2c5f8f81-af7e-4cf2-a669-52da0688c0ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.164272 Oct 22 03:54:20.792022 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3332/6800] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:20 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:21.815703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:21.816359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:21.819108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:21.824734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:21.825232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:21.825682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:21.826389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:21.826853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:21.827291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:21.961506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:21.969184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fd0e0edb-c34c-413a-967f-e6bfbe079ea2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.158494 Oct 22 03:54:21.969757 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3469/6801] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:21 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:22.992382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:22.992978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:22.994899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:22.995558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:23.002111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:23.003968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:23.004450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:23.005143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:23.005599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:23.006029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:23.142536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:23.150327 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9df125c-008d-46e2-8346-f9bbb1fb1cd4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.161858 Oct 22 03:54:23.150902 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3333/6802] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:22 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:24.173450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:24.174465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:24.180590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:24.181082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:24.181525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:24.182222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:24.182686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:24.183123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:24.185680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=72 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:24.315310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:24.323091 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f39ce50a-49ba-45c0-b051-0da1e408e8fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.153746 Oct 22 03:54:24.323665 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3470/6803] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:24 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:25.346519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:25.347134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:25.353985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:25.354471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:25.354911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:25.355609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:25.356069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:25.356520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:25.495085 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:25.503818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c72da4ec-6cae-4b79-a817-c0e14d53704b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.161293 Oct 22 03:54:25.504435 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3334/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:25 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:26.526878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:26.527511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:26.535540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:26.536035 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:26.536526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:26.537227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:26.537694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:26.538130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:26.669135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:26.677404 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c17414fc-8c4f-4f4c-b8ed-566e668c9d8f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.154469 Oct 22 03:54:26.678012 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3471/6805] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:26 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:27.004759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-daa7540b-b06a-46cc-89bf-b2e599eb5739 req-d87d4d76-a8b3-452b-9568-ed3cd8f780ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a", "name": "network-vif-plugged", "status": "completed", "tag": "d9d8e3c1-a866-4fb0-8f78-018d151a8e0c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:54:27.015703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-daa7540b-b06a-46cc-89bf-b2e599eb5739 req-d87d4d76-a8b3-452b-9568-ed3cd8f780ba service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:27.016183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-daa7540b-b06a-46cc-89bf-b2e599eb5739 req-d87d4d76-a8b3-452b-9568-ed3cd8f780ba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:27.016644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-daa7540b-b06a-46cc-89bf-b2e599eb5739 req-d87d4d76-a8b3-452b-9568-ed3cd8f780ba service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:27.028335 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-daa7540b-b06a-46cc-89bf-b2e599eb5739 req-d87d4d76-a8b3-452b-9568-ed3cd8f780ba service nova] Creating event network-vif-plugged:d9d8e3c1-a866-4fb0-8f78-018d151a8e0c for instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a on n-h1-862416-2 Oct 22 03:54:27.033280 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-daa7540b-b06a-46cc-89bf-b2e599eb5739 req-d87d4d76-a8b3-452b-9568-ed3cd8f780ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Oct 22 03:54:27.033890 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3335/6806] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:54:27.700800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:27.701424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:27.709055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:27.709554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:27.710008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:27.710711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:27.711177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:27.711614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:27.849603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:27.857290 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cd2de6f9-04c5-4499-83a3-a732d413ea0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1266 microversion: 2.1 time: 0.160480 Oct 22 03:54:27.857870 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3472/6807] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:27 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:28.883854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:28.884623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:28.891580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:28.892065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:28.892677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:28.893598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:28.894513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:28.894513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:28.897184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=70 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:29.035870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:29.044482 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0afcd021-c991-4565-aa4c-c7d575fa419e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1453 microversion: 2.1 time: 0.166172 Oct 22 03:54:29.045116 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3336/6808] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:28 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:54:29.068870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:54:29.069491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:29.076392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:29.076890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:29.077340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:29.078043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:29.078512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:29.078951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:29.210565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:54:29.218357 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4328e899-b25f-4692-8a39-fcd349c8b36e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1453 microversion: 2.1 time: 0.154410 Oct 22 03:54:29.218932 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3473/6809] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:54:29 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:54:30.885747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-048ea9d1-79bb-4773-b59d-fa48030d00d4 req-07bb7a2a-313d-41b3-986f-467a42f238ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a", "tag": "d9d8e3c1-a866-4fb0-8f78-018d151a8e0c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:54:30.890771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:30.896585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-048ea9d1-79bb-4773-b59d-fa48030d00d4 req-07bb7a2a-313d-41b3-986f-467a42f238ea service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:30.897069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-048ea9d1-79bb-4773-b59d-fa48030d00d4 req-07bb7a2a-313d-41b3-986f-467a42f238ea service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:30.897507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-048ea9d1-79bb-4773-b59d-fa48030d00d4 req-07bb7a2a-313d-41b3-986f-467a42f238ea service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:30.910128 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-048ea9d1-79bb-4773-b59d-fa48030d00d4 req-07bb7a2a-313d-41b3-986f-467a42f238ea service nova] Creating event network-changed:d9d8e3c1-a866-4fb0-8f78-018d151a8e0c for instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a on n-h1-862416-2 Oct 22 03:54:30.915181 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-048ea9d1-79bb-4773-b59d-fa48030d00d4 req-07bb7a2a-313d-41b3-986f-467a42f238ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097527 Oct 22 03:54:30.915854 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3337/6810] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:54:41.183352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:54:41.185802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:54:41.188473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=23 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:41.189146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=23 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:54:41.195676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:41.196175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:41.196653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:41.197360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:54:41.197828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:54:41.198270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:54:41.247418 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3dc16dc2-bd85-41da-a3f3-c6db2a2869a1 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "POST /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e/action" status: 200 len: 24539 microversion: 2.1 time: 0.067787 Oct 22 03:54:41.249021 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3474/6811] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 03:54:41 2022] POST /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e/action => generated 24539 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 03:55:12.565579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=7 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:55:12.567113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:55:12.569612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ed3f5e8f-babf-4c2e-9122-e9c7c4db648b req-9f59914f-40f5-4db4-9307-2f2f5f4224d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b7e16b-66fa-4176-be45-c364b21c0e0e", "tag": "34cdaf05-0d88-474e-8a9c-75c42dd0892c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:55:12.572148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:55:12.572939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:55:12.575761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:55:12.577692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:55:12.579233 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:55:12.579399 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 03:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 22 03:55:12.590187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:12.591020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:12.591700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:12.592673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:12.594698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:12.595126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:12.595877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed3f5e8f-babf-4c2e-9122-e9c7c4db648b req-9f59914f-40f5-4db4-9307-2f2f5f4224d2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:12.596947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed3f5e8f-babf-4c2e-9122-e9c7c4db648b req-9f59914f-40f5-4db4-9307-2f2f5f4224d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:12.597417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ed3f5e8f-babf-4c2e-9122-e9c7c4db648b req-9f59914f-40f5-4db4-9307-2f2f5f4224d2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:12.609126 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ed3f5e8f-babf-4c2e-9122-e9c7c4db648b req-9f59914f-40f5-4db4-9307-2f2f5f4224d2 service nova] Creating event network-changed:34cdaf05-0d88-474e-8a9c-75c42dd0892c for instance a6b7e16b-66fa-4176-be45-c364b21c0e0e on n-h2-862416-2 Oct 22 03:55:12.614614 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ed3f5e8f-babf-4c2e-9122-e9c7c4db648b req-9f59914f-40f5-4db4-9307-2f2f5f4224d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049685 Oct 22 03:55:12.615427 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3475/6812] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 03:55:12.629610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:55:12.719893 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4a5d4d03-eaf4-43b9-a5ff-576e9a52ca3c tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 204 len: 0 microversion: 2.1 time: 0.157301 Oct 22 03:55:12.721684 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3338/6813] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:55:12 2022] DELETE /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 03:55:12.730147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:55:12.730791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:55:12.738050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:12.738966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:12.739675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:12.740440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:12.740932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:12.741370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:12.883221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:55:12.891310 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-16bf514d-1091-4dc9-966e-d0b3f78d7ee5 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1689 microversion: 2.1 time: 0.165516 Oct 22 03:55:12.892043 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3476/6814] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:55:12 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:55:13.915752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:55:13.916460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:55:13.923070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:13.923553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:13.924332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:13.924734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:13.925184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:13.925605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:14.130993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:55:14.140108 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e050f82-5f5c-4261-aa83-5ea04cf7431d tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1689 microversion: 2.1 time: 0.228549 Oct 22 03:55:14.140729 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3339/6815] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:55:13 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:55:14.774546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e82cea86-c922-4b46-b2bb-a8c22a856423 req-4a75ac3b-4f3c-46cf-983d-12b0e1cd457e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7e16b-66fa-4176-be45-c364b21c0e0e", "name": "network-vif-deleted", "tag": "34cdaf05-0d88-474e-8a9c-75c42dd0892c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:55:14.785994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82cea86-c922-4b46-b2bb-a8c22a856423 req-4a75ac3b-4f3c-46cf-983d-12b0e1cd457e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:14.786500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82cea86-c922-4b46-b2bb-a8c22a856423 req-4a75ac3b-4f3c-46cf-983d-12b0e1cd457e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:14.786948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e82cea86-c922-4b46-b2bb-a8c22a856423 req-4a75ac3b-4f3c-46cf-983d-12b0e1cd457e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:14.800290 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e82cea86-c922-4b46-b2bb-a8c22a856423 req-4a75ac3b-4f3c-46cf-983d-12b0e1cd457e service nova] Creating event network-vif-deleted:34cdaf05-0d88-474e-8a9c-75c42dd0892c for instance a6b7e16b-66fa-4176-be45-c364b21c0e0e on n-h2-862416-2 Oct 22 03:55:14.805189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e82cea86-c922-4b46-b2bb-a8c22a856423 req-4a75ac3b-4f3c-46cf-983d-12b0e1cd457e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034457 Oct 22 03:55:14.805793 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3477/6816] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:55:15.165470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:55:15.165999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:55:15.174313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:15.175183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:15.175674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:15.176809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:15.177268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:15.177866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:15.211558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:15.212047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:15.212687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:15.213295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lazy-loading 'fault' on Instance uuid a6b7e16b-66fa-4176-be45-c364b21c0e0e {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 03:55:15.261152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '754cd3eb62c24a1eb25a4d294a063588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73e2096501b458ca6d9f587c21c6d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:55:15.270397 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-03e4dd9c-bf82-48dc-ad11-28a8c275a082 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 200 len: 1356 microversion: 2.1 time: 0.108872 Oct 22 03:55:15.278571 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3340/6817] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:55:15 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 1356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:55:16.295087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:55:16.295832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] [instance: a6b7e16b-66fa-4176-be45-c364b21c0e0e] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:55:16.302620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:16.303126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:16.303583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:16.304326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:55:16.304798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:55:16.305247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:55:16.319200 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] HTTP exception thrown: Instance a6b7e16b-66fa-4176-be45-c364b21c0e0e could not be found. Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Request method failure captured: Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e HTTP/1.1 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2cuhsqeIjxZRi8SYlVM2YAHKWF908XmT0FuqmGR_L4W9OH0DVS6J-6-4DQBAHeUYH9qZx6kksVB3TAAqd1NlyYBvJLfYErPtU6joZfwY40hpzy6-8IeuUE7fYhuFP1m381kmKeryIRqkoJQK11VP6EdDXSGvwQC-0XfXiowIBCbCvU Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: f73e2096501b458ca6d9f587c21c6d23 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f73e2096501b458ca6d9f587c21c6d23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f73e2096501b458ca6d9f587c21c6d23"}]}] Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: f73e2096501b458ca6d9f587c21c6d23 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1799870770 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestNetworkAdvancedServerOps-1799870770-project Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 754cd3eb62c24a1eb25a4d294a063588 Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1799870770-project Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance a6b7e16b-66fa-4176-be45-c364b21c0e0e could not be found. Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'a6b7e16b-66fa-4176-be45-c364b21c0e0e'} Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b7e16b-66fa-4176-be45-c364b21c0e0e could not be found. Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b7e16b-66fa-4176-be45-c364b21c0e0e could not be found. Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:55:16.320861 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b7e16b-66fa-4176-be45-c364b21c0e0e could not be found. Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Returning 404 to user: Instance a6b7e16b-66fa-4176-be45-c364b21c0e0e could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23c75f40-c311-4b94-bbdb-69e614788e63 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e" status: 404 len: 111 microversion: 2.1 time: 0.032323 Oct 22 03:55:16.325369 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3478/6818] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:55:16 2022] GET /compute/v2.1/servers/a6b7e16b-66fa-4176-be45-c364b21c0e0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:55:20.031285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8d1c15a8-7591-4a22-b858-a4574671b011 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] Calling method '.version_select at 0x7f0d1a462550>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:55:20.056674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8d1c15a8-7591-4a22-b858-a4574671b011 tempest-TestNetworkAdvancedServerOps-1799870770 tempest-TestNetworkAdvancedServerOps-1799870770-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-801545323" status: 202 len: 0 microversion: 2.1 time: 0.030568 Oct 22 03:55:20.057751 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3341/6819] 10.222.0.25 () {58 vars in 1281 bytes} [Sat Oct 22 03:55:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-801545323 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 03:56:28.185294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:28.186066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:28.364110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:28.364678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:28.370684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:28.371199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:28.371630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:28.372383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:28.372850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:28.373290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:28.399767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 03:56:28.479594 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18ade6c6-c25d-44d2-b0eb-29fd8e75058b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 204 len: 0 microversion: 2.1 time: 0.296149 Oct 22 03:56:28.480220 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3479/6820] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 03:56:28 2022] DELETE /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 03:56:28.487025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:28.488717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:28.493647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:28.494262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:28.503572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:28.504895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:28.505604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:28.506306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:28.506762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:28.507188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:28.637352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:28.645279 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46559bf3-48a4-449d-95fe-ba852a918474 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1578 microversion: 2.1 time: 0.160776 Oct 22 03:56:28.645844 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3342/6821] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:28 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:29.669918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:29.670563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:29.677703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:29.678205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:29.678661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:29.679371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:29.679844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:29.680317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:29.818532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:29.826682 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19942100-a377-436e-865f-4767917d7dc3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1578 microversion: 2.1 time: 0.161193 Oct 22 03:56:29.827320 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3480/6822] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:29 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:56:30.852359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:30.854712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:30.861946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:30.862452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:30.862922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:30.864252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:30.864697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:30.865126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:30.960594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:30.968340 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68b2b55b-e74d-41da-9f74-beab47739ca3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1511 microversion: 2.1 time: 0.121575 Oct 22 03:56:30.968922 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3343/6823] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:30 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1511 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:31.187320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d59b8fa6-561c-46b1-95ff-47ccf7f2b2cd req-6b90f95e-b7ac-4e9e-90ad-654c2ee78314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a", "name": "network-vif-deleted", "tag": "d9d8e3c1-a866-4fb0-8f78-018d151a8e0c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:56:31.201920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d59b8fa6-561c-46b1-95ff-47ccf7f2b2cd req-6b90f95e-b7ac-4e9e-90ad-654c2ee78314 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:31.202410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d59b8fa6-561c-46b1-95ff-47ccf7f2b2cd req-6b90f95e-b7ac-4e9e-90ad-654c2ee78314 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:31.203252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d59b8fa6-561c-46b1-95ff-47ccf7f2b2cd req-6b90f95e-b7ac-4e9e-90ad-654c2ee78314 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:31.218461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d59b8fa6-561c-46b1-95ff-47ccf7f2b2cd req-6b90f95e-b7ac-4e9e-90ad-654c2ee78314 service nova] Creating event network-vif-deleted:d9d8e3c1-a866-4fb0-8f78-018d151a8e0c for instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a on n-h1-862416-2 Oct 22 03:56:31.223872 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d59b8fa6-561c-46b1-95ff-47ccf7f2b2cd req-6b90f95e-b7ac-4e9e-90ad-654c2ee78314 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041179 Oct 22 03:56:31.224844 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3481/6824] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:56:31.993528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:31.994181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:32.001524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:32.002017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:32.002471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:32.003203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:32.003707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:32.004143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:32.077814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:32.086226 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-29e8679a-437f-4feb-bc93-953f231d7542 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1226 microversion: 2.1 time: 0.096641 Oct 22 03:56:32.086831 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3344/6825] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:31 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:33.110852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:33.111561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:33.119430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:33.119924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:33.120409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:33.121114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:33.121581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:33.122021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:33.188011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:33.196077 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5a5e4eb0-c4fd-48cd-b2c5-372bf8646a8a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1226 microversion: 2.1 time: 0.089566 Oct 22 03:56:33.196707 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3482/6826] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:33 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:34.218977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:34.219754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:34.227159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:34.227640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:34.228070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:34.228795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:34.229242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:34.229662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:34.296259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:34.304850 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-073b70b6-5430-4263-b0e7-08cd33c2b54c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1226 microversion: 2.1 time: 0.089754 Oct 22 03:56:34.305432 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3345/6827] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:34 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:56:35.329729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:35.330371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:35.338019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:35.338537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:35.339000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:35.339747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:35.340280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:35.340733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:35.408432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:35.417223 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-77834003-d22a-456a-9113-340c82c748c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 200 len: 1226 microversion: 2.1 time: 0.092761 Oct 22 03:56:35.417809 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3483/6828] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:35 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:36.441448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:36.442049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:36.448955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:36.449441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:36.449877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:36.450578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:36.451031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:36.451460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:36.467727 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a HTTP/1.1 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a'} Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 03:56:36.469429 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-70590644-12ed-4b70-af04-d415f1759ac5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 404 len: 111 microversion: 2.1 time: 0.033341 Oct 22 03:56:36.473936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3346/6829] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:36 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 03:56:36.520577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1951359317", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1847453664", "security_groups": [{"name": "tempest-secgroup-smoke-620824907"}], "block_device_mapping_v2": [{"uuid": "06847162-e8bc-4548-bf4f-e4de68d7e214", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7175b844-9cdb-45d6-b4f9-304c2c700bec"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:56:36.754329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] validate_networks() for [('7175b844-9cdb-45d6-b4f9-304c2c700bec', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:56:37.204873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:56:37.205322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:56:37.205824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:56:37.206254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:56:37.206688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:56:37.216242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:37.216686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:37.217140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:37.217886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:37.218360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:37.218807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:37.235603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:56:37.240929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:56:37.299615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:56:37.301683 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06847162-e8bc-4548-bf4f-e4de68d7e214',volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:56:37.431992 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [97bf58a7-6c22-4a79-82b9-d585dab6ab0d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 03:56:38.438665 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [97bf58a7-6c22-4a79-82b9-d585dab6ab0d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33030. Oct 22 03:56:38.443037 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34bbc7c3-795a-4298-83d5-f5322809ad2e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.926862 Oct 22 03:56:38.443889 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3484/6830] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:56:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:56:38.454947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fff88117-57b7-4be4-a4c3-fb8ddd22a432 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:38.455567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fff88117-57b7-4be4-a4c3-fb8ddd22a432 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:38.572641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fff88117-57b7-4be4-a4c3-fb8ddd22a432 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:38.580579 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fff88117-57b7-4be4-a4c3-fb8ddd22a432 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1095 microversion: 2.1 time: 0.129583 Oct 22 03:56:38.581175 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3347/6831] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:38 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1095 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:39.604603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:39.605233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:39.611614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:39.612120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:39.612611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:39.613517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:39.614604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:39.615056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:39.685239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:39.694806 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba7d3273-fe67-4bc5-96e9-28a5b56ba4dd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1211 microversion: 2.1 time: 0.095221 Oct 22 03:56:39.695660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3485/6832] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:39 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:40.719751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:40.720740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:40.727699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:40.728994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:40.729499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:40.730309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:40.730935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:40.731364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:40.978380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:40.987335 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-318bdfd0-a5f6-4429-9092-606fc197e81c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1278 microversion: 2.1 time: 0.271946 Oct 22 03:56:40.987926 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3348/6833] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:40 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:41.215262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-139337b3-cdee-4599-921e-d5be6c4485b2 req-eda54c12-d40b-4bdd-8cef-af4aa1a42ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa99b1e8-195f-417f-a412-bc59244f760d", "tag": "56a4159b-aeab-47b9-bec9-42e47791b7ff"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:56:41.231908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-139337b3-cdee-4599-921e-d5be6c4485b2 req-eda54c12-d40b-4bdd-8cef-af4aa1a42ab3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:41.233021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-139337b3-cdee-4599-921e-d5be6c4485b2 req-eda54c12-d40b-4bdd-8cef-af4aa1a42ab3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:41.233481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-139337b3-cdee-4599-921e-d5be6c4485b2 req-eda54c12-d40b-4bdd-8cef-af4aa1a42ab3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:41.250206 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-139337b3-cdee-4599-921e-d5be6c4485b2 req-eda54c12-d40b-4bdd-8cef-af4aa1a42ab3 service nova] Creating event network-changed:56a4159b-aeab-47b9-bec9-42e47791b7ff for instance aa99b1e8-195f-417f-a412-bc59244f760d on n-h2-862416-2 Oct 22 03:56:41.256717 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-139337b3-cdee-4599-921e-d5be6c4485b2 req-eda54c12-d40b-4bdd-8cef-af4aa1a42ab3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125083 Oct 22 03:56:41.257683 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3486/6834] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:56:42.011539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:42.012158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:42.020457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:42.021205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:42.021648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:42.022374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:42.022835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:42.023452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:42.182216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:42.190201 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f50fd3f4-e0ee-455b-b56d-f13378d44711 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1278 microversion: 2.1 time: 0.182671 Oct 22 03:56:42.190785 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3349/6835] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:42 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:43.214894 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:43.215611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:43.222735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:43.223317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:43.223970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:43.225011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:43.225490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:43.225936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:43.361341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:43.370422 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9399ba1-ba41-4086-a0b2-83d8513310d1 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1278 microversion: 2.1 time: 0.159811 Oct 22 03:56:43.371011 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3487/6836] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:43 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:44.394436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:44.396049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:44.403573 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:44.404059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:44.404521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:44.405223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:44.405674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:44.406100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:44.567925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:44.576145 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c52867cd-0c6a-413c-bd1e-487778fad3e5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1278 microversion: 2.1 time: 0.185618 Oct 22 03:56:44.576768 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3350/6837] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:44 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:45.600799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:45.601337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:45.608254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:45.608755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:45.609207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:45.609909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:45.610377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:45.610812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:45.751097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:45.761564 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0708a919-47cb-4239-bbfc-78e13fe0fc21 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.164770 Oct 22 03:56:45.762146 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3488/6838] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:45 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:46.784819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:46.785362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:46.792945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:46.793431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:46.793864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:46.794554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:46.795006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:46.795432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:46.925678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:46.933546 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8cbc9e8f-d907-497c-922f-a3e94ec6341c tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.152729 Oct 22 03:56:46.934120 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3351/6839] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:46 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:47.956615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:47.957250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:47.960801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:47.961520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:47.968101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:47.968630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:47.969084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:47.969795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:47.970265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:47.970707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:48.105367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:48.113082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e61a97bb-d038-4031-89ad-d8fb526a282f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.160537 Oct 22 03:56:48.113666 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3489/6840] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:47 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:49.136746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:49.137363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:49.139696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:49.145826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:49.146316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:49.146775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:49.147478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:49.147934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:49.148403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:49.283948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:49.292609 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a2614d75-3626-4db6-bc69-9279a23d08b2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.159954 Oct 22 03:56:49.293179 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3352/6841] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:49 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:50.316175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:50.316835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:50.323714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:50.324215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:50.324684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:50.325390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:50.325851 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:50.326288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:50.460789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:50.468438 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-347ad690-8b82-47da-b0fa-f7aeea604854 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.156203 Oct 22 03:56:50.469012 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3490/6842] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:50 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 03:56:51.491989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:51.492638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:51.499440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:51.499921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:51.500392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:51.501087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:51.501542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:51.501966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:51.634291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:51.641988 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3039490c-c7b0-4d90-953c-39b62a326cfd tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.154894 Oct 22 03:56:51.642576 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3353/6843] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:51 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:52.665054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:52.665794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:52.673517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:52.674019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:52.674477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:52.675191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:52.675666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:52.676120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:52.810184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:52.817949 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-83cf1fd0-2526-4a9d-bb6c-749f025baf3f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.157170 Oct 22 03:56:52.818533 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3491/6844] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:52 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:53.840408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:53.841042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:53.844156 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:56:53.844326 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 03:56:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d (ip 10.222.0.25) !!! Oct 22 03:56:53.856956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:53.857444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:53.857879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:53.858643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:53.859120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:53.859519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:54.002088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:54.010965 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-06789c46-c243-42f1-852a-0adaf37a7f53 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.174528 Oct 22 03:56:54.011547 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3354/6845] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:53 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:55.033414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:55.034043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:55.041490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:55.041993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:55.042447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:55.043191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:55.043664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:55.044110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:55.180676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:55.188485 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-983f278d-4b87-408c-bdd6-6a83de4719ac tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.159021 Oct 22 03:56:55.189095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3492/6846] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:55 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:55.968020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-aedb697a-1a38-4c1d-b56a-f9aa705d70e5 req-a0db2330-db0f-443e-8734-b49dd40456ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa99b1e8-195f-417f-a412-bc59244f760d", "name": "network-vif-plugged", "status": "completed", "tag": "56a4159b-aeab-47b9-bec9-42e47791b7ff"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:56:55.979094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aedb697a-1a38-4c1d-b56a-f9aa705d70e5 req-a0db2330-db0f-443e-8734-b49dd40456ff service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:55.980183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aedb697a-1a38-4c1d-b56a-f9aa705d70e5 req-a0db2330-db0f-443e-8734-b49dd40456ff service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:55.980684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-aedb697a-1a38-4c1d-b56a-f9aa705d70e5 req-a0db2330-db0f-443e-8734-b49dd40456ff service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:55.991919 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-aedb697a-1a38-4c1d-b56a-f9aa705d70e5 req-a0db2330-db0f-443e-8734-b49dd40456ff service nova] Creating event network-vif-plugged:56a4159b-aeab-47b9-bec9-42e47791b7ff for instance aa99b1e8-195f-417f-a412-bc59244f760d on n-h2-862416-2 Oct 22 03:56:55.996916 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-aedb697a-1a38-4c1d-b56a-f9aa705d70e5 req-a0db2330-db0f-443e-8734-b49dd40456ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032688 Oct 22 03:56:55.997504 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3355/6847] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:56:56.212045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:56.212701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:56.219413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:56.219903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:56.220385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:56.221082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:56.221548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:56.221989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:56.352408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:56.360176 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a95cd12-f843-4faa-b0b4-e05ab969a30f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.153148 Oct 22 03:56:56.360729 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3493/6848] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:56 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:57.384094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:57.384844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:57.391766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:57.392277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:57.392720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:57.393412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:57.393868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:57.394291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:57.530214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:57.538761 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e1a5c73-220b-4e32-a275-024cf8368654 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1266 microversion: 2.1 time: 0.159185 Oct 22 03:56:57.539330 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3356/6849] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:57 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:58.562209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:58.562864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:58.565742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:58.571984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:58.572496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:58.572979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:58.573691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:58.574159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:58.574598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:58.579134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:58.710607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:58.718355 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0bcae5a5-4c1d-490f-9235-547160d09634 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1452 microversion: 2.1 time: 0.160152 Oct 22 03:56:58.718930 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3494/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:58 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:56:58.741604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:56:58.742146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:56:58.744888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=33 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:58.750181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:58.750655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:58.751084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:58.751764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:56:58.752236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:56:58.752659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:56:58.757977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=77 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:56:59.183693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:56:59.191422 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-29c987da-6c14-43b2-a682-4a29cb1c0b09 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1452 microversion: 2.1 time: 0.454568 Oct 22 03:56:59.191992 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3357/6851] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:56:58 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1452 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:57:00.873373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c11fa99a-7671-4098-82c2-1a421cf64c6e req-e1bcb53c-3316-49ec-8817-68d41a60d7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa99b1e8-195f-417f-a412-bc59244f760d", "tag": "56a4159b-aeab-47b9-bec9-42e47791b7ff"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:57:00.885144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c11fa99a-7671-4098-82c2-1a421cf64c6e req-e1bcb53c-3316-49ec-8817-68d41a60d7bb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:57:00.885635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c11fa99a-7671-4098-82c2-1a421cf64c6e req-e1bcb53c-3316-49ec-8817-68d41a60d7bb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:57:00.886085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c11fa99a-7671-4098-82c2-1a421cf64c6e req-e1bcb53c-3316-49ec-8817-68d41a60d7bb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:57:00.897568 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c11fa99a-7671-4098-82c2-1a421cf64c6e req-e1bcb53c-3316-49ec-8817-68d41a60d7bb service nova] Creating event network-changed:56a4159b-aeab-47b9-bec9-42e47791b7ff for instance aa99b1e8-195f-417f-a412-bc59244f760d on n-h2-862416-2 Oct 22 03:57:00.902601 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c11fa99a-7671-4098-82c2-1a421cf64c6e req-e1bcb53c-3316-49ec-8817-68d41a60d7bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033273 Oct 22 03:57:00.903235 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3495/6852] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:58:43.670525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:58:43.671410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:58:43.672655 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:58:43.672912 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 03:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 22 03:58:43.685540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1365216759", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1847453664", "security_groups": [{"name": "tempest-secgroup-smoke-620824907"}], "block_device_mapping_v2": [{"uuid": "5ea313ec-3dcc-4bf5-b86f-6c0630aee66f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7175b844-9cdb-45d6-b4f9-304c2c700bec"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:58:43.799404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] validate_networks() for [('7175b844-9cdb-45d6-b4f9-304c2c700bec', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 03:58:44.224144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 03:58:44.224605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 03:58:44.225084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 03:58:44.225494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 03:58:44.225909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 03:58:44.234597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:44.235077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:44.235514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:44.236268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:44.236969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:44.237402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:44.253986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 03:58:44.259408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Getting quotas for user 51f67baebcf6426f86837b4f504955b9 and project 0e58348ceac746268bc3b5e7f189f415. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 03:58:44.317926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 03:58:44.320073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ea313ec-3dcc-4bf5-b86f-6c0630aee66f',volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 03:58:44.449164 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa95628b-c49b-4b81-98f7-875bbfd750c8 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.780338 Oct 22 03:58:44.449990 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3358/6853] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 03:58:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 03:58:44.460327 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [487d215f-f51f-4b17-90c4-baae2d45644a] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 22 03:58:44.460949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:58:44.461699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=7 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:58:44.462524 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 03:58:44.462699 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 03:58:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b (ip 10.222.0.25) !!! Oct 22 03:58:44.469261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f7e4dde2-0025-4e88-96d7-314690c09679 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:44.469993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7e4dde2-0025-4e88-96d7-314690c09679 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:44.537885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f7e4dde2-0025-4e88-96d7-314690c09679 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:44.545640 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f7e4dde2-0025-4e88-96d7-314690c09679 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1095 microversion: 2.1 time: 0.087888 Oct 22 03:58:44.546211 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3496/6854] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:44 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:45.570942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3cfb1caa-4beb-4655-8e4c-fd783ea33f86 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:45.571555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3cfb1caa-4beb-4655-8e4c-fd783ea33f86 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:45.625173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3cfb1caa-4beb-4655-8e4c-fd783ea33f86 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:45.632160 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3cfb1caa-4beb-4655-8e4c-fd783ea33f86 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1095 microversion: 2.1 time: 0.066240 Oct 22 03:58:45.636642 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3359/6855] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:45 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:46.657349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-354125b9-e4ec-4f91-a30c-901d6cb0d717 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:46.657980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-354125b9-e4ec-4f91-a30c-901d6cb0d717 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:46.672755 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] [487d215f-f51f-4b17-90c4-baae2d45644a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33200. Oct 22 03:58:46.718660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-354125b9-e4ec-4f91-a30c-901d6cb0d717 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:46.726358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-354125b9-e4ec-4f91-a30c-901d6cb0d717 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1095 microversion: 2.1 time: 0.072916 Oct 22 03:58:46.726885 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3497/6856] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:46 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:47.752917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:47.753538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:47.761904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:47.762409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:47.762843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:47.763563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:47.764476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:47.764913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:48.073990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:48.082915 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cad703e6-f75d-4e79-8291-58da812000f4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1211 microversion: 2.1 time: 0.335678 Oct 22 03:58:48.083660 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3360/6857] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:47 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1211 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:49.107239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:49.107961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:49.116022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:49.116909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:49.117480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:49.118282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:49.118836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:49.119353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:49.270385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:49.280503 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-336a869d-61ed-49c3-9c2a-9e2de79294ce tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1278 microversion: 2.1 time: 0.178252 Oct 22 03:58:49.281621 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3498/6858] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:49 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:49.458173 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-dedbda7c-6773-43df-91a1-61cdb96638d6 req-17591ea6-6209-42e3-abcf-cef2d67dd4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb6a629-93a1-4772-b4da-b15aae69a91b", "tag": "33815f24-4bcd-4cf6-ba9a-29e65e0229d2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:58:49.469296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dedbda7c-6773-43df-91a1-61cdb96638d6 req-17591ea6-6209-42e3-abcf-cef2d67dd4f7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:49.470045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dedbda7c-6773-43df-91a1-61cdb96638d6 req-17591ea6-6209-42e3-abcf-cef2d67dd4f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:49.470622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-dedbda7c-6773-43df-91a1-61cdb96638d6 req-17591ea6-6209-42e3-abcf-cef2d67dd4f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:49.487767 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-dedbda7c-6773-43df-91a1-61cdb96638d6 req-17591ea6-6209-42e3-abcf-cef2d67dd4f7 service nova] Creating event network-changed:33815f24-4bcd-4cf6-ba9a-29e65e0229d2 for instance 9eb6a629-93a1-4772-b4da-b15aae69a91b on n-h1-862416-2 Oct 22 03:58:49.494220 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-dedbda7c-6773-43df-91a1-61cdb96638d6 req-17591ea6-6209-42e3-abcf-cef2d67dd4f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040551 Oct 22 03:58:49.494838 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3361/6859] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:58:50.304745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:50.305992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:50.313211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:50.313712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:50.314165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:50.314914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:50.315361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:50.315992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:50.473721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:50.481819 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19fc9883-e86b-4c81-8603-c141bf553a6e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1278 microversion: 2.1 time: 0.181168 Oct 22 03:58:50.482434 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3499/6860] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:50 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:51.506069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:51.506773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:51.514158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:51.514642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:51.515080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:51.515786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:51.516388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:51.516824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:51.659383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:51.667764 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dabf725a-4513-4e1e-946b-1b5bbe058976 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1278 microversion: 2.1 time: 0.165891 Oct 22 03:58:51.668383 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3362/6861] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:51 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:52.691204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:52.691919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:52.698755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:52.699257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:52.699709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:52.700516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:52.700994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:52.701432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:52.838395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:52.846652 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-83c54b7e-92e3-4b35-bd8c-d001c630a00f tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1278 microversion: 2.1 time: 0.159833 Oct 22 03:58:52.847248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3500/6862] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:52 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:53.870039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:53.870652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:53.877978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:53.878460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:53.878895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:53.879584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:53.880031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:53.880485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:54.012779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:54.020992 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ff0af72-bb59-47a5-9050-4025b03e90d2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.154816 Oct 22 03:58:54.021565 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3363/6863] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:53 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:55.045237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:55.045870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:55.052842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:55.053340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:55.053795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:55.054500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:55.054972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:55.055412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:55.187910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:55.197048 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3273cf61-0d5c-474d-b662-9c815d4d0524 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.155818 Oct 22 03:58:55.197734 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3501/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:55 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:56.221524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:56.222781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:56.224817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:58:56.226420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=8 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:58:56.232170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:56.232681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:56.233265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:56.234232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:56.234820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:56.235264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:56.379831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:56.388323 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad007c97-b79d-4ba8-b5d9-e11e55cf7da2 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.171212 Oct 22 03:58:56.388938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3364/6865] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:56 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:57.414485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:57.415114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:57.417817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 03:58:57.423343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:57.423841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:57.424322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:57.425723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:57.426309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:57.426755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:57.563883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:57.572126 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fff1c7bd-e48f-4d9e-973b-81fb5b17919b tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.161614 Oct 22 03:58:57.572750 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3502/6866] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:57 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:58.594995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:58.595710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:58.602810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:58.603298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:58.603746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:58.604481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:58.604944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:58.605372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:58.734219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:58.742514 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8acb6317-4e15-4320-a58f-3496fa4e5c0a tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.151520 Oct 22 03:58:58.743099 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3365/6867] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:58 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:58:59.766377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:58:59.767003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:58:59.774839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:59.775335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:59.775790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:59.776532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:58:59.777004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:58:59.777447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:58:59.909976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:58:59.917769 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9593cc52-73ae-4e8f-8d45-5b32f6aa65fc tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.155439 Oct 22 03:58:59.918349 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3503/6868] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:58:59 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:59:00.940099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:59:00.941908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:59:00.948829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:00.949333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:00.949766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:00.950446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:00.950895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:00.951312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:01.086769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:59:01.094384 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-69c020ee-6ec9-4726-8a78-61ab2f4125df tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.158230 Oct 22 03:59:01.094957 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3366/6869] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:59:00 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:59:02.118957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:59:02.119579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:59:02.131101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:02.131610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:02.132063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:02.133118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:02.133848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:02.134301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:02.282141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:59:02.290587 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d515882-90d7-4d7e-a79d-38a4174019d9 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.175852 Oct 22 03:59:02.291178 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3504/6870] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:59:02 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:59:03.313734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:59:03.314337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:59:03.321219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:03.321713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:03.322130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:03.322824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:03.323274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:03.323696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:03.457318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:59:03.464931 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e79bcdc0-fe67-43bf-b659-a03c4d14d5c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.155087 Oct 22 03:59:03.465508 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3367/6871] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:59:03 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:59:04.161477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b206b0ce-287b-49e9-98db-91bb571e6fbe req-30120f20-fee7-4c54-8279-b1a1800ff147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb6a629-93a1-4772-b4da-b15aae69a91b", "name": "network-vif-plugged", "status": "completed", "tag": "33815f24-4bcd-4cf6-ba9a-29e65e0229d2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:59:04.171036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b206b0ce-287b-49e9-98db-91bb571e6fbe req-30120f20-fee7-4c54-8279-b1a1800ff147 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:04.171528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b206b0ce-287b-49e9-98db-91bb571e6fbe req-30120f20-fee7-4c54-8279-b1a1800ff147 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:04.171979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b206b0ce-287b-49e9-98db-91bb571e6fbe req-30120f20-fee7-4c54-8279-b1a1800ff147 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:04.183067 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b206b0ce-287b-49e9-98db-91bb571e6fbe req-30120f20-fee7-4c54-8279-b1a1800ff147 service nova] Creating event network-vif-plugged:33815f24-4bcd-4cf6-ba9a-29e65e0229d2 for instance 9eb6a629-93a1-4772-b4da-b15aae69a91b on n-h1-862416-2 Oct 22 03:59:04.188505 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b206b0ce-287b-49e9-98db-91bb571e6fbe req-30120f20-fee7-4c54-8279-b1a1800ff147 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097230 Oct 22 03:59:04.189031 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3505/6872] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 03:59:04.488765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:59:04.489375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:59:04.496111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:04.496631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:04.497070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:04.497763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:04.498239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:04.498672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:04.631650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:59:04.639547 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-091a8174-afd1-44c5-98bb-d05fd68de7f0 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1266 microversion: 2.1 time: 0.155273 Oct 22 03:59:04.640119 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3368/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:59:04 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:59:05.662578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:59:05.663240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:59:05.670415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:05.670908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:05.671355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:05.672053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:05.672545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:05.672982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:05.804241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:59:05.811943 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-57de3523-2bfe-4364-811f-1aa4dcb52a62 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1452 microversion: 2.1 time: 0.153855 Oct 22 03:59:05.812543 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3506/6874] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:59:05 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:59:05.835811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 03:59:05.836458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 03:59:05.843538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:05.844019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:05.844483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:05.845176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:05.845631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:05.846059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:05.976161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 03:59:05.983963 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-479a80f5-b7eb-4cea-821c-940c86bdcf45 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1452 microversion: 2.1 time: 0.152796 Oct 22 03:59:05.984596 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3369/6875] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 03:59:05 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 03:59:07.587889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b7a37b16-21e2-4b3d-92a4-d9fdaca143ca req-9cba41b2-678e-4974-b718-ebcac72567eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb6a629-93a1-4772-b4da-b15aae69a91b", "tag": "33815f24-4bcd-4cf6-ba9a-29e65e0229d2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 03:59:07.598410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7a37b16-21e2-4b3d-92a4-d9fdaca143ca req-9cba41b2-678e-4974-b718-ebcac72567eb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 03:59:07.598912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7a37b16-21e2-4b3d-92a4-d9fdaca143ca req-9cba41b2-678e-4974-b718-ebcac72567eb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 03:59:07.599358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b7a37b16-21e2-4b3d-92a4-d9fdaca143ca req-9cba41b2-678e-4974-b718-ebcac72567eb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 03:59:07.614784 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b7a37b16-21e2-4b3d-92a4-d9fdaca143ca req-9cba41b2-678e-4974-b718-ebcac72567eb service nova] Creating event network-changed:33815f24-4bcd-4cf6-ba9a-29e65e0229d2 for instance 9eb6a629-93a1-4772-b4da-b15aae69a91b on n-h1-862416-2 Oct 22 03:59:07.619881 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b7a37b16-21e2-4b3d-92a4-d9fdaca143ca req-9cba41b2-678e-4974-b718-ebcac72567eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035759 Oct 22 03:59:07.620552 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3507/6876] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 03:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:00:36.053516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:00:36.054931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=58 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:00:36.058645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=28 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:00:36.059751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=52 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:00:36.061188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:36.061690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:36.071138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:36.072488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:36.072937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:36.073671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:36.074133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:36.074568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:36.102137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:00:36.144432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b470848d-bbe2-414c-a87b-bbba4cdac785 req-f8baa429-0d4b-4a9d-afd8-a9f05ed2bfdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb6a629-93a1-4772-b4da-b15aae69a91b", "tag": "33815f24-4bcd-4cf6-ba9a-29e65e0229d2"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:00:36.155205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b470848d-bbe2-414c-a87b-bbba4cdac785 req-f8baa429-0d4b-4a9d-afd8-a9f05ed2bfdc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:36.155773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b470848d-bbe2-414c-a87b-bbba4cdac785 req-f8baa429-0d4b-4a9d-afd8-a9f05ed2bfdc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:36.156263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b470848d-bbe2-414c-a87b-bbba4cdac785 req-f8baa429-0d4b-4a9d-afd8-a9f05ed2bfdc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:36.168973 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b470848d-bbe2-414c-a87b-bbba4cdac785 req-f8baa429-0d4b-4a9d-afd8-a9f05ed2bfdc service nova] Creating event network-changed:33815f24-4bcd-4cf6-ba9a-29e65e0229d2 for instance 9eb6a629-93a1-4772-b4da-b15aae69a91b on n-h1-862416-2 Oct 22 04:00:36.173943 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b470848d-bbe2-414c-a87b-bbba4cdac785 req-f8baa429-0d4b-4a9d-afd8-a9f05ed2bfdc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118701 Oct 22 04:00:36.175146 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3508/6877] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:00:36.192635 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-753229a6-6789-4a65-965b-3a2a6890a6c4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 204 len: 0 microversion: 2.1 time: 0.141034 Oct 22 04:00:36.193836 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3370/6878] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:00:36 2022] DELETE /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:00:36.202753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:36.203753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:36.211080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:36.211656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:36.212175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:36.213040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:36.213573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:36.214100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:36.354652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:36.362529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30a6485e-a170-424a-8762-fad667be9ecf tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1576 microversion: 2.1 time: 0.164269 Oct 22 04:00:36.363307 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3509/6879] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:36 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:00:37.385974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:37.386553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:37.394257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:37.394749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:37.395723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:37.396436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:37.396895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:37.397331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:37.609852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:37.617986 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d202ddfa-8d06-4acd-8f06-abedd2e953ae tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1576 microversion: 2.1 time: 0.236652 Oct 22 04:00:37.618567 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3371/6880] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:37 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:38.643192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:38.643816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:38.651450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:38.651973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:38.652529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:38.653298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:38.653947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:38.654391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:38.798468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:38.811636 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4d5886c-c3f6-475b-8bae-9217fa8d93be tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1458 microversion: 2.1 time: 0.172362 Oct 22 04:00:38.812236 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3510/6881] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:38 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1458 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:38.856038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-ed73864d-f0e3-43dd-842a-5f5f5bf7f60c req-033ac80f-9bec-4cc4-9f84-ac8a68e589cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb6a629-93a1-4772-b4da-b15aae69a91b", "name": "network-vif-deleted", "tag": "33815f24-4bcd-4cf6-ba9a-29e65e0229d2"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:00:38.871080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ed73864d-f0e3-43dd-842a-5f5f5bf7f60c req-033ac80f-9bec-4cc4-9f84-ac8a68e589cd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:38.871564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ed73864d-f0e3-43dd-842a-5f5f5bf7f60c req-033ac80f-9bec-4cc4-9f84-ac8a68e589cd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:38.871989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-ed73864d-f0e3-43dd-842a-5f5f5bf7f60c req-033ac80f-9bec-4cc4-9f84-ac8a68e589cd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:38.886046 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-ed73864d-f0e3-43dd-842a-5f5f5bf7f60c req-033ac80f-9bec-4cc4-9f84-ac8a68e589cd service nova] Creating event network-vif-deleted:33815f24-4bcd-4cf6-ba9a-29e65e0229d2 for instance 9eb6a629-93a1-4772-b4da-b15aae69a91b on n-h1-862416-2 Oct 22 04:00:38.891747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-ed73864d-f0e3-43dd-842a-5f5f5bf7f60c req-033ac80f-9bec-4cc4-9f84-ac8a68e589cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039509 Oct 22 04:00:38.892365 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3372/6882] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:00:39.838455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:39.839109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:39.845310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:39.845808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:39.846267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:39.846977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:39.847486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:39.847920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:39.910775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:39.919326 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87bf4c04-e246-47b4-b994-5ac48b55f7de tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1226 microversion: 2.1 time: 0.086394 Oct 22 04:00:39.919916 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3511/6883] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:39 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:40.944074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:40.944813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:40.951394 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:40.951871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:40.952340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:40.953036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:40.953481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:40.953900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:41.016612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:41.025300 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f8d5ecd8-6ba6-4133-b40b-67d205fc0ba4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1226 microversion: 2.1 time: 0.086083 Oct 22 04:00:41.026006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3373/6884] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:40 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:42.049033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:42.049621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:42.057836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:42.058411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:42.058901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:42.059639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:42.060117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:42.060602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:42.126537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:42.135270 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b6bf1d87-6f54-4a03-a638-418b373062d4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1226 microversion: 2.1 time: 0.090204 Oct 22 04:00:42.135873 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3512/6885] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:42 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:43.158641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:43.159256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:43.166637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:43.167018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:43.167459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:43.168174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:43.168663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:43.169128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:43.208355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:43.209205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:43.209658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:43.210122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lazy-loading 'fault' on Instance uuid 9eb6a629-93a1-4772-b4da-b15aae69a91b {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:00:43.252796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:43.261816 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e6a0a16-170b-4521-b940-cbd23666f9b6 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 200 len: 1231 microversion: 2.1 time: 0.106879 Oct 22 04:00:43.262424 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3374/6886] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:43 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:44.286758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:44.287390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 9eb6a629-93a1-4772-b4da-b15aae69a91b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:44.294945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:44.295446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:44.295898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:44.296651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:44.297123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:44.297567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:44.311569 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 9eb6a629-93a1-4772-b4da-b15aae69a91b could not be found. Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b HTTP/1.1 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 9eb6a629-93a1-4772-b4da-b15aae69a91b could not be found. Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '9eb6a629-93a1-4772-b4da-b15aae69a91b'} Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb6a629-93a1-4772-b4da-b15aae69a91b could not be found. Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb6a629-93a1-4772-b4da-b15aae69a91b could not be found. Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:00:44.313261 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb6a629-93a1-4772-b4da-b15aae69a91b could not be found. Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 9eb6a629-93a1-4772-b4da-b15aae69a91b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2c2f00df-d4fc-4bbe-bfc6-111fb4bc4a7e tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b" status: 404 len: 111 microversion: 2.1 time: 0.031978 Oct 22 04:00:44.317965 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3513/6887] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:44 2022] GET /compute/v2.1/servers/9eb6a629-93a1-4772-b4da-b15aae69a91b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:00:50.549379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:50.550191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:50.551410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f57a2991-5d6c-4b17-83c8-dfd5acb01981 req-8aa302c8-8ff2-4989-82f6-e24f23e5d107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa99b1e8-195f-417f-a412-bc59244f760d", "tag": "56a4159b-aeab-47b9-bec9-42e47791b7ff"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:00:50.557422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:50.558029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:50.558563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:50.560153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:50.560726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:50.561453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:50.562555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f57a2991-5d6c-4b17-83c8-dfd5acb01981 req-8aa302c8-8ff2-4989-82f6-e24f23e5d107 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:50.563254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f57a2991-5d6c-4b17-83c8-dfd5acb01981 req-8aa302c8-8ff2-4989-82f6-e24f23e5d107 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:50.563875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f57a2991-5d6c-4b17-83c8-dfd5acb01981 req-8aa302c8-8ff2-4989-82f6-e24f23e5d107 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:50.576129 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f57a2991-5d6c-4b17-83c8-dfd5acb01981 req-8aa302c8-8ff2-4989-82f6-e24f23e5d107 service nova] Creating event network-changed:56a4159b-aeab-47b9-bec9-42e47791b7ff for instance aa99b1e8-195f-417f-a412-bc59244f760d on n-h2-862416-2 Oct 22 04:00:50.581496 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f57a2991-5d6c-4b17-83c8-dfd5acb01981 req-8aa302c8-8ff2-4989-82f6-e24f23e5d107 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033937 Oct 22 04:00:50.582289 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3514/6888] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:00:50.593684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:00:50.686084 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4856837-caa5-4521-8dec-12848bea0a25 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 204 len: 0 microversion: 2.1 time: 0.140683 Oct 22 04:00:50.688277 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3375/6889] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:00:50 2022] DELETE /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:00:50.697345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:50.698089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:50.707518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:50.708149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:50.708745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:50.709572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:50.710151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:50.710736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:50.863058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:50.871934 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f40feeb-30bd-4415-924e-f71f22787587 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1577 microversion: 2.1 time: 0.180014 Oct 22 04:00:50.872747 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3515/6890] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:50 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:51.897515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:51.898382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:51.905088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:51.905565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:51.906000 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:51.906683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:51.907131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:51.907551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:52.091477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:52.099318 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef1037cd-a1bb-4179-9632-4ada674cb6fe tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1577 microversion: 2.1 time: 0.206059 Oct 22 04:00:52.099906 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3376/6891] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:51 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:52.715509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-bbd35d8b-0c94-457d-a533-7afeff051620 req-fda57f12-e3da-415f-9c36-217ec911028d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa99b1e8-195f-417f-a412-bc59244f760d", "name": "network-vif-deleted", "tag": "56a4159b-aeab-47b9-bec9-42e47791b7ff"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:00:52.726772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bbd35d8b-0c94-457d-a533-7afeff051620 req-fda57f12-e3da-415f-9c36-217ec911028d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:52.727493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bbd35d8b-0c94-457d-a533-7afeff051620 req-fda57f12-e3da-415f-9c36-217ec911028d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:52.727955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-bbd35d8b-0c94-457d-a533-7afeff051620 req-fda57f12-e3da-415f-9c36-217ec911028d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:52.740400 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-bbd35d8b-0c94-457d-a533-7afeff051620 req-fda57f12-e3da-415f-9c36-217ec911028d service nova] Creating event network-vif-deleted:56a4159b-aeab-47b9-bec9-42e47791b7ff for instance aa99b1e8-195f-417f-a412-bc59244f760d on n-h2-862416-2 Oct 22 04:00:52.745548 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-bbd35d8b-0c94-457d-a533-7afeff051620 req-fda57f12-e3da-415f-9c36-217ec911028d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034686 Oct 22 04:00:52.746162 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3516/6892] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:00:53.124073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:53.124722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:53.131829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:53.132353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:53.132795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:53.133498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:53.133963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:53.134396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:53.197569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:53.205504 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dd7d80f5-0fc1-4808-a38e-663debd40e67 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1226 microversion: 2.1 time: 0.085751 Oct 22 04:00:53.206028 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3377/6893] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:53 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:54.230481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:54.231188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:54.237502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:54.238005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:54.238456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:54.239167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:54.239646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:54.240085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:54.306771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:54.315418 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5126c31d-0605-444b-a7f4-35fa49285a4d tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1226 microversion: 2.1 time: 0.090401 Oct 22 04:00:54.316021 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3517/6894] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:54 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:55.339892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:55.340537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:55.347369 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:55.347849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:55.348311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:55.349010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:55.349462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:55.349890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:55.416801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:55.424702 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-100f1079-0402-4a95-95d8-cbdad0c479c7 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1226 microversion: 2.1 time: 0.089422 Oct 22 04:00:55.425283 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3378/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:55 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:56.448665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:56.449289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:56.456339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:56.456839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:56.457291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:56.458001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:56.458465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:56.458903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:56.523215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f67baebcf6426f86837b4f504955b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e58348ceac746268bc3b5e7f189f415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:00:56.531174 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4ef33e4-380c-482c-8056-5f845641dc50 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 200 len: 1226 microversion: 2.1 time: 0.087530 Oct 22 04:00:56.531748 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3518/6896] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:56 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:00:57.554255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:57.555329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: aa99b1e8-195f-417f-a412-bc59244f760d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:57.562056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:57.562532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:57.562961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:57.563674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:57.564129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:57.564572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:57.578591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance aa99b1e8-195f-417f-a412-bc59244f760d could not be found. Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d HTTP/1.1 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance aa99b1e8-195f-417f-a412-bc59244f760d could not be found. Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'aa99b1e8-195f-417f-a412-bc59244f760d'} Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa99b1e8-195f-417f-a412-bc59244f760d could not be found. Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa99b1e8-195f-417f-a412-bc59244f760d could not be found. Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:00:57.580223 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa99b1e8-195f-417f-a412-bc59244f760d could not be found. Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance aa99b1e8-195f-417f-a412-bc59244f760d could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4023f942-e024-4c6a-939f-be360f1b9969 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d" status: 404 len: 111 microversion: 2.1 time: 0.031360 Oct 22 04:00:57.584631 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3379/6897] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:57 2022] GET /compute/v2.1/servers/aa99b1e8-195f-417f-a412-bc59244f760d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:00:58.028606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:58.029118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:58.036124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:58.036685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:58.037143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:58.037884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:58.038357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:58.038936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:58.052301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a HTTP/1.1 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a'} Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:00:58.053976 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-952b8448-3721-4ae1-9190-53b3f2a9d6c5 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 404 len: 111 microversion: 2.1 time: 0.031324 Oct 22 04:00:58.058622 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3519/6898] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:00:58 2022] DELETE /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:00:58.064518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:00:58.065152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] [instance: 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:00:58.071189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:58.071665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:58.072180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:58.072886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:00:58.073338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:00:58.073758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:00:58.088489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] HTTP exception thrown: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Request method failure captured: Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a HTTP/1.1 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2htzZP5v9l60_-9NGK2RskojnXgvmE8BJTHPKYy3zHUktnnjP-mi9cz1S5KazxVhAYhjy2qNEMgQsS4DC6FV1Kcszl5i14BUMg67Z7fZal_DYz4wWvA0IYBST8dZuZm15PpdiQNMc_wCPkqBDpZ8umdUA9_o91v9LDBDCcIN164_8E Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e58348ceac746268bc3b5e7f189f415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e58348ceac746268bc3b5e7f189f415"}]}] Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 0e58348ceac746268bc3b5e7f189f415 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestVolumeBootPattern-1067534439 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestVolumeBootPattern-1067534439-project Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 51f67baebcf6426f86837b4f504955b9 Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestVolumeBootPattern-1067534439-project Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a'} Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:00:58.089971 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Returning 404 to user: Instance 0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-675964a6-b06c-4c25-950b-95485828fea3 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a" status: 404 len: 111 microversion: 2.1 time: 0.030762 Oct 22 04:00:58.094515 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3380/6899] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:00:58 2022] GET /compute/v2.1/servers/0d7f1a58-9dda-4f4b-b0c0-72f8ec88006a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:01:01.511885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-634dd814-35e1-41b9-ae41-4b326cfc16e4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] Calling method '.version_select at 0x7f0d1e503a60>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:01.541370 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-634dd814-35e1-41b9-ae41-4b326cfc16e4 tempest-TestVolumeBootPattern-1067534439 tempest-TestVolumeBootPattern-1067534439-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1847453664" status: 202 len: 0 microversion: 2.1 time: 0.034936 Oct 22 04:01:01.544629 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3520/6900] 10.222.0.25 () {58 vars in 1263 bytes} [Sat Oct 22 04:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1847453664 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:01:19.517602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:19.518336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:19.627220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1191191672", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:19.684712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] validate_networks() for None {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:01:19.961003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:01:19.961427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:01:19.962441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:01:19.963281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:01:19.963693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:01:19.972650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:19.973128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:19.973563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:19.974280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:19.975022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:19.975450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:19.992246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Getting quotas for project a552fef8918f43c685b83f9d978b6270. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:01:19.998774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Getting quotas for user 52bb58bc33334f9990507974251d7920 and project a552fef8918f43c685b83f9d978b6270. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:01:20.012052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:01:20.014396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:01:20.058569 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [6be31140-6fd0-468e-9e61-ee8df99b2160] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:01:21.067091 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [6be31140-6fd0-468e-9e61-ee8df99b2160] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33484. Oct 22 04:01:21.073687 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4f6d7d2b-7ed1-4e03-905d-bd779ad513ae tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.559050 Oct 22 04:01:21.074166 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3381/6901] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:01:21.083243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=52 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:21.084654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:21.091015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0dd725f-2039-4387-87a4-27218ab80a73 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:21.091835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0dd725f-2039-4387-87a4-27218ab80a73 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:21.153787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d0dd725f-2039-4387-87a4-27218ab80a73 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:21.162698 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0dd725f-2039-4387-87a4-27218ab80a73 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1222 microversion: 2.1 time: 0.081156 Oct 22 04:01:21.163771 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3521/6902] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:21 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:22.187778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:22.188600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:22.195555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:22.196131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:22.197433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:22.198373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:22.198709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:22.199164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:22.266269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:22.274649 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a3ca47e3-0406-4b90-bee6-1fea00dfb64c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1292 microversion: 2.1 time: 0.091552 Oct 22 04:01:22.285707 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3382/6903] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:22 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:23.300183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:23.301005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:23.309401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:23.309984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:23.310542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:23.311318 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:23.311864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:23.312425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:23.443030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:23.451667 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4fced9e1-1b04-45f8-a388-7f8b3687c246 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1322 microversion: 2.1 time: 0.155361 Oct 22 04:01:23.452292 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3522/6904] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:23 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:24.065756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1bbdbd1d-3162-4d60-9a68-ad4a21b1d506 req-d9ee0da8-66a0-41e6-87fb-a4d5f9bdde08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30cee40-b13c-4270-8d6f-09967e5b1432", "tag": "55f8242c-0116-489e-86a6-6233edd03ba5"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:24.078336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1bbdbd1d-3162-4d60-9a68-ad4a21b1d506 req-d9ee0da8-66a0-41e6-87fb-a4d5f9bdde08 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:24.078816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1bbdbd1d-3162-4d60-9a68-ad4a21b1d506 req-d9ee0da8-66a0-41e6-87fb-a4d5f9bdde08 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:24.079244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1bbdbd1d-3162-4d60-9a68-ad4a21b1d506 req-d9ee0da8-66a0-41e6-87fb-a4d5f9bdde08 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:24.091981 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1bbdbd1d-3162-4d60-9a68-ad4a21b1d506 req-d9ee0da8-66a0-41e6-87fb-a4d5f9bdde08 service nova] Creating event network-changed:55f8242c-0116-489e-86a6-6233edd03ba5 for instance c30cee40-b13c-4270-8d6f-09967e5b1432 on n-h1-862416-2 Oct 22 04:01:24.096836 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1bbdbd1d-3162-4d60-9a68-ad4a21b1d506 req-d9ee0da8-66a0-41e6-87fb-a4d5f9bdde08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034842 Oct 22 04:01:24.097445 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3383/6905] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:01:24.476095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:24.476829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:24.484510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:24.485006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:24.485454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:24.486173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:24.486640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:24.487080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:24.625628 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:24.633334 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-121d75f1-a810-4f01-9de6-983201805dc1 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1322 microversion: 2.1 time: 0.162070 Oct 22 04:01:24.633939 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3523/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:24 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:25.658323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:25.659014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:25.665250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:25.666712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:25.666869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:25.667572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:25.668030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:25.668486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:25.859220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:25.866967 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9bd0c671-f863-4834-bcb4-d0cae1e078fa tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1322 microversion: 2.1 time: 0.213740 Oct 22 04:01:25.867546 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3384/6907] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:25 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:26.890400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:26.891016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:26.897883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:26.898371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:26.898818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:26.899520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:26.900458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:26.900904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:27.035601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:27.044088 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1343b8b4-82c7-4067-b2cc-01306083945b tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1322 microversion: 2.1 time: 0.157652 Oct 22 04:01:27.044734 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3524/6908] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:26 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:28.067013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:28.067613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:28.074474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:28.074955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:28.075392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:28.076104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:28.076584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:28.077018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:28.205849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:28.214614 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f87c31e-16cf-454c-b0b2-ea1053cf4918 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1322 microversion: 2.1 time: 0.151552 Oct 22 04:01:28.215184 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3385/6909] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:28 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:28.705474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6a1491b4-2f60-4650-bc57-edcfd7ce17d0 req-d147dd02-55d6-44ec-95f8-d6d8c3577553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30cee40-b13c-4270-8d6f-09967e5b1432", "name": "network-vif-plugged", "status": "completed", "tag": "55f8242c-0116-489e-86a6-6233edd03ba5"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:28.716886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6a1491b4-2f60-4650-bc57-edcfd7ce17d0 req-d147dd02-55d6-44ec-95f8-d6d8c3577553 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:28.717378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6a1491b4-2f60-4650-bc57-edcfd7ce17d0 req-d147dd02-55d6-44ec-95f8-d6d8c3577553 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:28.717838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6a1491b4-2f60-4650-bc57-edcfd7ce17d0 req-d147dd02-55d6-44ec-95f8-d6d8c3577553 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:28.729619 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6a1491b4-2f60-4650-bc57-edcfd7ce17d0 req-d147dd02-55d6-44ec-95f8-d6d8c3577553 service nova] Creating event network-vif-plugged:55f8242c-0116-489e-86a6-6233edd03ba5 for instance c30cee40-b13c-4270-8d6f-09967e5b1432 on n-h1-862416-2 Oct 22 04:01:28.734509 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6a1491b4-2f60-4650-bc57-edcfd7ce17d0 req-d147dd02-55d6-44ec-95f8-d6d8c3577553 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032866 Oct 22 04:01:28.735295 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3525/6910] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:01:29.238570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:29.239187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:29.246788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:29.247275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:29.247713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:29.248460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:29.248902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:29.249332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:29.378403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:29.386297 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-05c2fb37-ca31-48a9-8796-0c32ea88ee2f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1322 microversion: 2.1 time: 0.151577 Oct 22 04:01:29.386867 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3386/6911] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:29 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:30.409954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:30.410662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:30.417074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:30.417575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:30.418031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:30.418742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:30.419215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:30.419661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:30.550126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:30.558623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0a5739c-8139-4f7d-8594-d173e13e87c3 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1471 microversion: 2.1 time: 0.153756 Oct 22 04:01:30.559210 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3526/6912] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:30 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:30.584129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:30.584966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:30.634740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-df80419a-ad9e-48bc-b016-ce44b8a4d2e9 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Calling method '.version_select at 0x7f0d190d7940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:30.702455 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-df80419a-ad9e-48bc-b016-ce44b8a4d2e9 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/eb96e82bd39c40b79544e319d9ffd482" status: 200 len: 371 microversion: 2.1 time: 0.122900 Oct 22 04:01:30.703042 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3387/6913] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 04:01:30 2022] GET /compute/v2.1/os-quota-sets/eb96e82bd39c40b79544e319d9ffd482 => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:01:30.715308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c142281f-d42e-4ca0-8612-90914fb522bc tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1235503478", "id": 1411967370, "os-flavor-access:is_public": "True"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:30.734104 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c142281f-d42e-4ca0-8612-90914fb522bc tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022589 Oct 22 04:01:30.734689 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3527/6914] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:01:30 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:01:30.747480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1411967370"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:30.749732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:30.755626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:30.756111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:30.756588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:30.757291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:30.757747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:30.758176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:30.845742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '94d83a91a7684f018177d9a215315ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb96e82bd39c40b79544e319d9ffd482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:30.851869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1235503478 {{(pid=120582) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:01:30.859225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:30.859707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:30.860146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:30.860903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:30.861359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:30.861789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:30.882889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Getting quotas for project a552fef8918f43c685b83f9d978b6270. Resources: {'cores', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:01:30.888122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Getting quotas for user 52bb58bc33334f9990507974251d7920 and project a552fef8918f43c685b83f9d978b6270. Resources: {'cores', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:01:30.900370 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.compute.api [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] ram quota exceeded for eb96e82bd39c40b79544e319d9ffd482, tried to resize instance. Oct 22 04:01:30.901482 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Request method failure captured: Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432/action HTTP/1.1 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 39 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2sPikBfpS4M-F56JprrVicoKCmTR7Sr36Ny-4lsRK536sBimJZnHa5cOVgnCUFS22mCpVCcluKAfli8_OZv9-_mquByU9LJg7emi8WdB8DUmi8uiKD_1Tcn9rdP2r0YydKoJxzrsIDXTearqwXGJNfbQ8x-GC-EZ3S6BlSGIS9N5ps Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: eb96e82bd39c40b79544e319d9ffd482 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-306188234 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Role: admin,member,reader Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: admin,member,reader Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb96e82bd39c40b79544e319d9ffd482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb96e82bd39c40b79544e319d9ffd482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb96e82bd39c40b79544e319d9ffd482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb96e82bd39c40b79544e319d9ffd482"}]}] Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersAdminNegativeTestJSON-306188234 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: eb96e82bd39c40b79544e319d9ffd482 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-306188234 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersAdminNegativeTestJSON-306188234-project-admin Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 94d83a91a7684f018177d9a215315ae9 Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersAdminNegativeTestJSON-306188234-project-admin Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: {"resize": {"flavorRef": "1411967370"}} Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'c30cee40-b13c-4270-8d6f-09967e5b1432', 'body': {'resize': {'flavorRef': '1411967370'}}} Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:01:30.903509 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c211388-2ef1-4aeb-955f-204c3f935f86 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432/action" status: 403 len: 118 microversion: 2.1 time: 0.162074 Oct 22 04:01:30.908018 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3388/6915] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:01:30 2022] POST /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432/action => generated 118 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 22 04:01:30.914605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-853b8367-5161-427d-bc58-b7e3bd8e2608 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:30.932337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-853b8367-5161-427d-bc58-b7e3bd8e2608 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1411967370" status: 202 len: 0 microversion: 2.1 time: 0.021351 Oct 22 04:01:30.932911 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3528/6916] 10.222.0.25 () {58 vars in 1161 bytes} [Sat Oct 22 04:01:30 2022] DELETE /compute/v2.1/flavors/1411967370 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 04:01:30.940746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9113a550-73f7-438f-92af-cc18a55c8acf tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:30.960729 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9113a550-73f7-438f-92af-cc18a55c8acf tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023615 Oct 22 04:01:30.961281 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3389/6917] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 04:01:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:30.982954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35163a0d-cc3c-4a40-a002-7b2d77ed5643 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Calling method '.version_select at 0x7f0d1a278550>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:31.057595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35163a0d-cc3c-4a40-a002-7b2d77ed5643 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/eb96e82bd39c40b79544e319d9ffd482" status: 200 len: 371 microversion: 2.1 time: 0.079230 Oct 22 04:01:31.058178 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3529/6918] 10.222.0.25 () {58 vars in 1242 bytes} [Sat Oct 22 04:01:30 2022] GET /compute/v2.1/os-quota-sets/eb96e82bd39c40b79544e319d9ffd482 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:01:31.069848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-98d6ae35-f3c3-4abf-859b-94d06ece696b tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1715626208", "id": 951868766, "os-flavor-access:is_public": "True"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:31.087595 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-98d6ae35-f3c3-4abf-859b-94d06ece696b tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021441 Oct 22 04:01:31.088891 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3390/6919] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:01:31 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:01:31.101251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "951868766"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:31.104233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:31.110712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:31.111215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:31.111668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:31.112408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:31.112881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:31.113320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:31.197739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '94d83a91a7684f018177d9a215315ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb96e82bd39c40b79544e319d9ffd482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:31.203585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1715626208 {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:01:31.210198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:31.210691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:31.211141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:31.211878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:31.212386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:31.212829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:31.238188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Getting quotas for project a552fef8918f43c685b83f9d978b6270. Resources: {'cores', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:01:31.243232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Getting quotas for user 52bb58bc33334f9990507974251d7920 and project a552fef8918f43c685b83f9d978b6270. Resources: {'cores', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:01:31.255375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.compute.api [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] cores quota exceeded for eb96e82bd39c40b79544e319d9ffd482, tried to resize instance. Oct 22 04:01:31.255926 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Request method failure captured: Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432/action HTTP/1.1 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 38 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2sPikBfpS4M-F56JprrVicoKCmTR7Sr36Ny-4lsRK536sBimJZnHa5cOVgnCUFS22mCpVCcluKAfli8_OZv9-_mquByU9LJg7emi8WdB8DUmi8uiKD_1Tcn9rdP2r0YydKoJxzrsIDXTearqwXGJNfbQ8x-GC-EZ3S6BlSGIS9N5ps Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: eb96e82bd39c40b79544e319d9ffd482 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-306188234 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Role: admin,member,reader Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: admin,member,reader Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb96e82bd39c40b79544e319d9ffd482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb96e82bd39c40b79544e319d9ffd482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb96e82bd39c40b79544e319d9ffd482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb96e82bd39c40b79544e319d9ffd482"}]}] Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersAdminNegativeTestJSON-306188234 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: eb96e82bd39c40b79544e319d9ffd482 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-306188234 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersAdminNegativeTestJSON-306188234-project-admin Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 94d83a91a7684f018177d9a215315ae9 Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersAdminNegativeTestJSON-306188234-project-admin Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: {"resize": {"flavorRef": "951868766"}} Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'c30cee40-b13c-4270-8d6f-09967e5b1432', 'body': {'resize': {'flavorRef': '951868766'}}} Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:01:31.258069 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-935f79c2-0eba-47db-acb2-06e2de5989f2 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432/action" status: 403 len: 113 microversion: 2.1 time: 0.162245 Oct 22 04:01:31.263270 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3530/6920] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:01:31 2022] POST /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432/action => generated 113 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:01:31.269190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-06ad5214-30bb-43f5-899b-27793821e71f tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:31.287059 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-06ad5214-30bb-43f5-899b-27793821e71f tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/951868766" status: 202 len: 0 microversion: 2.1 time: 0.021749 Oct 22 04:01:31.287856 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3391/6921] 10.222.0.25 () {58 vars in 1158 bytes} [Sat Oct 22 04:01:31 2022] DELETE /compute/v2.1/flavors/951868766 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:01:31.295668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a3f88d44-2b43-4a51-8e22-82b973beff48 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:31.315386 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a3f88d44-2b43-4a51-8e22-82b973beff48 tempest-ServersAdminNegativeTestJSON-306188234 tempest-ServersAdminNegativeTestJSON-306188234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023299 Oct 22 04:01:31.315943 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3531/6922] 10.222.0.25 () {58 vars in 1146 bytes} [Sat Oct 22 04:01:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:31.336423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:31.336920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:31.344099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:31.344613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:31.345053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:31.345740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:31.346191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:31.346614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:31.371709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:01:31.444314 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c651913-1911-4c78-89ce-7983798b749a tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 204 len: 0 microversion: 2.1 time: 0.111139 Oct 22 04:01:31.445154 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3392/6923] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:01:31 2022] DELETE /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:01:31.453955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:31.454680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:31.461658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:31.462157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:31.462629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:31.464017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:31.464447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:31.464891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:31.603225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:31.611840 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95550da4-8122-42c8-a2ed-b5470de4cecf tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1477 microversion: 2.1 time: 0.162202 Oct 22 04:01:31.612452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3532/6924] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:31 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:32.636228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:32.636937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:32.643748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:32.644257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:32.644702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:32.645393 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:32.645844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:32.646268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:32.781606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:32.789328 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7ee449b0-473d-4020-bf10-cbbe16d83012 tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1477 microversion: 2.1 time: 0.157836 Oct 22 04:01:32.789903 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3393/6925] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:32 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:33.289309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1a5c3d6d-c91e-4e63-97d9-9005d4bd6906 req-3904dcf5-08fd-42eb-b8da-e86ef4659a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30cee40-b13c-4270-8d6f-09967e5b1432", "name": "network-vif-deleted", "tag": "55f8242c-0116-489e-86a6-6233edd03ba5"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:33.302663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1a5c3d6d-c91e-4e63-97d9-9005d4bd6906 req-3904dcf5-08fd-42eb-b8da-e86ef4659a7b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:33.303081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1a5c3d6d-c91e-4e63-97d9-9005d4bd6906 req-3904dcf5-08fd-42eb-b8da-e86ef4659a7b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:33.303720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1a5c3d6d-c91e-4e63-97d9-9005d4bd6906 req-3904dcf5-08fd-42eb-b8da-e86ef4659a7b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:33.317210 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1a5c3d6d-c91e-4e63-97d9-9005d4bd6906 req-3904dcf5-08fd-42eb-b8da-e86ef4659a7b service nova] Creating event network-vif-deleted:55f8242c-0116-489e-86a6-6233edd03ba5 for instance c30cee40-b13c-4270-8d6f-09967e5b1432 on n-h1-862416-2 Oct 22 04:01:33.323058 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1a5c3d6d-c91e-4e63-97d9-9005d4bd6906 req-3904dcf5-08fd-42eb-b8da-e86ef4659a7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036744 Oct 22 04:01:33.323698 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3533/6926] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:01:33.812636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:33.813241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:33.820120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:33.820616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:33.821060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:33.821740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:33.822192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:33.823158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:33.855199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:33.855708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:33.856167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:33.856601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lazy-loading 'fault' on Instance uuid c30cee40-b13c-4270-8d6f-09967e5b1432 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:01:33.899436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bb58bc33334f9990507974251d7920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a552fef8918f43c685b83f9d978b6270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:33.906781 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-33bde82f-1e2e-4a98-8f8f-929ca801cb1f tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 200 len: 1312 microversion: 2.1 time: 0.098058 Oct 22 04:01:33.907352 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3394/6927] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:33 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:01:34.931460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:34.932621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] [instance: c30cee40-b13c-4270-8d6f-09967e5b1432] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:34.938827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:34.939330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:34.939789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:34.940533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:34.941006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:34.941452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:34.955018 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] HTTP exception thrown: Instance c30cee40-b13c-4270-8d6f-09967e5b1432 could not be found. Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Request method failure captured: Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 HTTP/1.1 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2sOXf4610GvhHr6nEBupl_HTZAzF225HCRMttR_qQAjOcKytMkqHunQuQpRm6OUdVRfmFXpzv2qDRGcg8eFCnzg_yx5RakuQsGVPdNWjrhGQtg2ief7CDd7upi6bFktB4qx0q-kH-JpxEL--WBd2Hjkv-NEhBL7RO8Z_Ipgetp36VQ Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a552fef8918f43c685b83f9d978b6270 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-798381310 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a552fef8918f43c685b83f9d978b6270"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a552fef8918f43c685b83f9d978b6270"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a552fef8918f43c685b83f9d978b6270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a552fef8918f43c685b83f9d978b6270"}]}] Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersAdminNegativeTestJSON-798381310 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a552fef8918f43c685b83f9d978b6270 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-798381310 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersAdminNegativeTestJSON-798381310-project Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 52bb58bc33334f9990507974251d7920 Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersAdminNegativeTestJSON-798381310-project Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance c30cee40-b13c-4270-8d6f-09967e5b1432 could not be found. Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'c30cee40-b13c-4270-8d6f-09967e5b1432'} Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30cee40-b13c-4270-8d6f-09967e5b1432 could not be found. Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30cee40-b13c-4270-8d6f-09967e5b1432 could not be found. Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:34.956671 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30cee40-b13c-4270-8d6f-09967e5b1432 could not be found. Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] Returning 404 to user: Instance c30cee40-b13c-4270-8d6f-09967e5b1432 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-acb55d21-8b74-44a5-9c0a-914434ace24c tempest-ServersAdminNegativeTestJSON-798381310 tempest-ServersAdminNegativeTestJSON-798381310-project] 10.222.0.25 "GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432" status: 404 len: 111 microversion: 2.1 time: 0.031813 Oct 22 04:01:34.961229 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3534/6928] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:34 2022] GET /compute/v2.1/servers/c30cee40-b13c-4270-8d6f-09967e5b1432 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:01:41.049746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:41.050700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:41.171731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1276438304", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "2c4df099-946f-4ecc-b926-914376dfc456"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:41.441299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] validate_networks() for [('2c4df099-946f-4ecc-b926-914376dfc456', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:01:41.865755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:01:41.866177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:01:41.866642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:01:41.867054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:01:41.867490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:01:41.879263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:41.879674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:41.880314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:41.881039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:41.881494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:41.882184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:41.900916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Getting quotas for project 008d6bba48594e4883d2ed41b071d902. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:01:41.906355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Getting quotas for user 39ec46842ac24e9cae0c173fb8c8945b and project 008d6bba48594e4883d2ed41b071d902. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:01:41.920316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:01:41.922749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:01:41.975855 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1c1c390-dbfb-409b-b528-18caee1a17c5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931570 Oct 22 04:01:41.976774 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3395/6929] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:01:41.989128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74b017ee-df7d-4f1e-a2f7-59d981a25831 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:41.989759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74b017ee-df7d-4f1e-a2f7-59d981a25831 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:41.992872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:41.993699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:42.122205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74b017ee-df7d-4f1e-a2f7-59d981a25831 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:42.129708 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74b017ee-df7d-4f1e-a2f7-59d981a25831 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1215 microversion: 2.1 time: 0.144472 Oct 22 04:01:42.130222 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3535/6930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:41 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:43.155234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:43.155840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:43.442740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:43.443244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:43.443688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:43.444455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:43.444916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:43.445352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:43.578809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:43.595114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fea405da-5144-4760-93f7-53be766bec96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1273 microversion: 2.1 time: 0.444907 Oct 22 04:01:43.597062 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3396/6931] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:43 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1273 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:44.620125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:44.621429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:44.631569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:44.632232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:44.632792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:44.633594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:44.634191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:44.635163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:44.782497 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:44.790547 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8474609f-12f2-4512-b91b-8c3f5f5ba091 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1315 microversion: 2.1 time: 0.175246 Oct 22 04:01:44.792451 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3536/6932] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:44 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:44.949653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2ec47842-6f70-4b3f-a85c-530d5af035a0 req-c8901764-195a-4561-84ae-6f19db61d021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b", "tag": "8436eefa-6b03-44ae-b807-d2ad4c510790"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:44.960398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2ec47842-6f70-4b3f-a85c-530d5af035a0 req-c8901764-195a-4561-84ae-6f19db61d021 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:44.961081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2ec47842-6f70-4b3f-a85c-530d5af035a0 req-c8901764-195a-4561-84ae-6f19db61d021 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:44.961443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2ec47842-6f70-4b3f-a85c-530d5af035a0 req-c8901764-195a-4561-84ae-6f19db61d021 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:44.974057 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2ec47842-6f70-4b3f-a85c-530d5af035a0 req-c8901764-195a-4561-84ae-6f19db61d021 service nova] Creating event network-changed:8436eefa-6b03-44ae-b807-d2ad4c510790 for instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b on n-h1-862416-2 Oct 22 04:01:44.979443 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2ec47842-6f70-4b3f-a85c-530d5af035a0 req-c8901764-195a-4561-84ae-6f19db61d021 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125861 Oct 22 04:01:44.980136 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3397/6933] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:01:45.815074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:45.815697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:45.823160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:45.823656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:45.824105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:45.824840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:45.825305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:45.825742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:45.960831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:45.971140 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1092dd70-7c9f-403b-8842-64492499990f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1315 microversion: 2.1 time: 0.159900 Oct 22 04:01:45.971993 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3537/6934] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:45 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:46.997453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:46.998140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:47.004905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:47.005383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:47.005814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:47.006497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:47.006943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:47.007364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:47.140828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:47.148662 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-69c4031a-2c1a-4c58-a4a9-a161202c8523 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1315 microversion: 2.1 time: 0.157287 Oct 22 04:01:47.149229 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3398/6935] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:46 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:48.171720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:48.172305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:48.178882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:48.179386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:48.179843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:48.180584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:48.181062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:48.182041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:48.311619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:48.319353 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-02a3db94-f21f-4c33-b5f2-1128a4b2ef19 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1315 microversion: 2.1 time: 0.151862 Oct 22 04:01:48.320342 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3538/6936] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:48 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:49.346329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:49.346867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:49.353524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:49.354009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:49.354448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:49.355146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:49.355599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:49.356029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:49.493527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:49.502191 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dc542fb3-5515-458d-b409-1c2012c5583b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1315 microversion: 2.1 time: 0.159925 Oct 22 04:01:49.503082 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3399/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:49 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:50.526504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:50.527127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:50.534970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:50.535471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:50.536167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:50.537058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:50.537532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:50.537979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:50.682364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:50.691844 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-24d96581-79df-4f1d-bad8-f86dd417ae42 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1315 microversion: 2.1 time: 0.169228 Oct 22 04:01:50.696386 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3539/6938] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:50 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:50.901183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9b097a22-7cb0-42a4-91a4-9d81a7d8258c req-b32d5134-b6f5-437b-a489-13559fb43753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b", "name": "network-vif-plugged", "status": "completed", "tag": "8436eefa-6b03-44ae-b807-d2ad4c510790"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:50.910411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:50.913474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9b097a22-7cb0-42a4-91a4-9d81a7d8258c req-b32d5134-b6f5-437b-a489-13559fb43753 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:50.914081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9b097a22-7cb0-42a4-91a4-9d81a7d8258c req-b32d5134-b6f5-437b-a489-13559fb43753 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:50.914479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9b097a22-7cb0-42a4-91a4-9d81a7d8258c req-b32d5134-b6f5-437b-a489-13559fb43753 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:50.918781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:50.930593 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9b097a22-7cb0-42a4-91a4-9d81a7d8258c req-b32d5134-b6f5-437b-a489-13559fb43753 service nova] Creating event network-vif-plugged:8436eefa-6b03-44ae-b807-d2ad4c510790 for instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b on n-h1-862416-2 Oct 22 04:01:50.937786 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9b097a22-7cb0-42a4-91a4-9d81a7d8258c req-b32d5134-b6f5-437b-a489-13559fb43753 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039325 Oct 22 04:01:50.937786 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3400/6939] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:01:51.717600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:51.718248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:51.720958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:51.726230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:51.726729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:51.727183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:51.727887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:51.728390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:51.728833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:51.733548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=74 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:51.867131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:51.875347 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e73c1ed1-381b-47f7-b1dd-9a13284271e5 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1315 microversion: 2.1 time: 0.162185 Oct 22 04:01:51.875937 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3540/6940] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:51 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:52.901113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:52.901837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:52.903750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:52.905324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:52.913199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:52.913681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:52.914116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:52.914810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:52.915259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:52.915680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:53.050843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:53.058972 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aa6f7f8d-ed4c-4a9a-95bd-7673967bbc96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1501 microversion: 2.1 time: 0.163553 Oct 22 04:01:53.059896 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3401/6941] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:52 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:53.082027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:01:53.084177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:53.086106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:01:53.093025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:53.093516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:53.093963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:53.094660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:53.095143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:53.095562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:53.123977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:53.130534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:01:53.138217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:01:53.138650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:01:53.139137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:01:53.139587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:01:53.140010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:01:53.202394 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [97bf58a7-6c22-4a79-82b9-d585dab6ab0d] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:01:54.208643 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [97bf58a7-6c22-4a79-82b9-d585dab6ab0d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33672. Oct 22 04:01:54.212290 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-01e07c47-e0a4-4a3d-a3cf-84fa6b6ad1a9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "POST /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b/action" status: 202 len: 0 microversion: 2.1 time: 1.134352 Oct 22 04:01:54.213590 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3541/6942] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:01:53 2022] POST /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:01:54.221540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:54.222253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:54.229812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:54.230298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:54.230734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:54.231442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:54.231894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:54.232358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:54.401669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:54.409731 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8bafa580-32bd-479e-996e-55d027e05e04 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1510 microversion: 2.1 time: 0.192057 Oct 22 04:01:54.410341 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3402/6943] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:54 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:55.435027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:55.435657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:55.442697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:55.443197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:55.443653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:55.444436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:55.444911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:55.445353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:55.579500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:55.587292 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7032e0c5-0e25-47ab-a2a3-092d874ab184 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1510 microversion: 2.1 time: 0.157600 Oct 22 04:01:55.588543 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3542/6944] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:55 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:56.611165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:56.611771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:56.618570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:56.619624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:56.620060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:56.620787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:56.621240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:56.621662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:56.754964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:56.763035 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-103b0759-d0e5-41dc-941f-94d7688c983e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.155797 Oct 22 04:01:56.763608 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3403/6945] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:56 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:57.786855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:57.787392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:57.795306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:57.795810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:57.796299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:57.797021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:57.797500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:57.797947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:58.165439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:58.173915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-86418d14-546a-4dd7-8c04-2033458a3b96 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.391153 Oct 22 04:01:58.174497 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3543/6946] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:57 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:01:59.197454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:01:59.198091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:01:59.204965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:59.205441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:59.205872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:59.206557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:01:59.207004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:01:59.207452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:01:59.336054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:01:59.344383 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-329eb4a9-9b6b-46a9-a2c2-9e1e0665d057 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.150830 Oct 22 04:01:59.344951 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3404/6947] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:01:59 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:00.367434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:00.368055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:00.375164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:00.375660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:00.376113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:00.376846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:00.377316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:00.377756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:00.507124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:00.515799 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9dd9cbc-2c11-4142-87a7-1b188f3ba334 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.152269 Oct 22 04:02:00.516411 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3544/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:00 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:01.538945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:01.539674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:01.547127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:01.547607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:01.548050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:01.548781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:01.549236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:01.549670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:01.775789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:01.783675 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ecb9d3e2-3bc3-4a66-b45d-21fd62b942e9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.248639 Oct 22 04:02:01.784281 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3405/6949] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:01 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:02.807162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:02.807684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:02.814573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:02.815066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:02.815517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:02.816233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:02.816709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:02.817153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:02.950494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:02.958203 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fce3fde6-73ca-4fd8-a86c-b246bda36500 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.155154 Oct 22 04:02:02.958773 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3545/6950] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:02 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:03.982691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:03.983309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:03.990197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:03.990679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:03.991114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:03.991809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:03.992288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:03.992714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:04.127690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:04.136610 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-372e42de-1660-4434-be25-b0c4774995b8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.158233 Oct 22 04:02:04.137186 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3406/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:03 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:05.159944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:05.160543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:05.168182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:05.168708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:05.169163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:05.169879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:05.170359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:05.170808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:05.300986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:05.309509 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad814da6-1925-4171-b68d-cb8150bf5a57 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.153592 Oct 22 04:02:05.310085 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3546/6952] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:05 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:06.332584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:06.333221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:06.340605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:06.341092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:06.341527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:06.342222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:06.342673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:06.343097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:06.472958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:06.481364 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-48914ac8-bc3b-47ea-b95a-d27ea943b014 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.152763 Oct 22 04:02:06.481942 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3407/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:06 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:07.505444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:07.506072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:07.513267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:07.513771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:07.514227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:07.514931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:07.515404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:07.515850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:07.649188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:07.657647 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d58b30c-0f76-4024-8709-21b4562e879b tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.156128 Oct 22 04:02:07.658225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3547/6954] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:07 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:08.681861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:08.682481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:08.689545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:08.690228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:08.690591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:08.691334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:08.691875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:08.692382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:08.826897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:08.834560 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-014df101-61cd-4bdc-b567-957cc364f311 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.157169 Oct 22 04:02:08.835147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3408/6955] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:08 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:02:09.857646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:09.858303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:09.865082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:09.865573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:09.866316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:09.867024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:09.867488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:09.867922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:09.997091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:10.004915 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18d4b76d-a7e9-4219-9479-48094048d7a2 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.151330 Oct 22 04:02:10.005491 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3548/6956] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:09 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:11.029669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:11.030280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:11.036824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:11.037307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:11.037748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:11.038446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:11.038901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:11.039358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:11.168650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:11.176363 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-063d3f97-0ce8-46ec-8e73-7ad4b9db39c7 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.151381 Oct 22 04:02:11.176938 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3409/6957] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:11 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:12.199767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:12.200427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:12.207320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:12.207816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:12.208293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:12.209000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:12.209467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:12.209906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:12.342858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:12.350607 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-85d5c89e-5cba-46bf-91a7-ba08de7d8b34 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.155094 Oct 22 04:02:12.351190 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3549/6958] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:12 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:13.374910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:13.375522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:13.382410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:13.382896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:13.384730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:13.384730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:13.385064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:13.385534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:13.517091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:13.525494 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-412b9ff5-e55b-45b7-b2e9-835ba9b819fe tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.153946 Oct 22 04:02:13.526193 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3410/6959] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:13 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:14.549155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:14.549776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:14.557701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:14.558200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:14.558650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:14.559353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:14.559819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:14.560284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:14.691744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:14.699769 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9afb5ae5-92dd-471e-96f0-5ccfcf24d083 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.154558 Oct 22 04:02:14.700380 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3550/6960] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:14 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:15.723920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:15.724549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:15.732484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:15.732982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:15.733424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:15.734265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:15.734607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:15.735034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:15.874352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:15.882209 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d7350096-2c29-4431-8220-9b14ebc714ce tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.162342 Oct 22 04:02:15.882792 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3411/6961] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:15 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:16.905904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:16.906514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:16.913882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:16.914381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:16.914833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:16.915716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:16.916286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:16.916738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:17.049228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:17.058020 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bf1ffef6-bb57-43c1-8b30-d20c3c44ed01 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.156092 Oct 22 04:02:17.058610 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3551/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:16 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:18.081283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:18.081808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:18.083786 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:02:18.083931 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:02:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b (ip 10.222.0.25) !!! Oct 22 04:02:18.092376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:18.092857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:18.093292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:18.093990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:18.094440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:18.094868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:18.223361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:18.231971 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8ee7c565-8c23-44e0-ba9a-2a66ead39a4f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.154629 Oct 22 04:02:18.232582 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3412/6963] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:18 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:19.255010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:19.255642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:19.263228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:19.263724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:19.264194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:19.264977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:19.265446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:19.265888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:19.399313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:19.408061 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10fc3e29-7b41-4cef-b769-cf8f88d5ff94 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.156997 Oct 22 04:02:19.408681 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3552/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:19 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:20.431392 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:20.433117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:20.439541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:20.440023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:20.440495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:20.441180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:20.441629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:20.442052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:20.888778 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:20.896665 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f6b4186c-17b6-46fb-97a1-f9bfd475ae50 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.469356 Oct 22 04:02:20.897230 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3413/6965] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:20 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:21.921012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:21.921663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:21.924356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=30 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:21.929774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:21.930268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:21.930858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:21.932594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:21.933082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:21.933531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:21.936298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:22.064561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:22.072924 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96878bfe-04fa-41af-85b8-f09fe11762d9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.155139 Oct 22 04:02:22.073635 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3553/6966] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:21 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:23.096930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:23.097540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:23.100198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=28 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:23.105931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:23.106418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:23.106858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:23.107593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:23.108049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:23.108525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:23.111280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=80 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:23.242228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:23.250348 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c411a28d-3ba7-4051-b262-464bb06f2fdc tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1515 microversion: 2.1 time: 0.157455 Oct 22 04:02:23.250931 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3414/6967] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:23 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:24.019493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f9cb1c1e-98de-41de-b266-626a087ad1cf req-d2b3e4e5-28be-42f5-ac9c-11cee1b788f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b", "name": "network-vif-unplugged", "status": "completed", "tag": "8436eefa-6b03-44ae-b807-d2ad4c510790"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:24.031305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f9cb1c1e-98de-41de-b266-626a087ad1cf req-d2b3e4e5-28be-42f5-ac9c-11cee1b788f5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:24.031874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f9cb1c1e-98de-41de-b266-626a087ad1cf req-d2b3e4e5-28be-42f5-ac9c-11cee1b788f5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:24.032402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f9cb1c1e-98de-41de-b266-626a087ad1cf req-d2b3e4e5-28be-42f5-ac9c-11cee1b788f5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:24.046112 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f9cb1c1e-98de-41de-b266-626a087ad1cf req-d2b3e4e5-28be-42f5-ac9c-11cee1b788f5 service nova] Creating event network-vif-unplugged:8436eefa-6b03-44ae-b807-d2ad4c510790 for instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b on n-h2-862416-2 Oct 22 04:02:24.051553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-f9cb1c1e-98de-41de-b266-626a087ad1cf req-d2b3e4e5-28be-42f5-ac9c-11cee1b788f5 service nova] Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:02:24.062805 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f9cb1c1e-98de-41de-b266-626a087ad1cf req-d2b3e4e5-28be-42f5-ac9c-11cee1b788f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047328 Oct 22 04:02:24.063434 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3554/6968] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:02:24.273870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:24.274479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:24.281681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:24.282172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:24.282632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:24.283319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:24.283883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:24.284262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:24.531458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:24.539963 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3e83971-f551-48e3-9001-ec2389ecf88f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1514 microversion: 2.1 time: 0.269909 Oct 22 04:02:24.552629 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3415/6969] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:24 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:25.566353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:25.567069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:25.573896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:25.574393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:25.574844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:25.575550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:25.576021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:25.576493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:25.711044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:25.719106 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45c24174-a3e9-44ad-b85f-f935e46f28e8 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1512 microversion: 2.1 time: 0.157878 Oct 22 04:02:25.719699 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3555/6970] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:25 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:26.085648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e34e2117-a157-49fc-9e92-50b21012f7dc req-bc2b67dd-95e2-4f26-9bf6-a722b04bdf7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b", "tag": "8436eefa-6b03-44ae-b807-d2ad4c510790"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:26.096932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e34e2117-a157-49fc-9e92-50b21012f7dc req-bc2b67dd-95e2-4f26-9bf6-a722b04bdf7c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:26.097416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e34e2117-a157-49fc-9e92-50b21012f7dc req-bc2b67dd-95e2-4f26-9bf6-a722b04bdf7c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:26.097845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e34e2117-a157-49fc-9e92-50b21012f7dc req-bc2b67dd-95e2-4f26-9bf6-a722b04bdf7c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:26.109855 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e34e2117-a157-49fc-9e92-50b21012f7dc req-bc2b67dd-95e2-4f26-9bf6-a722b04bdf7c service nova] Creating event network-changed:8436eefa-6b03-44ae-b807-d2ad4c510790 for instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b on n-h2-862416-2 Oct 22 04:02:26.115318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-e34e2117-a157-49fc-9e92-50b21012f7dc req-bc2b67dd-95e2-4f26-9bf6-a722b04bdf7c service nova] Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:02:26.126677 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e34e2117-a157-49fc-9e92-50b21012f7dc req-bc2b67dd-95e2-4f26-9bf6-a722b04bdf7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044661 Oct 22 04:02:26.127299 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3416/6971] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:02:26.742539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:26.743157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:26.750289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:26.750784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:26.751240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:26.751950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:26.752459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:26.752906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:26.883024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:26.891863 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a146fd6-2744-4ca9-acce-317b71b8e849 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1512 microversion: 2.1 time: 0.153269 Oct 22 04:02:26.892483 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3556/6972] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:26 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:27.918903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:27.919888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:27.926255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:27.926753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:27.927191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:27.927906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:27.928403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:27.928838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:28.071894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:28.080502 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d861fba8-c265-441f-9452-5bc6aff41ef0 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1509 microversion: 2.1 time: 0.167359 Oct 22 04:02:28.081079 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3417/6973] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:27 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:28.104427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:28.104961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:28.111929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:28.112465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:28.112918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:28.113635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:28.114105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:28.114546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:28.141280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:02:28.195105 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.compute.api [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Found an unconfirmed migration during delete, id: 16, status: finished Oct 22 04:02:29.665624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-46a23fb7-ac18-486d-8aa6-b3deb818fefe req-e7004a2f-1c7f-4a79-af4a-578d309f59f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b", "name": "network-vif-plugged", "status": "completed", "tag": "8436eefa-6b03-44ae-b807-d2ad4c510790"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:29.676378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-46a23fb7-ac18-486d-8aa6-b3deb818fefe req-e7004a2f-1c7f-4a79-af4a-578d309f59f1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:29.676887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-46a23fb7-ac18-486d-8aa6-b3deb818fefe req-e7004a2f-1c7f-4a79-af4a-578d309f59f1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:29.677611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-46a23fb7-ac18-486d-8aa6-b3deb818fefe req-e7004a2f-1c7f-4a79-af4a-578d309f59f1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:29.691114 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-46a23fb7-ac18-486d-8aa6-b3deb818fefe req-e7004a2f-1c7f-4a79-af4a-578d309f59f1 service nova] Creating event network-vif-plugged:8436eefa-6b03-44ae-b807-d2ad4c510790 for instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b on n-h2-862416-2 Oct 22 04:02:29.697118 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-46a23fb7-ac18-486d-8aa6-b3deb818fefe req-e7004a2f-1c7f-4a79-af4a-578d309f59f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035090 Oct 22 04:02:29.698264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3418/6974] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:02:29.734865 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-417987d9-066c-4294-b9cd-2e9ff4c0024f tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "DELETE /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 204 len: 0 microversion: 2.1 time: 1.635076 Oct 22 04:02:29.735476 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3557/6975] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:02:28 2022] DELETE /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 0 bytes in 1637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:02:29.744261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:29.745061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:29.751268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:29.751752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:29.752271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:29.752900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:29.753352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:29.753777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:29.939890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:29.948322 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4de2b588-1cfe-41da-8230-37b2ba74c55c tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1501 microversion: 2.1 time: 0.208462 Oct 22 04:02:29.948897 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3419/6976] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:29 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1501 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:30.972046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:30.972788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:30.980592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:30.981130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:30.981587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:30.982302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:30.982776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:30.983220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:31.153766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ec46842ac24e9cae0c173fb8c8945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008d6bba48594e4883d2ed41b071d902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:31.162217 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-609aed17-24de-4f83-a7bd-e3c4ae966bf9 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 200 len: 1501 microversion: 2.1 time: 0.194348 Oct 22 04:02:31.162815 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3558/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:30 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:31.602970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-c697b58d-a6ba-4e59-96e8-e92eafda3f26 req-9c0d2771-796a-44e9-92f9-e785ed65426c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b", "name": "network-vif-deleted", "tag": "8436eefa-6b03-44ae-b807-d2ad4c510790"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:31.614050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c697b58d-a6ba-4e59-96e8-e92eafda3f26 req-9c0d2771-796a-44e9-92f9-e785ed65426c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:31.614544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c697b58d-a6ba-4e59-96e8-e92eafda3f26 req-9c0d2771-796a-44e9-92f9-e785ed65426c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:31.614982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c697b58d-a6ba-4e59-96e8-e92eafda3f26 req-9c0d2771-796a-44e9-92f9-e785ed65426c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:31.626444 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-c697b58d-a6ba-4e59-96e8-e92eafda3f26 req-9c0d2771-796a-44e9-92f9-e785ed65426c service nova] Creating event network-vif-deleted:8436eefa-6b03-44ae-b807-d2ad4c510790 for instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b on n-h2-862416-2 Oct 22 04:02:31.631155 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-c697b58d-a6ba-4e59-96e8-e92eafda3f26 req-9c0d2771-796a-44e9-92f9-e785ed65426c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032014 Oct 22 04:02:31.631749 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3420/6978] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:02:32.187185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:32.187816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:32.194776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:32.195276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:32.195733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:32.196461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:32.196951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:32.197398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:32.210925 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] HTTP exception thrown: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Request method failure captured: Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b HTTP/1.1 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2sk_jTtesN9dVrNxrPXmC24XxcoRa8-t1bx6urdFgMdM0l0faL-159Om1PpV7eL-TjyMghD7i9FmaZ10NPnHWlq1YKcb_gQ2mq6iP6nwEiPLUvMkLcx5p0oqznTcAaGOPFy3tvhTMVGhguMTY9vy2dESztQdoCiVl-Hipr7zxL5roQ Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 008d6bba48594e4883d2ed41b071d902 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_008d6bba48594e4883d2ed41b071d902"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/008d6bba48594e4883d2ed41b071d902"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/008d6bba48594e4883d2ed41b071d902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/008d6bba48594e4883d2ed41b071d902"}]}] Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 008d6bba48594e4883d2ed41b071d902 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1799663101-project Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 39ec46842ac24e9cae0c173fb8c8945b Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1799663101-project Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b'} Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:02:32.212690 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Returning 404 to user: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e574cde4-e482-4d26-b2e0-bd8433c0a2ee tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 404 len: 111 microversion: 2.1 time: 0.030975 Oct 22 04:02:32.217463 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3559/6979] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:32 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 04:02:32.229667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:32.230252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:32.236408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:32.236895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:32.237333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:32.238024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:32.238479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:32.238908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:32.252486 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] HTTP exception thrown: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Request method failure captured: Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b HTTP/1.1 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2sk_jTtesN9dVrNxrPXmC24XxcoRa8-t1bx6urdFgMdM0l0faL-159Om1PpV7eL-TjyMghD7i9FmaZ10NPnHWlq1YKcb_gQ2mq6iP6nwEiPLUvMkLcx5p0oqznTcAaGOPFy3tvhTMVGhguMTY9vy2dESztQdoCiVl-Hipr7zxL5roQ Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 008d6bba48594e4883d2ed41b071d902 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_008d6bba48594e4883d2ed41b071d902"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/008d6bba48594e4883d2ed41b071d902"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/008d6bba48594e4883d2ed41b071d902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/008d6bba48594e4883d2ed41b071d902"}]}] Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 008d6bba48594e4883d2ed41b071d902 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-DeleteServersTestJSON-1799663101-project Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 39ec46842ac24e9cae0c173fb8c8945b Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-DeleteServersTestJSON-1799663101-project Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b'} Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:02:32.254108 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Returning 404 to user: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35f37c26-a7fd-4bc6-813e-0e989306f9f1 tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "DELETE /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 404 len: 111 microversion: 2.1 time: 0.030562 Oct 22 04:02:32.258535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3421/6980] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:02:32 2022] DELETE /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:02:32.264663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:32.265306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] [instance: 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:32.271376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:32.271874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:32.272358 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:32.273070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:32.273546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:32.273992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:32.287525 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] HTTP exception thrown: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Request method failure captured: Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b HTTP/1.1 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2sk_jTtesN9dVrNxrPXmC24XxcoRa8-t1bx6urdFgMdM0l0faL-159Om1PpV7eL-TjyMghD7i9FmaZ10NPnHWlq1YKcb_gQ2mq6iP6nwEiPLUvMkLcx5p0oqznTcAaGOPFy3tvhTMVGhguMTY9vy2dESztQdoCiVl-Hipr7zxL5roQ Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 008d6bba48594e4883d2ed41b071d902 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_008d6bba48594e4883d2ed41b071d902"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/008d6bba48594e4883d2ed41b071d902"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/008d6bba48594e4883d2ed41b071d902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/008d6bba48594e4883d2ed41b071d902"}]}] Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 008d6bba48594e4883d2ed41b071d902 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-DeleteServersTestJSON-1799663101 Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-DeleteServersTestJSON-1799663101-project Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 39ec46842ac24e9cae0c173fb8c8945b Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-DeleteServersTestJSON-1799663101-project Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b'} Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:02:32.289172 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] Returning 404 to user: Instance 359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f6a7627-d616-4776-8e81-0d9b4a69dd8e tempest-DeleteServersTestJSON-1799663101 tempest-DeleteServersTestJSON-1799663101-project] 10.222.0.25 "GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b" status: 404 len: 111 microversion: 2.1 time: 0.030299 Oct 22 04:02:32.294361 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3560/6981] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:32 2022] GET /compute/v2.1/servers/359c09de-ecfc-4b9c-ba76-2bc0a5e1d38b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:02:41.078120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-899048185", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "53f05f11-f79f-4c2f-97b9-12315fcdb1d8"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:41.272875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] validate_networks() for [('53f05f11-f79f-4c2f-97b9-12315fcdb1d8', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:02:41.675160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:02:41.675627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:02:41.676114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:02:41.676811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:02:41.676980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:02:41.687417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:41.687910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:41.688398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:41.689138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:41.689735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:41.690329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:41.713604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Getting quotas for project a72400f54df2461fb444e1a4d2360802. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:02:41.719166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Getting quotas for user cba10708636e4433bdb720cfaf27922e and project a72400f54df2461fb444e1a4d2360802. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:02:41.732316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:02:41.734658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:02:41.781841 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-89fc622e-0272-486e-b2cd-b26277f83a65 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841707 Oct 22 04:02:41.782819 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3422/6982] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:02:41.795588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-89e35cbe-4304-4e04-a4ce-7b1349954ad7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:41.796243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-89e35cbe-4304-4e04-a4ce-7b1349954ad7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:41.961676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-89e35cbe-4304-4e04-a4ce-7b1349954ad7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:41.970384 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-89e35cbe-4304-4e04-a4ce-7b1349954ad7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1217 microversion: 2.1 time: 0.180031 Oct 22 04:02:41.973136 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3561/6983] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:41 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:42.996465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:42.997019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:43.006464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:43.006957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:43.007459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:43.008329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:43.008795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:43.009254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:43.085809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:43.094877 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72680679-ba9f-4606-ac0f-484f6ff2bbbc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1275 microversion: 2.1 time: 0.103842 Oct 22 04:02:43.095478 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3423/6984] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:42 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:44.119982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:44.121968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:44.125846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:44.140604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:44.141498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:44.142320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:44.143105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:44.143593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:44.144051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:44.324067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:44.333512 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-70efcfcc-629b-4fe0-a462-15c8d9c7afe2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1317 microversion: 2.1 time: 0.218982 Oct 22 04:02:44.344621 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3562/6985] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:44 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:44.377844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1086d57d-892d-4e35-a4f8-d9efd1d3a7f2 req-4e205e86-d872-4d89-a621-b650bf0d80b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3662a8-e128-4886-b561-199e49ab9f55", "tag": "a23f418c-1a2c-4d45-8e68-faa7797d810a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:44.391956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1086d57d-892d-4e35-a4f8-d9efd1d3a7f2 req-4e205e86-d872-4d89-a621-b650bf0d80b1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:44.392999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1086d57d-892d-4e35-a4f8-d9efd1d3a7f2 req-4e205e86-d872-4d89-a621-b650bf0d80b1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:44.393505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1086d57d-892d-4e35-a4f8-d9efd1d3a7f2 req-4e205e86-d872-4d89-a621-b650bf0d80b1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:44.407159 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1086d57d-892d-4e35-a4f8-d9efd1d3a7f2 req-4e205e86-d872-4d89-a621-b650bf0d80b1 service nova] Creating event network-changed:a23f418c-1a2c-4d45-8e68-faa7797d810a for instance ff3662a8-e128-4886-b561-199e49ab9f55 on n-h2-862416-2 Oct 22 04:02:44.413696 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1086d57d-892d-4e35-a4f8-d9efd1d3a7f2 req-4e205e86-d872-4d89-a621-b650bf0d80b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039416 Oct 22 04:02:44.414463 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3424/6986] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:02:45.359335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:45.359953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:45.366890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:45.367381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:45.367828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:45.368559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:45.369640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:45.370088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:45.498966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:45.506667 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8444c248-4361-4d6f-8add-296261b212db tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1317 microversion: 2.1 time: 0.151330 Oct 22 04:02:45.507248 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3563/6987] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:45 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:46.531664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:46.532402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:46.539531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:46.540021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:46.540534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:46.541234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:46.541696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:46.542136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:46.670284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:46.677980 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ac6db595-a367-4242-80fa-25705f9ddfbb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1317 microversion: 2.1 time: 0.150612 Oct 22 04:02:46.678559 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3425/6988] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:46 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:47.702404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:47.703031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:47.710136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:47.710634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:47.711086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:47.711801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:47.712302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:47.712745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:47.844979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:47.852761 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5ad4a5b-3ee6-41ac-b2d9-72bbdf451caa tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1317 microversion: 2.1 time: 0.154439 Oct 22 04:02:47.853342 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3564/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:47 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:48.875449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:48.876072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:48.882776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:48.883268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:48.883714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:48.884447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:48.884903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:48.885950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:49.013967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:49.021711 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e397cef0-c3f2-4a8e-922f-34a1aa2ab3f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1317 microversion: 2.1 time: 0.150243 Oct 22 04:02:49.022283 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3426/6990] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:48 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:49.718160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b41ea73c-fe2d-4a56-b83b-cd9929bc0c93 req-a2373afc-93c2-4e83-bf0e-889e7ac26a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3662a8-e128-4886-b561-199e49ab9f55", "name": "network-vif-plugged", "status": "completed", "tag": "a23f418c-1a2c-4d45-8e68-faa7797d810a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:49.729307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b41ea73c-fe2d-4a56-b83b-cd9929bc0c93 req-a2373afc-93c2-4e83-bf0e-889e7ac26a36 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:49.729925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b41ea73c-fe2d-4a56-b83b-cd9929bc0c93 req-a2373afc-93c2-4e83-bf0e-889e7ac26a36 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:49.730556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b41ea73c-fe2d-4a56-b83b-cd9929bc0c93 req-a2373afc-93c2-4e83-bf0e-889e7ac26a36 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:49.744576 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b41ea73c-fe2d-4a56-b83b-cd9929bc0c93 req-a2373afc-93c2-4e83-bf0e-889e7ac26a36 service nova] Creating event network-vif-plugged:a23f418c-1a2c-4d45-8e68-faa7797d810a for instance ff3662a8-e128-4886-b561-199e49ab9f55 on n-h2-862416-2 Oct 22 04:02:49.749808 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b41ea73c-fe2d-4a56-b83b-cd9929bc0c93 req-a2373afc-93c2-4e83-bf0e-889e7ac26a36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035552 Oct 22 04:02:49.750620 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3565/6991] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:02:50.046624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:50.047209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:50.053141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:50.053618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:50.054054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:50.054744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:50.055194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:50.055616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:50.185587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:50.193262 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0c5e5d6-7e45-409d-af3e-5baba329c7ee tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1317 microversion: 2.1 time: 0.152026 Oct 22 04:02:50.193824 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3427/6992] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:50 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:51.218604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:51.219893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:51.227463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.227974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.228460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.229236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.229891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.230156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.381963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:51.392194 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfe0c42a-57e5-4c45-8cdc-7b2054f3863a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1506 microversion: 2.1 time: 0.179508 Oct 22 04:02:51.392805 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3566/6993] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:51 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:02:51.417094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:51.417714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:51.425096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.425831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.426339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.426984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.427435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.428400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.578607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:51.587534 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bfcccd51-a362-41f9-908f-c3cd297f20c1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1506 microversion: 2.1 time: 0.175002 Oct 22 04:02:51.588272 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3428/6994] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:51 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:51.615372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:51.618016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:51.624700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.625200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.625657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.626522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.626998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.627465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.697454 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0f7b41d8-e7f3-43ad-a566-e0a6190760ac tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "PUT /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1078 microversion: 2.1 time: 0.087742 Oct 22 04:02:51.698037 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3567/6995] 10.222.0.25 () {60 vars in 1256 bytes} [Sat Oct 22 04:02:51 2022] PUT /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1078 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:02:51.721374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:51.721977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:51.725219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:51.726989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:51.732250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.732729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.733231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.734196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.734646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.735069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.886061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:51.895705 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a53a665-bce6-45ad-8782-a90ead2f6574 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1504 microversion: 2.1 time: 0.178198 Oct 22 04:02:51.896537 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3429/6996] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:51 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:51.925590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:51.926223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:51.932508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.933012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.933475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.934200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:51.934664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:51.935102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:51.969885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:52.076653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:52.084388 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f35f29b6-6639-42fb-924b-6c8970304361 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1504 microversion: 2.1 time: 0.163708 Oct 22 04:02:52.084963 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3568/6997] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:51 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:02:52.107802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:02:52.110069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:52.116221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:52.116725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:52.117167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:52.117912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:52.118367 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:52.118790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:52.194451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:52.200485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Old instance type m1.heat2, new instance type m1.heat {{(pid=120582) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:02:52.206891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:02:52.207322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:02:52.207802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:02:52.208238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:02:52.208656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:02:52.321575 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1696aabd-9219-41bd-bd9e-02485c28ae51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "POST /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55/action" status: 202 len: 0 microversion: 2.1 time: 0.218526 Oct 22 04:02:52.322221 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3430/6998] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:02:52 2022] POST /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:02:52.331031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:52.331663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:52.337803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:52.340920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:52.341434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:52.341895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:52.342629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:52.348073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:52.348073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:52.488690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:52.496720 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b335144-9b94-4870-8b91-e48678a7814a tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1515 microversion: 2.1 time: 0.169593 Oct 22 04:02:52.497305 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3569/6999] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:52 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:53.522199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:53.522819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:53.524722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:53.532585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:53.533081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:53.533526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:53.534241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:53.534701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:53.535135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:53.539745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:02:53.763976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:53.772577 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3d89af25-df96-4b5e-846c-7e04b149fa21 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1515 microversion: 2.1 time: 0.255375 Oct 22 04:02:53.773787 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3431/7000] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:53 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:54.797427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:54.798054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:54.804664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:54.805167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:54.805624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:54.806335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:54.807474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:54.808120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:54.938759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:54.946777 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-042b2ddf-b754-49cf-a3d4-94172e907657 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.153519 Oct 22 04:02:54.948108 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3570/7001] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:54 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:02:55.971015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:55.971626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:55.979119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:55.979610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:55.980048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:55.980792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:55.981251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:55.981676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:56.120322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:56.127946 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a74caf75-9cfb-4ac1-b5f2-cfa4571e27d4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.160913 Oct 22 04:02:56.128555 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3432/7002] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:55 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:57.152153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:57.152811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:57.159626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:57.160122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:57.160606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:57.161311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:57.161781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:57.162224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:57.298507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:57.306322 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e36e58a9-26d9-459c-be09-2d8b92f750ad tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.158588 Oct 22 04:02:57.306942 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3571/7003] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:57 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:58.330920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:58.331833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:58.340368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:58.340368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:58.340827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:58.341537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:58.341996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:58.342425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:58.477140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:58.485413 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ffb3b45c-9be0-41fa-a4f4-eb8f031f7f11 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.158539 Oct 22 04:02:58.485979 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3433/7004] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:58 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:02:59.508990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:02:59.509615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:02:59.517431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:59.517968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:59.518413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:59.519116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:02:59.519611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:02:59.520051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:02:59.651142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:02:59.658837 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bbd2b756-4141-48e8-9c8a-a754041c040b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.153777 Oct 22 04:02:59.659417 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3572/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:02:59 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:00.682021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:00.682640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:00.689560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:00.690030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:00.690479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:00.691182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:00.691645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:00.692082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:00.826203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:00.833939 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-55810ac6-2d9f-45f6-b144-ace13489f383 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.155927 Oct 22 04:03:00.834524 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3434/7006] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:00 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:01.857392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:01.857969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:01.864922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:01.865420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:01.865875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:01.866583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:01.867054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:01.867496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:02.001505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:02.009171 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13b761e5-bbbb-4e2a-9589-4095815e317f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.155992 Oct 22 04:03:02.009811 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3573/7007] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:01 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:03.033076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:03.033683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:03.040629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:03.041638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:03.042084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:03.042775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:03.043245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:03.043657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:03.172087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:03.179908 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f76c37b8-6525-4943-b25b-bbb22d0b3f16 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.150742 Oct 22 04:03:03.180516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3435/7008] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:03 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:04.203639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:04.204302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:04.211108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:04.211602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:04.212055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:04.213416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:04.214010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:04.214422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:04.344963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:04.352651 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e08e2c53-2436-4643-a814-5c79076a5b83 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.152936 Oct 22 04:03:04.353226 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3574/7009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:04 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:05.375632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:05.376260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:05.383079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:05.383557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:05.383986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:05.385318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:05.385785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:05.386204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:05.520331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:05.528555 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-21fdd01d-04ae-4dd6-b8a8-17b9daa1f560 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.156815 Oct 22 04:03:05.529120 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3436/7010] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:05 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:06.551029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:06.551685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:06.558692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:06.559189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:06.559642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:06.560385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:06.560855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:06.561298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:06.691532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:06.700463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8830d4bf-388a-4a48-929b-21c2cd5689e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.153368 Oct 22 04:03:06.701047 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3575/7011] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:06 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:07.724025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:07.724594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:07.731985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:07.732490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:07.732927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:07.733608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:07.734057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:07.734481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:07.870016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:07.877741 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b750919a-b5a4-4181-bcd2-576957bc7b0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.157625 Oct 22 04:03:07.878308 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3437/7012] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:07 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:08.902249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:08.902877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:08.909789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:08.910287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:08.910744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:08.911455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:08.911931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:08.912413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:09.045231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:09.052927 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-944800a9-c4ba-4670-b8f6-0886f3b5e18d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.155374 Oct 22 04:03:09.053502 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3576/7013] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:08 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:10.076649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:10.077194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:10.084931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:10.085421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:10.085867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:10.086575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:10.087028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:10.088422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:10.219809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:10.227491 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c71dd73f-33dd-40a3-938e-d7bfd8b899bd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.155502 Oct 22 04:03:10.228078 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3438/7014] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:10 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:11.251314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:11.251938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:11.258936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:11.259436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:11.260408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:11.261125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:11.261861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:11.262304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:11.395924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:11.403784 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d96023b-0254-40d8-9b96-2a4176d27a50 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.156445 Oct 22 04:03:11.404403 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3577/7015] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:11 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:12.427237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:12.427937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:12.434352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:12.434828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:12.435262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:12.435947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:12.436433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:12.436953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:12.571636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:12.579847 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7f8a3a58-bb76-44d8-91c5-e6f664e41035 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.156628 Oct 22 04:03:12.580457 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3439/7016] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:12 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:13.602886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:13.603508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:13.610915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:13.611409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:13.611857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:13.612593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:13.613057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:13.613526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:13.633775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:13.750159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:13.757800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-77dc551e-286f-4b4b-a5f3-c4b5cbe427bc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.158944 Oct 22 04:03:13.758369 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3578/7017] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:13 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:14.781888 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:14.782425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:14.789354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:14.789824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:14.790252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:14.791086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:14.791518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:14.792118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:14.919935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:14.927756 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-860bada5-fef8-46a7-bd9a-4bf6b99f6b9c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.149846 Oct 22 04:03:14.928353 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3440/7018] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:14 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:15.950976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:15.951607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:15.958670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:15.959173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:15.959631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:15.960416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:15.960880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:15.961328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:16.098081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:16.107437 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0d8f55db-138a-4736-a325-94c7385f987d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.160631 Oct 22 04:03:16.108020 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3579/7019] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:15 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:17.130925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:17.131578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:17.139370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:17.139855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:17.140324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:17.141024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:17.141482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:17.141910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:17.270235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:17.278805 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-abc70398-dd87-452b-a8a7-297423a24ec9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.151847 Oct 22 04:03:17.279382 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3441/7020] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:17 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:18.302478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:18.303135 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:18.310252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:18.310755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:18.311212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:18.311928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:18.312433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:18.312882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:18.447819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:18.455854 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-466070b9-7593-44dc-bd7d-c89b7dc58df8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.157511 Oct 22 04:03:18.456472 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3580/7021] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:18 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:19.480438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:19.481054 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:19.491612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:19.492096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:19.492575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:19.493274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:19.493728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:19.494915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:19.627673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:19.636058 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6f45f97a-8e98-4ab4-8e4f-6543caed5ab7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.160269 Oct 22 04:03:19.636921 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3442/7022] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:19 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:20.660194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:20.660843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:20.667794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:20.668384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:20.668834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:20.669533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:20.669998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:20.670433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:20.805514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:20.813891 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10ec4b1a-7322-4c0e-8ca4-7d0fc3ed4b7f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1520 microversion: 2.1 time: 0.157613 Oct 22 04:03:20.814477 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3581/7023] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:20 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:21.779450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-61c9efe8-dab5-4b1c-81b4-357844b7b0b2 req-1f0835d4-6c6d-45d5-9482-3d18eb991a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3662a8-e128-4886-b561-199e49ab9f55", "name": "network-vif-unplugged", "status": "completed", "tag": "a23f418c-1a2c-4d45-8e68-faa7797d810a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:21.789520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-61c9efe8-dab5-4b1c-81b4-357844b7b0b2 req-1f0835d4-6c6d-45d5-9482-3d18eb991a46 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:21.789921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-61c9efe8-dab5-4b1c-81b4-357844b7b0b2 req-1f0835d4-6c6d-45d5-9482-3d18eb991a46 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:21.790354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-61c9efe8-dab5-4b1c-81b4-357844b7b0b2 req-1f0835d4-6c6d-45d5-9482-3d18eb991a46 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:21.802813 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-61c9efe8-dab5-4b1c-81b4-357844b7b0b2 req-1f0835d4-6c6d-45d5-9482-3d18eb991a46 service nova] Creating event network-vif-unplugged:a23f418c-1a2c-4d45-8e68-faa7797d810a for instance ff3662a8-e128-4886-b561-199e49ab9f55 on n-h1-862416-2 Oct 22 04:03:21.809118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-61c9efe8-dab5-4b1c-81b4-357844b7b0b2 req-1f0835d4-6c6d-45d5-9482-3d18eb991a46 service nova] Instance ff3662a8-e128-4886-b561-199e49ab9f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:03:21.819989 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-61c9efe8-dab5-4b1c-81b4-357844b7b0b2 req-1f0835d4-6c6d-45d5-9482-3d18eb991a46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096899 Oct 22 04:03:21.820642 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3443/7024] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:03:21.838302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:21.839158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:21.845746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:21.846246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:21.846698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:21.847408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:21.847877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:21.848350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:21.985555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:21.993621 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3f844de9-f6bb-4d04-9de5-e9abb059634d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1519 microversion: 2.1 time: 0.159639 Oct 22 04:03:21.995499 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3582/7025] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:21 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:03:23.020673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:23.021330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:23.028465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:23.028986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:23.029432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:23.030137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:23.030599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:23.031035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:23.166181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:23.173775 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ff768fe-dc47-4821-afd7-5a2ce500a23b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1517 microversion: 2.1 time: 0.158348 Oct 22 04:03:23.174362 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3444/7026] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:23 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:23.836652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-15f74016-fec8-4b37-b5ad-84c27ab1eda2 req-85396aa1-475e-4673-b15e-d8782a162970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3662a8-e128-4886-b561-199e49ab9f55", "tag": "a23f418c-1a2c-4d45-8e68-faa7797d810a"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:23.842657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=28 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:23.849044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-15f74016-fec8-4b37-b5ad-84c27ab1eda2 req-85396aa1-475e-4673-b15e-d8782a162970 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:23.849528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-15f74016-fec8-4b37-b5ad-84c27ab1eda2 req-85396aa1-475e-4673-b15e-d8782a162970 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:23.849969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-15f74016-fec8-4b37-b5ad-84c27ab1eda2 req-85396aa1-475e-4673-b15e-d8782a162970 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:23.861893 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-15f74016-fec8-4b37-b5ad-84c27ab1eda2 req-85396aa1-475e-4673-b15e-d8782a162970 service nova] Creating event network-changed:a23f418c-1a2c-4d45-8e68-faa7797d810a for instance ff3662a8-e128-4886-b561-199e49ab9f55 on n-h1-862416-2 Oct 22 04:03:23.867094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-15f74016-fec8-4b37-b5ad-84c27ab1eda2 req-85396aa1-475e-4673-b15e-d8782a162970 service nova] Instance ff3662a8-e128-4886-b561-199e49ab9f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:03:23.878020 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-15f74016-fec8-4b37-b5ad-84c27ab1eda2 req-85396aa1-475e-4673-b15e-d8782a162970 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045321 Oct 22 04:03:23.878603 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3583/7027] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:03:24.199001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:24.199613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:24.202416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=28 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:24.207603 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:24.208087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:24.208548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:24.209374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:24.209868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:24.210292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:24.214952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=82 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:24.513464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:24.521647 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-420e99bb-7773-472b-8d61-c0d69d9433e1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1517 microversion: 2.1 time: 0.327835 Oct 22 04:03:24.522607 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3445/7028] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:24 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1517 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:25.547815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:25.548579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:25.554926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:25.555430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:25.555886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:25.557147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:25.557729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:25.558178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:25.699097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:25.706920 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2f905f96-1df1-462b-bd8a-4c0630bf999e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1514 microversion: 2.1 time: 0.164235 Oct 22 04:03:25.707515 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3584/7029] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:25 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:03:25.729371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:25.729971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:25.736985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:25.737475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:25.737911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:25.738619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:25.739076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:25.739509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:25.798290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c188e38f-a9f7-4033-8833-6fef6efd5ca2 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "POST /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55/action" status: 204 len: 0 microversion: 2.1 time: 0.072681 Oct 22 04:03:25.798879 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3446/7030] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:03:25 2022] POST /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:03:25.807592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:25.808241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:25.814239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:25.814743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:25.815200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:25.815951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:25.816411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:25.816856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:25.953334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:25.961239 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d0b2230-8f88-4940-ab08-8426afe0dd51 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1514 microversion: 2.1 time: 0.158126 Oct 22 04:03:25.961821 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3585/7031] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:25 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:03:26.985648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:26.986677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:26.993611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:26.994632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:26.995076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:26.995767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:26.996234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:26.996667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:27.135409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:27.144131 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-691e3266-1eb7-428e-8a01-ccebfb2cc456 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1506 microversion: 2.1 time: 0.163150 Oct 22 04:03:27.144747 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3447/7032] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:26 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:27.167589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:27.168235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:27.175021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:27.175514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:27.175970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:27.176709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:27.177178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:27.177618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:27.319361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:27.335409 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-40cbf2d9-0598-4bfc-8b6d-dec88655f846 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1506 microversion: 2.1 time: 0.172129 Oct 22 04:03:27.336542 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3586/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:27 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:27.363424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-996b63d4-7556-48a1-a489-383b03f8cb0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Action: 'create', calling method: .version_select at 0x7f0d1a1e3670>, body: {"keypair": {"name": "tempest-keypair-1747657470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPooupQSC3x/BEgZXll6ZqjNDuWU1f7s08iv7DZfuwTaWGPC84FGGO9R2C2Hx1NCb37yZKwT2c3zC3eEoXGocJh4ZH+oX9W5XCNLxBY87NaOn0JLCXGXnyjeNLRaX5+5ow=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:27.381014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-996b63d4-7556-48a1-a489-383b03f8cb0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Getting quotas for project a72400f54df2461fb444e1a4d2360802. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:03:27.387979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-996b63d4-7556-48a1-a489-383b03f8cb0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Getting quotas for user cba10708636e4433bdb720cfaf27922e and project a72400f54df2461fb444e1a4d2360802. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:03:27.412092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e9b11b5c-c263-4bf7-8111-da964d7b037e req-cc154ada-2d4d-4f3f-9f93-975127044ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3662a8-e128-4886-b561-199e49ab9f55", "name": "network-vif-plugged", "status": "completed", "tag": "a23f418c-1a2c-4d45-8e68-faa7797d810a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:27.415614 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-996b63d4-7556-48a1-a489-383b03f8cb0b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056185 Oct 22 04:03:27.416764 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3587/7034] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:03:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:03:27.423960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e9b11b5c-c263-4bf7-8111-da964d7b037e req-cc154ada-2d4d-4f3f-9f93-975127044ec2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:27.424608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e9b11b5c-c263-4bf7-8111-da964d7b037e req-cc154ada-2d4d-4f3f-9f93-975127044ec2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:27.425056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e9b11b5c-c263-4bf7-8111-da964d7b037e req-cc154ada-2d4d-4f3f-9f93-975127044ec2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:27.437055 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e9b11b5c-c263-4bf7-8111-da964d7b037e req-cc154ada-2d4d-4f3f-9f93-975127044ec2 service nova] Creating event network-vif-plugged:a23f418c-1a2c-4d45-8e68-faa7797d810a for instance ff3662a8-e128-4886-b561-199e49ab9f55 on n-h1-862416-2 Oct 22 04:03:27.442622 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e9b11b5c-c263-4bf7-8111-da964d7b037e req-cc154ada-2d4d-4f3f-9f93-975127044ec2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092170 Oct 22 04:03:27.443497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3448/7035] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:03:28.591922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:28.592580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:28.599467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:28.599967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:28.600444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:28.601147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:28.601611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:28.602050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:28.732169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:28.740049 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8875cef-aa3c-4764-998d-fc5d2a22cb08 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 200 len: 1506 microversion: 2.1 time: 0.153680 Oct 22 04:03:28.740669 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3588/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:28 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:28.764395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:28.764975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:28.771023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:28.771499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:28.771935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:28.772645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:28.773101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:28.773524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:28.799649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:03:28.876857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d513200-ab0c-4d80-8dc6-a2a1576bd7a1 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 204 len: 0 microversion: 2.1 time: 0.117275 Oct 22 04:03:28.877877 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3449/7037] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:03:28 2022] DELETE /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:03:28.933918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2127927672", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "53f05f11-f79f-4c2f-97b9-12315fcdb1d8"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:28.987980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] validate_networks() for [('53f05f11-f79f-4c2f-97b9-12315fcdb1d8', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:03:29.438804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:03:29.439238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:03:29.439726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:03:29.440146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:03:29.440592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:03:29.449655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:29.450147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:29.450594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:29.451330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:29.451793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:29.452249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:29.469464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Getting quotas for project a72400f54df2461fb444e1a4d2360802. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:03:29.474735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Getting quotas for user cba10708636e4433bdb720cfaf27922e and project a72400f54df2461fb444e1a4d2360802. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:03:29.487586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:03:29.489878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:03:29.542528 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-476b2f6a-74e3-40b9-8b16-7154daf08aba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612405 Oct 22 04:03:29.543404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3589/7038] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:03:29.555807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28158363-e704-4e5e-9206-8cf591a5a160 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:29.557222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28158363-e704-4e5e-9206-8cf591a5a160 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:29.614486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28158363-e704-4e5e-9206-8cf591a5a160 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:29.621509 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28158363-e704-4e5e-9206-8cf591a5a160 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1218 microversion: 2.1 time: 0.070325 Oct 22 04:03:29.622083 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3450/7039] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:29 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:30.645428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:30.646061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:30.654341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:30.654805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:30.655264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:30.655989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:30.656671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:30.657120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:30.721728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:30.732494 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-606846a8-0731-453a-b40c-3860913aacbf tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1270 microversion: 2.1 time: 0.090855 Oct 22 04:03:30.733137 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3590/7040] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:30 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:03:30.819216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-69d70716-c582-4435-b149-4dbb30354d72 req-416413fd-70be-4d4e-aa99-c4796121bd81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3662a8-e128-4886-b561-199e49ab9f55", "name": "network-vif-deleted", "tag": "a23f418c-1a2c-4d45-8e68-faa7797d810a"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:30.834857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-69d70716-c582-4435-b149-4dbb30354d72 req-416413fd-70be-4d4e-aa99-c4796121bd81 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:30.835342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-69d70716-c582-4435-b149-4dbb30354d72 req-416413fd-70be-4d4e-aa99-c4796121bd81 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:30.835775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-69d70716-c582-4435-b149-4dbb30354d72 req-416413fd-70be-4d4e-aa99-c4796121bd81 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:30.848283 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-69d70716-c582-4435-b149-4dbb30354d72 req-416413fd-70be-4d4e-aa99-c4796121bd81 service nova] Creating event network-vif-deleted:a23f418c-1a2c-4d45-8e68-faa7797d810a for instance ff3662a8-e128-4886-b561-199e49ab9f55 on n-h1-862416-2 Oct 22 04:03:30.859044 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-69d70716-c582-4435-b149-4dbb30354d72 req-416413fd-70be-4d4e-aa99-c4796121bd81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043507 Oct 22 04:03:30.859921 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3451/7041] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:03:31.757827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:31.759179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:31.766943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:31.767130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:31.767541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:31.768286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:31.768795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:31.769242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:31.908388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:31.916125 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb3ac95b-4b51-4bff-901d-2867591be7fb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1318 microversion: 2.1 time: 0.162512 Oct 22 04:03:31.932234 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3591/7042] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:31 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:32.875490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5afb7988-6245-4493-abf5-2c57edc031f0 req-64821e52-b600-4030-ad41-eab67ac38e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7c4114-72fa-4152-acd2-f01111e02314", "tag": "e478e9a1-6869-48c6-8203-5da6ee42cd96"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:32.886143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5afb7988-6245-4493-abf5-2c57edc031f0 req-64821e52-b600-4030-ad41-eab67ac38e2c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:32.886628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5afb7988-6245-4493-abf5-2c57edc031f0 req-64821e52-b600-4030-ad41-eab67ac38e2c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:32.887321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5afb7988-6245-4493-abf5-2c57edc031f0 req-64821e52-b600-4030-ad41-eab67ac38e2c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:32.900999 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5afb7988-6245-4493-abf5-2c57edc031f0 req-64821e52-b600-4030-ad41-eab67ac38e2c service nova] Creating event network-changed:e478e9a1-6869-48c6-8203-5da6ee42cd96 for instance 7d7c4114-72fa-4152-acd2-f01111e02314 on n-h1-862416-2 Oct 22 04:03:32.905793 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5afb7988-6245-4493-abf5-2c57edc031f0 req-64821e52-b600-4030-ad41-eab67ac38e2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034460 Oct 22 04:03:32.906386 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3452/7043] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:03:32.939314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:32.939932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:32.947095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:32.947703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:32.948701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:32.949411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:32.949882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:32.950326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:33.081240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:33.089822 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08bd80a2-a3a7-4167-870a-0614d817a401 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1318 microversion: 2.1 time: 0.154371 Oct 22 04:03:33.090399 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3592/7044] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:32 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:34.114842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:34.115532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:34.122186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:34.122659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:34.123091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:34.123779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:34.124251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:34.124678 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:34.268462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:34.276162 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d5abcdf-bfb7-48e4-8eca-2b1f187fd993 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1318 microversion: 2.1 time: 0.166366 Oct 22 04:03:34.276851 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3453/7045] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:34 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:35.299408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:35.300072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:35.307535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:35.308158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:35.308644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:35.309366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:35.309841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:35.310291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:35.445992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:35.455508 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-10af025b-6eb9-44be-8954-0c50d3ec72a7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1318 microversion: 2.1 time: 0.160098 Oct 22 04:03:35.456104 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3593/7046] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:35 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:36.479016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:36.479655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:36.487339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:36.487826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:36.488322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:36.489053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:36.489512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:36.489944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:36.621936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:36.629605 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2ed82755-6ab8-400e-8c5d-c8c86d10669b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1318 microversion: 2.1 time: 0.154521 Oct 22 04:03:36.630178 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3454/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:36 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:37.348937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d3b54e92-20f0-4ee1-a6fe-7b161f618fa9 req-4b720649-c5ac-4320-b883-26e8740c1509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7c4114-72fa-4152-acd2-f01111e02314", "name": "network-vif-plugged", "status": "completed", "tag": "e478e9a1-6869-48c6-8203-5da6ee42cd96"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:37.362913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d3b54e92-20f0-4ee1-a6fe-7b161f618fa9 req-4b720649-c5ac-4320-b883-26e8740c1509 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:37.363486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d3b54e92-20f0-4ee1-a6fe-7b161f618fa9 req-4b720649-c5ac-4320-b883-26e8740c1509 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:37.363964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d3b54e92-20f0-4ee1-a6fe-7b161f618fa9 req-4b720649-c5ac-4320-b883-26e8740c1509 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:37.376982 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d3b54e92-20f0-4ee1-a6fe-7b161f618fa9 req-4b720649-c5ac-4320-b883-26e8740c1509 service nova] Creating event network-vif-plugged:e478e9a1-6869-48c6-8203-5da6ee42cd96 for instance 7d7c4114-72fa-4152-acd2-f01111e02314 on n-h1-862416-2 Oct 22 04:03:37.382256 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d3b54e92-20f0-4ee1-a6fe-7b161f618fa9 req-4b720649-c5ac-4320-b883-26e8740c1509 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037117 Oct 22 04:03:37.382861 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3594/7048] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:03:37.653548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:37.654160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:37.661117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:37.661600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:37.662040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:37.662737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:37.663198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:37.663627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:37.795861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:37.803674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e8a9df2-a867-4d0c-9a28-a0062ecafcde tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1318 microversion: 2.1 time: 0.154775 Oct 22 04:03:37.804267 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3455/7049] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:37 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:38.826949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:38.827657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:38.834794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:38.835289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:38.835740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:38.836853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:38.836943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:38.837429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:38.967996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:38.976018 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b52301e-0a86-4d97-b4af-6c7990c02ebc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1507 microversion: 2.1 time: 0.153335 Oct 22 04:03:38.976624 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3595/7050] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:38 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:38.999088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:38.999694 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:39.006523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:39.007005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:39.007441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:39.008139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:39.008617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:39.009072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:39.140532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:39.148322 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4483215-4423-4431-8ca5-da8007dfc8df tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1507 microversion: 2.1 time: 0.153752 Oct 22 04:03:39.148900 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3456/7051] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:38 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:39.171022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:03:39.173349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:39.179190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:39.179678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:39.180126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:39.180877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:39.181340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:39.181774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:39.211245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:39.217217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Old instance type m1.heat2, new instance type m1.heat {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:03:39.223799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:03:39.224292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:03:39.224785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:03:39.225211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:03:39.225638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:03:39.263663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:39.291486 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0abc14a2-1d55-4aaf-a916-0ad072bfa23f tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "POST /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314/action" status: 202 len: 0 microversion: 2.1 time: 0.124411 Oct 22 04:03:39.292154 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3596/7052] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:03:39 2022] POST /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:03:39.300584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:39.301320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:39.307266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:39.307751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:39.308701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:39.309685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:39.310149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:39.310579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:39.469298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:39.478141 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff177e3e-f5a3-42e3-a978-4900c0928d05 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1514 microversion: 2.1 time: 0.181336 Oct 22 04:03:39.479002 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3457/7053] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:39 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:40.502855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:40.503481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:40.506441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:40.507287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=10 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:40.513819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:40.514326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:40.515007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:40.515735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:40.516456 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:40.516830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:40.673416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:40.682090 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-74713b7a-71ce-40a1-893a-9bd2346db9dd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1514 microversion: 2.1 time: 0.183063 Oct 22 04:03:40.684662 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3597/7054] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:40 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:41.707691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:41.708341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:41.710451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:41.716416 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:41.716900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:41.717338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:41.718035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:41.718486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:41.718914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:42.160198 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:42.168419 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fe0a8846-32cb-4384-97d0-cf7a5fbf8ceb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.464601 Oct 22 04:03:42.169006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3458/7055] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:41 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:43.192703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:43.193329 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:43.200227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:43.200731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:43.201183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:43.201888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:43.202363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:43.202806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:43.333684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:43.341904 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-887200dc-a73e-4011-aa6f-8fbdf1e82d5c tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.153145 Oct 22 04:03:43.342479 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3598/7056] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:43 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:44.365722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:44.366258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:44.373650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:44.374132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:44.374569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:44.375263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:44.375719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:44.376149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:44.508401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:44.517126 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4772d232-a6e5-4a2c-ac2e-ccbbce3755a6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.155460 Oct 22 04:03:44.517700 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3459/7057] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:44 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:45.539671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:45.540357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:45.547241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:45.547729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:45.548175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:45.548896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:45.549360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:45.549800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:45.686181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:45.694016 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc5dcd70-2f01-4863-a45d-cac06fae6be5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.158327 Oct 22 04:03:45.694593 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3599/7058] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:45 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:46.718982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:46.719592 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:46.726749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:46.727179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:46.727616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:46.728342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:46.728800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:46.729225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:46.860517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:46.868173 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-16d28cb4-aebe-4c7d-a40a-32a49e5ae29e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.153870 Oct 22 04:03:46.868781 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3460/7059] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:46 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:47.892044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:47.892725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:47.899451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:47.899952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:47.900438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:47.901157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:47.901680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:47.902131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:48.040055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:48.048516 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3d46af87-08d6-4195-a0fe-e40f1cca62ba tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.160437 Oct 22 04:03:48.049096 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3600/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:47 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:49.071961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:49.072593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:49.081550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:49.082029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:49.082463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:49.083151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:49.083600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:49.084028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:49.217841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:49.221255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:49.226244 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-72f1c3fa-0f33-46ba-8152-cd425357a5dc tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.158522 Oct 22 04:03:49.226823 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3461/7061] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:49 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:50.250361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:50.250991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:50.257945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:50.258449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:50.258907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:50.259617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:50.260092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:50.260593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:50.390711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:50.398679 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8ee87821-13c2-4762-b088-38f9f24fc24b tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.152825 Oct 22 04:03:50.399266 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3601/7062] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:50 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:51.424387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:51.424993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:51.432357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:51.432846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:51.433994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:51.434716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:51.435176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:51.435606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:51.567009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:51.575370 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-581eb6f2-8acc-43d6-ac08-db4ff06f00b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.155614 Oct 22 04:03:51.575957 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3462/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:51 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:52.599077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:52.599706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:52.609426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:52.609931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:52.610385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:52.611094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:52.611563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:52.612007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:52.746508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:52.754304 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ed646dcd-9f79-4b7a-89c3-33bc67fa6053 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.159219 Oct 22 04:03:52.754885 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3602/7064] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:52 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:53.778455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:53.779006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:53.787832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:53.788345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:53.788787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:53.789487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:53.789939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:53.790368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:53.941377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:53.950471 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e84b3e28-f8d9-46b4-a777-6946033f70eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.176233 Oct 22 04:03:53.951054 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3463/7065] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:53 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:54.974922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:54.975573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:54.977957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:54.983965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:54.984489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:54.984943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:54.985649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:54.986121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:54.986563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:55.116406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:55.124350 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d0733b2d-ed08-4361-8b77-eca52ff209f5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.153582 Oct 22 04:03:55.124927 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3603/7066] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:54 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:56.147684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:56.148307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:56.150997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:03:56.156959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:56.157444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:56.157883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:56.158581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:56.159034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:56.159462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:56.285585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:56.293393 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f0b91e61-fc9a-4df8-923b-609dea098264 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.149664 Oct 22 04:03:56.293971 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3464/7067] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:56 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:57.317087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:57.317711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:57.325065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:57.325564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:57.326012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:57.326713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:57.327180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:57.327618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:57.470490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:57.478421 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3b702d55-d7fc-447c-be88-81d7218195b5 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.165230 Oct 22 04:03:57.479013 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3604/7068] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:57 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:58.501106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:58.501720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:58.509325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:58.509812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:58.510251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:58.510946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:58.512900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:58.513331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:58.648583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:58.656389 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-96fef06f-4ec1-4c71-9982-5425f0e39036 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.159142 Oct 22 04:03:58.656981 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3465/7069] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:58 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:03:59.680113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:03:59.680760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:03:59.688702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:59.689193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:59.689639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:59.690339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:03:59.690801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:03:59.691235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:03:59.823093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:03:59.831047 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23f358a1-9ed8-44ef-ae8b-b072797fc6eb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.154886 Oct 22 04:03:59.831631 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3605/7070] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:03:59 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:00.854251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:00.856061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:00.863539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:00.864017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:00.864486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:00.865172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:00.865622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:00.866047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:00.994301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:01.002057 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2de0d502-c898-4899-bb0a-3133f4a02fc7 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.151683 Oct 22 04:04:01.002641 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3466/7071] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:00 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:02.025957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:02.026630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:02.033569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:02.034063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:02.034511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:02.035213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:02.035679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:02.036119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:02.165469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:02.173903 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-38e15378-7132-4ebe-8030-cc6f63ccc0d8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.151978 Oct 22 04:04:02.174486 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3606/7072] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:02 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:03.198112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:03.199599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:03.206219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:03.206697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:03.207132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:03.207819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:03.208301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:03.208727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:03.338409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:03.346480 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4815d8ac-aec2-4ae4-87ec-12b5c6a0bdb6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.152407 Oct 22 04:04:03.347050 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3467/7073] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:03 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:04.369819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:04.371567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:04.378573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:04.379060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:04.379508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:04.380235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:04.380692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:04.381131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:04.515642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:04.523316 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-518505f8-f0ee-4a2b-8d2d-a203940ec46d tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.157450 Oct 22 04:04:04.523891 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3607/7074] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:04 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:05.547407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:05.548026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:05.554980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:05.555470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:05.555915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:05.556657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:05.557116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:05.557550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:05.688396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:05.696021 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c56d4ff4-c8c6-4f7a-b6b3-571844b25528 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.152562 Oct 22 04:04:05.696669 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3468/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:05 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:06.720511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:06.721167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:06.728023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:06.728492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:06.728945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:06.729652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:06.730147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:06.730592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:06.858194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:06.865895 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e5280db-b090-49ab-98d0-7fe0662bc1f9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.149432 Oct 22 04:04:06.866471 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3608/7076] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:06 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:07.890835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:07.891481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:07.898293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:07.898781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:07.899221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:07.899920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:07.900485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:07.900915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:08.040430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:08.049426 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e640bbb8-6cdd-4aed-94e3-a476b4522da8 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1519 microversion: 2.1 time: 0.163268 Oct 22 04:04:08.050206 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3469/7077] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:07 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:08.489771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ce48f35e-c346-42a4-9fb9-5943551dfb55 req-f533a636-efa9-440e-839b-a8e18eb9c430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7c4114-72fa-4152-acd2-f01111e02314", "name": "network-vif-unplugged", "status": "completed", "tag": "e478e9a1-6869-48c6-8203-5da6ee42cd96"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:08.499312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ce48f35e-c346-42a4-9fb9-5943551dfb55 req-f533a636-efa9-440e-839b-a8e18eb9c430 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:08.499907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ce48f35e-c346-42a4-9fb9-5943551dfb55 req-f533a636-efa9-440e-839b-a8e18eb9c430 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:08.500242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ce48f35e-c346-42a4-9fb9-5943551dfb55 req-f533a636-efa9-440e-839b-a8e18eb9c430 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:08.512477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ce48f35e-c346-42a4-9fb9-5943551dfb55 req-f533a636-efa9-440e-839b-a8e18eb9c430 service nova] Creating event network-vif-unplugged:e478e9a1-6869-48c6-8203-5da6ee42cd96 for instance 7d7c4114-72fa-4152-acd2-f01111e02314 on n-h2-862416-2 Oct 22 04:04:08.518001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-ce48f35e-c346-42a4-9fb9-5943551dfb55 req-f533a636-efa9-440e-839b-a8e18eb9c430 service nova] Instance 7d7c4114-72fa-4152-acd2-f01111e02314 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:04:08.529679 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ce48f35e-c346-42a4-9fb9-5943551dfb55 req-f533a636-efa9-440e-839b-a8e18eb9c430 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044544 Oct 22 04:04:08.530503 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3609/7078] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:04:09.073125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:09.074751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:09.081399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:09.081885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:09.082355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:09.083056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:09.083517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:09.083947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:09.312889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:09.320504 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7e776e64-1c74-4a81-8577-8c3438020898 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1518 microversion: 2.1 time: 0.251283 Oct 22 04:04:09.321081 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3470/7079] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:09 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:10.346263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:10.347000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:10.353167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:10.353667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:10.354120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:10.355437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:10.355907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:10.356380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:10.360383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:10.559856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-316129cc-4516-41a5-a619-3c937bb4dcfc req-aa09aabd-99de-464e-9ccc-97aaba18a5fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7c4114-72fa-4152-acd2-f01111e02314", "tag": "e478e9a1-6869-48c6-8203-5da6ee42cd96"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:10.570725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-316129cc-4516-41a5-a619-3c937bb4dcfc req-aa09aabd-99de-464e-9ccc-97aaba18a5fb service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:10.571205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-316129cc-4516-41a5-a619-3c937bb4dcfc req-aa09aabd-99de-464e-9ccc-97aaba18a5fb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:10.571641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-316129cc-4516-41a5-a619-3c937bb4dcfc req-aa09aabd-99de-464e-9ccc-97aaba18a5fb service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:10.587471 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-316129cc-4516-41a5-a619-3c937bb4dcfc req-aa09aabd-99de-464e-9ccc-97aaba18a5fb service nova] Creating event network-changed:e478e9a1-6869-48c6-8203-5da6ee42cd96 for instance 7d7c4114-72fa-4152-acd2-f01111e02314 on n-h2-862416-2 Oct 22 04:04:10.594037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-316129cc-4516-41a5-a619-3c937bb4dcfc req-aa09aabd-99de-464e-9ccc-97aaba18a5fb service nova] Instance 7d7c4114-72fa-4152-acd2-f01111e02314 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:04:10.605969 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-316129cc-4516-41a5-a619-3c937bb4dcfc req-aa09aabd-99de-464e-9ccc-97aaba18a5fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049732 Oct 22 04:04:10.606598 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3471/7080] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:04:10.742171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:10.750099 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef6d8651-e82f-4c5e-8964-f0561ba14093 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1516 microversion: 2.1 time: 0.408941 Oct 22 04:04:10.750686 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3610/7081] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:10 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1516 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:11.775441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:11.776137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:11.782551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:11.783030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:11.783463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:11.784160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:11.784642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:11.785066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:11.927505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:11.935908 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1bb0e729-8aaa-4662-99ca-52eaba2349e6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1516 microversion: 2.1 time: 0.165603 Oct 22 04:04:11.936595 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3472/7082] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:11 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:12.959660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:12.960313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:12.967222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:12.967720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:12.968171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:12.968897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:12.969371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:12.969812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:13.107666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:13.115765 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a34217e9-354d-49ec-ad68-7cab9d42dd47 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1513 microversion: 2.1 time: 0.161503 Oct 22 04:04:13.116414 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3611/7083] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:12 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:13.139629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:13.140229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:13.147141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:13.147624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:13.148064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:13.148801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:13.149257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:13.149684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:13.206305 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eba0edf8-0f98-44cb-8da6-22c3ee106265 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "POST /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314/action" status: 204 len: 0 microversion: 2.1 time: 0.071635 Oct 22 04:04:13.206986 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3473/7084] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:04:13 2022] POST /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:04:13.215097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:13.215752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:13.221879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:13.222375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:13.222828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:13.223546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:13.224017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:13.224486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:13.359642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:13.367561 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3080593c-0778-45e3-8165-d6ef9bacff6e tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1513 microversion: 2.1 time: 0.156308 Oct 22 04:04:13.368527 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3612/7085] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:13 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:14.393971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:14.394581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:14.401200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:14.401820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:14.402452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:14.403174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:14.403627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:14.404066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:14.543703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:14.551527 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a87607a-e90b-4e55-b7b0-1ed8e19badfd tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1513 microversion: 2.1 time: 0.162808 Oct 22 04:04:14.552123 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3474/7086] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:14 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:15.575823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:15.576614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:15.584051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:15.584600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:15.585057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:15.585778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:15.586246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:15.586697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:15.724231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:15.733176 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5bf7c4a-9b6f-43b4-9e6c-ad33ebd39dfe tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1505 microversion: 2.1 time: 0.161366 Oct 22 04:04:15.736709 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3613/7087] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:15 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:15.757037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:15.757869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:15.766094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:15.766584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:15.767026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:15.767767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:15.768249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:15.768685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:15.909659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:15.918556 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f787c9a6-e89e-4529-b867-c178db99d6bb tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1505 microversion: 2.1 time: 0.165816 Oct 22 04:04:15.919153 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3475/7088] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:15 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:04:15.941966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:15.942605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:15.948952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:15.949465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:15.949931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:15.950660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:15.951143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:15.951600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:16.001455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-40aa1fb8-74e5-4ca3-9407-0c0d4db6660e req-5a35b7ff-58a9-4b4a-b7ee-c59aefa876c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7c4114-72fa-4152-acd2-f01111e02314", "name": "network-vif-plugged", "status": "completed", "tag": "e478e9a1-6869-48c6-8203-5da6ee42cd96"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:16.013751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-40aa1fb8-74e5-4ca3-9407-0c0d4db6660e req-5a35b7ff-58a9-4b4a-b7ee-c59aefa876c4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:16.015096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-40aa1fb8-74e5-4ca3-9407-0c0d4db6660e req-5a35b7ff-58a9-4b4a-b7ee-c59aefa876c4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:16.015548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-40aa1fb8-74e5-4ca3-9407-0c0d4db6660e req-5a35b7ff-58a9-4b4a-b7ee-c59aefa876c4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:16.033613 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-40aa1fb8-74e5-4ca3-9407-0c0d4db6660e req-5a35b7ff-58a9-4b4a-b7ee-c59aefa876c4 service nova] Creating event network-vif-plugged:e478e9a1-6869-48c6-8203-5da6ee42cd96 for instance 7d7c4114-72fa-4152-acd2-f01111e02314 on n-h2-862416-2 Oct 22 04:04:16.039069 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-40aa1fb8-74e5-4ca3-9407-0c0d4db6660e req-5a35b7ff-58a9-4b4a-b7ee-c59aefa876c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046792 Oct 22 04:04:16.040223 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3476/7089] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:04:16.096261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:16.104529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d43f49f2-c5a5-4fd0-9c05-9a4f2aa8ee60 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1505 microversion: 2.1 time: 0.166263 Oct 22 04:04:16.105206 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3614/7090] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:15 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:16.127738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:16.128359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:16.134800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:16.135291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:16.136389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:16.137113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:16.137833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:16.138269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:16.163447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:04:16.190840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:16.244022 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d1c2c954-7868-4898-99f0-65bb33c3f008 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 204 len: 0 microversion: 2.1 time: 0.120074 Oct 22 04:04:16.244613 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3477/7091] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:04:16 2022] DELETE /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:04:16.262638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:16.263143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:16.269207 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:16.269697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:16.270140 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:16.270832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:16.271295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:16.271730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:16.296795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:04:16.345262 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.compute.api [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Instance is already in deleting state, ignoring this request Oct 22 04:04:16.346127 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4f23ec6a-3c2b-46d9-8e12-968707c0c172 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 204 len: 0 microversion: 2.1 time: 0.088524 Oct 22 04:04:16.346720 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3615/7092] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:04:16 2022] DELETE /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:04:16.356171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:16.356908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:16.363058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:16.363538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:16.364240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:16.364702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:16.365154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:16.365608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:16.497368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:16.505266 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ce255d2-2b1e-429d-9af3-1e2fb5bb38c4 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1511 microversion: 2.1 time: 0.154044 Oct 22 04:04:16.505839 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3478/7093] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:16 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:04:17.529809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:17.530359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:17.539934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:17.540600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:17.541049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:17.541755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:17.542863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:17.543303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:17.676773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:17.684529 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-987ddd20-257f-4c44-9624-73bf5d8de788 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1511 microversion: 2.1 time: 0.159615 Oct 22 04:04:17.685113 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3616/7094] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:17 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:18.187861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-eaa254e4-1b76-430a-92a3-76100786e1f8 req-63e7d335-01eb-41c7-b6c4-4d732c3ecbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7c4114-72fa-4152-acd2-f01111e02314", "name": "network-vif-deleted", "tag": "e478e9a1-6869-48c6-8203-5da6ee42cd96"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:18.201121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eaa254e4-1b76-430a-92a3-76100786e1f8 req-63e7d335-01eb-41c7-b6c4-4d732c3ecbdf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:18.201601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eaa254e4-1b76-430a-92a3-76100786e1f8 req-63e7d335-01eb-41c7-b6c4-4d732c3ecbdf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:18.202053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-eaa254e4-1b76-430a-92a3-76100786e1f8 req-63e7d335-01eb-41c7-b6c4-4d732c3ecbdf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:18.214338 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-eaa254e4-1b76-430a-92a3-76100786e1f8 req-63e7d335-01eb-41c7-b6c4-4d732c3ecbdf service nova] Creating event network-vif-deleted:e478e9a1-6869-48c6-8203-5da6ee42cd96 for instance 7d7c4114-72fa-4152-acd2-f01111e02314 on n-h2-862416-2 Oct 22 04:04:18.220329 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-eaa254e4-1b76-430a-92a3-76100786e1f8 req-63e7d335-01eb-41c7-b6c4-4d732c3ecbdf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036007 Oct 22 04:04:18.221018 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3479/7095] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:04:18.708892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:18.710258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:18.719131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:18.719927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:18.720587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:18.721877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:18.722356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:18.723044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:18.758598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:18.759129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:18.759582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:18.760048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lazy-loading 'fault' on Instance uuid 7d7c4114-72fa-4152-acd2-f01111e02314 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:04:18.803637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba10708636e4433bdb720cfaf27922e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72400f54df2461fb444e1a4d2360802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:18.811720 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e6ffeb31-16a4-4c4e-9996-c4841f32f4e9 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 200 len: 1306 microversion: 2.1 time: 0.107075 Oct 22 04:04:18.816179 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3617/7096] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:18 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:19.836676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:19.837372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: 7d7c4114-72fa-4152-acd2-f01111e02314] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:19.843670 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:19.844152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:19.844614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:19.845308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:19.845764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:19.846195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:19.859240 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] HTTP exception thrown: Instance 7d7c4114-72fa-4152-acd2-f01111e02314 could not be found. Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Request method failure captured: Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 HTTP/1.1 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2tgZM68pmpXYcwiYnzblG7Mn6QooechHnJRg8K6iEh6K8LbOpA7S0ok1Lia9_Vp6rq3SWT3dxLN1hpB91ji2Y35ryGTeuleoP-6QWf9d15eZehC30WHXPpTtuB4lSR3QEqfHHiUr8hFJ_ueM_NpiDxYNHVWe5yUzFmNGDstogKoqIM Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a72400f54df2461fb444e1a4d2360802 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a72400f54df2461fb444e1a4d2360802"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a72400f54df2461fb444e1a4d2360802"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a72400f54df2461fb444e1a4d2360802"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a72400f54df2461fb444e1a4d2360802"}]}] Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a72400f54df2461fb444e1a4d2360802 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerDiskConfigTestJSON-1908591523-project Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: cba10708636e4433bdb720cfaf27922e Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerDiskConfigTestJSON-1908591523-project Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 7d7c4114-72fa-4152-acd2-f01111e02314 could not be found. Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '7d7c4114-72fa-4152-acd2-f01111e02314'} Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7c4114-72fa-4152-acd2-f01111e02314 could not be found. Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7c4114-72fa-4152-acd2-f01111e02314 could not be found. Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:04:19.860890 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7c4114-72fa-4152-acd2-f01111e02314 could not be found. Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Returning 404 to user: Instance 7d7c4114-72fa-4152-acd2-f01111e02314 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1cc3f557-8a97-4f72-bd10-b15c53750201 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314" status: 404 len: 111 microversion: 2.1 time: 0.030949 Oct 22 04:04:19.865728 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3480/7097] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:19 2022] GET /compute/v2.1/servers/7d7c4114-72fa-4152-acd2-f01111e02314 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:04:19.872081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4c899ca-bebe-486f-b5c8-241eafd92202 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '.version_select at 0x7f0d19517280>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:19.891967 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4c899ca-bebe-486f-b5c8-241eafd92202 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747657470" status: 202 len: 0 microversion: 2.1 time: 0.024714 Oct 22 04:04:19.892560 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3618/7098] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Oct 22 04:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747657470 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:04:20.497836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:20.498334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:20.504440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:20.504957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:20.505397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:20.506091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:20.506547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:20.506973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:20.520523 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] HTTP exception thrown: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Request method failure captured: Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 HTTP/1.1 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2tgZM68pmpXYcwiYnzblG7Mn6QooechHnJRg8K6iEh6K8LbOpA7S0ok1Lia9_Vp6rq3SWT3dxLN1hpB91ji2Y35ryGTeuleoP-6QWf9d15eZehC30WHXPpTtuB4lSR3QEqfHHiUr8hFJ_ueM_NpiDxYNHVWe5yUzFmNGDstogKoqIM Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: a72400f54df2461fb444e1a4d2360802 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a72400f54df2461fb444e1a4d2360802"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a72400f54df2461fb444e1a4d2360802"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a72400f54df2461fb444e1a4d2360802"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a72400f54df2461fb444e1a4d2360802"}]}] Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: a72400f54df2461fb444e1a4d2360802 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerDiskConfigTestJSON-1908591523-project Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: cba10708636e4433bdb720cfaf27922e Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerDiskConfigTestJSON-1908591523-project Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'ff3662a8-e128-4886-b561-199e49ab9f55'} Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:04:20.522046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Returning 404 to user: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-690aab73-cf9c-4ef0-8ffe-9f71e025c6f6 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 404 len: 111 microversion: 2.1 time: 0.030047 Oct 22 04:04:20.527072 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3481/7099] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:04:20 2022] DELETE /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:04:20.532766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:20.533384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] [instance: ff3662a8-e128-4886-b561-199e49ab9f55] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:20.543388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:20.543889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:20.544385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:20.545093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:20.545562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:20.546002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:20.559518 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] HTTP exception thrown: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Request method failure captured: Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 HTTP/1.1 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2tgZM68pmpXYcwiYnzblG7Mn6QooechHnJRg8K6iEh6K8LbOpA7S0ok1Lia9_Vp6rq3SWT3dxLN1hpB91ji2Y35ryGTeuleoP-6QWf9d15eZehC30WHXPpTtuB4lSR3QEqfHHiUr8hFJ_ueM_NpiDxYNHVWe5yUzFmNGDstogKoqIM Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: a72400f54df2461fb444e1a4d2360802 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a72400f54df2461fb444e1a4d2360802"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a72400f54df2461fb444e1a4d2360802"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a72400f54df2461fb444e1a4d2360802"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a72400f54df2461fb444e1a4d2360802"}]}] Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: a72400f54df2461fb444e1a4d2360802 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1908591523 Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerDiskConfigTestJSON-1908591523-project Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: cba10708636e4433bdb720cfaf27922e Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerDiskConfigTestJSON-1908591523-project Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'ff3662a8-e128-4886-b561-199e49ab9f55'} Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:04:20.561200 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] Returning 404 to user: Instance ff3662a8-e128-4886-b561-199e49ab9f55 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0553fda8-d350-48f3-b0ba-a8d93ce02175 tempest-ServerDiskConfigTestJSON-1908591523 tempest-ServerDiskConfigTestJSON-1908591523-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55" status: 404 len: 111 microversion: 2.1 time: 0.033844 Oct 22 04:04:20.569050 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3619/7100] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:20 2022] GET /compute/v2.1/servers/ff3662a8-e128-4886-b561-199e49ab9f55 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:04:29.196096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2720b187-7668-45dd-af5b-6d034a5708c2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'create', calling method: .version_select at 0x7f0d1999c160>, body: {"keypair": {"name": "tempest-keypair-155216636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvGiCmOe6UP2SkGPQB043FSR3rQ+lZvuCWpWCBWf/MZQUN21M9no7LydO0I+ya+MuwK+SYjCzWd9pJc0awjSWMz12n6zIc+6V61VbTp6OnTBORF/e15nnqEdk//GDWeuA=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:29.203196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:29.218336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2720b187-7668-45dd-af5b-6d034a5708c2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:04:29.224536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2720b187-7668-45dd-af5b-6d034a5708c2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for user 8e7f634ee8704cc49f72f588710f866f and project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:04:29.258604 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2720b187-7668-45dd-af5b-6d034a5708c2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.206434 Oct 22 04:04:29.259578 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3482/7101] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:04:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:04:30.612143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-380969247", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be3d6f20-8885-4923-83cf-bfa15bd79e7c"}], "security_groups": [{"name": "tempest-securitygroup--139377022"}], "key_name": "tempest-keypair-155216636", "user_data": "}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:30.623433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:30.624127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:30.724548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] validate_networks() for [('be3d6f20-8885-4923-83cf-bfa15bd79e7c', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:04:31.110338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:04:31.110775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:04:31.111263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:04:31.111685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:04:31.112106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:04:31.124989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:31.125651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:31.126117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:31.126856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:31.127323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:31.127761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:31.153640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:04:31.159473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for user 8e7f634ee8704cc49f72f588710f866f and project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:04:31.173785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:04:31.176124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:04:31.226451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b2f2204-f4ea-4e7f-b590-ec08c278b93b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.618577 Oct 22 04:04:31.227415 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3620/7102] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:04:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:04:31.239077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-05b85985-331e-4a8a-b67b-35c17f604e72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:31.239626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-05b85985-331e-4a8a-b67b-35c17f604e72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:31.247241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:31.307960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-05b85985-331e-4a8a-b67b-35c17f604e72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:31.319368 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-05b85985-331e-4a8a-b67b-35c17f604e72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1237 microversion: 2.1 time: 0.083787 Oct 22 04:04:31.327078 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3483/7103] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:31 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:32.345460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:32.346390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:32.358700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:32.362809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:32.363761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:32.364827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:32.365331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:32.366151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:32.453176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:32.464277 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-367c8f88-0998-49d6-97d5-92013eff1bd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1297 microversion: 2.1 time: 0.122355 Oct 22 04:04:32.477271 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3621/7104] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:32 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1297 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:33.494067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:33.494789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:33.504657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:33.505183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:33.505624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:33.506330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:33.506786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:33.507210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:33.748970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:33.757097 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7829b346-e04b-40bc-bede-2220df77ea13 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1362 microversion: 2.1 time: 0.267019 Oct 22 04:04:33.758262 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3484/7105] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:33 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:04:33.956596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-9224c7dd-b44d-40a6-85cc-d97bc7aabd23 req-f13d306b-25de-4149-9d70-5f61082951cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758db383-8538-4332-afec-ebe9bc5c3f99", "tag": "57efd6cd-e65b-4b53-8f3c-ca3721fb7dee"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:33.968802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9224c7dd-b44d-40a6-85cc-d97bc7aabd23 req-f13d306b-25de-4149-9d70-5f61082951cf service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:33.969450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9224c7dd-b44d-40a6-85cc-d97bc7aabd23 req-f13d306b-25de-4149-9d70-5f61082951cf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:33.970036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-9224c7dd-b44d-40a6-85cc-d97bc7aabd23 req-f13d306b-25de-4149-9d70-5f61082951cf service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:33.984112 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-9224c7dd-b44d-40a6-85cc-d97bc7aabd23 req-f13d306b-25de-4149-9d70-5f61082951cf service nova] Creating event network-changed:57efd6cd-e65b-4b53-8f3c-ca3721fb7dee for instance 758db383-8538-4332-afec-ebe9bc5c3f99 on n-h1-862416-2 Oct 22 04:04:33.990189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-9224c7dd-b44d-40a6-85cc-d97bc7aabd23 req-f13d306b-25de-4149-9d70-5f61082951cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037300 Oct 22 04:04:33.991435 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3622/7106] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:04:34.782133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:34.782675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:34.791746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:34.792423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:34.792866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:34.793569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:34.794020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:34.794445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:34.926862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:34.935199 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b470be6-382a-474c-9118-42c05ba26545 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1362 microversion: 2.1 time: 0.157109 Oct 22 04:04:34.935773 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3485/7107] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:34 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:35.958814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:35.959529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:35.967266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:35.967771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:35.968242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:35.968971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:35.969440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:35.969886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:36.108618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:36.116282 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d57a4642-b452-487b-b47b-3e4d3f3a9c30 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1362 microversion: 2.1 time: 0.161736 Oct 22 04:04:36.116865 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3623/7108] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:35 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:37.140499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:37.141116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:37.147958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:37.148501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:37.148937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:37.150667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:37.151817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:37.152276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:37.279178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:37.286761 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a85551d-9739-4008-b685-d58db3f42ab7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1362 microversion: 2.1 time: 0.151161 Oct 22 04:04:37.287328 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3486/7109] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:37 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:38.310915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:38.311439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:38.318316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:38.318821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:38.319272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:38.319975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:38.320472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:38.320915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:38.454299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:38.462147 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ba929305-3a06-4819-ae50-6f83124a020c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1362 microversion: 2.1 time: 0.155743 Oct 22 04:04:38.462723 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3624/7110] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:38 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:39.485772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:39.486414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:39.493386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:39.493865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:39.494299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:39.494988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:39.495470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:39.496528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:39.637124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:39.645181 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ca24a51-2182-45e7-8d14-7c6abd3bfafc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1362 microversion: 2.1 time: 0.163287 Oct 22 04:04:39.645785 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3487/7111] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:39 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:39.669818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-884d8655-6656-4c18-8570-ee3fad96e459 req-d1c432a8-a5fd-41fe-ad7c-278e4acd7fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758db383-8538-4332-afec-ebe9bc5c3f99", "name": "network-vif-plugged", "status": "completed", "tag": "57efd6cd-e65b-4b53-8f3c-ca3721fb7dee"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:39.681432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-884d8655-6656-4c18-8570-ee3fad96e459 req-d1c432a8-a5fd-41fe-ad7c-278e4acd7fc2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:39.681928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-884d8655-6656-4c18-8570-ee3fad96e459 req-d1c432a8-a5fd-41fe-ad7c-278e4acd7fc2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:39.682376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-884d8655-6656-4c18-8570-ee3fad96e459 req-d1c432a8-a5fd-41fe-ad7c-278e4acd7fc2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:39.694191 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-884d8655-6656-4c18-8570-ee3fad96e459 req-d1c432a8-a5fd-41fe-ad7c-278e4acd7fc2 service nova] Creating event network-vif-plugged:57efd6cd-e65b-4b53-8f3c-ca3721fb7dee for instance 758db383-8538-4332-afec-ebe9bc5c3f99 on n-h1-862416-2 Oct 22 04:04:39.699594 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-884d8655-6656-4c18-8570-ee3fad96e459 req-d1c432a8-a5fd-41fe-ad7c-278e4acd7fc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033380 Oct 22 04:04:39.700614 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3625/7112] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:04:40.670777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:40.671419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:40.677820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:40.678302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:40.678743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:40.679434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:40.679889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:40.680340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:40.812192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:40.819933 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-45e0a78f-6eb7-417d-b414-d33d6bdc4c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1362 microversion: 2.1 time: 0.153896 Oct 22 04:04:40.820543 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3488/7113] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:40 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:41.842398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:41.843192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:41.848488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:41.849201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:41.856784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:41.857283 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:41.857764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:41.858485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:41.858956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:41.859399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:41.999105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:04:42.007072 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-285aa60d-865f-42ab-8108-f0cfcc095b4e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1548 microversion: 2.1 time: 0.167140 Oct 22 04:04:42.007706 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3626/7114] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:04:41 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:04:42.031741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:04:42.032306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:04:42.034323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:04:42.040430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:42.040922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:42.041365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:42.042066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:42.042523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:42.043699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:42.120626 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8ead8ee-59cf-486c-8164-40d9f64f4fa8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093431 Oct 22 04:04:42.122028 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3489/7115] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 04:04:42 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:04:43.043913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3510f01f-e7da-457c-bfbe-a7616533e613 req-b9179d8b-7103-4bc5-87e7-f70112960636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758db383-8538-4332-afec-ebe9bc5c3f99", "tag": "57efd6cd-e65b-4b53-8f3c-ca3721fb7dee"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:04:43.054512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3510f01f-e7da-457c-bfbe-a7616533e613 req-b9179d8b-7103-4bc5-87e7-f70112960636 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:04:43.055078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3510f01f-e7da-457c-bfbe-a7616533e613 req-b9179d8b-7103-4bc5-87e7-f70112960636 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:04:43.055588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3510f01f-e7da-457c-bfbe-a7616533e613 req-b9179d8b-7103-4bc5-87e7-f70112960636 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:04:43.067951 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3510f01f-e7da-457c-bfbe-a7616533e613 req-b9179d8b-7103-4bc5-87e7-f70112960636 service nova] Creating event network-changed:57efd6cd-e65b-4b53-8f3c-ca3721fb7dee for instance 758db383-8538-4332-afec-ebe9bc5c3f99 on n-h1-862416-2 Oct 22 04:04:43.072795 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3510f01f-e7da-457c-bfbe-a7616533e613 req-b9179d8b-7103-4bc5-87e7-f70112960636 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 Oct 22 04:04:43.073944 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3627/7116] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:05:19.047585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:05:19.048425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=34 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:05:19.052584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:19.053229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:19.060372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.060862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.061804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.062589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.063047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.063479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.192342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:19.200096 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2465a2fc-beb0-46f0-905e-3c9982c12309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1667 microversion: 2.1 time: 0.154623 Oct 22 04:05:19.200702 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3490/7117] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:19 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:19.223692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:19.224435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:19.226735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:05:19.227413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=32 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:05:19.233898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.234399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.234840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.235541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.236003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.236466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.366623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:19.375099 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11f078a9-e6a5-4148-a968-9046421699d9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1667 microversion: 2.1 time: 0.155771 Oct 22 04:05:19.375765 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3628/7118] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:19 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:19.397586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:19.398130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:19.404002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.404806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.404962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.406734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.407191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.407615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.539463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:19.547406 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-da83b0ce-d3fb-42a3-bdba-10f968f7d67a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1667 microversion: 2.1 time: 0.153711 Oct 22 04:05:19.547979 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3491/7119] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:19 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:19.569846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:05:19.572092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:19.578621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.579114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.579566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.580289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.580762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.581204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.609919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:19.615266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Old instance type m1.heat2, new instance type m1.heat {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:05:19.622018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:05:19.622457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:05:19.622949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:05:19.623374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:05:19.623963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:05:19.687966 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a10b66d-4409-44bb-a32d-6337549fe6fe tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99/action" status: 202 len: 0 microversion: 2.1 time: 0.121915 Oct 22 04:05:19.688660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3629/7120] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:05:19 2022] POST /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:05:19.697051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:19.698040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:19.705604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.706205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.706907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.707512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:19.708181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:19.709079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:19.887677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:19.895842 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7e72b73-19be-4c03-b18a-0c30e8e5f40c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1676 microversion: 2.1 time: 0.202922 Oct 22 04:05:19.896663 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3492/7121] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:19 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:20.922936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:20.923562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:20.930510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:20.931014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:20.931467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:20.932180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:20.932681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:20.933124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:21.069437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:21.081930 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-966c0b45-66c6-4211-8561-eca79e39bf29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1676 microversion: 2.1 time: 0.164474 Oct 22 04:05:21.082512 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3630/7122] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:20 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:22.106739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:22.107290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:22.114255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:22.114735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:22.115167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:22.115852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:22.116327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:22.116754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:22.249924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:22.257769 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c4a9826-c48a-43cd-bd02-168f7c5e37eb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.155169 Oct 22 04:05:22.258351 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3493/7123] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:22 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:23.282631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:23.283293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:23.290334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:23.290818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:23.291274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:23.292016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:23.292518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:23.292962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:23.423113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:23.430830 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3bb00afa-8b1b-433a-a738-c740c4b7c841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.152330 Oct 22 04:05:23.431418 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3631/7124] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:23 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:24.456108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:24.456765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:24.463472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:24.463956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:24.464426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:24.465127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:24.465582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:24.466007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:24.599976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:24.607735 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-be5a51a5-5f06-4569-895b-82896a0eeb71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.156300 Oct 22 04:05:24.608493 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3494/7125] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:24 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:25.631958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:25.632625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:25.640245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:25.640749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:25.641201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:25.641904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:25.642369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:25.642806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:25.773370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:25.781881 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cdd97ab3-b7e6-4765-887a-092b00f3f5ac tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.153844 Oct 22 04:05:25.782461 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3632/7126] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:25 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:26.805476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:26.806025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:26.813569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:26.814051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:26.814490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:26.815184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:26.815646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:26.816073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:26.949387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:26.957212 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d68cbf18-7efa-4579-bfcb-a148ebe45b3a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.155726 Oct 22 04:05:26.957789 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3495/7127] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:26 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:27.980936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:27.981559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:27.989052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:27.989570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:27.990014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:27.990707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:27.991169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:27.991601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:28.127096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:28.134914 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-430aa306-78a9-4965-9e26-448b107f9770 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.157922 Oct 22 04:05:28.135491 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3633/7128] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:27 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:29.158529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:29.159149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:29.166075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:29.166552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:29.166987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:29.167682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:29.168137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:29.168591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:29.298999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:29.306749 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e1a55911-3bf4-45b6-851b-ea5ec575c3f3 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.152685 Oct 22 04:05:29.307328 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3496/7129] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:29 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:30.329955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:30.330589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:30.337662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:30.338162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:30.338617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:30.339320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:30.339790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:30.340260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:30.470669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:30.478534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ebd7c8ff-85cb-4b79-8716-f594cee793b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.153225 Oct 22 04:05:30.479118 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3634/7130] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:30 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:31.502568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:31.503181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:31.510079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:31.510559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:31.510998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:31.511690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:31.512147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:31.512599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:31.641910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:31.649622 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-67229e0b-a011-4078-903e-c8d79c00a487 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.151699 Oct 22 04:05:31.650191 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3497/7131] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:31 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:32.674694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:32.675314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:32.682185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:32.682677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:32.683126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:32.683824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:32.684323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:32.684766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:32.818386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:32.826129 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-edc0d1b9-fa0e-4256-b967-8d6ee10bbede tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.155906 Oct 22 04:05:32.827352 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3635/7132] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:32 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:33.850305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:33.850846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:33.857801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:33.858345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:33.858781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:33.859475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:33.859934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:33.860405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:33.991845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:34.000684 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3724bbf6-7ae1-492c-9d4b-eea714f71460 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.154327 Oct 22 04:05:34.001265 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3498/7133] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:33 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:35.024662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:35.025288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:35.032593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:35.033093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:35.033548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:35.034268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:35.034741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:35.035185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:35.164804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:35.173401 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c8b52aa2-1e9c-4fbe-b177-c2b288b70355 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.152736 Oct 22 04:05:35.173982 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3636/7134] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:35 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:36.197833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:36.198440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:36.205550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:36.206057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:36.206494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:36.207178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:36.207631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:36.208057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:36.336489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:36.344842 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-66f3697c-da0e-4378-a41b-e2fa2975339c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.150976 Oct 22 04:05:36.345424 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3499/7135] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:36 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:37.369186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:37.369805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:37.377286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:37.377780 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:37.378228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:37.378954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:37.379420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:37.379857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:37.515306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:37.522989 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67d5bde6-fd99-4998-bcd5-82f308008083 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.157713 Oct 22 04:05:37.523567 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3637/7136] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:37 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:38.546499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:38.547105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:38.550125 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:05:38.550264 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:05:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 (ip 10.222.0.25) !!! Oct 22 04:05:38.557675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:38.558156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:38.558591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:38.559286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:38.559737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:38.560159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:38.726342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:38.734379 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08238d8b-38ed-48dc-a04e-91b16278f81c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1681 microversion: 2.1 time: 0.191899 Oct 22 04:05:38.734973 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3500/7137] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:38 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:39.301029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a38a7c96-0a4e-4648-9c30-845f72609b54 req-9b573238-9d59-458b-a9b1-9515254cce4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758db383-8538-4332-afec-ebe9bc5c3f99", "name": "network-vif-unplugged", "status": "completed", "tag": "57efd6cd-e65b-4b53-8f3c-ca3721fb7dee"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:05:39.312089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a38a7c96-0a4e-4648-9c30-845f72609b54 req-9b573238-9d59-458b-a9b1-9515254cce4d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:39.312967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a38a7c96-0a4e-4648-9c30-845f72609b54 req-9b573238-9d59-458b-a9b1-9515254cce4d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:39.313582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a38a7c96-0a4e-4648-9c30-845f72609b54 req-9b573238-9d59-458b-a9b1-9515254cce4d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:39.326234 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a38a7c96-0a4e-4648-9c30-845f72609b54 req-9b573238-9d59-458b-a9b1-9515254cce4d service nova] Creating event network-vif-unplugged:57efd6cd-e65b-4b53-8f3c-ca3721fb7dee for instance 758db383-8538-4332-afec-ebe9bc5c3f99 on n-h2-862416-2 Oct 22 04:05:39.332509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-a38a7c96-0a4e-4648-9c30-845f72609b54 req-9b573238-9d59-458b-a9b1-9515254cce4d service nova] Instance 758db383-8538-4332-afec-ebe9bc5c3f99 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:05:39.344201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a38a7c96-0a4e-4648-9c30-845f72609b54 req-9b573238-9d59-458b-a9b1-9515254cce4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047681 Oct 22 04:05:39.344839 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3638/7138] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:05:39.758572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:39.759216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:39.767352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:39.767838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:39.768297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:39.769005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:39.769462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:39.769886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:39.987320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:39.995068 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a02be95d-e9b8-4f05-813a-09ac0b702b01 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1680 microversion: 2.1 time: 0.240448 Oct 22 04:05:39.995650 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3501/7139] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:39 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:41.020098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:41.020858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:41.028082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:41.028617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:41.029075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:41.029788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:41.030263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:41.030704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:41.166707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:41.175345 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d455873a-ac58-45c9-8401-de27b5f6f06f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1678 microversion: 2.1 time: 0.159873 Oct 22 04:05:41.175945 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3639/7140] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:41 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:05:41.383214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-af3391da-4ddb-40f6-9707-0df9236a83f6 req-a1cd15aa-69f3-463a-be0d-c3bc2bccd7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758db383-8538-4332-afec-ebe9bc5c3f99", "tag": "57efd6cd-e65b-4b53-8f3c-ca3721fb7dee"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:05:41.394017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-af3391da-4ddb-40f6-9707-0df9236a83f6 req-a1cd15aa-69f3-463a-be0d-c3bc2bccd7f2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:41.394492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-af3391da-4ddb-40f6-9707-0df9236a83f6 req-a1cd15aa-69f3-463a-be0d-c3bc2bccd7f2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:41.394920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-af3391da-4ddb-40f6-9707-0df9236a83f6 req-a1cd15aa-69f3-463a-be0d-c3bc2bccd7f2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:41.407633 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-af3391da-4ddb-40f6-9707-0df9236a83f6 req-a1cd15aa-69f3-463a-be0d-c3bc2bccd7f2 service nova] Creating event network-changed:57efd6cd-e65b-4b53-8f3c-ca3721fb7dee for instance 758db383-8538-4332-afec-ebe9bc5c3f99 on n-h2-862416-2 Oct 22 04:05:41.412906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-af3391da-4ddb-40f6-9707-0df9236a83f6 req-a1cd15aa-69f3-463a-be0d-c3bc2bccd7f2 service nova] Instance 758db383-8538-4332-afec-ebe9bc5c3f99 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:05:41.424523 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-af3391da-4ddb-40f6-9707-0df9236a83f6 req-a1cd15aa-69f3-463a-be0d-c3bc2bccd7f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044962 Oct 22 04:05:41.425127 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3502/7141] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:05:42.199026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:42.199654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:42.206677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:42.207182 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:42.207639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:42.208389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:42.208867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:42.209313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:42.338486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:42.346895 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b33aa9c4-1652-4479-8152-6e19d6c2a598 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1678 microversion: 2.1 time: 0.151877 Oct 22 04:05:42.347486 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3640/7142] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:42 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:43.372705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:43.373413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:43.380387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:43.380913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:43.381374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:43.382086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:43.382544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:43.382976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:43.546465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:43.555082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d886b7e9-34c1-431d-a784-b2a5eb076834 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1678 microversion: 2.1 time: 0.187623 Oct 22 04:05:43.555666 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3503/7143] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:43 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:44.579403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:44.580025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:44.586873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:44.587367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:44.587815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:44.588649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:44.589119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:44.589558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:44.723013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:44.730840 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7953daa3-a67d-4ec8-a102-9b2c97cc2591 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1675 microversion: 2.1 time: 0.156020 Oct 22 04:05:44.731396 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3641/7144] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:44 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:44.754553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:05:44.755116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:44.761989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:44.762469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:44.762904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:44.763865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:44.764348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:44.764762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:44.821878 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-68021dec-1baa-4baa-993f-5cfb81e59689 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99/action" status: 204 len: 0 microversion: 2.1 time: 0.071546 Oct 22 04:05:44.822452 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3504/7145] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:05:44 2022] POST /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:05:44.830957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:44.831577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:44.837576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:44.838085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:44.838541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:44.839263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:44.839743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:44.840191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:44.979663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:44.988543 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8c84741-1fb6-4cbe-b7f8-867d31a4b000 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1675 microversion: 2.1 time: 0.161683 Oct 22 04:05:44.989141 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3642/7146] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:44 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:05:46.014004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:46.014660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:46.021692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:46.022418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:46.022869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:46.023575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:46.024037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:46.024505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:46.160679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:46.163099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:05:46.170687 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9db5ad95-fa6d-4fb5-8369-8d1682f8cb64 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1675 microversion: 2.1 time: 0.162130 Oct 22 04:05:46.171265 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3505/7147] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:46 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:46.500609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c9b916c9-0c9d-4af5-9ce7-5241f07d811e req-ff9d9a81-3b74-4d89-a892-89faa17f410e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758db383-8538-4332-afec-ebe9bc5c3f99", "name": "network-vif-plugged", "status": "completed", "tag": "57efd6cd-e65b-4b53-8f3c-ca3721fb7dee"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:05:46.511870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c9b916c9-0c9d-4af5-9ce7-5241f07d811e req-ff9d9a81-3b74-4d89-a892-89faa17f410e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:46.512409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c9b916c9-0c9d-4af5-9ce7-5241f07d811e req-ff9d9a81-3b74-4d89-a892-89faa17f410e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:46.512888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c9b916c9-0c9d-4af5-9ce7-5241f07d811e req-ff9d9a81-3b74-4d89-a892-89faa17f410e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:46.526234 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c9b916c9-0c9d-4af5-9ce7-5241f07d811e req-ff9d9a81-3b74-4d89-a892-89faa17f410e service nova] Creating event network-vif-plugged:57efd6cd-e65b-4b53-8f3c-ca3721fb7dee for instance 758db383-8538-4332-afec-ebe9bc5c3f99 on n-h2-862416-2 Oct 22 04:05:46.531393 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c9b916c9-0c9d-4af5-9ce7-5241f07d811e req-ff9d9a81-3b74-4d89-a892-89faa17f410e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035194 Oct 22 04:05:46.532312 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3643/7148] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:05:47.194773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:47.195387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:47.203660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.204310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.204755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.205450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.205909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.206335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.333525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:47.341228 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-34e2e5e0-c46f-4f35-9b42-4cc11e79ec5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1667 microversion: 2.1 time: 0.150715 Oct 22 04:05:47.341808 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3506/7149] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:47 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:47.365404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:47.366164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:47.372603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.373098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.373547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.374243 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.374711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.375193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.379442 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:05:47.514025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:47.522706 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d3a65d82-9779-4836-ad40-04e8cf05e841 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1667 microversion: 2.1 time: 0.161576 Oct 22 04:05:47.523279 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3644/7150] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:47 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:47.544659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:47.545303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:47.552144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.552664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.553104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.553803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.554259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.554688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.686959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:47.694810 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef5cb56a-1fd9-4908-83ce-8e99eff7d6f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1667 microversion: 2.1 time: 0.154109 Oct 22 04:05:47.695390 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3507/7151] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:47 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:47.720812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:47.721281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:47.727445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.727951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.728466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.729185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.729705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.730162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.754936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:05:47.835189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ecb12dee-22fc-4a8f-907e-60e15abbb065 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 204 len: 0 microversion: 2.1 time: 0.118856 Oct 22 04:05:47.835785 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3645/7152] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:05:47 2022] DELETE /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:05:47.845483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:47.846094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:47.851981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.852491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.852944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.853607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:47.854055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:47.854475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:47.988199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:47.995962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dfa72d92-616c-4a54-ba58-6f8ff8aa7168 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1673 microversion: 2.1 time: 0.155497 Oct 22 04:05:47.996574 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3508/7153] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:47 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:05:49.022260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:49.023000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:49.029717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:49.030213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:49.030661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:49.032095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:49.033096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:49.033538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:49.166898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:49.175107 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b4e43958-add3-4f69-ad1c-921ff74667c5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1673 microversion: 2.1 time: 0.157160 Oct 22 04:05:49.175688 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3646/7154] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:49 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:50.070380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a54c69d1-8872-46b9-8347-2e8283c92673 req-bf10b0a4-0fc1-4701-b3e4-32384bfb83c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758db383-8538-4332-afec-ebe9bc5c3f99", "name": "network-vif-deleted", "tag": "57efd6cd-e65b-4b53-8f3c-ca3721fb7dee"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:05:50.077784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=39 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:05:50.084246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a54c69d1-8872-46b9-8347-2e8283c92673 req-bf10b0a4-0fc1-4701-b3e4-32384bfb83c1 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:50.084729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a54c69d1-8872-46b9-8347-2e8283c92673 req-bf10b0a4-0fc1-4701-b3e4-32384bfb83c1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:50.085161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a54c69d1-8872-46b9-8347-2e8283c92673 req-bf10b0a4-0fc1-4701-b3e4-32384bfb83c1 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:50.102090 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a54c69d1-8872-46b9-8347-2e8283c92673 req-bf10b0a4-0fc1-4701-b3e4-32384bfb83c1 service nova] Creating event network-vif-deleted:57efd6cd-e65b-4b53-8f3c-ca3721fb7dee for instance 758db383-8538-4332-afec-ebe9bc5c3f99 on n-h2-862416-2 Oct 22 04:05:50.107549 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a54c69d1-8872-46b9-8347-2e8283c92673 req-bf10b0a4-0fc1-4701-b3e4-32384bfb83c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040977 Oct 22 04:05:50.108100 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3509/7155] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:05:50.199495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:50.200937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:50.204047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:05:50.210368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:50.211097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:50.211551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:50.212483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:50.212960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:50.213423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:50.246616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:50.247385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:50.247844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:50.248338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lazy-loading 'fault' on Instance uuid 758db383-8538-4332-afec-ebe9bc5c3f99 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:05:50.298802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:50.306031 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2a537271-9668-4948-a249-5d1ba94b9042 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 200 len: 1327 microversion: 2.1 time: 0.110486 Oct 22 04:05:50.307527 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3647/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:50 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:51.331738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:51.332487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:51.338707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:51.339194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:51.339637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:51.340376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:51.340841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:51.341270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:51.355192 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 HTTP/1.1 Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '758db383-8538-4332-afec-ebe9bc5c3f99'} Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:05:51.356845 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1007ae5f-2a20-44b1-ad0e-43861699be85 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 404 len: 111 microversion: 2.1 time: 0.032204 Oct 22 04:05:51.361864 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3510/7157] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:51 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:05:51.371922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:51.372596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:51.379842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:51.380392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:51.380856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:51.381575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:51.382058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:51.382509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:51.397382 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 HTTP/1.1 Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '758db383-8538-4332-afec-ebe9bc5c3f99'} Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:05:51.399048 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e14969d8-f7dd-4112-bdbc-f53df7fd2360 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 404 len: 111 microversion: 2.1 time: 0.032404 Oct 22 04:05:51.403165 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3648/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:51 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:05:51.448922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-373995607", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "be3d6f20-8885-4923-83cf-bfa15bd79e7c"}], "security_groups": [{"name": "tempest-securitygroup--139377022"}], "key_name": "tempest-keypair-155216636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:05:51.556462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] validate_networks() for [('be3d6f20-8885-4923-83cf-bfa15bd79e7c', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:05:52.015428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:05:52.016519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:05:52.016999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:05:52.017408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:05:52.017822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:05:52.026486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:52.026968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:52.027405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:52.028129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:52.028644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:52.029074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:52.048916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:05:52.054204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for user 8e7f634ee8704cc49f72f588710f866f and project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:05:52.067271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:05:52.069629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:05:52.118616 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9e997d9-b58e-45c0-aed5-660488edb020 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673502 Oct 22 04:05:52.119274 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3511/7159] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:05:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:05:52.132553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23172df6-e4cd-46e4-abcb-6358dcd16d61 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:52.133281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23172df6-e4cd-46e4-abcb-6358dcd16d61 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:52.191407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23172df6-e4cd-46e4-abcb-6358dcd16d61 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:52.198871 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23172df6-e4cd-46e4-abcb-6358dcd16d61 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1237 microversion: 2.1 time: 0.070503 Oct 22 04:05:52.199442 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3649/7160] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:52 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:53.222748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:53.223358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:53.232322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:53.232821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:53.233337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:53.234035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:53.234774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:53.235368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:53.306045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:53.316269 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-354a88a9-2058-4633-a79f-c34af9e99d5b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1297 microversion: 2.1 time: 0.097488 Oct 22 04:05:53.317140 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3512/7161] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:53 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:54.340538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:54.341183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:54.349821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:54.350326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:54.350776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:54.351489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:54.351961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:54.352428 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:54.490855 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:54.498872 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-210aaa36-3d0c-4256-9f44-0a21658ebed2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1362 microversion: 2.1 time: 0.162356 Oct 22 04:05:54.499465 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3650/7162] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:54 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:54.982174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-af4a9c4a-d31c-4d90-9d4c-0c64fc6e7a74 req-a7f7098b-8ca0-450c-890e-334ee147cfae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31dc979-ce86-4d77-ad36-bbc09731d035", "tag": "a4761d93-5bf7-4457-b973-e0593c083024"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:05:54.994267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-af4a9c4a-d31c-4d90-9d4c-0c64fc6e7a74 req-a7f7098b-8ca0-450c-890e-334ee147cfae service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:54.994833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-af4a9c4a-d31c-4d90-9d4c-0c64fc6e7a74 req-a7f7098b-8ca0-450c-890e-334ee147cfae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:54.995359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-af4a9c4a-d31c-4d90-9d4c-0c64fc6e7a74 req-a7f7098b-8ca0-450c-890e-334ee147cfae service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:55.008467 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-af4a9c4a-d31c-4d90-9d4c-0c64fc6e7a74 req-a7f7098b-8ca0-450c-890e-334ee147cfae service nova] Creating event network-changed:a4761d93-5bf7-4457-b973-e0593c083024 for instance f31dc979-ce86-4d77-ad36-bbc09731d035 on n-h1-862416-2 Oct 22 04:05:55.013679 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-af4a9c4a-d31c-4d90-9d4c-0c64fc6e7a74 req-a7f7098b-8ca0-450c-890e-334ee147cfae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035027 Oct 22 04:05:55.014289 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3513/7163] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:05:55.524037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:55.524707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:55.531911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:55.532463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:55.532954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:55.533659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:55.534137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:55.534587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:55.691733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:55.701066 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b255d9ef-35c0-4326-ac32-21bf84b3e636 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1362 microversion: 2.1 time: 0.180963 Oct 22 04:05:55.701642 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3651/7164] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:55 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:56.727618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:56.728346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:56.735011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:56.735487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:56.735922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:56.736641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:56.737089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:56.737512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:56.942877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:56.950798 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-42a6cefe-e689-4e18-b3c0-77c89cded9a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1362 microversion: 2.1 time: 0.228225 Oct 22 04:05:56.951381 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3514/7165] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:56 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:57.975853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:57.976556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:57.983873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:57.985077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:57.985534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:57.986460 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:57.986937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:57.987387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:58.125822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:58.134028 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d519b401-f80d-4671-8744-f5581c3e917d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1362 microversion: 2.1 time: 0.162177 Oct 22 04:05:58.134619 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3652/7166] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:57 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:05:59.159356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:05:59.159923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:05:59.166818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:59.167303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:59.167741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:59.168476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:05:59.168933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:05:59.169361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:05:59.302918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:05:59.310548 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5253000d-8c58-4a24-8461-5a38a14c9400 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1362 microversion: 2.1 time: 0.155873 Oct 22 04:05:59.311124 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3515/7167] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:05:59 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:00.036869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b308eaca-2464-4a15-a679-3d44fdd5572a req-25bb1ebc-aef8-4173-9371-d5329c7a1102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31dc979-ce86-4d77-ad36-bbc09731d035", "name": "network-vif-plugged", "status": "completed", "tag": "a4761d93-5bf7-4457-b973-e0593c083024"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:00.047678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b308eaca-2464-4a15-a679-3d44fdd5572a req-25bb1ebc-aef8-4173-9371-d5329c7a1102 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:00.048239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b308eaca-2464-4a15-a679-3d44fdd5572a req-25bb1ebc-aef8-4173-9371-d5329c7a1102 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:00.049486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b308eaca-2464-4a15-a679-3d44fdd5572a req-25bb1ebc-aef8-4173-9371-d5329c7a1102 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:00.061596 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b308eaca-2464-4a15-a679-3d44fdd5572a req-25bb1ebc-aef8-4173-9371-d5329c7a1102 service nova] Creating event network-vif-plugged:a4761d93-5bf7-4457-b973-e0593c083024 for instance f31dc979-ce86-4d77-ad36-bbc09731d035 on n-h1-862416-2 Oct 22 04:06:00.067404 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b308eaca-2464-4a15-a679-3d44fdd5572a req-25bb1ebc-aef8-4173-9371-d5329c7a1102 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Oct 22 04:06:00.068305 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3653/7168] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:06:00.334472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:00.335087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:00.341934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:00.342418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:00.342854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:00.343584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:00.344063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:00.344522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:00.477150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:00.485569 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee3b12ef-cf04-446e-8912-f1e2af1ac18f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1362 microversion: 2.1 time: 0.154972 Oct 22 04:06:00.486150 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3516/7169] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:00 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:01.509985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:01.510695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:01.519339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:01.519832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:01.520311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:01.521023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:01.521488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:01.521926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:01.657477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:01.665243 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8455eb4e-8878-45d7-b4e6-fbb70bace23d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1548 microversion: 2.1 time: 0.159546 Oct 22 04:06:01.665832 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3654/7170] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:01 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:01.688935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:01.689452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:01.696148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:01.696669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:01.697115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:01.697831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:01.698281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:01.698715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:01.779626 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c8e6be3e-ee77-4a0b-a3cf-fdf0af701c6c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095075 Oct 22 04:06:01.780266 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3517/7171] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 04:06:01 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:06:02.720857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f5e71ae3-6435-455c-b4fe-574af70dac1a req-b83a7619-379a-4f35-920b-96510578b2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31dc979-ce86-4d77-ad36-bbc09731d035", "tag": "a4761d93-5bf7-4457-b973-e0593c083024"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:02.725816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:02.732908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5e71ae3-6435-455c-b4fe-574af70dac1a req-b83a7619-379a-4f35-920b-96510578b2a4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:02.733611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5e71ae3-6435-455c-b4fe-574af70dac1a req-b83a7619-379a-4f35-920b-96510578b2a4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:02.734055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f5e71ae3-6435-455c-b4fe-574af70dac1a req-b83a7619-379a-4f35-920b-96510578b2a4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:02.745860 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f5e71ae3-6435-455c-b4fe-574af70dac1a req-b83a7619-379a-4f35-920b-96510578b2a4 service nova] Creating event network-changed:a4761d93-5bf7-4457-b973-e0593c083024 for instance f31dc979-ce86-4d77-ad36-bbc09731d035 on n-h1-862416-2 Oct 22 04:06:02.751411 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f5e71ae3-6435-455c-b4fe-574af70dac1a req-b83a7619-379a-4f35-920b-96510578b2a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035666 Oct 22 04:06:02.752019 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3655/7172] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:06:35.871370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:35.872081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:35.873925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:35.874550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=55 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:35.879374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8b64abd-54cb-451e-875c-bde9781b7ccb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:35.887014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8b64abd-54cb-451e-875c-bde9781b7ccb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:35.887497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8b64abd-54cb-451e-875c-bde9781b7ccb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:35.887938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8b64abd-54cb-451e-875c-bde9781b7ccb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:35.912452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8b64abd-54cb-451e-875c-bde9781b7ccb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Going to try to stop instance {{(pid=120582) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 04:06:35.953001 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8b64abd-54cb-451e-875c-bde9781b7ccb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/action" status: 202 len: 0 microversion: 2.1 time: 0.082286 Oct 22 04:06:35.953636 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3518/7173] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:06:35 2022] POST /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:06:35.961229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=21 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:35.962043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:35.966195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:35.966943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:35.975241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:35.975743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:35.976196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:35.976935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:35.977407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:35.977881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:36.121190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:36.129119 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d51b6bd1-759d-4044-9bd7-193bb190ee8d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.169957 Oct 22 04:06:36.129687 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3656/7174] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:35 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:37.154569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:37.155273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:37.162016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:37.162503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:37.162948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:37.163644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:37.164101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:37.164559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:37.293841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:37.302169 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6d09df5a-fc12-4a53-9d12-9fb67729f2f6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.152801 Oct 22 04:06:37.302751 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3519/7175] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:37 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:38.325486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:38.326152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:38.333772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:38.334275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:38.334733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:38.335449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:38.335923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:38.336398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:38.469160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:38.478307 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1723e542-b60e-4a06-9812-1069b79926ea tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.156745 Oct 22 04:06:38.478893 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3657/7176] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:38 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:39.502262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:39.502874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:39.511946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:39.512465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:39.512912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:39.513619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:39.514335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:39.514764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:39.648260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:39.655946 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7c384e8a-84ab-4ca7-a1f1-147bd684d11c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.158149 Oct 22 04:06:39.656580 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3520/7177] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:39 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:40.681341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:40.681997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:40.688835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:40.689558 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:40.691055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:40.691777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:40.692279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:40.692730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:40.835655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:40.843764 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bac927b3-ff11-44f3-ae6a-249c0725b309 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.166311 Oct 22 04:06:40.844406 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3658/7178] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:40 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:41.868635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:41.869216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:41.875743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:41.876246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:41.876693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:41.878014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:41.878470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:41.878899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:42.012562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:42.020838 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c430ab41-8924-4a1f-9253-fd6149eded88 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.156440 Oct 22 04:06:42.021420 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3521/7179] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:41 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:43.044075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:43.044740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:43.052422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:43.052928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:43.053387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:43.054129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:43.054602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:43.055045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:43.182464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:43.190925 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e8f7b87-d270-4699-8b4a-d0d0c30e95fb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.150811 Oct 22 04:06:43.191507 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3659/7180] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:43 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:44.214664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:44.215273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:44.223260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:44.223737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:44.224171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:44.224880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:44.225328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:44.225747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:44.354110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:44.361946 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2a983af7-3a3b-4c7c-991d-a35250e5000f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.151206 Oct 22 04:06:44.362601 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3522/7181] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:44 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:45.385947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:45.386571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:45.393917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:45.394413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:45.394865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:45.395569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:45.396039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:45.396510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:45.525513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:45.533892 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-99f5daf7-0595-4cee-b1aa-2ce886ba9b87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.151366 Oct 22 04:06:45.534573 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3660/7182] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:45 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:46.557528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:46.558142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:46.565112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:46.565594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:46.566031 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:46.566727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:46.567180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:46.567607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:46.702578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:46.711222 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d9c8ffaa-6da9-4250-baee-6ca8f5b69f87 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1654 microversion: 2.1 time: 0.157399 Oct 22 04:06:46.711791 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3523/7183] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:46 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:06:46.734797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:46.737125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:46.743661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:46.744161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:46.744688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:46.745388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:46.745874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:46.746302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:46.778150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:46.783697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Old instance type m1.heat2, new instance type m1.heat {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:06:46.790183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:06:46.790620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:06:46.791114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:06:46.791539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:06:46.791971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:06:46.854225 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7c50ae4a-8b10-4075-be9d-345fbe237576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/action" status: 202 len: 0 microversion: 2.1 time: 0.123667 Oct 22 04:06:46.854863 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3661/7184] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:06:46 2022] POST /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:06:46.863192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:46.863798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:46.869656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:46.870630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:46.870630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:46.871231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:46.871683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:46.872112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:47.032001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:47.040201 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-36f3a8d4-34c8-45e2-860a-464b28d3f4b9 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.180977 Oct 22 04:06:47.040941 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3524/7185] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:46 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:06:48.065864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:48.066491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:48.073484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:48.073990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:48.074448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:48.075191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:48.075663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:48.076105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:48.210588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:48.218409 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5e240ff1-7a4e-438c-8df4-26e12536af71 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1677 microversion: 2.1 time: 0.157306 Oct 22 04:06:48.218990 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3662/7186] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:48 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:49.243021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:49.243649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:49.250120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:49.250597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:49.251033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:49.252253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:49.253252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:49.253676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:49.388787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:49.396837 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-739e5a5f-c542-4765-a092-15ab41c92033 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1682 microversion: 2.1 time: 0.157940 Oct 22 04:06:49.397418 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3525/7187] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:49 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:50.421052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:50.422774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:50.431631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:50.432162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:50.432759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:50.433662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:50.434150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:50.434615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:50.566213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:50.574098 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ab6602cd-aae1-471c-9b39-fd4b260a5ad7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1682 microversion: 2.1 time: 0.157130 Oct 22 04:06:50.574688 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3663/7188] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:50 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:06:51.195840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-77a58e10-2cfa-4c3f-99e3-1f9426d81919 req-d233b279-689a-4feb-b756-e4f7467bc59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31dc979-ce86-4d77-ad36-bbc09731d035", "name": "network-vif-unplugged", "status": "completed", "tag": "a4761d93-5bf7-4457-b973-e0593c083024"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:51.207791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-77a58e10-2cfa-4c3f-99e3-1f9426d81919 req-d233b279-689a-4feb-b756-e4f7467bc59f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:51.208751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-77a58e10-2cfa-4c3f-99e3-1f9426d81919 req-d233b279-689a-4feb-b756-e4f7467bc59f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:51.209234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-77a58e10-2cfa-4c3f-99e3-1f9426d81919 req-d233b279-689a-4feb-b756-e4f7467bc59f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:51.222241 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-77a58e10-2cfa-4c3f-99e3-1f9426d81919 req-d233b279-689a-4feb-b756-e4f7467bc59f service nova] Creating event network-vif-unplugged:a4761d93-5bf7-4457-b973-e0593c083024 for instance f31dc979-ce86-4d77-ad36-bbc09731d035 on n-h2-862416-2 Oct 22 04:06:51.227649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-77a58e10-2cfa-4c3f-99e3-1f9426d81919 req-d233b279-689a-4feb-b756-e4f7467bc59f service nova] Instance f31dc979-ce86-4d77-ad36-bbc09731d035 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:06:51.239958 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-77a58e10-2cfa-4c3f-99e3-1f9426d81919 req-d233b279-689a-4feb-b756-e4f7467bc59f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047822 Oct 22 04:06:51.240991 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3526/7189] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:06:51.597678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:51.598301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:51.605107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:51.605604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:51.606055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:51.606760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:51.607224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:51.607662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:51.767968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:51.775769 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8d5fea69-8440-4f12-8ff6-cc8f59068faf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1681 microversion: 2.1 time: 0.182608 Oct 22 04:06:51.776408 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3664/7190] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:51 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:52.799832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:52.800497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:52.807449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:52.807925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:52.808398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:52.809091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:52.809546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:52.809973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:53.240562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:53.248242 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-76ab7177-a759-410e-a465-8adb524b0b33 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1679 microversion: 2.1 time: 0.453062 Oct 22 04:06:53.248815 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3527/7191] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:52 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1679 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:06:53.275340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0b5548b5-c43d-4cb3-9099-0e14baf7b579 req-a8dae33a-1d8b-4c97-aa4d-d70e1e0954c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31dc979-ce86-4d77-ad36-bbc09731d035", "tag": "a4761d93-5bf7-4457-b973-e0593c083024"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:53.285579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0b5548b5-c43d-4cb3-9099-0e14baf7b579 req-a8dae33a-1d8b-4c97-aa4d-d70e1e0954c0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:53.286072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0b5548b5-c43d-4cb3-9099-0e14baf7b579 req-a8dae33a-1d8b-4c97-aa4d-d70e1e0954c0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:53.286520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0b5548b5-c43d-4cb3-9099-0e14baf7b579 req-a8dae33a-1d8b-4c97-aa4d-d70e1e0954c0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:53.297953 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0b5548b5-c43d-4cb3-9099-0e14baf7b579 req-a8dae33a-1d8b-4c97-aa4d-d70e1e0954c0 service nova] Creating event network-changed:a4761d93-5bf7-4457-b973-e0593c083024 for instance f31dc979-ce86-4d77-ad36-bbc09731d035 on n-h2-862416-2 Oct 22 04:06:53.303821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-0b5548b5-c43d-4cb3-9099-0e14baf7b579 req-a8dae33a-1d8b-4c97-aa4d-d70e1e0954c0 service nova] Instance f31dc979-ce86-4d77-ad36-bbc09731d035 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:06:53.315135 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0b5548b5-c43d-4cb3-9099-0e14baf7b579 req-a8dae33a-1d8b-4c97-aa4d-d70e1e0954c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042811 Oct 22 04:06:53.315719 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3665/7192] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:06:54.273234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:54.273845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:54.280658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:54.281138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:54.281578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:54.282270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:54.282721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:54.283146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:54.416466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:54.424355 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9335802a-ad40-48ae-881f-fe1fac6bcecf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1679 microversion: 2.1 time: 0.154926 Oct 22 04:06:54.424936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3528/7193] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:54 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:55.449652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:55.450365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:55.457158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:55.457657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:55.458111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:55.458844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:55.459315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:55.459788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:55.590445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:55.599024 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4a49b29d-4d1b-45a3-9a51-89e9891dcc67 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1675 microversion: 2.1 time: 0.154600 Oct 22 04:06:55.599612 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3666/7194] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:55 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:55.621715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:55.622344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:55.629102 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:55.629582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:55.630017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:55.630715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:55.631171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:55.631597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:55.688601 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5ddb7a4-4da5-4669-bf26-344f3bff051e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/action" status: 204 len: 0 microversion: 2.1 time: 0.070649 Oct 22 04:06:55.689699 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3529/7195] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:06:55 2022] POST /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:06:55.698769 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:55.699392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:55.706000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:55.706427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:55.706880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:55.707588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:55.708049 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:55.708509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:55.852316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:55.860624 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-46508099-1d28-41fd-84fc-f29332b79d74 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1675 microversion: 2.1 time: 0.166515 Oct 22 04:06:55.861276 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3667/7196] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:55 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:56.885746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:56.886470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:56.895705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:56.896222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:56.896686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:56.897389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:56.897851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:56.898282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:57.065158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:57.073658 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-478bcfa7-c7bf-4d14-a6b6-dd030cffe37d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1675 microversion: 2.1 time: 0.192270 Oct 22 04:06:57.074253 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3530/7197] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:56 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:58.098328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:58.099114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:58.106143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:58.106645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:58.107099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:58.107815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:58.108325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:58.108778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:58.237443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:58.245120 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fba1e052-0552-430b-aca7-fcf060dee4d0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1654 microversion: 2.1 time: 0.151292 Oct 22 04:06:58.245693 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3668/7198] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:58 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:58.267630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:58.268263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:58.276496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:58.276982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:58.277422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:58.278122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:58.278620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:58.279053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:58.411501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:58.419329 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b06cfc55-c7d8-4041-a3f8-9edd899c19a8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1654 microversion: 2.1 time: 0.155832 Oct 22 04:06:58.419901 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3531/7199] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:58 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:58.441663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ce79102-ccf4-421a-831c-9a766cff3f83 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:58.454246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce79102-ccf4-421a-831c-9a766cff3f83 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:58.455644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce79102-ccf4-421a-831c-9a766cff3f83 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:58.456197 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ce79102-ccf4-421a-831c-9a766cff3f83 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:58.479282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ce79102-ccf4-421a-831c-9a766cff3f83 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Going to try to start instance {{(pid=120581) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 04:06:58.521024 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ce79102-ccf4-421a-831c-9a766cff3f83 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/action" status: 202 len: 0 microversion: 2.1 time: 0.083366 Oct 22 04:06:58.521663 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3669/7200] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:06:58 2022] POST /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:06:58.529877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:58.530495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:58.537559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:58.538059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:58.538484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:58.539188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:58.539639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:58.540066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:58.748523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:58.752310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:58.760639 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bf9a926e-9521-4a09-b451-61cf727ab7e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1663 microversion: 2.1 time: 0.234583 Oct 22 04:06:58.761573 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3532/7201] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:58 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1663 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:58.914069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b05ae89d-3ce3-4e23-914e-8220dd5dccd8 req-ae3c1fb3-3212-4396-bad0-903cf6d0809f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31dc979-ce86-4d77-ad36-bbc09731d035", "name": "network-vif-plugged", "status": "completed", "tag": "a4761d93-5bf7-4457-b973-e0593c083024"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:06:58.926437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b05ae89d-3ce3-4e23-914e-8220dd5dccd8 req-ae3c1fb3-3212-4396-bad0-903cf6d0809f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:58.927021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b05ae89d-3ce3-4e23-914e-8220dd5dccd8 req-ae3c1fb3-3212-4396-bad0-903cf6d0809f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:58.927682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b05ae89d-3ce3-4e23-914e-8220dd5dccd8 req-ae3c1fb3-3212-4396-bad0-903cf6d0809f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:58.939761 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b05ae89d-3ce3-4e23-914e-8220dd5dccd8 req-ae3c1fb3-3212-4396-bad0-903cf6d0809f service nova] Creating event network-vif-plugged:a4761d93-5bf7-4457-b973-e0593c083024 for instance f31dc979-ce86-4d77-ad36-bbc09731d035 on n-h2-862416-2 Oct 22 04:06:58.944858 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b05ae89d-3ce3-4e23-914e-8220dd5dccd8 req-ae3c1fb3-3212-4396-bad0-903cf6d0809f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037297 Oct 22 04:06:58.946054 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3670/7202] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:06:59.784789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:59.785356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:59.792945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:59.793431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:59.793872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:59.794568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:59.795036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:59.795469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:59.924620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:06:59.932376 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-35491c95-4295-416e-b05c-cb35c889258b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1667 microversion: 2.1 time: 0.151644 Oct 22 04:06:59.933149 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3533/7203] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:06:59 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:06:59.957326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:06:59.957925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:06:59.964179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:59.964789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:59.965249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:59.965955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:06:59.966424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:06:59.966873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:06:59.970957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:06:59.994339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:07:00.069726 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-384a9957-0775-493b-a386-ce983a16ac75 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 204 len: 0 microversion: 2.1 time: 0.117551 Oct 22 04:07:00.070275 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3671/7204] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:06:59 2022] DELETE /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:07:00.078938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:00.079549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:00.086229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:00.086706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:00.087139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:00.087825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:00.088300 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:00.088723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:00.223457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:00.231130 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-936482ef-af03-4c6f-9d5a-a9a26932b32e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1673 microversion: 2.1 time: 0.156200 Oct 22 04:07:00.231700 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3534/7205] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:00 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:01.255866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:01.256602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:01.263420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:01.263877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:01.264591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:01.265300 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:01.265771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:01.266212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:01.400530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:01.408474 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-626275ea-88d3-42a1-9e5e-e45af929cf02 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 200 len: 1673 microversion: 2.1 time: 0.157428 Oct 22 04:07:01.409052 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3672/7206] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:01 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:02.182561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e0d912e3-2a38-4e81-a737-9487cc9fba83 req-37ecfa57-afaa-45ba-92b8-30744da56679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31dc979-ce86-4d77-ad36-bbc09731d035", "name": "network-vif-deleted", "tag": "a4761d93-5bf7-4457-b973-e0593c083024"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:07:02.197088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e0d912e3-2a38-4e81-a737-9487cc9fba83 req-37ecfa57-afaa-45ba-92b8-30744da56679 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:02.197554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e0d912e3-2a38-4e81-a737-9487cc9fba83 req-37ecfa57-afaa-45ba-92b8-30744da56679 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:02.197990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e0d912e3-2a38-4e81-a737-9487cc9fba83 req-37ecfa57-afaa-45ba-92b8-30744da56679 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:02.212331 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e0d912e3-2a38-4e81-a737-9487cc9fba83 req-37ecfa57-afaa-45ba-92b8-30744da56679 service nova] Creating event network-vif-deleted:a4761d93-5bf7-4457-b973-e0593c083024 for instance f31dc979-ce86-4d77-ad36-bbc09731d035 on n-h2-862416-2 Oct 22 04:07:02.217539 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e0d912e3-2a38-4e81-a737-9487cc9fba83 req-37ecfa57-afaa-45ba-92b8-30744da56679 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038746 Oct 22 04:07:02.218152 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3535/7207] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:07:02.432841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:02.433560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:02.440948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:02.441520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:02.442038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:02.442814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:02.443349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:02.443959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:02.457789 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 HTTP/1.1 Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f31dc979-ce86-4d77-ad36-bbc09731d035'} Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:07:02.459468 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2dc85ecb-2fbf-4a10-bc07-ab97110e9170 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 404 len: 111 microversion: 2.1 time: 0.032151 Oct 22 04:07:02.464088 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3673/7208] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:02 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:07:02.481063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:02.481882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:02.489007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:02.489570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:02.490080 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:02.490849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:02.491373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:02.491895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:02.505603 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 HTTP/1.1 Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f31dc979-ce86-4d77-ad36-bbc09731d035'} Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:07:02.507434 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d77f7917-9299-4a12-9d30-3b97901f9dc0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 404 len: 111 microversion: 2.1 time: 0.033625 Oct 22 04:07:02.517805 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3536/7209] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:02 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:07:02.560715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-828768643", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "be3d6f20-8885-4923-83cf-bfa15bd79e7c"}], "security_groups": [{"name": "tempest-securitygroup--139377022"}], "key_name": "tempest-keypair-155216636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:07:02.669776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] validate_networks() for [('be3d6f20-8885-4923-83cf-bfa15bd79e7c', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:07:03.049502 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:07:03.049935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:07:03.050422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:07:03.050840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:07:03.051290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:07:03.060415 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:03.060909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:03.061353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:03.062083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:03.062668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:03.062969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:03.080721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:07:03.086816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for user 8e7f634ee8704cc49f72f588710f866f and project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:07:03.101148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:07:03.103522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:07:03.151882 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2fbb88b0-2eb9-4990-9987-d165a39d3b50 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.595023 Oct 22 04:07:03.152742 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3674/7210] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:07:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:07:03.165083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90555836-df15-4202-871e-0607bf20d1ae tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:03.166245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90555836-df15-4202-871e-0607bf20d1ae tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:03.225345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90555836-df15-4202-871e-0607bf20d1ae tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:03.233835 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90555836-df15-4202-871e-0607bf20d1ae tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1237 microversion: 2.1 time: 0.073014 Oct 22 04:07:03.234475 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3537/7211] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:03 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:04.259056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:04.259716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:04.266925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:04.268037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:04.268534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:04.269246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:04.269723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:04.270175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:04.347712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:04.356154 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48e71462-f213-49be-94d2-853bdfd8df45 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1297 microversion: 2.1 time: 0.101907 Oct 22 04:07:04.356996 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3675/7212] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:04 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:05.382498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:05.383076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:05.390048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:05.390531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:05.390993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:05.391909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:05.392262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:05.392757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:05.611721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:05.619486 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-03c417b9-e70b-4084-8909-c63593cb9447 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1362 microversion: 2.1 time: 0.241066 Oct 22 04:07:05.620072 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3538/7213] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:05 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:07:05.766225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c69d954a-0b7c-408a-aff7-eef160c37618 req-79cd6277-a13b-4a08-aa47-2e69338dcc96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6b904f-5de3-47c3-9078-4b7f2beaadf9", "tag": "75305cd8-0836-48bc-9ec9-289b4277d32b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:07:05.777852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c69d954a-0b7c-408a-aff7-eef160c37618 req-79cd6277-a13b-4a08-aa47-2e69338dcc96 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:05.778505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c69d954a-0b7c-408a-aff7-eef160c37618 req-79cd6277-a13b-4a08-aa47-2e69338dcc96 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:05.779175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c69d954a-0b7c-408a-aff7-eef160c37618 req-79cd6277-a13b-4a08-aa47-2e69338dcc96 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:05.794202 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c69d954a-0b7c-408a-aff7-eef160c37618 req-79cd6277-a13b-4a08-aa47-2e69338dcc96 service nova] Creating event network-changed:75305cd8-0836-48bc-9ec9-289b4277d32b for instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 on n-h1-862416-2 Oct 22 04:07:05.800509 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c69d954a-0b7c-408a-aff7-eef160c37618 req-79cd6277-a13b-4a08-aa47-2e69338dcc96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038269 Oct 22 04:07:05.801137 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3676/7214] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:07:06.643882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:06.644518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:06.647277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=45 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:06.652983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:06.653470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:06.653910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:06.654604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:06.655059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:06.655483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:06.790004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:06.797653 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aec1e9ef-391c-4f44-ac23-dc64f2e87512 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1362 microversion: 2.1 time: 0.158441 Oct 22 04:07:06.798296 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3539/7215] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:06 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:07.822928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:07.823645 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:07.825676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:07.831697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:07.832221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:07.832680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:07.833538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:07.834008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:07.834452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:07.967847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:07.976701 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e9ab16be-038f-4cfd-aec1-fccd78ee1bdd tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1362 microversion: 2.1 time: 0.158897 Oct 22 04:07:07.977271 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3677/7216] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:07 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:09.000657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:09.001271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:09.008189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:09.008704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:09.009144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:09.009851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:09.010302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:09.010727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:09.138146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:09.146704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9a5fa47-fbae-4c92-a5df-a73f0d7f8ee7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1362 microversion: 2.1 time: 0.149924 Oct 22 04:07:09.147220 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3540/7217] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:08 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:07:10.169924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:10.170598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:10.178443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:10.178951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:10.179402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:10.180124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:10.180621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:10.181064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:10.568951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:10.576587 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f35dc272-a00b-40c9-934f-dbb80e7c217e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1362 microversion: 2.1 time: 0.410560 Oct 22 04:07:10.577165 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3678/7218] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:10 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:11.600097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:11.600734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:11.607356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:11.607860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:11.608335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:11.609043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:11.609497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:11.609926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:11.749619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:11.757766 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bb916d87-b5f1-4154-ae32-7db9db9a20f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1362 microversion: 2.1 time: 0.161608 Oct 22 04:07:11.758353 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3541/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:11 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:12.301390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0b30afcf-4ee8-4bb2-8db1-f102cae3d1c9 req-7ac4338b-5705-468e-92fd-0bc759168be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa6b904f-5de3-47c3-9078-4b7f2beaadf9", "name": "network-vif-plugged", "status": "completed", "tag": "75305cd8-0836-48bc-9ec9-289b4277d32b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:07:12.311795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0b30afcf-4ee8-4bb2-8db1-f102cae3d1c9 req-7ac4338b-5705-468e-92fd-0bc759168be0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:12.312326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0b30afcf-4ee8-4bb2-8db1-f102cae3d1c9 req-7ac4338b-5705-468e-92fd-0bc759168be0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:12.312783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0b30afcf-4ee8-4bb2-8db1-f102cae3d1c9 req-7ac4338b-5705-468e-92fd-0bc759168be0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:12.323998 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0b30afcf-4ee8-4bb2-8db1-f102cae3d1c9 req-7ac4338b-5705-468e-92fd-0bc759168be0 service nova] Creating event network-vif-plugged:75305cd8-0836-48bc-9ec9-289b4277d32b for instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 on n-h1-862416-2 Oct 22 04:07:12.329099 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0b30afcf-4ee8-4bb2-8db1-f102cae3d1c9 req-7ac4338b-5705-468e-92fd-0bc759168be0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031701 Oct 22 04:07:12.330200 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3679/7220] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:07:12.782181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:12.783216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:12.789998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:12.790486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:12.790917 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:12.791609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:12.792060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:12.792514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:12.921197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:12.930032 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-74ab8014-ca62-4673-bf59-9700c131c496 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1362 microversion: 2.1 time: 0.151883 Oct 22 04:07:12.930588 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3542/7221] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:12 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:13.950922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:13.951705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:13.958572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:13.959277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:13.965992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:13.966486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:13.966936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:13.967633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:13.968133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:13.968597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:14.102495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:14.110305 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e78d41fc-076a-441d-8e02-f72d9b402d8c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1548 microversion: 2.1 time: 0.160361 Oct 22 04:07:14.110935 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3680/7222] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:13 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:14.133444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:14.133963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:14.135795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:14.142712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:14.143201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:14.143645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:14.144380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:14.144842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:14.145274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:14.225036 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a266fff6-5504-4b80-beb8-387aca9469ca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095457 Oct 22 04:07:14.225638 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3543/7223] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 04:07:14 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:07:15.158261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ffd1b972-7b19-4ac5-b4a3-4c922e4a16de req-7021e8bb-f936-4c3c-8ad1-8762a7d10b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6b904f-5de3-47c3-9078-4b7f2beaadf9", "tag": "75305cd8-0836-48bc-9ec9-289b4277d32b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:07:15.169342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ffd1b972-7b19-4ac5-b4a3-4c922e4a16de req-7021e8bb-f936-4c3c-8ad1-8762a7d10b56 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:15.169929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ffd1b972-7b19-4ac5-b4a3-4c922e4a16de req-7021e8bb-f936-4c3c-8ad1-8762a7d10b56 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:15.170618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ffd1b972-7b19-4ac5-b4a3-4c922e4a16de req-7021e8bb-f936-4c3c-8ad1-8762a7d10b56 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:15.182232 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ffd1b972-7b19-4ac5-b4a3-4c922e4a16de req-7021e8bb-f936-4c3c-8ad1-8762a7d10b56 service nova] Creating event network-changed:75305cd8-0836-48bc-9ec9-289b4277d32b for instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 on n-h1-862416-2 Oct 22 04:07:15.187461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ffd1b972-7b19-4ac5-b4a3-4c922e4a16de req-7021e8bb-f936-4c3c-8ad1-8762a7d10b56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032917 Oct 22 04:07:15.188492 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3681/7224] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:07:50.811343 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:07:50.811845 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:07:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9/action (ip 10.222.0.25) !!! Oct 22 04:07:50.813836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=9 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:50.814644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=51 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:50.821123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:07:50.823511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:50.836430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:50.836919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:50.837361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:50.838062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:50.838521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:50.838953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:50.869036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:50.875098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120582) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:07:50.883222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:07:50.883651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:07:50.884133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:07:50.884583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:07:50.884999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:07:50.949431 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5ad88f0-fc92-4662-bf05-a1e1928d946f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9/action" status: 202 len: 0 microversion: 2.1 time: 0.140052 Oct 22 04:07:50.950059 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3544/7225] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:07:50 2022] POST /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:07:50.957627 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:07:50.958156 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:07:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 (ip 10.222.0.25) !!! Oct 22 04:07:50.959766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=9 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:50.960818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:07:50.970825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:50.972189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:50.983995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:50.984639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:50.985166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:50.985950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:50.986457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:50.987573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:51.192952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:51.200800 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d616b9d2-a15e-48fb-9334-730e2eb42507 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1676 microversion: 2.1 time: 0.246299 Oct 22 04:07:51.201388 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3682/7226] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:50 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:52.225139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:52.225952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:52.233566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:52.234060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:52.234509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:52.235219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:52.235674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:52.236101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:52.489588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:52.497295 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7da5b00-12a3-4805-939a-42392093d641 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1676 microversion: 2.1 time: 0.276747 Oct 22 04:07:52.497889 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3545/7227] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:52 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1676 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:53.521659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:53.522265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:53.529186 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:53.529685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:53.530142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:53.530847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:53.531319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:53.531764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:53.661848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:53.669566 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d42fa194-78af-4138-805b-d9fba9d4e83c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.152380 Oct 22 04:07:53.670265 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3683/7228] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:53 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:54.694994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:54.696062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:54.702793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:54.703272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:54.703704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:54.704418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:54.704868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:54.705291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:54.840055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:54.848001 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3701984-6608-4d7e-9167-d199d6717566 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.157660 Oct 22 04:07:54.848613 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3546/7229] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:54 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:55.870620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:55.871166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:55.878034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:55.878524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:55.878974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:55.879670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:55.880134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:55.880600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:56.013156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:56.021646 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-935a9784-1e88-4c06-b1e1-e5fd7f07d125 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.155044 Oct 22 04:07:56.022229 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3684/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:55 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:57.045542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:57.046161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:57.052950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:57.053434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:57.053869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:57.054564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:57.055016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:57.055446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:57.185053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:57.193487 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28f72105-7d41-40d5-892c-10d1bea92d37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.151943 Oct 22 04:07:57.194076 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3547/7231] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:57 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:58.218521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:58.219146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:58.227742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:58.228297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:58.229229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:58.229955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:58.230427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:58.230871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:58.383295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:58.393769 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2614021c-61d7-4650-a91a-671aafc178b0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.181039 Oct 22 04:07:58.394875 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3685/7232] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:58 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:07:59.418551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:07:59.419140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:07:59.426830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:59.427316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:59.427783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:59.428532 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:07:59.428988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:07:59.429419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:07:59.562901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:07:59.570621 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-67943f4b-e49c-446c-ab3d-b901cd0138a6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.155949 Oct 22 04:07:59.571190 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3548/7233] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:07:59 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:00.594554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:00.595192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:00.602216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:00.602722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:00.603183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:00.603896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:00.604407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:00.604863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:00.738461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:00.746186 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa45794f-e540-44f0-9456-f67ccf6248d4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.155653 Oct 22 04:08:00.746766 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3686/7234] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:00 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:01.769756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:01.770402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:01.777435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:01.777920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:01.778362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:01.779056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:01.779513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:01.779943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:01.907623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:01.915583 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1859575-8acc-41b7-9fff-b62c67bb223b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.149740 Oct 22 04:08:01.916160 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3549/7235] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:01 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:02.941037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:02.941686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:02.948681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:02.949176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:02.949627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:02.950324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:02.950789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:02.951228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:03.080113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:03.088477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b6e2f75-7c4d-4079-99e0-c495baf1ee7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.151940 Oct 22 04:08:03.089064 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3687/7236] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:02 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:04.112754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:04.113356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:04.120115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:04.120631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:04.121069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:04.121764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:04.122221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:04.122652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:04.259433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:04.267398 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c12b0a34-1e40-4f25-8c48-6b5f61d0ab0b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.158886 Oct 22 04:08:04.268488 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3550/7237] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:04 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:05.291015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:05.291636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:05.298461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:05.298957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:05.300608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:05.301320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:05.301788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:05.302231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:05.438326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:05.446389 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-11bc21ca-e095-4a10-b09c-7abac0fe8d6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.159276 Oct 22 04:08:05.446980 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3688/7238] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:05 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:06.470267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:06.470925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:06.478540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:06.479064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:06.479503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:06.480229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:06.480692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:06.481118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:06.613948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:06.624815 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f8a94bcb-bcd2-49f9-ac5b-bd864ca30edf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.158030 Oct 22 04:08:06.625893 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3551/7239] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:06 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:07.649672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:07.650305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:07.657170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:07.657673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:07.658132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:07.658981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:07.659524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:07.659979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:07.795266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:07.804026 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-14781d50-c1d7-4a4a-aa7b-eba4ebb205a5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.158307 Oct 22 04:08:07.804651 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3689/7240] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:07 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:08.828132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:08.828776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:08.837428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:08.837901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:08.838333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:08.839016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:08.839465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:08.839890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:08.973039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:08.980724 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e60e6905-7914-49b2-81f9-ebf6b8bdbd6f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.156482 Oct 22 04:08:08.981284 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3552/7241] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:08 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:10.004566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:10.005203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:10.012333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:10.012845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:10.013306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:10.014041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:10.014505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:10.015208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:10.143711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:10.151519 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-397c2394-cdfd-49ec-9997-761b0169a6b8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1681 microversion: 2.1 time: 0.151675 Oct 22 04:08:10.152140 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3690/7242] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:09 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:10.848720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7f1cba60-06b1-48a8-b15d-bb1d0149b1e6 req-54bc8c53-9bf8-40a8-987f-d86683eefea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa6b904f-5de3-47c3-9078-4b7f2beaadf9", "name": "network-vif-unplugged", "status": "completed", "tag": "75305cd8-0836-48bc-9ec9-289b4277d32b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:10.859225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7f1cba60-06b1-48a8-b15d-bb1d0149b1e6 req-54bc8c53-9bf8-40a8-987f-d86683eefea8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:10.859753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7f1cba60-06b1-48a8-b15d-bb1d0149b1e6 req-54bc8c53-9bf8-40a8-987f-d86683eefea8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:10.860233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7f1cba60-06b1-48a8-b15d-bb1d0149b1e6 req-54bc8c53-9bf8-40a8-987f-d86683eefea8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:10.873717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7f1cba60-06b1-48a8-b15d-bb1d0149b1e6 req-54bc8c53-9bf8-40a8-987f-d86683eefea8 service nova] Creating event network-vif-unplugged:75305cd8-0836-48bc-9ec9-289b4277d32b for instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 on n-h2-862416-2 Oct 22 04:08:10.880478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-7f1cba60-06b1-48a8-b15d-bb1d0149b1e6 req-54bc8c53-9bf8-40a8-987f-d86683eefea8 service nova] Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:08:10.891823 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7f1cba60-06b1-48a8-b15d-bb1d0149b1e6 req-54bc8c53-9bf8-40a8-987f-d86683eefea8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047003 Oct 22 04:08:10.892481 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3553/7243] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:08:11.175857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:11.176542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:11.183335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:11.183834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:11.184308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:11.185024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:11.185494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:11.185936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:11.322886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:11.330895 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-355471ad-e858-4342-a862-26bbcd55fbb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1680 microversion: 2.1 time: 0.159909 Oct 22 04:08:11.331602 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3691/7244] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:11 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:12.356442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:12.357064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:12.363575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:12.364057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:12.364538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:12.365234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:12.365689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:12.366118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:12.499501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:12.507415 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97212e42-dd2c-4dbc-a97e-3573b9a125cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1678 microversion: 2.1 time: 0.156348 Oct 22 04:08:12.507990 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3554/7245] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:12 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:12.929178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-df2f9867-5008-41a2-a065-4aef91c8147b req-b8ec004a-bf08-4fcf-9cb3-c4412c2bba08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6b904f-5de3-47c3-9078-4b7f2beaadf9", "tag": "75305cd8-0836-48bc-9ec9-289b4277d32b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:12.939364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-df2f9867-5008-41a2-a065-4aef91c8147b req-b8ec004a-bf08-4fcf-9cb3-c4412c2bba08 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:12.940506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-df2f9867-5008-41a2-a065-4aef91c8147b req-b8ec004a-bf08-4fcf-9cb3-c4412c2bba08 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:12.941044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-df2f9867-5008-41a2-a065-4aef91c8147b req-b8ec004a-bf08-4fcf-9cb3-c4412c2bba08 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:12.952479 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-df2f9867-5008-41a2-a065-4aef91c8147b req-b8ec004a-bf08-4fcf-9cb3-c4412c2bba08 service nova] Creating event network-changed:75305cd8-0836-48bc-9ec9-289b4277d32b for instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 on n-h2-862416-2 Oct 22 04:08:12.957916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-df2f9867-5008-41a2-a065-4aef91c8147b req-b8ec004a-bf08-4fcf-9cb3-c4412c2bba08 service nova] Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:08:12.968715 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-df2f9867-5008-41a2-a065-4aef91c8147b req-b8ec004a-bf08-4fcf-9cb3-c4412c2bba08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043241 Oct 22 04:08:12.969305 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3692/7246] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:08:13.532026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:13.532703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:13.539572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:13.540064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:13.540544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:13.541247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:13.541705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:13.542137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:13.670413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:13.678783 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-29a6c9d6-16fa-494f-b06f-68331b1b2aca tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1678 microversion: 2.1 time: 0.150699 Oct 22 04:08:13.679367 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3555/7247] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:13 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:14.704350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:14.705591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:14.711815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:14.712367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:14.712822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:14.713554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:14.714024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:14.714465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:14.852586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:14.861668 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-145e30d1-92ae-4402-bedb-60d573729968 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1678 microversion: 2.1 time: 0.162321 Oct 22 04:08:14.862260 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3693/7248] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:14 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:15.885485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:15.886210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:15.894304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:15.894792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:15.895238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:15.895946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:15.896439 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:15.896874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:16.032104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:16.040119 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6cadc3b-d307-4b56-bcec-e0dafec4a9f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1675 microversion: 2.1 time: 0.158479 Oct 22 04:08:16.040747 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3556/7249] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:15 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:16.064136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:16.064746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:16.071976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:16.072515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:16.072969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:16.073681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:16.074155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:16.074595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:16.116754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:16.117255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:16.117711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:16.118459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:16.118939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:16.119382 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:16.140652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:08:16.146503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for user 8e7f634ee8704cc49f72f588710f866f and project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:08:16.249053 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a9d83d6c-a273-408a-92b7-f7bfceab6e8b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9/action" status: 202 len: 0 microversion: 2.1 time: 0.188699 Oct 22 04:08:16.249673 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3694/7250] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:08:16 2022] POST /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:08:16.259648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:16.260303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:16.266449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:16.266943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:16.267542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:16.268825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:16.269490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:16.269967 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:16.475057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:16.482453 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32fc74d4-042b-4adf-b748-7e1ab0a9b631 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1674 microversion: 2.1 time: 0.228071 Oct 22 04:08:16.483029 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3557/7251] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:16 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:17.508565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:17.509284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:17.516323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:17.516825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:17.517279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:17.518040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:17.518694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:17.519144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:17.654363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:17.657949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:08:17.663272 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f0aebb82-5544-4f1b-9e4a-5067630aab6d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1674 microversion: 2.1 time: 0.159347 Oct 22 04:08:17.663854 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3695/7252] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:17 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:08:18.687338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:18.687946 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:18.695866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:18.696372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:18.696805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:18.697494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:18.697942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:18.698364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:18.838883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:18.847214 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5d24229-a845-4164-8f40-eca1bd01484d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1674 microversion: 2.1 time: 0.163730 Oct 22 04:08:18.847787 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3558/7253] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:18 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:19.871717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:19.872380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:19.886328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:19.886854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:19.887291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:19.888017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:19.888524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:19.888970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:20.024121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:20.032298 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e67e45a2-dd2f-494e-b554-815b8391c627 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1674 microversion: 2.1 time: 0.165384 Oct 22 04:08:20.033070 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3696/7254] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:19 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:20.290049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-31a8eb97-8ae7-446b-8b61-cfbb335a3c44 req-b174904c-ae93-41bb-97d1-37401d1e5992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6b904f-5de3-47c3-9078-4b7f2beaadf9", "tag": "75305cd8-0836-48bc-9ec9-289b4277d32b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:20.300227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-31a8eb97-8ae7-446b-8b61-cfbb335a3c44 req-b174904c-ae93-41bb-97d1-37401d1e5992 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:20.300712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-31a8eb97-8ae7-446b-8b61-cfbb335a3c44 req-b174904c-ae93-41bb-97d1-37401d1e5992 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:20.301148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-31a8eb97-8ae7-446b-8b61-cfbb335a3c44 req-b174904c-ae93-41bb-97d1-37401d1e5992 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:20.313204 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-31a8eb97-8ae7-446b-8b61-cfbb335a3c44 req-b174904c-ae93-41bb-97d1-37401d1e5992 service nova] Creating event network-changed:75305cd8-0836-48bc-9ec9-289b4277d32b for instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 on n-h1-862416-2 Oct 22 04:08:20.315781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:08:20.319658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-31a8eb97-8ae7-446b-8b61-cfbb335a3c44 req-b174904c-ae93-41bb-97d1-37401d1e5992 service nova] Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:08:20.330785 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-31a8eb97-8ae7-446b-8b61-cfbb335a3c44 req-b174904c-ae93-41bb-97d1-37401d1e5992 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102898 Oct 22 04:08:20.331404 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3559/7255] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:08:21.055917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:21.056801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:21.059593 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:08:21.065537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:21.066148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:21.066664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:21.067474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:21.068412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:21.068548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:21.212889 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:21.220687 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b87e65ac-14de-44c3-9c34-4439f797de8a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1674 microversion: 2.1 time: 0.168710 Oct 22 04:08:21.221418 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3697/7256] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:21 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:22.247296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:22.247988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:22.250389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=37 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:08:22.256878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:22.257375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:22.257825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:22.258533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:22.258995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:22.259425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:22.389610 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:22.398210 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-875ea53f-f525-49cb-b876-59f8134bebb4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1674 microversion: 2.1 time: 0.156002 Oct 22 04:08:22.398928 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3560/7257] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:22 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:23.421598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:23.422250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:23.429838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:23.430330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:23.430777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:23.431473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:23.431938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:23.432408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:23.565086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:23.572814 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f56cbfaf-2614-42bb-bd23-3842dcc7b6d6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1667 microversion: 2.1 time: 0.155132 Oct 22 04:08:23.573394 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3698/7258] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:23 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:23.595675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:23.596916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:23.603745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:23.604233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:23.604686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:23.605406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:23.605857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:23.606280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:23.736422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:23.744900 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f52cf35-672e-4be8-baf5-718a0d3b3ad1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1667 microversion: 2.1 time: 0.153036 Oct 22 04:08:23.745476 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3561/7259] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:23 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:23.768417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:23.768973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:23.774928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:23.775426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:23.775879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:23.776618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:23.777089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:23.777535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:23.904920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:23.913071 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-22a0dd83-d933-41b0-aa2f-f9bb115efe18 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1667 microversion: 2.1 time: 0.149017 Oct 22 04:08:23.913649 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3699/7260] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:23 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:23.935618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:23.936106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:23.942148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:23.942625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:23.943061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:23.943748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:23.944195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:23.944641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:23.968755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:08:24.043000 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-372d7217-17fe-463a-8e4b-b16931c257d2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 204 len: 0 microversion: 2.1 time: 0.110968 Oct 22 04:08:24.043502 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3562/7261] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:08:23 2022] DELETE /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:08:24.053045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:24.053662 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:24.059521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:24.060012 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:24.060488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:24.061184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:24.061651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:24.062084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:24.198083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:24.206449 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a90cb511-abad-4c35-8877-3827ecb3035d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1673 microversion: 2.1 time: 0.158035 Oct 22 04:08:24.207034 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3700/7262] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:24 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:08:25.231443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:25.232132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:25.238877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:25.239356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:25.239794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:25.240510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:25.240961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:25.241384 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:25.410715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:25.418692 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e775f5f-7a92-495f-bb7e-b692c74da5e7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 200 len: 1673 microversion: 2.1 time: 0.191581 Oct 22 04:08:25.419271 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3563/7263] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:25 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:26.194254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c26af39e-bdbd-4f2d-8302-d66c5c6418e6 req-9dace84a-5cb5-4377-b4f5-9ff92795e016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa6b904f-5de3-47c3-9078-4b7f2beaadf9", "name": "network-vif-deleted", "tag": "75305cd8-0836-48bc-9ec9-289b4277d32b"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:26.201111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:08:26.205469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c26af39e-bdbd-4f2d-8302-d66c5c6418e6 req-9dace84a-5cb5-4377-b4f5-9ff92795e016 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:26.206605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c26af39e-bdbd-4f2d-8302-d66c5c6418e6 req-9dace84a-5cb5-4377-b4f5-9ff92795e016 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:26.207112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c26af39e-bdbd-4f2d-8302-d66c5c6418e6 req-9dace84a-5cb5-4377-b4f5-9ff92795e016 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:26.218907 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c26af39e-bdbd-4f2d-8302-d66c5c6418e6 req-9dace84a-5cb5-4377-b4f5-9ff92795e016 service nova] Creating event network-vif-deleted:75305cd8-0836-48bc-9ec9-289b4277d32b for instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 on n-h1-862416-2 Oct 22 04:08:26.224150 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c26af39e-bdbd-4f2d-8302-d66c5c6418e6 req-9dace84a-5cb5-4377-b4f5-9ff92795e016 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034388 Oct 22 04:08:26.224802 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3701/7264] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:08:26.442827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:26.443452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:26.452357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:26.452357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:26.452357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:26.453466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:26.453695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:26.454238 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:26.469696 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 HTTP/1.1 Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'aa6b904f-5de3-47c3-9078-4b7f2beaadf9'} Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:08:26.471501 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3bf069a6-f2a3-4477-b173-8ae3b6304886 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 404 len: 111 microversion: 2.1 time: 0.034983 Oct 22 04:08:26.477521 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3564/7265] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:26 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:08:26.491541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:26.492146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:26.498957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:26.499453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:26.499898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:26.500646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:26.501084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:26.501524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:26.515133 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 HTTP/1.1 Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'aa6b904f-5de3-47c3-9078-4b7f2beaadf9'} Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:08:26.516866 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47483f0f-38cf-42b4-9a1a-96c56209d6de tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 404 len: 111 microversion: 2.1 time: 0.031225 Oct 22 04:08:26.521978 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3702/7266] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:26 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:08:26.568886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1383128846", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "be3d6f20-8885-4923-83cf-bfa15bd79e7c"}], "security_groups": [{"name": "tempest-securitygroup--139377022"}], "key_name": "tempest-keypair-155216636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:26.678449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] validate_networks() for [('be3d6f20-8885-4923-83cf-bfa15bd79e7c', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:08:27.074866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:08:27.075298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:08:27.075777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:08:27.076257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:08:27.076707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:08:27.086350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:27.086837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:27.087286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:27.088112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:27.088776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:27.089211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:27.106312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:08:27.111766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for user 8e7f634ee8704cc49f72f588710f866f and project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:08:27.124437 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:08:27.126766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:08:27.175869 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-03d0b3c5-de13-4dd8-872e-2f303831c739 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.610888 Oct 22 04:08:27.176581 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3565/7267] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:08:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:08:27.188003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0dd4963f-1b0d-4163-b0cd-54e48aafdd9e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:27.188659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0dd4963f-1b0d-4163-b0cd-54e48aafdd9e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:27.258527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0dd4963f-1b0d-4163-b0cd-54e48aafdd9e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:27.266554 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0dd4963f-1b0d-4163-b0cd-54e48aafdd9e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1238 microversion: 2.1 time: 0.082549 Oct 22 04:08:27.267121 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3703/7268] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:27 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:28.292122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:28.292769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:28.299819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:28.300346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:28.300801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:28.301519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:28.301980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:28.302415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:28.396990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:28.404705 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cafd8cab-11fa-4264-bb26-c4154c9692c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1296 microversion: 2.1 time: 0.117440 Oct 22 04:08:28.405599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3566/7269] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:28 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1296 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:29.428655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:29.429359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:29.436244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:29.436770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:29.437218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:29.437921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:29.438386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:29.438825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:29.566836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6426bfc6-d34b-4af3-8596-a7dd77c366b2 req-f4564433-a291-4628-b89b-013e7290d105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:29.578305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:29.583086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6426bfc6-d34b-4af3-8596-a7dd77c366b2 req-f4564433-a291-4628-b89b-013e7290d105 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:29.583795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6426bfc6-d34b-4af3-8596-a7dd77c366b2 req-f4564433-a291-4628-b89b-013e7290d105 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:29.584453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6426bfc6-d34b-4af3-8596-a7dd77c366b2 req-f4564433-a291-4628-b89b-013e7290d105 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:29.588832 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-adf08d0b-b165-4aee-a485-d1546cba4576 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1363 microversion: 2.1 time: 0.164459 Oct 22 04:08:29.589883 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3704/7270] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:29 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:29.597692 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6426bfc6-d34b-4af3-8596-a7dd77c366b2 req-f4564433-a291-4628-b89b-013e7290d105 service nova] Creating event network-changed:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h2-862416-2 Oct 22 04:08:29.602579 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6426bfc6-d34b-4af3-8596-a7dd77c366b2 req-f4564433-a291-4628-b89b-013e7290d105 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045405 Oct 22 04:08:29.603180 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3567/7271] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:08:30.613818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:30.614371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:30.621298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:30.621793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:30.622248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:30.622953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:30.623424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:30.623868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:30.758956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:30.766868 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-807b79d6-70ee-4838-8dbf-30901d334dce tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1363 microversion: 2.1 time: 0.157140 Oct 22 04:08:30.767431 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3705/7272] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:30 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:31.792707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:31.793326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:31.799446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:31.800422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:31.800865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:31.801556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:31.802013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:31.802441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:31.946743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:31.954663 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d68503fa-895b-473c-81f8-d06c39f68772 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1363 microversion: 2.1 time: 0.167150 Oct 22 04:08:31.955241 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3568/7273] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:31 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:32.978648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:32.979272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:32.986286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:32.986787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:32.987286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:32.988008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:32.988583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:32.989033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:33.117157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:33.124832 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5ba597d1-6174-4179-8330-3da224a1ac9c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1363 microversion: 2.1 time: 0.150119 Oct 22 04:08:33.125410 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3706/7274] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:32 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:34.149456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:34.150056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:34.157045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:34.158055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:34.158055 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:34.158724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:34.159232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:34.159762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:34.291145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:34.299115 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b88459a0-71ba-4c3a-b20e-6036dc2aab47 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1363 microversion: 2.1 time: 0.153610 Oct 22 04:08:34.300318 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3569/7275] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:34 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:35.319891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d87b1f31-9e9d-46ca-9723-74b893e10bd9 req-7ddf197b-63b6-4a9e-ba71-26d98fce8adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "name": "network-vif-plugged", "status": "completed", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:35.325033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:35.325661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:35.329552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d87b1f31-9e9d-46ca-9723-74b893e10bd9 req-7ddf197b-63b6-4a9e-ba71-26d98fce8adc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:35.330036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d87b1f31-9e9d-46ca-9723-74b893e10bd9 req-7ddf197b-63b6-4a9e-ba71-26d98fce8adc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:35.330484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d87b1f31-9e9d-46ca-9723-74b893e10bd9 req-7ddf197b-63b6-4a9e-ba71-26d98fce8adc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:35.333065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:35.333563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:35.334008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:35.334719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:35.335177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:35.335607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:35.342249 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d87b1f31-9e9d-46ca-9723-74b893e10bd9 req-7ddf197b-63b6-4a9e-ba71-26d98fce8adc service nova] Creating event network-vif-plugged:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h2-862416-2 Oct 22 04:08:35.347283 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d87b1f31-9e9d-46ca-9723-74b893e10bd9 req-7ddf197b-63b6-4a9e-ba71-26d98fce8adc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091294 Oct 22 04:08:35.347890 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3707/7276] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:08:35.519012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:35.526732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2dc661ef-8da0-4c63-abd5-6d4bdd6f9fde tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1363 microversion: 2.1 time: 0.207097 Oct 22 04:08:35.527303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3570/7277] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:35 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:36.551619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:36.552367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:36.558576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:36.559074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:36.559528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:36.560248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:36.560722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:36.561166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:36.698688 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:36.707371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2e3cbce-6ad4-4c8f-a866-d34384b5a5ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1363 microversion: 2.1 time: 0.161646 Oct 22 04:08:36.707989 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3708/7278] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:36 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:37.737058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:37.737712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:37.740525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:08:37.741192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:08:37.746837 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:37.747322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:37.747764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:37.748500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:37.748960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:37.749387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:37.880317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:08:37.888013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8d436ec3-a68c-4613-8faf-8c7c29f00955 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1548 microversion: 2.1 time: 0.154948 Oct 22 04:08:37.888625 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3571/7279] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:08:37 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:08:37.912874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:08:37.913416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:08:37.915304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:08:37.921706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:37.922198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:37.922664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:37.923346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:37.923809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:37.924269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:38.001469 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc29a373-bff2-42f5-b87d-24eb63a385bf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093575 Oct 22 04:08:38.002097 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3709/7280] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 04:08:37 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:08:39.021741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-c46fc064-1cb7-4526-9b89-5edfffb9f2eb req-87faa3ce-9650-40f0-9b47-041edc78f84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:08:39.031266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c46fc064-1cb7-4526-9b89-5edfffb9f2eb req-87faa3ce-9650-40f0-9b47-041edc78f84e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:08:39.031696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c46fc064-1cb7-4526-9b89-5edfffb9f2eb req-87faa3ce-9650-40f0-9b47-041edc78f84e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:08:39.032111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c46fc064-1cb7-4526-9b89-5edfffb9f2eb req-87faa3ce-9650-40f0-9b47-041edc78f84e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:08:39.046581 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-c46fc064-1cb7-4526-9b89-5edfffb9f2eb req-87faa3ce-9650-40f0-9b47-041edc78f84e service nova] Creating event network-changed:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h2-862416-2 Oct 22 04:08:39.052327 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-c46fc064-1cb7-4526-9b89-5edfffb9f2eb req-87faa3ce-9650-40f0-9b47-041edc78f84e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083599 Oct 22 04:08:39.053054 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3572/7281] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:09:42.134241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=27 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:09:42.134998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=64 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:09:42.141852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:09:42.142996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:42.149128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:42.149635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:42.150150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:42.150906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:42.151411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:42.151861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:42.283789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:09:42.291832 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9a36a5c-1e4a-4f38-ac77-47219b5ac1bb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1667 microversion: 2.1 time: 0.160003 Oct 22 04:09:42.292460 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3710/7282] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:09:42 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:09:42.313842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:09:42.315089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:09:42.320397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0df5b97b-7d5c-434a-a10c-7a70e3832aa6"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:09:42.322815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:42.331252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:42.331675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:42.332108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:42.332833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:42.333284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:42.333700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:42.574207 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b9db87e-8f06-411d-ae8d-0aa6b2fb0d66 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262870 Oct 22 04:09:42.574817 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3573/7283] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 04:09:42 2022] POST /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:09:53.291918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:09:53.294304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:53.296830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:09:53.297589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:09:53.303811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:53.304333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:53.304784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:53.305532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:53.305980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:53.306416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:53.334829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:09:53.340190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Old instance type m1.heat2, new instance type m1.heat {{(pid=120581) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:09:53.347762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:09:53.348191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:09:53.348707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:09:53.349127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:09:53.349548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:09:53.411512 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9e3d7fb-3a70-42eb-91ef-e1128d7262d1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/action" status: 202 len: 0 microversion: 2.1 time: 0.123616 Oct 22 04:09:53.412292 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3711/7284] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:09:53 2022] POST /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:09:53.421019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:09:53.421716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:53.425568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:09:53.426281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:09:53.430707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:53.431189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:53.431681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:53.432564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:53.433018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:53.433571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:53.902322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:09:53.911342 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-49bb03c0-f213-4370-9523-3cca5d07c40d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1722 microversion: 2.1 time: 0.494606 Oct 22 04:09:53.911925 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3574/7285] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:09:53 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1722 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:09:54.935614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:09:54.936279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:54.944178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:54.944702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:54.945147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:54.945861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:54.946325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:54.946762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:55.086340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:09:55.094906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7854a863-20b8-42a7-beda-38fbec10cfb5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1722 microversion: 2.1 time: 0.164086 Oct 22 04:09:55.096115 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3712/7286] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:09:54 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:09:56.119130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:09:56.119685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:56.126822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:56.127304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:56.127746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:56.128476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:56.128938 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:56.129372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:56.262009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:09:56.271059 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1c1c5331-72c0-4558-a187-e18f9f045b9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.155987 Oct 22 04:09:56.271645 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3575/7287] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:09:56 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:09:57.295184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:09:57.295823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:57.303234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:57.303757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:57.304196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:57.304930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:57.305407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:57.305860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:57.433531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:09:57.442551 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4cb27e80-15ad-4860-934e-f6b6ccd9da58 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.151365 Oct 22 04:09:57.443129 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3713/7288] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:09:57 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:09:58.465959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:09:58.467273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:58.475180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:58.475526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:58.475964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:58.476692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:58.477141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:58.477561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:58.605821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:09:58.614475 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-192ec62d-740e-4584-9db7-2a238099bfba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.152435 Oct 22 04:09:58.615057 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3576/7289] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:09:58 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:09:59.638221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:09:59.638838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:09:59.646526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:59.647020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:59.647466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:59.648161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:09:59.648652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:09:59.649088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:09:59.786722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:09:59.795164 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c8b6ae9-bd4e-470f-88f8-0c2b441a0845 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.160848 Oct 22 04:09:59.795744 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3714/7290] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:09:59 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:00.818166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:00.818711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:00.825531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:00.826006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:00.826438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:00.827123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:00.827568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:00.827991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:00.964920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:00.973214 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-792063ae-5f6b-4a78-85c4-8982b7e47ff2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.159203 Oct 22 04:10:00.973785 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3577/7291] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:00 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:01.996518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:01.997065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:02.004324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:02.004819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:02.005267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:02.005961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:02.006423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:02.006864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:02.150020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:02.159039 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e71526d-5599-42c9-9499-70ca005c26da tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.166545 Oct 22 04:10:02.159736 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3715/7292] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:01 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:10:03.182972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:03.183569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:03.191548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:03.192030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:03.192500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:03.193187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:03.193671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:03.194352 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:03.325513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:03.333732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3c5e1c09-0cde-410a-9869-e90d015ba1e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.154637 Oct 22 04:10:03.334326 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3578/7293] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:03 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:04.357966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:04.358591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:04.365722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:04.366229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:04.366685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:04.367429 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:04.367911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:04.368403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:04.499811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:04.509084 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb3d3741-0c09-4795-81e6-6c926b42f253 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.155105 Oct 22 04:10:04.509663 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3716/7294] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:04 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:05.534226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:05.534835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:05.541691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:05.542168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:05.542601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:05.543299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:05.543732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:05.544151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:05.675401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:05.683574 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-721a2b49-a9d9-4457-9620-878569a845e1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.153849 Oct 22 04:10:05.684154 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3579/7295] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:05 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:06.707075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:06.707706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:06.714836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:06.715343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:06.715822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:06.716582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:06.717060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:06.717533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:06.851954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:06.860158 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5115df21-fafd-4ef4-a781-e1699670a969 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.157127 Oct 22 04:10:06.861647 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3717/7296] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:06 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:07.888709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:07.889316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:07.896362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:07.896841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:07.897302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:07.897983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:07.898435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:07.898859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:08.034710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:08.042939 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f675d6ef-c379-4e96-9707-383e80f3c549 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.158163 Oct 22 04:10:08.043517 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3580/7297] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:07 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:09.067189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:09.067808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:09.074679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:09.075176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:09.075625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:09.076352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:09.076819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:09.077256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:09.207821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:09.216140 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-021e62a8-7ade-4fe5-8e4f-5d59499c5b43 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.153398 Oct 22 04:10:09.216743 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3718/7298] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:09 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:10.239541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:10.240138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:10.247026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:10.247512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:10.247947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:10.248666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:10.249125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:10.249555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:10.378505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:10.386734 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e77fb99f-2d62-44ac-830c-81a2c4aaff16 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.151081 Oct 22 04:10:10.387293 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3581/7299] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:10 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:11.411348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:11.411974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:11.418830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:11.419333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:11.419791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:11.420746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:11.421223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:11.421672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:11.556390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:11.565317 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b3a134d3-d354-4837-b58f-ac1bc0a6337c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.158808 Oct 22 04:10:11.565906 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3719/7300] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:11 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:12.589858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:12.590472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:12.598033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:12.598510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:12.598948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:12.599639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:12.600103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:12.600560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:12.740990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:12.749674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-51b6ffec-0e99-4d4b-b680-e2d243cbfd29 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.163679 Oct 22 04:10:12.750258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3582/7301] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:12 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:13.773818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:13.774438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:13.781495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:13.781927 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:13.782985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:13.784082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:13.784580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:13.785022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:13.918775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:13.927727 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e156ff0e-0046-4729-a91c-3953a5be0f7d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1727 microversion: 2.1 time: 0.157775 Oct 22 04:10:13.928352 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3720/7302] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:13 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:14.951488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:14.952097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:14.959430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:14.959910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:14.960372 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:14.961121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:14.961576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:14.962170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:15.025802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ec9abda3-b3cd-4600-82a9-64b29143ade5 req-2c00c003-71be-4e8f-b114-91231852bdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "name": "network-vif-unplugged", "status": "completed", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:10:15.036718 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec9abda3-b3cd-4600-82a9-64b29143ade5 req-2c00c003-71be-4e8f-b114-91231852bdc4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:15.037201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec9abda3-b3cd-4600-82a9-64b29143ade5 req-2c00c003-71be-4e8f-b114-91231852bdc4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:15.037642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ec9abda3-b3cd-4600-82a9-64b29143ade5 req-2c00c003-71be-4e8f-b114-91231852bdc4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:15.049415 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ec9abda3-b3cd-4600-82a9-64b29143ade5 req-2c00c003-71be-4e8f-b114-91231852bdc4 service nova] Creating event network-vif-unplugged:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h1-862416-2 Oct 22 04:10:15.055071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-ec9abda3-b3cd-4600-82a9-64b29143ade5 req-2c00c003-71be-4e8f-b114-91231852bdc4 service nova] Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:10:15.066601 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ec9abda3-b3cd-4600-82a9-64b29143ade5 req-2c00c003-71be-4e8f-b114-91231852bdc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044410 Oct 22 04:10:15.067225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3721/7303] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:10:15.276766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:15.288532 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ddaa1928-5a26-4f70-97c7-453891360eeb tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1726 microversion: 2.1 time: 0.340623 Oct 22 04:10:15.290029 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3583/7304] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:14 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1726 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:16.316097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:16.316839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:16.323499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:16.324017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:16.324523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:16.325248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:16.325724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:16.326400 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:16.465939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:16.475905 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1de998d6-c115-4b10-8b8a-3b07bd8df5a7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.165280 Oct 22 04:10:16.476538 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3722/7305] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:16 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:17.097306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-35153791-894d-4ffb-9046-9f2ee29259cc req-65d09d35-c92f-45b6-adfb-99f96a4aa851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:10:17.107945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35153791-894d-4ffb-9046-9f2ee29259cc req-65d09d35-c92f-45b6-adfb-99f96a4aa851 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:17.108529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35153791-894d-4ffb-9046-9f2ee29259cc req-65d09d35-c92f-45b6-adfb-99f96a4aa851 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:17.108968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-35153791-894d-4ffb-9046-9f2ee29259cc req-65d09d35-c92f-45b6-adfb-99f96a4aa851 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:17.120928 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-35153791-894d-4ffb-9046-9f2ee29259cc req-65d09d35-c92f-45b6-adfb-99f96a4aa851 service nova] Creating event network-changed:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h1-862416-2 Oct 22 04:10:17.126366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-35153791-894d-4ffb-9046-9f2ee29259cc req-65d09d35-c92f-45b6-adfb-99f96a4aa851 service nova] Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:10:17.137142 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-35153791-894d-4ffb-9046-9f2ee29259cc req-65d09d35-c92f-45b6-adfb-99f96a4aa851 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044618 Oct 22 04:10:17.137754 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3584/7306] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:10:17.500866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:17.501823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:17.508557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:17.509157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:17.509772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:17.510550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:17.511089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:17.511872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:17.654128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:17.663945 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-42771f2b-299e-4937-bfa1-d288b575f2ed tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.167273 Oct 22 04:10:17.668253 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3723/7307] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:17 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:18.690473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:18.691208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:18.698315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:18.698563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:18.699003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:18.699872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:18.700349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:18.700779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:18.846845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:18.855627 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-27eadcf8-b7db-4c52-bfa8-3632677b853b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.171209 Oct 22 04:10:18.868228 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3585/7308] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:18 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:19.879340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:19.879959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:19.886937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:19.887432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:19.887881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:19.888618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:19.889085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:19.889521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:20.023925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:20.033354 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c6a9fee-7acf-422f-a8b2-2a259d306a79 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.158017 Oct 22 04:10:20.036006 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3724/7309] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:19 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:21.059798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:21.060458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:21.068148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:21.068668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:21.069109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:21.069835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:21.070523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:21.070747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:21.208500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:21.216861 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-facfd1eb-5a06-4eb5-8249-d863432459cc tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.161446 Oct 22 04:10:21.217446 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3586/7310] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:21 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:22.241689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:22.242309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:22.249164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:22.249660 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:22.250109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:22.250821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:22.251427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:22.251867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:22.385555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:22.394426 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8359759f-36dc-46be-867a-2405c4d58d5d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.156620 Oct 22 04:10:22.395005 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3725/7311] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:22 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:23.419541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:23.420161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:23.426773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:23.427264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:23.427705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:23.428440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:23.428894 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:23.429325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:23.564828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:23.567151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=81 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:23.574732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-08994a7c-63ed-4670-b955-cd51e135b128 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.160075 Oct 22 04:10:23.575758 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3587/7312] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:23 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:24.598462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:24.599090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:24.601556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=35 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:24.606915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:24.607413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:24.607871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:24.608614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:24.609087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:24.609525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:24.612783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:24.742305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:24.750497 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-69419676-5307-4e5d-bd62-ca5e89732c0d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.156143 Oct 22 04:10:24.751613 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3726/7313] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:24 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:25.775760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:25.776405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:25.779030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=29 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:25.785234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:25.785719 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:25.786155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:25.786846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:25.787298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:25.787752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:25.918320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:25.926757 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7f234e70-b5a7-46be-915f-a9210f848e78 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.155114 Oct 22 04:10:25.927333 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3588/7314] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:25 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:26.950141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:26.950770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:26.958533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:26.959033 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:26.959488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:26.960202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:26.960711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:26.961158 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:27.096814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:27.105115 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8b2b4a20-d952-4583-8ac2-25386ecd9d28 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.158926 Oct 22 04:10:27.106209 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3727/7315] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:26 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:28.132360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:28.132994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:28.139963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:28.140488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:28.140933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:28.141925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:28.142389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:28.142819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:28.284904 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:28.293241 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f2589256-ae86-4310-a143-2e00bb04e660 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1724 microversion: 2.1 time: 0.164907 Oct 22 04:10:28.293969 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3589/7316] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:28 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:29.316105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:29.316707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:29.323401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:29.323896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:29.324392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:29.325093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:29.325564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:29.326004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:29.456199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:29.464489 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc1ee7df-0b4c-4b46-9ffc-7a0f31162830 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1721 microversion: 2.1 time: 0.152356 Oct 22 04:10:29.465074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3728/7317] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:29 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:29.487629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:10:29.488169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:29.494930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:29.495405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:29.495840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:29.496563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:29.497010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:29.497429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:29.535990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:29.536633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:29.537069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:29.537795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:29.538246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:29.538683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:29.558607 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:10:29.564350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Getting quotas for user 8e7f634ee8704cc49f72f588710f866f and project 9af3b3cee49548799322b8f23f47ea5d. Resources: {'cores', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:10:29.668756 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d2822ee-aa0f-4759-bb33-8b35132622cf tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "POST /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/action" status: 202 len: 0 microversion: 2.1 time: 0.185169 Oct 22 04:10:29.669278 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3590/7318] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:10:29 2022] POST /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:10:29.677652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:29.678280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:29.684359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:29.684874 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:29.685331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:29.686029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:29.686667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:29.687209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:29.818608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:29.827034 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fe16c73b-a9c5-4399-99b9-db03fd8167f7 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.153288 Oct 22 04:10:29.827656 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3729/7319] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:29 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:10:30.859800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:30.860740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:30.866869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:30.867359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:30.867799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:30.868533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:30.868988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:30.869415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:30.888136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3ad2861f-d88e-455d-acd7-c7703f052f69 req-0a05c627-fb54-4bfb-a831-f9d4d99f95b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "name": "network-vif-plugged", "status": "completed", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:10:30.900083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3ad2861f-d88e-455d-acd7-c7703f052f69 req-0a05c627-fb54-4bfb-a831-f9d4d99f95b4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:30.900535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3ad2861f-d88e-455d-acd7-c7703f052f69 req-0a05c627-fb54-4bfb-a831-f9d4d99f95b4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:30.901048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3ad2861f-d88e-455d-acd7-c7703f052f69 req-0a05c627-fb54-4bfb-a831-f9d4d99f95b4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:30.918231 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3ad2861f-d88e-455d-acd7-c7703f052f69 req-0a05c627-fb54-4bfb-a831-f9d4d99f95b4 service nova] Creating event network-vif-plugged:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h1-862416-2 Oct 22 04:10:30.926908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-3ad2861f-d88e-455d-acd7-c7703f052f69 req-0a05c627-fb54-4bfb-a831-f9d4d99f95b4 service nova] Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:10:30.940841 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3ad2861f-d88e-455d-acd7-c7703f052f69 req-0a05c627-fb54-4bfb-a831-f9d4d99f95b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056448 Oct 22 04:10:30.941465 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3730/7320] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:10:31.017153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:31.025560 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3470e8b4-d10c-4cfa-86ed-90775428274f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.170973 Oct 22 04:10:31.026169 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3591/7321] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:30 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:32.051899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:32.052551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:32.059615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:32.060115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:32.060661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:32.061369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:32.061834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:32.062275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:32.197154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:32.205413 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03ff50d6-ed95-4737-8d85-5811c72edce6 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.158232 Oct 22 04:10:32.206004 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3731/7322] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:32 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:33.231844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:33.232923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:33.241082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:33.241574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:33.242007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:33.242721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:33.243172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:33.243593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:33.378801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:33.387228 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cdf5e137-328d-4c59-95e2-621e778ad252 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.161940 Oct 22 04:10:33.387803 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3592/7323] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:33 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:34.411421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:34.411960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:34.419006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:34.419504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:34.419951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:34.420679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:34.421145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:34.421584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:34.550918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:34.559253 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efe8a855-7587-479f-8e61-2174bb914c72 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.151758 Oct 22 04:10:34.559838 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3732/7324] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:34 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:34.865759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-cb6538ba-c10c-43c8-8c9a-feb1d45568ed req-cb667426-aa19-41d5-a529-3716fdb68ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "name": "network-vif-unplugged", "status": "completed", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:10:34.877773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cb6538ba-c10c-43c8-8c9a-feb1d45568ed req-cb667426-aa19-41d5-a529-3716fdb68ae7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:34.878249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cb6538ba-c10c-43c8-8c9a-feb1d45568ed req-cb667426-aa19-41d5-a529-3716fdb68ae7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:34.880299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-cb6538ba-c10c-43c8-8c9a-feb1d45568ed req-cb667426-aa19-41d5-a529-3716fdb68ae7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:34.892823 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-cb6538ba-c10c-43c8-8c9a-feb1d45568ed req-cb667426-aa19-41d5-a529-3716fdb68ae7 service nova] Creating event network-vif-unplugged:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h2-862416-2 Oct 22 04:10:34.898588 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-cb6538ba-c10c-43c8-8c9a-feb1d45568ed req-cb667426-aa19-41d5-a529-3716fdb68ae7 service nova] Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:10:34.910044 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-cb6538ba-c10c-43c8-8c9a-feb1d45568ed req-cb667426-aa19-41d5-a529-3716fdb68ae7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049295 Oct 22 04:10:34.911299 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3593/7325] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:10:35.583960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:35.584538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:35.591507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:35.591998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:35.592474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:35.593179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:35.593642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:35.594080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:35.733258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:35.741889 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-136e134b-e22e-4ba7-aa55-6214263cb30d tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.161955 Oct 22 04:10:35.742477 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3733/7326] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:35 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:35.802389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7afa7824-e7c7-4695-a817-054d87f924bb req-ccc0104d-55f1-4085-8bee-df99d897620d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:10:35.812375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7afa7824-e7c7-4695-a817-054d87f924bb req-ccc0104d-55f1-4085-8bee-df99d897620d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:35.812860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7afa7824-e7c7-4695-a817-054d87f924bb req-ccc0104d-55f1-4085-8bee-df99d897620d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:35.813805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7afa7824-e7c7-4695-a817-054d87f924bb req-ccc0104d-55f1-4085-8bee-df99d897620d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:35.825796 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7afa7824-e7c7-4695-a817-054d87f924bb req-ccc0104d-55f1-4085-8bee-df99d897620d service nova] Creating event network-changed:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h2-862416-2 Oct 22 04:10:35.831895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-7afa7824-e7c7-4695-a817-054d87f924bb req-ccc0104d-55f1-4085-8bee-df99d897620d service nova] Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:10:35.842920 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7afa7824-e7c7-4695-a817-054d87f924bb req-ccc0104d-55f1-4085-8bee-df99d897620d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044789 Oct 22 04:10:35.843474 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3594/7327] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:10:36.765651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:36.767805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:36.774891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:36.775539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:36.775996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:36.776743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:36.777438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:36.777884 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:36.923212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:36.932692 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f2cfa0a5-273d-4de5-9cb4-4d6c76667f37 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.170900 Oct 22 04:10:36.933930 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3734/7328] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:36 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:37.957707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:37.958396 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:37.965482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:37.965986 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:37.966420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:37.967110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:37.967556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:37.967977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:38.110807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:38.121815 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ebdeeb79-75e8-4070-90ec-0125d8e10fe1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.169102 Oct 22 04:10:38.122414 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3595/7329] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:37 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:39.147026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:39.147636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:39.154796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:39.155294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:39.155747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:39.156492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:39.157774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:39.158252 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:39.299115 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:39.307467 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1493da31-f0f1-4434-bdca-ee43405189f2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.164434 Oct 22 04:10:39.308043 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3735/7330] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:39 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:40.332101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:40.332849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:40.335741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:40.341097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:40.341576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:40.342006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:40.342700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:40.343150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:40.343599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:40.487954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:40.497080 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-673337bf-5a82-472f-b4fb-0c75acb1a960 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.169686 Oct 22 04:10:40.498015 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3596/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:40 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:41.578274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:41.579000 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:41.585908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:41.586436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:41.586896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:41.587605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:41.588077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:41.588548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:41.718980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:41.728360 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-af380faf-1e9d-414b-86d5-1dba473b0069 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.154175 Oct 22 04:10:41.730312 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3736/7332] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:41 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:42.752305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:42.752839 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:42.759170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:42.759647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:42.760079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:42.760805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:42.761251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:42.761669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:42.895758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:42.903909 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1739ecea-5e5b-4ffb-af5b-707c4e7d6ee4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.155780 Oct 22 04:10:42.904515 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3597/7333] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:42 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:43.928494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:43.929118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:43.936008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:43.936562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:43.937015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:43.937719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:43.938365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:43.938836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:44.071367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:44.080263 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-46c10532-3e13-4380-8b89-905fe9b53747 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.155712 Oct 22 04:10:44.080851 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3737/7334] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:43 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:45.104747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:45.105356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:45.112860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:45.113347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:45.113785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:45.114470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:45.114922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:45.115344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:45.248020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:45.257331 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9baf1f5-054f-423f-b77b-0bc66d61e41b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.156156 Oct 22 04:10:45.258304 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3598/7335] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:45 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:46.284285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:46.285467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:46.292409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:46.292904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:46.293353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:46.294055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:46.294527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:46.294966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:46.426861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:46.435154 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aca2b06a-dacb-4306-9ca8-458602e20357 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.155265 Oct 22 04:10:46.435868 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3738/7336] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:46 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:47.459547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:47.460157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:47.466985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:47.467466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:47.467906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:47.468651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:47.469149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:47.469724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:47.601690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:47.610723 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7969f8cd-2602-430d-a255-20e82f35979c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.154979 Oct 22 04:10:47.611202 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3599/7337] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:47 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:48.635377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:48.635907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:48.643244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:48.643745 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:48.644202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:48.644944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:48.645422 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:48.645901 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:48.775389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:48.783761 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48ab31d0-ab37-4925-bd4e-d5935f6e87f1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1720 microversion: 2.1 time: 0.152571 Oct 22 04:10:48.784362 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3739/7338] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:48 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:49.808949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:49.809688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:49.817594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:49.818166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:49.818669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:49.819445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:49.819966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:49.820480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:49.959974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:49.968645 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f5b11eae-7052-4c9d-b160-e76bb79364c1 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1713 microversion: 2.1 time: 0.165023 Oct 22 04:10:49.969270 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3600/7339] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:49 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:49.992134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:49.992720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:49.999706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:50.000846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:50.001313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:50.002205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:50.002681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:50.003123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:50.139596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:50.148517 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c3454f6a-4afd-46fb-a161-6770ae2b4cba tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1713 microversion: 2.1 time: 0.160245 Oct 22 04:10:50.149105 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3740/7340] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:49 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:10:50.171098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:50.171706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:50.178972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:50.179454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:50.179886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:50.180630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:50.181078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:50.181497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:50.315271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:50.323520 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d151d849-4257-421b-8285-fefeaf928881 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1713 microversion: 2.1 time: 0.156247 Oct 22 04:10:50.324889 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3601/7341] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:50 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:50.347789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:50.348328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:50.354210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:50.354707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:50.355154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:50.355860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:50.356385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:50.356829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:50.383272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:10:50.439348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:50.479959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-25668425-226a-406d-a077-241ccf5d0dd2 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 204 len: 0 microversion: 2.1 time: 0.136663 Oct 22 04:10:50.480858 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3741/7342] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:10:50 2022] DELETE /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:10:50.489699 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:50.490340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:50.496370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:50.496858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:50.497301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:50.498138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:50.498442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:50.498914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:50.501704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:50.632733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:50.641077 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-caeb73e7-dcd8-4495-bc5f-ac404af202f0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1719 microversion: 2.1 time: 0.155294 Oct 22 04:10:50.641876 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3602/7343] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:50 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:51.665359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:51.665975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:51.673232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:51.673723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:51.674173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:51.674873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:51.675340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:51.675778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:51.811357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:51.821476 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f3118baa-a669-4568-9b3b-f7953d05610e tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1719 microversion: 2.1 time: 0.160448 Oct 22 04:10:51.822071 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3742/7344] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:51 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:51.950784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-222111d5-b801-4fab-b33c-f80083261ac0 req-f482439d-a345-4c2c-976e-d60a5b80f67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "name": "network-vif-plugged", "status": "completed", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:10:51.962463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-222111d5-b801-4fab-b33c-f80083261ac0 req-f482439d-a345-4c2c-976e-d60a5b80f67c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:51.962949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-222111d5-b801-4fab-b33c-f80083261ac0 req-f482439d-a345-4c2c-976e-d60a5b80f67c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:51.963381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-222111d5-b801-4fab-b33c-f80083261ac0 req-f482439d-a345-4c2c-976e-d60a5b80f67c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:51.975111 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-222111d5-b801-4fab-b33c-f80083261ac0 req-f482439d-a345-4c2c-976e-d60a5b80f67c service nova] Creating event network-vif-plugged:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h2-862416-2 Oct 22 04:10:51.980073 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-222111d5-b801-4fab-b33c-f80083261ac0 req-f482439d-a345-4c2c-976e-d60a5b80f67c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Oct 22 04:10:51.980729 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3603/7345] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:10:52.846610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:52.847952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:52.855355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:52.855933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:52.856501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:52.857293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:52.858815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:52.860172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:52.926691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:52.935117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ea4fbb39-75b1-4241-8bd1-4f04b5ba6ca8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1652 microversion: 2.1 time: 0.092748 Oct 22 04:10:52.948600 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3743/7346] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:52 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1652 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:52.990278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-64e88460-cb31-4729-bb61-82c435f2c7c3 req-6b1d8cd3-e024-43b5-8d2c-e88afda2a933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ae8b95-818d-4efb-8d7e-94389f048ee4", "name": "network-vif-deleted", "tag": "324d3ea1-ff87-4534-a5ae-4ec3001691ab"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:10:53.000911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-64e88460-cb31-4729-bb61-82c435f2c7c3 req-6b1d8cd3-e024-43b5-8d2c-e88afda2a933 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:53.001978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-64e88460-cb31-4729-bb61-82c435f2c7c3 req-6b1d8cd3-e024-43b5-8d2c-e88afda2a933 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:53.001978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-64e88460-cb31-4729-bb61-82c435f2c7c3 req-6b1d8cd3-e024-43b5-8d2c-e88afda2a933 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:53.014249 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-64e88460-cb31-4729-bb61-82c435f2c7c3 req-6b1d8cd3-e024-43b5-8d2c-e88afda2a933 service nova] Creating event network-vif-deleted:324d3ea1-ff87-4534-a5ae-4ec3001691ab for instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 on n-h2-862416-2 Oct 22 04:10:53.019860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-64e88460-cb31-4729-bb61-82c435f2c7c3 req-6b1d8cd3-e024-43b5-8d2c-e88afda2a933 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035074 Oct 22 04:10:53.020541 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3604/7347] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:10:53.959988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:53.961535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:53.969316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:53.970029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:53.970601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:53.971477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:53.972166 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:53.972740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:54.042650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:54.051168 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d636576e-1d04-454b-a68d-924ee8ae1f39 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1369 microversion: 2.1 time: 0.095344 Oct 22 04:10:54.051755 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3744/7348] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:53 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:55.076432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:55.077131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:55.084531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:55.085012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:55.085445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:55.086132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:55.086581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:55.087001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:55.154499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:55.164891 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1729bfad-1b4b-45b0-9e4b-e72195372bc8 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1369 microversion: 2.1 time: 0.093534 Oct 22 04:10:55.165469 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3605/7349] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:55 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:56.187887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:56.188639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:56.191829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:56.197600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:56.198110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:56.198559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:56.199288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:56.199763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:56.200224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:56.267188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f634ee8704cc49f72f588710f866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af3b3cee49548799322b8f23f47ea5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:10:56.275597 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1e324cdb-12e7-4bf6-b6a4-cb966c52452b tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 200 len: 1369 microversion: 2.1 time: 0.091847 Oct 22 04:10:56.276177 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3745/7350] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:56 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:10:57.299523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:57.300086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:57.303232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:10:57.308667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:57.309147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:57.309583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:57.310279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:57.310731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:57.311156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:57.325381 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 HTTP/1.1 Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '79ae8b95-818d-4efb-8d7e-94389f048ee4'} Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:10:57.326995 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-23f3274a-9296-4796-bfb2-706a28666145 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 404 len: 111 microversion: 2.1 time: 0.033306 Oct 22 04:10:57.333058 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3606/7351] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:10:57 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:10:57.389364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:10:57.392361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:10:57.399159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:57.399663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:57.400121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:57.400890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:10:57.401371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:10:57.401821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:10:57.417542 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/os-volume_attachments HTTP/1.1 Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': '79ae8b95-818d-4efb-8d7e-94389f048ee4'} Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:10:57.419216 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b60280c-6574-493c-82a0-3d714e61335c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035427 Oct 22 04:10:57.423918 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3746/7352] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:10:57 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:00.742182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:00.742810 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:00.750729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.751291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.751736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.752513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.752969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.753402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.770162 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 HTTP/1.1 Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '79ae8b95-818d-4efb-8d7e-94389f048ee4'} Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:00.771948 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.776832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:00.778673 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0b790e6b-738c-4d73-89f1-512daba300e5 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 404 len: 111 microversion: 2.1 time: 0.040602 Oct 22 04:11:00.779651 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3607/7353] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:11:00 2022] DELETE /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:00.788075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:00.788900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 79ae8b95-818d-4efb-8d7e-94389f048ee4] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:00.796410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.796998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.797676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.798423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.798900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.799354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.815238 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 HTTP/1.1 Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '79ae8b95-818d-4efb-8d7e-94389f048ee4'} Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.816872 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance 79ae8b95-818d-4efb-8d7e-94389f048ee4 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:00.821504 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-004d03f6-1f04-443a-bf84-5840a97df9e0 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4" status: 404 len: 111 microversion: 2.1 time: 0.034380 Oct 22 04:11:00.825242 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3747/7354] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:00 2022] GET /compute/v2.1/servers/79ae8b95-818d-4efb-8d7e-94389f048ee4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:00.827169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:00.827671 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:00.834907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.835411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.835854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.836602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.837063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.837499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.852024 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 HTTP/1.1 Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'aa6b904f-5de3-47c3-9078-4b7f2beaadf9'} Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:00.853625 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.858198 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.859802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:00.860701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dab5016c-bef8-4ff7-b05a-5eaf79f2369c tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 404 len: 111 microversion: 2.1 time: 0.037412 Oct 22 04:11:00.861272 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3608/7355] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:11:00 2022] DELETE /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:00.869292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:00.869925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: aa6b904f-5de3-47c3-9078-4b7f2beaadf9] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:00.877929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.878430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.878881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.879604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.880079 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.880553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.895098 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 HTTP/1.1 Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'aa6b904f-5de3-47c3-9078-4b7f2beaadf9'} Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.896682 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance aa6b904f-5de3-47c3-9078-4b7f2beaadf9 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d57e2d26-2ab5-4fde-8235-e52d3f37d23a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9" status: 404 len: 111 microversion: 2.1 time: 0.032724 Oct 22 04:11:00.901393 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3748/7356] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:00 2022] GET /compute/v2.1/servers/aa6b904f-5de3-47c3-9078-4b7f2beaadf9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 04:11:00.909633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:00.910135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:00.916271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.916758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.917194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.917891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.918350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.918774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.933098 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 HTTP/1.1 Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'f31dc979-ce86-4d77-ad36-bbc09731d035'} Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:00.934663 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:00.939591 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-39803fb6-538b-4e23-8676-fd8eae746628 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 404 len: 111 microversion: 2.1 time: 0.031698 Oct 22 04:11:00.940618 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3609/7357] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:11:00 2022] DELETE /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:00.946081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:00.946714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: f31dc979-ce86-4d77-ad36-bbc09731d035] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:00.952875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.953632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.954093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.954801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.955273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.955725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.969827 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 HTTP/1.1 Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f31dc979-ce86-4d77-ad36-bbc09731d035'} Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:00.971305 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance f31dc979-ce86-4d77-ad36-bbc09731d035 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ff288d1-315b-487f-a677-d9f051fdc54f tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035" status: 404 len: 111 microversion: 2.1 time: 0.030613 Oct 22 04:11:00.975586 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3749/7358] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:00 2022] GET /compute/v2.1/servers/f31dc979-ce86-4d77-ad36-bbc09731d035 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:00.981327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:00.981853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:00.989194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.989621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.990056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:00.990745 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:00.991197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:00.991623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:01.005452 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 HTTP/1.1 Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '758db383-8538-4332-afec-ebe9bc5c3f99'} Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:01.007046 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:01.011738 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04850ef5-e4fe-4f0b-8751-0b78f0d3dca4 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 404 len: 111 microversion: 2.1 time: 0.031025 Oct 22 04:11:01.012845 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3610/7359] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:11:00 2022] DELETE /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:01.019026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:01.019657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [instance: 758db383-8538-4332-afec-ebe9bc5c3f99] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:01.025944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:01.026447 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:01.026902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:01.027615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:01.028086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:01.028603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:01.042703 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] HTTP exception thrown: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Request method failure captured: Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 HTTP/1.1 Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2vMzO8C5YE4OhcpQBpLjPld9vvrn4ubKLSQsLdSvODMQms43q87t6a0d4p8G4mBasdi6Pjs0JIzG8VhFCTK9iTguoIBPBQBLhJ_Zw2eg0TDHkhpm4v1LH36MilYtYIas42jN5cSEpC7Ea1n-FkDPXdMUspbcQKz0CWy-KjqtSIpMbU Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9af3b3cee49548799322b8f23f47ea5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9af3b3cee49548799322b8f23f47ea5d"}]}] Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 9af3b3cee49548799322b8f23f47ea5d Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServerActionsTestJSON-1965043180 Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 8e7f634ee8704cc49f72f588710f866f Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServerActionsTestJSON-1965043180-project Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '758db383-8538-4332-afec-ebe9bc5c3f99'} Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:01.044461 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Returning 404 to user: Instance 758db383-8538-4332-afec-ebe9bc5c3f99 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ce102a70-3d47-483d-a508-8ba1c8533e03 tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99" status: 404 len: 111 microversion: 2.1 time: 0.031809 Oct 22 04:11:01.050275 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3750/7360] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:01 2022] GET /compute/v2.1/servers/758db383-8538-4332-afec-ebe9bc5c3f99 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:01.055715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c674ba7-4b3e-43ba-8180-e17643ef1f9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] Calling method '.version_select at 0x7f0d1a77e940>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:01.060103 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6c674ba7-4b3e-43ba-8180-e17643ef1f9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [1980de44-0dcb-4a09-8ed3-655070b2ac1a] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:11:02.067766 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [None req-6c674ba7-4b3e-43ba-8180-e17643ef1f9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] [1980de44-0dcb-4a09-8ed3-655070b2ac1a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35178. Oct 22 04:11:02.088551 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c674ba7-4b3e-43ba-8180-e17643ef1f9a tempest-ServerActionsTestJSON-1965043180 tempest-ServerActionsTestJSON-1965043180-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-155216636" status: 202 len: 0 microversion: 2.1 time: 1.036590 Oct 22 04:11:02.089131 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3611/7361] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Oct 22 04:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-155216636 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:11:11.445249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=11 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:11.446538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:11.582827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1528018408", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "9cb08a8d-a7f4-44ad-bbf1-a7628575479b"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:11.644752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] validate_networks() for [('9cb08a8d-a7f4-44ad-bbf1-a7628575479b', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:11:12.115178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:11:12.115618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:11:12.116110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:11:12.116587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:11:12.117034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:11:12.126716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:12.127244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:12.127699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:12.128485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:12.128956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:12.129577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:12.151648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Getting quotas for project 3f049f3a74ef468d9ef63184260e987f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:11:12.157920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Getting quotas for user d1162cad60404264bc16bccd1bf78485 and project 3f049f3a74ef468d9ef63184260e987f. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:11:12.171326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:11:12.173839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:11:12.222145 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5831e999-75d1-4286-8b32-3dc4d9935b12 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782569 Oct 22 04:11:12.223032 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3751/7362] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:11:12.232252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=25 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:12.233631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:12.240477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8ede63c-9377-4e05-bffd-8b822824e558 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:12.241490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f8ede63c-9377-4e05-bffd-8b822824e558 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:12.310568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f8ede63c-9377-4e05-bffd-8b822824e558 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:12.317965 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f8ede63c-9377-4e05-bffd-8b822824e558 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1217 microversion: 2.1 time: 0.087818 Oct 22 04:11:12.319054 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3612/7363] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:12 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:13.342488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a8ecfb98-1819-405f-826a-72d317931a60 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:13.343118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a8ecfb98-1819-405f-826a-72d317931a60 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:13.412798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a8ecfb98-1819-405f-826a-72d317931a60 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:13.420357 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a8ecfb98-1819-405f-826a-72d317931a60 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1217 microversion: 2.1 time: 0.082765 Oct 22 04:11:13.420941 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3752/7364] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:13 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:14.443958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ef0063ce-a3de-4b3d-ae03-0429e5bd25a6 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:14.445260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ef0063ce-a3de-4b3d-ae03-0429e5bd25a6 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:14.501116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ef0063ce-a3de-4b3d-ae03-0429e5bd25a6 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:14.508927 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ef0063ce-a3de-4b3d-ae03-0429e5bd25a6 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1217 microversion: 2.1 time: 0.068968 Oct 22 04:11:14.509510 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3613/7365] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:14 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:15.532783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:15.533646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:15.541494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:15.542039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:15.542520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:15.543468 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:15.543948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:15.544430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:15.614669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:15.625461 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-52f0a975-c3f7-4b65-b8b4-633130b410d8 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1275 microversion: 2.1 time: 0.096199 Oct 22 04:11:15.626575 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3753/7366] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:15 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:16.649688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:16.650262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:16.657060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:16.657547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:16.657987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:16.658698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:16.659183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:16.659617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:16.850028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:16.857889 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18b8e07f-54fb-4734-a7ac-de67b1cc21ce tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1317 microversion: 2.1 time: 0.212237 Oct 22 04:11:16.858477 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3614/7367] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:16 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:17.190681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1af9e69d-2c61-43b6-bb0d-096b21d6dc9d req-50fbc57e-ef76-428f-bfe6-1f9470ee26cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0342d244-3659-409e-bb6a-c8359f0ad42c", "tag": "b1d1750b-94d5-4e89-a66c-f2d9967861d4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:17.201224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1af9e69d-2c61-43b6-bb0d-096b21d6dc9d req-50fbc57e-ef76-428f-bfe6-1f9470ee26cd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:17.201750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1af9e69d-2c61-43b6-bb0d-096b21d6dc9d req-50fbc57e-ef76-428f-bfe6-1f9470ee26cd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:17.202196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1af9e69d-2c61-43b6-bb0d-096b21d6dc9d req-50fbc57e-ef76-428f-bfe6-1f9470ee26cd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:17.213578 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-1af9e69d-2c61-43b6-bb0d-096b21d6dc9d req-50fbc57e-ef76-428f-bfe6-1f9470ee26cd service nova] Creating event network-changed:b1d1750b-94d5-4e89-a66c-f2d9967861d4 for instance 0342d244-3659-409e-bb6a-c8359f0ad42c on n-h1-862416-2 Oct 22 04:11:17.220974 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1af9e69d-2c61-43b6-bb0d-096b21d6dc9d req-50fbc57e-ef76-428f-bfe6-1f9470ee26cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035921 Oct 22 04:11:17.221586 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3754/7368] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:11:17.881245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:17.881869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:17.888692 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:17.889180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:17.889631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:17.890335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:17.890898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:17.891729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:18.040891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:18.049831 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-885fa75e-10d6-47b5-ba76-7cbcc151a6a0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1317 microversion: 2.1 time: 0.172587 Oct 22 04:11:18.050408 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3615/7369] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:17 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:11:19.073461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:19.074204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:19.081025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:19.081522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:19.081978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:19.082685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:19.083168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:19.083627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:19.218934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:19.227184 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5214eb2b-52dc-4d22-a977-2220bc9d8990 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1317 microversion: 2.1 time: 0.158889 Oct 22 04:11:19.227758 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3755/7370] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:19 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:20.251462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:20.252072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:20.258448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:20.258925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:20.259358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:20.260049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:20.260524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:20.260952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:20.393881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:20.401656 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f8d7a2ab-e902-4cf1-ac68-406fffb67f90 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1317 microversion: 2.1 time: 0.155329 Oct 22 04:11:20.402242 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3616/7371] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:20 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:21.424471 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:21.425102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:21.432408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:21.432905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:21.433356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:21.434072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:21.434532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:21.435208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:21.568742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:21.576584 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c5091354-886a-4978-9172-b8303ab47b7c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1317 microversion: 2.1 time: 0.156113 Oct 22 04:11:21.577105 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3756/7372] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:21 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:22.600496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:22.601155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:22.604221 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:11:22.604361 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c (ip 10.222.0.25) !!! Oct 22 04:11:22.611538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:22.612045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:22.612500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:22.613208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:22.613668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:22.614108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:22.746831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:22.754825 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3b616018-7517-4884-89d7-8d7aae8a709b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1317 microversion: 2.1 time: 0.158264 Oct 22 04:11:22.755396 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3617/7373] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:22 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:23.087762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-52280a71-8742-444c-a805-7bfaea1ba004 req-3cb4871a-2f83-46be-9363-bcfde110751e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0342d244-3659-409e-bb6a-c8359f0ad42c", "name": "network-vif-plugged", "status": "completed", "tag": "b1d1750b-94d5-4e89-a66c-f2d9967861d4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:23.092956 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:11:23.093109 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:11:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 22 04:11:23.096004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:23.113133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-52280a71-8742-444c-a805-7bfaea1ba004 req-3cb4871a-2f83-46be-9363-bcfde110751e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:23.113615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-52280a71-8742-444c-a805-7bfaea1ba004 req-3cb4871a-2f83-46be-9363-bcfde110751e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:23.114061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-52280a71-8742-444c-a805-7bfaea1ba004 req-3cb4871a-2f83-46be-9363-bcfde110751e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:23.126056 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-52280a71-8742-444c-a805-7bfaea1ba004 req-3cb4871a-2f83-46be-9363-bcfde110751e service nova] Creating event network-vif-plugged:b1d1750b-94d5-4e89-a66c-f2d9967861d4 for instance 0342d244-3659-409e-bb6a-c8359f0ad42c on n-h1-862416-2 Oct 22 04:11:23.131276 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-52280a71-8742-444c-a805-7bfaea1ba004 req-3cb4871a-2f83-46be-9363-bcfde110751e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047193 Oct 22 04:11:23.132077 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3757/7374] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:11:23.779957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:23.780582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:23.787386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:23.787885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:23.788361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:23.789074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:23.789529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:23.790009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:23.920987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:23.929122 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cd9cab9a-1493-4d09-9f29-22eb5ae25bd0 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1317 microversion: 2.1 time: 0.154340 Oct 22 04:11:23.929694 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3618/7375] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:23 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:24.953972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:24.954678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:24.956649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:24.963013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:24.963515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:24.963970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:24.964740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:24.965206 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:24.965646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:25.098101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:25.106117 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-51ae248b-17f6-4245-a3a5-eac56b3b9954 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1506 microversion: 2.1 time: 0.156782 Oct 22 04:11:25.106749 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3758/7376] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:24 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:25.168312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1145499310", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "9cb08a8d-a7f4-44ad-bbf1-a7628575479b"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:25.176640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:25.222737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] validate_networks() for [('9cb08a8d-a7f4-44ad-bbf1-a7628575479b', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:11:25.644551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:11:25.644982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:11:25.645463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:11:25.645883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:11:25.646299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:11:25.655070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:25.655552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:25.656544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:25.657280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:25.657742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:25.658170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:25.675185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Getting quotas for project 3f049f3a74ef468d9ef63184260e987f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:11:25.680520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Getting quotas for user d1162cad60404264bc16bccd1bf78485 and project 3f049f3a74ef468d9ef63184260e987f. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:11:25.692525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:11:25.694797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:11:25.741784 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c138619-0885-4a5f-b60c-6922825edd2e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577344 Oct 22 04:11:25.742445 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3619/7377] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:11:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:11:25.753768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc3be312-0007-45d3-9f0d-665bf6a5dd63 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:25.754396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc3be312-0007-45d3-9f0d-665bf6a5dd63 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:25.812549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc3be312-0007-45d3-9f0d-665bf6a5dd63 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:25.819601 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc3be312-0007-45d3-9f0d-665bf6a5dd63 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1217 microversion: 2.1 time: 0.069898 Oct 22 04:11:25.820359 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3759/7378] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:25 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:26.846800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:26.848098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:26.856621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:26.857115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:26.857552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:26.858263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:26.858716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:26.859307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:26.934968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:26.943558 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee4de8ad-36a6-4188-bc05-6897f376489f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1275 microversion: 2.1 time: 0.104467 Oct 22 04:11:26.944135 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3620/7379] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:26 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:27.967500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:27.968885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:27.976234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:27.976871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:27.977425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:27.978238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:27.978791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:27.979312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:28.124828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-65738def-b266-49ba-8745-2d42e1e91593 req-e0da9178-f421-4644-a816-3d52baf99274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d98e33b-34df-4f09-86d5-21a5dbffd8f2", "tag": "2436aff3-8261-46be-9165-482c365b9bb8"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:28.138581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:28.139933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-65738def-b266-49ba-8745-2d42e1e91593 req-e0da9178-f421-4644-a816-3d52baf99274 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:28.140989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-65738def-b266-49ba-8745-2d42e1e91593 req-e0da9178-f421-4644-a816-3d52baf99274 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:28.141427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-65738def-b266-49ba-8745-2d42e1e91593 req-e0da9178-f421-4644-a816-3d52baf99274 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:28.148287 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc500f35-e64d-4bf9-8a32-b18826c9d26b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1317 microversion: 2.1 time: 0.185025 Oct 22 04:11:28.153336 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3760/7380] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:27 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:11:28.158273 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-65738def-b266-49ba-8745-2d42e1e91593 req-e0da9178-f421-4644-a816-3d52baf99274 service nova] Creating event network-changed:2436aff3-8261-46be-9165-482c365b9bb8 for instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 on n-h2-862416-2 Oct 22 04:11:28.163271 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-65738def-b266-49ba-8745-2d42e1e91593 req-e0da9178-f421-4644-a816-3d52baf99274 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042182 Oct 22 04:11:28.163964 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3621/7381] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:11:29.172732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:29.173367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:29.180242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:29.180749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:29.181202 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:29.181907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:29.182377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:29.182818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:29.315224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:29.322855 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b3e1506f-13df-4cb0-be82-71746c9737d7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1317 microversion: 2.1 time: 0.154142 Oct 22 04:11:29.323428 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3761/7382] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:29 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:30.346374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:30.347069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:30.353285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:30.353787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:30.354221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:30.354903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:30.355350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:30.355771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:30.491934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:30.500673 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6c8b96b1-7687-4850-bf8a-dc08614061ef tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1317 microversion: 2.1 time: 0.158351 Oct 22 04:11:30.501251 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3622/7383] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:30 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:31.523912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:31.524590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:31.531534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:31.532934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:31.533384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:31.534102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:31.534578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:31.535026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:31.666722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:31.674677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d58d4e32-6721-4fa2-862c-c18a0b61ff25 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1317 microversion: 2.1 time: 0.154677 Oct 22 04:11:31.675261 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3762/7384] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:31 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:32.698158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:32.698769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:32.706099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:32.706579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:32.707011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:32.707721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:32.708155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:32.708600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:32.840625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:32.848868 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-54da230c-fd10-4593-838c-92f2431f0266 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1317 microversion: 2.1 time: 0.154611 Oct 22 04:11:32.849453 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3623/7385] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:32 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:33.873367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:33.873987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:33.881368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:33.881863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:33.882315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:33.883015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:33.883487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:33.883919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:34.019972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:34.028031 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-909fd7a4-2fa1-48df-a256-1b7daacaee09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1317 microversion: 2.1 time: 0.158581 Oct 22 04:11:34.028638 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3763/7386] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:33 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:34.110104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-90ad5484-f0cf-4254-96ed-f2d31ca58eac req-80e00379-6cc7-470a-bddc-e92db4a8f72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d98e33b-34df-4f09-86d5-21a5dbffd8f2", "name": "network-vif-plugged", "status": "completed", "tag": "2436aff3-8261-46be-9165-482c365b9bb8"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:34.120952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-90ad5484-f0cf-4254-96ed-f2d31ca58eac req-80e00379-6cc7-470a-bddc-e92db4a8f72b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:34.121434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-90ad5484-f0cf-4254-96ed-f2d31ca58eac req-80e00379-6cc7-470a-bddc-e92db4a8f72b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:34.121868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-90ad5484-f0cf-4254-96ed-f2d31ca58eac req-80e00379-6cc7-470a-bddc-e92db4a8f72b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:34.133522 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-90ad5484-f0cf-4254-96ed-f2d31ca58eac req-80e00379-6cc7-470a-bddc-e92db4a8f72b service nova] Creating event network-vif-plugged:2436aff3-8261-46be-9165-482c365b9bb8 for instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 on n-h2-862416-2 Oct 22 04:11:34.138460 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-90ad5484-f0cf-4254-96ed-f2d31ca58eac req-80e00379-6cc7-470a-bddc-e92db4a8f72b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033034 Oct 22 04:11:34.139065 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3624/7387] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:11:35.051843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:35.052506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:35.059554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:35.060050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:35.060527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:35.061265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:35.061737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:35.062179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:35.197009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:35.204825 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bdeb52d3-4589-4f7a-92b3-cad2a783bc7e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1317 microversion: 2.1 time: 0.157403 Oct 22 04:11:35.205495 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3764/7388] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:35 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:36.226615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:36.227374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:36.231637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:36.232358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:36.239890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:36.240409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:36.240852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:36.241540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:36.241994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:36.242456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:36.374023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:36.382629 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d63ea504-0582-4d04-a6cb-743ed7051b18 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1505 microversion: 2.1 time: 0.157766 Oct 22 04:11:36.383187 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3625/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:36 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:36.405100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:36.405609 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:36.407550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:36.414086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:36.414587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:36.415038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:36.415747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:36.416231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:36.416692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:36.444910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:11:36.523524 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33e3b424-6d59-4e2d-891e-bc1ac9e3ab23 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 204 len: 0 microversion: 2.1 time: 0.122004 Oct 22 04:11:36.524226 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3765/7390] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:11:36 2022] DELETE /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:11:36.532234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:36.533273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:36.541092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:36.541586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:36.542030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:36.542738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:36.543195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:36.543627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:36.672034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:36.680388 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-51ccc1a7-f33c-4a2b-9d09-9cb685a1651e tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1511 microversion: 2.1 time: 0.152048 Oct 22 04:11:36.680975 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3626/7391] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:36 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:11:37.704088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:37.705004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:37.711751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:37.712276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:37.712733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:37.713430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:37.713896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:37.714334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:37.846989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:37.854676 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-320832a1-c9f4-42dc-9811-1ac22db23a62 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1511 microversion: 2.1 time: 0.155532 Oct 22 04:11:37.855264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3766/7392] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:37 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:38.694763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-414936d4-c2fb-477c-87c5-80c7933b76ba req-e9242386-de8c-4337-961f-6c3f2514f2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d98e33b-34df-4f09-86d5-21a5dbffd8f2", "name": "network-vif-deleted", "tag": "2436aff3-8261-46be-9165-482c365b9bb8"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:38.721284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-414936d4-c2fb-477c-87c5-80c7933b76ba req-e9242386-de8c-4337-961f-6c3f2514f2c3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:38.721820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-414936d4-c2fb-477c-87c5-80c7933b76ba req-e9242386-de8c-4337-961f-6c3f2514f2c3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:38.722485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-414936d4-c2fb-477c-87c5-80c7933b76ba req-e9242386-de8c-4337-961f-6c3f2514f2c3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:38.738938 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-414936d4-c2fb-477c-87c5-80c7933b76ba req-e9242386-de8c-4337-961f-6c3f2514f2c3 service nova] Creating event network-vif-deleted:2436aff3-8261-46be-9165-482c365b9bb8 for instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 on n-h2-862416-2 Oct 22 04:11:38.745497 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-414936d4-c2fb-477c-87c5-80c7933b76ba req-e9242386-de8c-4337-961f-6c3f2514f2c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054339 Oct 22 04:11:38.747101 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3627/7393] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:11:38.878328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:38.878952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:38.885722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:38.886302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:38.886753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:38.887566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:38.888039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:38.888508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:38.919703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:38.920121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:38.920606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:38.921067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lazy-loading 'fault' on Instance uuid 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:11:38.961553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:38.970121 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6589995e-466e-4163-9077-4a4fa85b7ee7 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 200 len: 1307 microversion: 2.1 time: 0.095812 Oct 22 04:11:38.970580 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3767/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:38 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:39.994112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:39.994841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:40.001701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.002180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.002618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.003309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.003763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.004189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.017962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] HTTP exception thrown: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Request method failure captured: Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 HTTP/1.1 Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU21fXtzBUCzbpwn0c-O5vVcRgsD4dc4fjYkgoqcqXrI_wtDKjYn5GTlcmnycgimW5VlMCFjOG7M5ZvY_u6WtSDTG4nQJcDDh1W3Lm2V5FHadMBuAtpB-MS9WGgBuqocMbCySk5k08NyDuE9F19eAs5Rnz8YUy4EAjd9efQ-LXk3F5to Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}] Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d1162cad60404264bc16bccd1bf78485 Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '2d98e33b-34df-4f09-86d5-21a5dbffd8f2'} Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:40.019558 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Returning 404 to user: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-13a052d3-4aec-4cd5-834b-fe1480145352 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 404 len: 111 microversion: 2.1 time: 0.032033 Oct 22 04:11:40.024422 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3628/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:39 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:40.030054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:40.030682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:40.038256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.038697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.039154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.039887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.040389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.040834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.173215 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:40.180947 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da799467-b9c8-4687-ae9d-10b2468fdc80 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1506 microversion: 2.1 time: 0.154806 Oct 22 04:11:40.181526 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3768/7396] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:40 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:40.203152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7dbdc58e-bf82-4ec3-b6a8-3cf9e3bdae42 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:40.206011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7dbdc58e-bf82-4ec3-b6a8-3cf9e3bdae42 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 1508d057-07d3-4d76-8da6-c3e1a5d34b08] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:40.211413 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-7dbdc58e-bf82-4ec3-b6a8-3cf9e3bdae42 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] HTTP exception thrown: Instance 1508d057-07d3-4d76-8da6-c3e1a5d34b08 could not be found. Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7dbdc58e-bf82-4ec3-b6a8-3cf9e3bdae42 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Request method failure captured: Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/1508d057-07d3-4d76-8da6-c3e1a5d34b08/action HTTP/1.1 Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 32 Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU21fXtzBUCzbpwn0c-O5vVcRgsD4dc4fjYkgoqcqXrI_wtDKjYn5GTlcmnycgimW5VlMCFjOG7M5ZvY_u6WtSDTG4nQJcDDh1W3Lm2V5FHadMBuAtpB-MS9WGgBuqocMbCySk5k08NyDuE9F19eAs5Rnz8YUy4EAjd9efQ-LXk3F5to Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}] Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d1162cad60404264bc16bccd1bf78485 Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: {"resize": {"flavorRef": "452"}} Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 1508d057-07d3-4d76-8da6-c3e1a5d34b08 could not be found. Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '1508d057-07d3-4d76-8da6-c3e1a5d34b08', 'body': {'resize': {'flavorRef': '452'}}} Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1508d057-07d3-4d76-8da6-c3e1a5d34b08 could not be found. Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:40.212990 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1508d057-07d3-4d76-8da6-c3e1a5d34b08 could not be found. Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1508d057-07d3-4d76-8da6-c3e1a5d34b08 could not be found. Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7dbdc58e-bf82-4ec3-b6a8-3cf9e3bdae42 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Returning 404 to user: Instance 1508d057-07d3-4d76-8da6-c3e1a5d34b08 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7dbdc58e-bf82-4ec3-b6a8-3cf9e3bdae42 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "POST /compute/v2.1/servers/1508d057-07d3-4d76-8da6-c3e1a5d34b08/action" status: 404 len: 111 microversion: 2.1 time: 0.015215 Oct 22 04:11:40.217998 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3629/7397] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:11:40 2022] POST /compute/v2.1/servers/1508d057-07d3-4d76-8da6-c3e1a5d34b08/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:40.223955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:40.224611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:40.230509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.231002 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.231453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.232156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.232656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.233133 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.254930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:40.365790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:40.373526 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c1588f41-2d69-4ce2-9256-d72c58907f09 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1506 microversion: 2.1 time: 0.153416 Oct 22 04:11:40.374106 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3769/7398] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:40 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:40.397686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:40.398313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:40.405043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.405523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.405955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.406641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.407093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.407512 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.544295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:40.553353 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6e9d9547-e7d3-4504-92df-98a915744c3b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1506 microversion: 2.1 time: 0.159386 Oct 22 04:11:40.553918 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3630/7399] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:40 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:40.576381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "fa5e016c-5d8a-42dd-a986-c56a91dce728"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:40.579677 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:40.587819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.588335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.589293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.589473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.591540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.592004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.635308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:40.641810 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] HTTP exception thrown: Flavor fa5e016c-5d8a-42dd-a986-c56a91dce728 could not be found. Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Request method failure captured: Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: request: POST /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c/action HTTP/1.1 Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 65 Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU21fXtzBUCzbpwn0c-O5vVcRgsD4dc4fjYkgoqcqXrI_wtDKjYn5GTlcmnycgimW5VlMCFjOG7M5ZvY_u6WtSDTG4nQJcDDh1W3Lm2V5FHadMBuAtpB-MS9WGgBuqocMbCySk5k08NyDuE9F19eAs5Rnz8YUy4EAjd9efQ-LXk3F5to Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}] Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: d1162cad60404264bc16bccd1bf78485 Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: {"resize": {"flavorRef": "fa5e016c-5d8a-42dd-a986-c56a91dce728"}} Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: exception: Flavor fa5e016c-5d8a-42dd-a986-c56a91dce728 could not be found. Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '0342d244-3659-409e-bb6a-c8359f0ad42c', 'body': {'resize': {'flavorRef': 'fa5e016c-5d8a-42dd-a986-c56a91dce728'}}} Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:40.652930 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor fa5e016c-5d8a-42dd-a986-c56a91dce728 could not be found. Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor fa5e016c-5d8a-42dd-a986-c56a91dce728 could not be found. Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor fa5e016c-5d8a-42dd-a986-c56a91dce728 could not be found. Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Returning 400 to user: Flavor fa5e016c-5d8a-42dd-a986-c56a91dce728 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97731082-85a9-4417-8cd4-68b61ef5cc52 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "POST /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c/action" status: 400 len: 107 microversion: 2.1 time: 0.082441 Oct 22 04:11:40.658101 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3770/7400] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:11:40 2022] POST /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c/action => generated 107 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 04:11:40.663829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:40.664469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:40.670470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.670957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.671391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.672549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.673145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.673572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.802284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:40.809982 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-71eab8ca-87e9-46b9-b2d9-068241003890 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1506 microversion: 2.1 time: 0.150465 Oct 22 04:11:40.810541 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3631/7401] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:40 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:11:40.834011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:40.834538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:40.840418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.840911 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.841396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.842093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:40.842555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:40.842989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:40.975693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:40.983661 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-50a4560f-5941-4caf-b4de-045d165f685a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1506 microversion: 2.1 time: 0.153651 Oct 22 04:11:40.984250 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3771/7402] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:40 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:41.007314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2af8bb0-4175-430d-9c71-cdf47944188c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2af8bb0-4175-430d-9c71-cdf47944188c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Request method failure captured: Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: request: POST /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c/action HTTP/1.1 Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 29 Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU21fXtzBUCzbpwn0c-O5vVcRgsD4dc4fjYkgoqcqXrI_wtDKjYn5GTlcmnycgimW5VlMCFjOG7M5ZvY_u6WtSDTG4nQJcDDh1W3Lm2V5FHadMBuAtpB-MS9WGgBuqocMbCySk5k08NyDuE9F19eAs5Rnz8YUy4EAjd9efQ-LXk3F5to Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}] Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d1162cad60404264bc16bccd1bf78485 Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: {"resize": {"flavorRef": ""}} Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '0342d244-3659-409e-bb6a-c8359f0ad42c', 'body': {'resize': {'flavorRef': ''}}} Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise error Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi '' Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.010953 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b2af8bb0-4175-430d-9c71-cdf47944188c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b2af8bb0-4175-430d-9c71-cdf47944188c tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "POST /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c/action" status: 400 len: 113 microversion: 2.1 time: 0.009089 Oct 22 04:11:41.017494 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3632/7403] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:11:41 2022] POST /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 22 04:11:41.021081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:41.021700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:41.027515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.028006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.028489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.029193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.029657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.030095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.158061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:41.165724 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0316747a-4468-4149-a1c4-5f45d3470f20 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1506 microversion: 2.1 time: 0.148343 Oct 22 04:11:41.166296 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3772/7404] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:41 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:41.197435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:41.197929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:41.205886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.206472 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.206915 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.207604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.208059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.208514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.223565 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] HTTP exception thrown: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Request method failure captured: Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 HTTP/1.1 Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU21fXtzBUCzbpwn0c-O5vVcRgsD4dc4fjYkgoqcqXrI_wtDKjYn5GTlcmnycgimW5VlMCFjOG7M5ZvY_u6WtSDTG4nQJcDDh1W3Lm2V5FHadMBuAtpB-MS9WGgBuqocMbCySk5k08NyDuE9F19eAs5Rnz8YUy4EAjd9efQ-LXk3F5to Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}] Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: d1162cad60404264bc16bccd1bf78485 Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '2d98e33b-34df-4f09-86d5-21a5dbffd8f2'} Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:41.225139 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Returning 404 to user: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f8ed1deb-aa4f-4ec8-9524-50556a0fc710 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 404 len: 111 microversion: 2.1 time: 0.033489 Oct 22 04:11:41.230158 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3633/7405] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:11:41 2022] DELETE /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:41.235126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:41.235743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 2d98e33b-34df-4f09-86d5-21a5dbffd8f2] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:41.241773 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.242263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.242711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.243410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.243872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.244337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.257894 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] HTTP exception thrown: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Request method failure captured: Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 HTTP/1.1 Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU21fXtzBUCzbpwn0c-O5vVcRgsD4dc4fjYkgoqcqXrI_wtDKjYn5GTlcmnycgimW5VlMCFjOG7M5ZvY_u6WtSDTG4nQJcDDh1W3Lm2V5FHadMBuAtpB-MS9WGgBuqocMbCySk5k08NyDuE9F19eAs5Rnz8YUy4EAjd9efQ-LXk3F5to Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}] Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: d1162cad60404264bc16bccd1bf78485 Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '2d98e33b-34df-4f09-86d5-21a5dbffd8f2'} Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:41.259405 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Returning 404 to user: Instance 2d98e33b-34df-4f09-86d5-21a5dbffd8f2 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7312d8e-f37b-45f4-85a4-3d086fd9eb24 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2" status: 404 len: 111 microversion: 2.1 time: 0.029704 Oct 22 04:11:41.264450 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3773/7406] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:41 2022] GET /compute/v2.1/servers/2d98e33b-34df-4f09-86d5-21a5dbffd8f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:11:41.270293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:41.270793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:41.276858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.277346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.277792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.278485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.278945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.279376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.303809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:11:41.353033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:41.383543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63baf5d9-7057-4bf3-85ec-a2226db5fe2d tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 204 len: 0 microversion: 2.1 time: 0.117704 Oct 22 04:11:41.384765 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3634/7407] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:11:41 2022] DELETE /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:11:41.393729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:41.394384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:41.400324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.400820 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.401274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.401975 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:41.402444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:41.402881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:41.536301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:41.544165 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b1bf01fb-46da-48f2-abfe-e14983ad7d6b tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1512 microversion: 2.1 time: 0.155246 Oct 22 04:11:41.544766 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3774/7408] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:41 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:42.568129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:42.568860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:42.571618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:42.577008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:42.577488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:42.577924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:42.578922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:42.579217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:42.579651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:42.711024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:42.719355 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-554cfe9e-ab9e-487a-9bd5-5a9ee58e30c9 tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1512 microversion: 2.1 time: 0.155166 Oct 22 04:11:42.719929 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3635/7409] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:42 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:43.316414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-8dd5947e-68fd-4772-afaa-28f05eae336b req-e4a355c9-b44c-4776-b981-e401b94d928a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0342d244-3659-409e-bb6a-c8359f0ad42c", "name": "network-vif-deleted", "tag": "b1d1750b-94d5-4e89-a66c-f2d9967861d4"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:11:43.323527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:11:43.342214 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8dd5947e-68fd-4772-afaa-28f05eae336b req-e4a355c9-b44c-4776-b981-e401b94d928a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:43.342756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8dd5947e-68fd-4772-afaa-28f05eae336b req-e4a355c9-b44c-4776-b981-e401b94d928a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:43.343174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-8dd5947e-68fd-4772-afaa-28f05eae336b req-e4a355c9-b44c-4776-b981-e401b94d928a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:43.356090 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-8dd5947e-68fd-4772-afaa-28f05eae336b req-e4a355c9-b44c-4776-b981-e401b94d928a service nova] Creating event network-vif-deleted:b1d1750b-94d5-4e89-a66c-f2d9967861d4 for instance 0342d244-3659-409e-bb6a-c8359f0ad42c on n-h1-862416-2 Oct 22 04:11:43.361259 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-8dd5947e-68fd-4772-afaa-28f05eae336b req-e4a355c9-b44c-4776-b981-e401b94d928a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049390 Oct 22 04:11:43.362084 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3775/7410] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:11:43.743591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:43.744446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:43.752016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:43.752567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:43.753011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:43.753726 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:43.754190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:43.754625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:43.786709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:43.787220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:43.787636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:43.788110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lazy-loading 'fault' on Instance uuid 0342d244-3659-409e-bb6a-c8359f0ad42c {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:11:43.833269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1162cad60404264bc16bccd1bf78485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f049f3a74ef468d9ef63184260e987f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:11:43.841389 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-097e9892-0902-4fd7-a20f-6f1f9c2b6b4f tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 200 len: 1307 microversion: 2.1 time: 0.101782 Oct 22 04:11:43.841970 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3636/7411] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:43 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:11:44.867078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:11:44.867705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] [instance: 0342d244-3659-409e-bb6a-c8359f0ad42c] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:11:44.873908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:44.874409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:44.874864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:44.876229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:11:44.876785 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:11:44.877253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:11:44.890493 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] HTTP exception thrown: Instance 0342d244-3659-409e-bb6a-c8359f0ad42c could not be found. Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Request method failure captured: Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c HTTP/1.1 Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU21fXtzBUCzbpwn0c-O5vVcRgsD4dc4fjYkgoqcqXrI_wtDKjYn5GTlcmnycgimW5VlMCFjOG7M5ZvY_u6WtSDTG4nQJcDDh1W3Lm2V5FHadMBuAtpB-MS9WGgBuqocMbCySk5k08NyDuE9F19eAs5Rnz8YUy4EAjd9efQ-LXk3F5to Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f049f3a74ef468d9ef63184260e987f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f049f3a74ef468d9ef63184260e987f"}]}] Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 3f049f3a74ef468d9ef63184260e987f Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-ServersNegativeTestJSON-568617159 Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: d1162cad60404264bc16bccd1bf78485 Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-ServersNegativeTestJSON-568617159-project Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 0342d244-3659-409e-bb6a-c8359f0ad42c could not be found. Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '0342d244-3659-409e-bb6a-c8359f0ad42c'} Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0342d244-3659-409e-bb6a-c8359f0ad42c could not be found. Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0342d244-3659-409e-bb6a-c8359f0ad42c could not be found. Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:11:44.892498 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0342d244-3659-409e-bb6a-c8359f0ad42c could not be found. Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] Returning 404 to user: Instance 0342d244-3659-409e-bb6a-c8359f0ad42c could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4c9e6c8a-3a92-478f-9e11-5a3cc9ecaa2a tempest-ServersNegativeTestJSON-568617159 tempest-ServersNegativeTestJSON-568617159-project] 10.222.0.25 "GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c" status: 404 len: 111 microversion: 2.1 time: 0.032094 Oct 22 04:11:44.897165 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3776/7412] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:11:44 2022] GET /compute/v2.1/servers/0342d244-3659-409e-bb6a-c8359f0ad42c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:12:17.176780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:17.177513 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=14 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:17.351786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2d9ad6d0-e119-4ec8-85ce-8b68ef127591 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: .version_select at 0x7f0d1a0fe0d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-830034628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXq1I1/kBQZIHZnvYaG0L9/FXN2Tz2m0QHfFTOEeA8wLp8acake9hK6GuGd8hlJcBYaeQi3vthDfEAFEw90/jkjqYMb2ypLWZ1hnEUt2PpkhNROFnHejiiq5ELbzz3qAQ=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:17.368354 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2d9ad6d0-e119-4ec8-85ce-8b68ef127591 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:12:17.373668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-2d9ad6d0-e119-4ec8-85ce-8b68ef127591 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for user 4d6b3911f0344bdb93d1eddf9d713730 and project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:12:17.401464 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2d9ad6d0-e119-4ec8-85ce-8b68ef127591 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.230820 Oct 22 04:12:17.402167 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3637/7413] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:12:17 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:17.455071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1520724706", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-830034628", "networks": [{"uuid": "6f8e8cc4-e903-40fe-b17a-8e804b91615b"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:17.464124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:17.464813 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=30 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:17.521423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] validate_networks() for [('6f8e8cc4-e903-40fe-b17a-8e804b91615b', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:12:17.939310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:12:17.939750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:12:17.940277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:12:17.940906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:12:17.941672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:12:17.951591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:17.952436 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:17.953793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:17.954765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:17.955416 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:17.955863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:17.976080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:12:17.982764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for user 4d6b3911f0344bdb93d1eddf9d713730 and project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:12:17.998423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:12:18.001484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:12:18.054910 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95767a79-d265-4258-aa20-7f6218820422 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605170 Oct 22 04:12:18.055580 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3777/7414] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:12:18.067123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-afaeee7b-5901-4fcf-903a-7d3bfab229db tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:18.067750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-afaeee7b-5901-4fcf-903a-7d3bfab229db tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:18.123945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-afaeee7b-5901-4fcf-903a-7d3bfab229db tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:18.137770 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-afaeee7b-5901-4fcf-903a-7d3bfab229db tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1262 microversion: 2.1 time: 0.073807 Oct 22 04:12:18.139871 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3638/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:18 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:19.163994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:19.164719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:19.170849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:19.171445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:19.171906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:19.172646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:19.173125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:19.173572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:19.243212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:19.251411 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b498b2c-a4f8-48c9-b33f-5388b4c49b6e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1314 microversion: 2.1 time: 0.092381 Oct 22 04:12:19.252234 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3778/7416] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:19 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1314 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:20.275940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:20.277414 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:20.286069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:20.286809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:20.287501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:20.288672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:20.289840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:20.290481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:20.504333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:20.512120 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5344bf1a-c860-466d-9820-2d28e87a31d0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1362 microversion: 2.1 time: 0.240918 Oct 22 04:12:20.522443 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3639/7417] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:20 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:20.856489 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b3584f7a-85a7-4e82-8229-11e69b17314e req-9a9ff158-687e-4533-bd53-0345b57e2114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753836bc-74a0-4eb7-a45e-0e8e5d1861ea", "tag": "81e3a887-a3a1-4936-b866-86510e9e896e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:20.883725 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b3584f7a-85a7-4e82-8229-11e69b17314e req-9a9ff158-687e-4533-bd53-0345b57e2114 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:20.884364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b3584f7a-85a7-4e82-8229-11e69b17314e req-9a9ff158-687e-4533-bd53-0345b57e2114 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:20.884906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b3584f7a-85a7-4e82-8229-11e69b17314e req-9a9ff158-687e-4533-bd53-0345b57e2114 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:20.902914 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b3584f7a-85a7-4e82-8229-11e69b17314e req-9a9ff158-687e-4533-bd53-0345b57e2114 service nova] Creating event network-changed:81e3a887-a3a1-4936-b866-86510e9e896e for instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea on n-h1-862416-2 Oct 22 04:12:20.912999 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b3584f7a-85a7-4e82-8229-11e69b17314e req-9a9ff158-687e-4533-bd53-0345b57e2114 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062844 Oct 22 04:12:20.914452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3779/7418] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:21.537205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:21.537823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:21.545213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:21.545988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:21.546469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:21.547191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:21.547652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:21.548086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:21.690530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:21.698635 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a634d671-8ef3-447a-a9d2-644bf35ad895 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1362 microversion: 2.1 time: 0.165495 Oct 22 04:12:21.699544 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3640/7419] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:21 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:12:22.724395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:22.725142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:22.732016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:22.732958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:22.733432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:22.735409 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:22.736448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:22.736920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:22.875487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:22.883324 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ae79a24c-9409-44f0-929e-178dda7f199a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1362 microversion: 2.1 time: 0.165351 Oct 22 04:12:22.883912 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3780/7420] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:22 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:23.907373 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:23.908094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:23.920162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:23.920784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:23.922040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:23.925748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:23.926323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:23.926854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:24.072460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:24.079364 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38cfcbe5-e823-4ea3-902d-5ba8219392d8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1362 microversion: 2.1 time: 0.176267 Oct 22 04:12:24.079963 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3641/7421] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:23 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:25.103897 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:25.104544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:25.111719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:25.112241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:25.112763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:25.113478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:25.113984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:25.114431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:25.254620 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:25.256350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-38aba895-c080-4dbc-85f1-abac040faf7a req-85c1737c-af11-411c-985f-b97ce7b95ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753836bc-74a0-4eb7-a45e-0e8e5d1861ea", "name": "network-vif-plugged", "status": "completed", "tag": "81e3a887-a3a1-4936-b866-86510e9e896e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:25.263490 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ef416bc2-c880-42fa-9028-5610f553c203 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1362 microversion: 2.1 time: 0.163528 Oct 22 04:12:25.264290 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3781/7422] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:25 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:25.268082 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-38aba895-c080-4dbc-85f1-abac040faf7a req-85c1737c-af11-411c-985f-b97ce7b95ea8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:25.268591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-38aba895-c080-4dbc-85f1-abac040faf7a req-85c1737c-af11-411c-985f-b97ce7b95ea8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:25.269027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-38aba895-c080-4dbc-85f1-abac040faf7a req-85c1737c-af11-411c-985f-b97ce7b95ea8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:25.280293 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-38aba895-c080-4dbc-85f1-abac040faf7a req-85c1737c-af11-411c-985f-b97ce7b95ea8 service nova] Creating event network-vif-plugged:81e3a887-a3a1-4936-b866-86510e9e896e for instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea on n-h1-862416-2 Oct 22 04:12:25.286072 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-38aba895-c080-4dbc-85f1-abac040faf7a req-85c1737c-af11-411c-985f-b97ce7b95ea8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033395 Oct 22 04:12:25.286688 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3642/7423] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:26.288907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:26.289539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:26.297256 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:26.297701 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:26.298156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:26.298870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:26.299342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:26.299786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:26.429879 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:26.438483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6e36c35b-1175-4101-a8a5-0c11896f54dc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1362 microversion: 2.1 time: 0.153377 Oct 22 04:12:26.439082 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3782/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:26 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:27.463473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:27.464161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:27.471074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:27.471561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:27.472017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:27.472750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:27.473199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:27.473618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:27.604033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:27.612358 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93db3bc8-b5fc-4276-a1be-0b3b2aad55f8 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1554 microversion: 2.1 time: 0.153961 Oct 22 04:12:27.612946 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3643/7425] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:27 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:27.635961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:27.636615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:27.643805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:27.644333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:27.644812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:27.645508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:27.645971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:27.646403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:27.773976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:27.782534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf606073-80e7-4b31-bef0-c46b5a13b236 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1554 microversion: 2.1 time: 0.150418 Oct 22 04:12:27.783109 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3783/7426] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:27 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:29.414180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24142e00-037f-4198-a2ce-5f4abf8a3f9c"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:29.416563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:29.418524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:29.424957 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:29.425441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:29.425882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:29.426583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:29.427038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:29.427469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:29.666160 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1718896e-0a8a-422a-8f1e-5f92a883cba6 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255681 Oct 22 04:12:29.666700 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3644/7427] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 04:12:29 2022] POST /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:40.376561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:40.377108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:40.379022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:40.379704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:40.381274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:40.381936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=34 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:40.389008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:40.389563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:40.390259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:40.390980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:40.391450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:40.391892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:40.477278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lazy-loading 'services' on Instance uuid 753836bc-74a0-4eb7-a45e-0e8e5d1861ea {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:12:40.550002 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc3973a4-83ff-44f8-a479-79cb006ac2c5 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments/24142e00-037f-4198-a2ce-5f4abf8a3f9c" status: 202 len: 0 microversion: 2.1 time: 0.178044 Oct 22 04:12:40.550642 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3784/7428] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:12:40 2022] DELETE /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments/24142e00-037f-4198-a2ce-5f4abf8a3f9c => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:12:40.560196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:40.563386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:40.566779 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:40.567947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:12:40.576767 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:40.578051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:40.578501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:40.579224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:40.579687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:40.580120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:40.614873 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2835e422-711b-4f3e-aa29-03f16e353a9e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058951 Oct 22 04:12:40.615449 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3645/7429] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:12:40 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:41.629109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:41.631587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:41.638011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:41.638642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:41.639107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:41.640356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:41.640958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:41.641412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:41.673145 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ff166ab6-7490-443d-aa33-be2f60ef0a94 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049317 Oct 22 04:12:41.673722 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3785/7430] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:12:41 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:42.685645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:42.688430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:42.695527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:42.696036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:42.696498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:42.697210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:42.697655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:42.698072 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:42.729013 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-808adb78-70d7-4ec4-9601-bb6916678406 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Oct 22 04:12:42.729497 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3646/7431] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:12:42 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:43.742491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:43.744700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:43.752592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:43.753101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:43.753560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:43.754279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:43.754799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:43.758990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:43.787156 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e8f24af-2833-482b-811d-7bcd77b1b3b2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048827 Oct 22 04:12:43.787738 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3786/7432] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:12:43 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:44.799639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:44.801867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:44.808679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:44.809161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:44.809596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:44.810340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:44.810741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:44.811164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:44.841290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c7ce583b-9625-4c54-b78b-8c9c81ac21dd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Oct 22 04:12:44.842020 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3647/7433] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:12:44 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:45.853827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:45.856020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:45.862997 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:45.863496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:45.863952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:45.864702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:45.865175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:45.865625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:45.896457 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6bb3e8cf-37de-43f7-aaea-caa0f72727a7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046563 Oct 22 04:12:45.897014 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3787/7434] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:12:45 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 04:12:45.907998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:45.908557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:45.915307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:45.915789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:45.916245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:45.917001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:45.917446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:45.917868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:45.995857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] HTTP exception thrown: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea is not attached to volume 24142e00-037f-4198-a2ce-5f4abf8a3f9c Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Request method failure captured: Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments/24142e00-037f-4198-a2ce-5f4abf8a3f9c HTTP/1.1 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU22bo5ummjMS0ghCLZFwqOXpYSYF0-sYNoSfyuemcgxR_bhak1hyoBSTCv-XkTi7zjjZWAYodgwJzgp84d8w348qb21ks5DH17gJ7poBDHyEWFTgEXW3suyRcI-6Fsznr5Y3yYjDi-FXtxsB7PC7fpRQ-IwDNiUdNHAYeih9PfcsuLs Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}] Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4d6b3911f0344bdb93d1eddf9d713730 Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea is not attached to volume 24142e00-037f-4198-a2ce-5f4abf8a3f9c Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': '753836bc-74a0-4eb7-a45e-0e8e5d1861ea', 'id': '24142e00-037f-4198-a2ce-5f4abf8a3f9c'} Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 24142e00-037f-4198-a2ce-5f4abf8a3f9c. Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea is not attached to volume 24142e00-037f-4198-a2ce-5f4abf8a3f9c Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:12:46.005541 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:12:46.010761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:12:46.010761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:12:46.010761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea is not attached to volume 24142e00-037f-4198-a2ce-5f4abf8a3f9c Oct 22 04:12:46.010761 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:12:46.010761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Returning 404 to user: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea is not attached to volume 24142e00-037f-4198-a2ce-5f4abf8a3f9c {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:12:46.010761 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f0d58ed-25d0-45ba-aa66-5edcd0b586f9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments/24142e00-037f-4198-a2ce-5f4abf8a3f9c" status: 404 len: 154 microversion: 2.1 time: 0.103448 Oct 22 04:12:46.010761 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3648/7435] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:12:45 2022] DELETE /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea/os-volume_attachments/24142e00-037f-4198-a2ce-5f4abf8a3f9c => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:12:49.355332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:49.356353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:49.364257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:49.364812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:49.365271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:49.365998 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:49.366472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:49.366918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:49.395299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:12:49.483215 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-508ee2df-9f97-44e7-9ce8-fb6adda1e84e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 204 len: 0 microversion: 2.1 time: 0.131843 Oct 22 04:12:49.484190 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3788/7436] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:12:49 2022] DELETE /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:12:49.494071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:49.494601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:49.501368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:49.501850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:49.502435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:49.503142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:49.503597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:49.504024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:49.953706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:49.961491 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e0357e4b-8a05-489a-bde6-940c191a799a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1560 microversion: 2.1 time: 0.471905 Oct 22 04:12:49.962083 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3649/7437] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:49 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1560 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:12:50.985848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:50.986564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:50.993523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:50.994016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:50.994462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:50.995159 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:50.995621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:50.996059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:51.283887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:51.291874 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3bf96b98-d576-424a-af08-50c702e5da47 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 200 len: 1560 microversion: 2.1 time: 0.310602 Oct 22 04:12:51.292508 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3789/7438] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:50 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:51.595707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-415d43a0-ed77-441e-8a75-c3ab320e0782 req-78feb75a-efa7-469e-8268-0cfbdcd39df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753836bc-74a0-4eb7-a45e-0e8e5d1861ea", "name": "network-vif-deleted", "tag": "81e3a887-a3a1-4936-b866-86510e9e896e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:51.608666 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-415d43a0-ed77-441e-8a75-c3ab320e0782 req-78feb75a-efa7-469e-8268-0cfbdcd39df5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:51.609178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-415d43a0-ed77-441e-8a75-c3ab320e0782 req-78feb75a-efa7-469e-8268-0cfbdcd39df5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:51.609620 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-415d43a0-ed77-441e-8a75-c3ab320e0782 req-78feb75a-efa7-469e-8268-0cfbdcd39df5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:51.622118 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-415d43a0-ed77-441e-8a75-c3ab320e0782 req-78feb75a-efa7-469e-8268-0cfbdcd39df5 service nova] Creating event network-vif-deleted:81e3a887-a3a1-4936-b866-86510e9e896e for instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea on n-h1-862416-2 Oct 22 04:12:51.628317 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-415d43a0-ed77-441e-8a75-c3ab320e0782 req-78feb75a-efa7-469e-8268-0cfbdcd39df5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Oct 22 04:12:51.628928 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3650/7439] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:52.315614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:52.316280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 753836bc-74a0-4eb7-a45e-0e8e5d1861ea] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:52.323148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:52.323653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:52.324114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:52.324857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:52.325333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:52.325781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:52.339213 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] HTTP exception thrown: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea could not be found. Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Request method failure captured: Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea HTTP/1.1 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU22bo5ummjMS0ghCLZFwqOXpYSYF0-sYNoSfyuemcgxR_bhak1hyoBSTCv-XkTi7zjjZWAYodgwJzgp84d8w348qb21ks5DH17gJ7poBDHyEWFTgEXW3suyRcI-6Fsznr5Y3yYjDi-FXtxsB7PC7fpRQ-IwDNiUdNHAYeih9PfcsuLs Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}] Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 4d6b3911f0344bdb93d1eddf9d713730 Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea could not be found. Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '753836bc-74a0-4eb7-a45e-0e8e5d1861ea'} Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea could not be found. Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea could not be found. Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:12:52.340838 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea could not be found. Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Returning 404 to user: Instance 753836bc-74a0-4eb7-a45e-0e8e5d1861ea could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7820d2fb-4da9-40d6-bb90-5c34015523ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea" status: 404 len: 111 microversion: 2.1 time: 0.031213 Oct 22 04:12:52.345929 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3790/7440] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:52 2022] GET /compute/v2.1/servers/753836bc-74a0-4eb7-a45e-0e8e5d1861ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:12:52.352008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4114049d-0961-498b-b786-4b5b2c168f3b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '.version_select at 0x7f0d1e51e040>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:52.373279 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4114049d-0961-498b-b786-4b5b2c168f3b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-830034628" status: 202 len: 0 microversion: 2.1 time: 0.025400 Oct 22 04:12:52.373851 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3651/7441] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Oct 22 04:12:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-830034628 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:12:52.391183 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6b30104a-5165-4d8e-8895-45bf827bcdad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: .version_select at 0x7f0d18b0bca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2042400617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzvFTIL18pbvfHUYH29K8Lg14TPnQ2tsPMVv4CzQN1KK6XvWKdCH3p5NiQ+YpK0OGIM2Sbkm6dTt+KY+ggdv/6Kg73Yorsgdm29SJVp20RK4NDUsh6XIgYBHjnMBZ4mBA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:52.406640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-6b30104a-5165-4d8e-8895-45bf827bcdad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:12:52.412413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-6b30104a-5165-4d8e-8895-45bf827bcdad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for user 4d6b3911f0344bdb93d1eddf9d713730 and project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:12:52.439209 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6b30104a-5165-4d8e-8895-45bf827bcdad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051570 Oct 22 04:12:52.439818 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3791/7442] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:12:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:12:52.491363 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-347022532", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2042400617", "networks": [{"uuid": "6f8e8cc4-e903-40fe-b17a-8e804b91615b"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:52.660381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] validate_networks() for [('6f8e8cc4-e903-40fe-b17a-8e804b91615b', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:12:53.039879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:12:53.040340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:12:53.040822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:12:53.041267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:12:53.041679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:12:53.051120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:53.051599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:53.052034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:53.052797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:53.053251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:53.053709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:53.070548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:12:53.075654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for user 4d6b3911f0344bdb93d1eddf9d713730 and project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:12:53.088855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:12:53.091247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:12:53.138463 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b04dba8e-69f1-47cb-9e30-f4c90e99200b tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650981 Oct 22 04:12:53.139052 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3652/7443] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:12:53.151137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30ca49f7-7f69-44c1-b899-a66d49cfd1ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:53.151762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30ca49f7-7f69-44c1-b899-a66d49cfd1ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:53.205248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30ca49f7-7f69-44c1-b899-a66d49cfd1ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:53.213826 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30ca49f7-7f69-44c1-b899-a66d49cfd1ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1262 microversion: 2.1 time: 0.066565 Oct 22 04:12:53.214410 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3792/7444] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:53 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:54.239098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:54.239804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:54.246756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:54.247228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:54.247667 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:54.248395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:54.248858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:54.249289 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:54.347317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:54.356997 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7d400f00-27ab-4696-85bd-7052aa56cfaa tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1322 microversion: 2.1 time: 0.123422 Oct 22 04:12:54.357787 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3653/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:54 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1322 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:12:55.380990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:55.382995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:55.388221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:55.388746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:55.389198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:55.389914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:55.390384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:55.390830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:55.528982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:55.537410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39a9eee9-2bbb-440b-b990-9d203378be3c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1362 microversion: 2.1 time: 0.160436 Oct 22 04:12:55.537999 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3793/7446] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:55 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:55.671415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-09f445b5-b8c0-4ac3-a79e-68d05ff7eeb4 req-d6e7de4a-4260-43fe-8816-15138ca1c0dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23de3496-097c-4008-b2e4-743499362de5", "tag": "a5c06721-7d3a-47db-bfd2-a3bcbc2be06b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:12:55.682862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-09f445b5-b8c0-4ac3-a79e-68d05ff7eeb4 req-d6e7de4a-4260-43fe-8816-15138ca1c0dc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:55.683342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-09f445b5-b8c0-4ac3-a79e-68d05ff7eeb4 req-d6e7de4a-4260-43fe-8816-15138ca1c0dc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:55.683773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-09f445b5-b8c0-4ac3-a79e-68d05ff7eeb4 req-d6e7de4a-4260-43fe-8816-15138ca1c0dc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:55.696831 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-09f445b5-b8c0-4ac3-a79e-68d05ff7eeb4 req-d6e7de4a-4260-43fe-8816-15138ca1c0dc service nova] Creating event network-changed:a5c06721-7d3a-47db-bfd2-a3bcbc2be06b for instance 23de3496-097c-4008-b2e4-743499362de5 on n-h1-862416-2 Oct 22 04:12:55.701723 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-09f445b5-b8c0-4ac3-a79e-68d05ff7eeb4 req-d6e7de4a-4260-43fe-8816-15138ca1c0dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034018 Oct 22 04:12:55.702520 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3654/7447] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:12:56.561210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:56.561834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:56.569053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:56.569565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:56.570020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:56.570728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:56.571198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:56.571642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:56.703721 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:56.712100 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d74e54de-973b-4cfc-b465-0011b8ba03cd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1362 microversion: 2.1 time: 0.154837 Oct 22 04:12:56.712699 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3794/7448] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:56 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:57.736112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:57.736751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:57.744561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:57.745049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:57.745483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:57.746186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:57.746637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:57.747063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:57.883224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:57.890897 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7b36cac-5879-4ef8-ad4b-d5481ae15686 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1362 microversion: 2.1 time: 0.159569 Oct 22 04:12:57.891487 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3655/7449] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:57 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:12:58.915181 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:12:58.915733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:12:58.922526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:58.923654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:58.924104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:58.924832 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:12:58.925298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:12:58.925737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:12:59.057216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:12:59.065608 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3bcb555c-05c0-4420-8d93-bd6529355cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1362 microversion: 2.1 time: 0.154470 Oct 22 04:12:59.066177 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3795/7450] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:12:58 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:00.088851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:00.089468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:00.096608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:00.097100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:00.097544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:00.098248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:00.098705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:00.099136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:00.229703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:00.238272 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9b3c80bf-2a2d-4746-bd15-24013fbcd3c9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1362 microversion: 2.1 time: 0.153311 Oct 22 04:13:00.238865 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3656/7451] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:00 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:01.261591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:01.262220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:01.270310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:01.270815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:01.271273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:01.271993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:01.272496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:01.272944 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:01.407972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-a2de205b-1347-42ad-b904-be5d4a3303a9 req-dc9d1c49-7c9f-46e9-9081-165137161203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23de3496-097c-4008-b2e4-743499362de5", "name": "network-vif-plugged", "status": "completed", "tag": "a5c06721-7d3a-47db-bfd2-a3bcbc2be06b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:13:01.413643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:01.421027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a2de205b-1347-42ad-b904-be5d4a3303a9 req-dc9d1c49-7c9f-46e9-9081-165137161203 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:01.421511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a2de205b-1347-42ad-b904-be5d4a3303a9 req-dc9d1c49-7c9f-46e9-9081-165137161203 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:01.421942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-a2de205b-1347-42ad-b904-be5d4a3303a9 req-dc9d1c49-7c9f-46e9-9081-165137161203 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:01.422188 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e2fb3e4c-1351-49f6-bcd9-1b1a3a2fabdd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1362 microversion: 2.1 time: 0.164595 Oct 22 04:13:01.429205 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3796/7452] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:01 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:01.441962 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-a2de205b-1347-42ad-b904-be5d4a3303a9 req-dc9d1c49-7c9f-46e9-9081-165137161203 service nova] Creating event network-vif-plugged:a5c06721-7d3a-47db-bfd2-a3bcbc2be06b for instance 23de3496-097c-4008-b2e4-743499362de5 on n-h1-862416-2 Oct 22 04:13:01.446982 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-a2de205b-1347-42ad-b904-be5d4a3303a9 req-dc9d1c49-7c9f-46e9-9081-165137161203 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042689 Oct 22 04:13:01.447777 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3657/7453] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:02.445942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:02.446578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:02.453516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:02.454476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:02.454936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:02.455653 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:02.456157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:02.456629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:02.588386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:02.596864 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9b2303ae-5d3e-4ad0-adbb-eeb9ad32d339 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1362 microversion: 2.1 time: 0.154891 Oct 22 04:13:02.597452 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3797/7454] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:02 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:03.618518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:03.619273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:03.623299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:03.623991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:03.632479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:03.632958 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:03.633387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:03.634073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:03.634518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:03.634939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:03.765252 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:03.773472 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-42b56d7f-c075-41e9-9025-91522c784917 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1554 microversion: 2.1 time: 0.157218 Oct 22 04:13:03.774050 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3658/7455] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:03 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:03.795702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:03.796349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:03.799530 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:03.806390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:03.806885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:03.807340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:03.808054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:03.808659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:03.809404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:03.942760 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:03.950865 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b67d6335-fd15-466f-b1af-0ba77b520cae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1554 microversion: 2.1 time: 0.159108 Oct 22 04:13:03.951442 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3798/7456] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:03 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:05.468858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9576eae-0732-4b89-bc73-00c6036e6c17"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:13:05.471195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:05.478400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:05.478883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:05.479325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:05.480028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:05.480517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:05.480948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:05.723960 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ee4601b4-558c-4a9a-a67d-5dff72aec205 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258867 Oct 22 04:13:05.724936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3659/7457] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 04:13:05 2022] POST /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:16.441185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:16.441703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:16.444476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:16.445317 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:16.451150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:16.451652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:16.452218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:16.452942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:16.453403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:16.453844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:16.537846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lazy-loading 'services' on Instance uuid 23de3496-097c-4008-b2e4-743499362de5 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:13:16.607595 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0309bfee-9828-46c6-b6f8-3f848ba2b0bf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments/d9576eae-0732-4b89-bc73-00c6036e6c17" status: 202 len: 0 microversion: 2.1 time: 0.171244 Oct 22 04:13:16.608239 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3799/7458] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:13:16 2022] DELETE /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments/d9576eae-0732-4b89-bc73-00c6036e6c17 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:13:16.617980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:16.620486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:16.623781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:16.624718 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:16.631525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:16.632008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:16.632501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:16.633203 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:16.633656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:16.634083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:16.667824 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a95c616f-09f6-4d53-ad51-4f4bc066c6ff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054202 Oct 22 04:13:16.668415 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3660/7459] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:16 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:17.682209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:17.684631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:17.691319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:17.691817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:17.692306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:17.693028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:17.693493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:17.693940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:17.724525 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-68bc47d6-e2be-498f-aed7-3d23e2d9a882 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047577 Oct 22 04:13:17.725021 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3800/7460] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:17 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:18.736270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:18.738486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:18.746685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:18.747288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:18.747815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:18.748659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:18.749240 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:18.749756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:18.780701 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c5bf0206-1dab-40bb-9667-160c461a8900 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048419 Oct 22 04:13:18.781266 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3661/7461] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:18 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:19.793990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:19.796094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:19.803632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:19.804132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:19.804859 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:19.805581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:19.806050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:19.806495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:19.836436 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-96cee40b-0411-4182-ae69-fad5a9620d0c tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046743 Oct 22 04:13:19.837245 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3801/7462] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:19 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:20.849395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:20.852024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:20.858703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:20.859187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:20.859617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:20.860344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:20.861480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:20.862091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:20.893604 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38700710-2d0a-47a5-80fb-6aaea2bda81a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048692 Oct 22 04:13:20.894608 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3662/7463] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:20 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:21.906298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:21.908517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:21.915671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:21.916171 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:21.916661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:21.917376 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:21.917853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:21.918303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:21.948362 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-49efe640-b489-463e-96fc-87e7b61febc2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046056 Oct 22 04:13:21.948929 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3802/7464] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:21 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 04:13:21.959801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:21.960324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:21.967293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:21.967782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:21.968237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:21.968948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:21.969405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:21.969832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:22.050119 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] HTTP exception thrown: Instance 23de3496-097c-4008-b2e4-743499362de5 is not attached to volume d9576eae-0732-4b89-bc73-00c6036e6c17 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Request method failure captured: Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments/d9576eae-0732-4b89-bc73-00c6036e6c17 HTTP/1.1 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU22bo5ummjMS0ghCLZFwqOXpYSYF0-sYNoSfyuemcgxR_bhak1hyoBSTCv-XkTi7zjjZWAYodgwJzgp84d8w348qb21ks5DH17gJ7poBDHyEWFTgEXW3suyRcI-6Fsznr5Y3yYjDi-FXtxsB7PC7fpRQ-IwDNiUdNHAYeih9PfcsuLs Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}] Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4d6b3911f0344bdb93d1eddf9d713730 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 23de3496-097c-4008-b2e4-743499362de5 is not attached to volume d9576eae-0732-4b89-bc73-00c6036e6c17 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': '23de3496-097c-4008-b2e4-743499362de5', 'id': 'd9576eae-0732-4b89-bc73-00c6036e6c17'} Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d9576eae-0732-4b89-bc73-00c6036e6c17. Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23de3496-097c-4008-b2e4-743499362de5 is not attached to volume d9576eae-0732-4b89-bc73-00c6036e6c17 Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:13:22.052479 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:13:22.057049 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:13:22.057049 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:13:22.057049 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23de3496-097c-4008-b2e4-743499362de5 is not attached to volume d9576eae-0732-4b89-bc73-00c6036e6c17 Oct 22 04:13:22.057049 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:22.057049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Returning 404 to user: Instance 23de3496-097c-4008-b2e4-743499362de5 is not attached to volume d9576eae-0732-4b89-bc73-00c6036e6c17 {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:13:22.057049 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ffc38779-99ec-44d7-8083-64f130b67edc tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments/d9576eae-0732-4b89-bc73-00c6036e6c17" status: 404 len: 154 microversion: 2.1 time: 0.098330 Oct 22 04:13:22.057049 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3663/7465] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:13:21 2022] DELETE /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5/os-volume_attachments/d9576eae-0732-4b89-bc73-00c6036e6c17 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:13:25.405777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:25.406420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:25.413022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:25.413526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:25.413979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:25.414706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:25.415177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:25.415618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:25.446036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:13:25.526082 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5894fa73-af70-48ac-ac7a-148707651c7f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 204 len: 0 microversion: 2.1 time: 0.124081 Oct 22 04:13:25.526742 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3803/7466] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:13:25 2022] DELETE /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 22 04:13:25.535433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:25.536132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:25.544004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:25.544705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:25.545421 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:25.546224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:25.546910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:25.547436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:25.687431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:25.696282 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38406924-be43-42d5-906b-6d3172c8ce73 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1560 microversion: 2.1 time: 0.164754 Oct 22 04:13:25.697102 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3664/7467] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:25 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:13:26.720136 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:26.720900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:26.728364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:26.728804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:26.729259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:26.729959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:26.730426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:26.730865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:26.860738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:26.869497 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67cd1340-508b-4fbe-bd17-13ff9a9def56 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1560 microversion: 2.1 time: 0.153658 Oct 22 04:13:26.870074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3804/7468] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:26 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:27.693160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-10dba689-ce2b-4ec3-91c3-2cd37c32eb79 req-52959d69-944c-41fb-bd45-dd3871abd947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23de3496-097c-4008-b2e4-743499362de5", "name": "network-vif-deleted", "tag": "a5c06721-7d3a-47db-bfd2-a3bcbc2be06b"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:13:27.703516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-10dba689-ce2b-4ec3-91c3-2cd37c32eb79 req-52959d69-944c-41fb-bd45-dd3871abd947 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:27.703993 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-10dba689-ce2b-4ec3-91c3-2cd37c32eb79 req-52959d69-944c-41fb-bd45-dd3871abd947 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:27.704471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-10dba689-ce2b-4ec3-91c3-2cd37c32eb79 req-52959d69-944c-41fb-bd45-dd3871abd947 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:27.718040 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-10dba689-ce2b-4ec3-91c3-2cd37c32eb79 req-52959d69-944c-41fb-bd45-dd3871abd947 service nova] Creating event network-vif-deleted:a5c06721-7d3a-47db-bfd2-a3bcbc2be06b for instance 23de3496-097c-4008-b2e4-743499362de5 on n-h1-862416-2 Oct 22 04:13:27.723296 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-10dba689-ce2b-4ec3-91c3-2cd37c32eb79 req-52959d69-944c-41fb-bd45-dd3871abd947 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095479 Oct 22 04:13:27.724256 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3665/7469] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:27.893637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:27.894323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:27.901164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:27.901667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:27.902139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:27.902825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:27.903295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:27.903737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:27.936285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:27.936794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:27.937242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:27.937704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lazy-loading 'fault' on Instance uuid 23de3496-097c-4008-b2e4-743499362de5 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:13:27.978793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:27.986446 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e587beba-3eed-4c1c-aa99-fbce02d5117f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 200 len: 1352 microversion: 2.1 time: 0.096969 Oct 22 04:13:27.987026 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3805/7470] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:27 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:29.010409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:29.011101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 23de3496-097c-4008-b2e4-743499362de5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:29.017155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:29.017889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:29.018321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:29.019009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:29.019902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:29.020034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:29.033287 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] HTTP exception thrown: Instance 23de3496-097c-4008-b2e4-743499362de5 could not be found. Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Request method failure captured: Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 HTTP/1.1 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU22bo5ummjMS0ghCLZFwqOXpYSYF0-sYNoSfyuemcgxR_bhak1hyoBSTCv-XkTi7zjjZWAYodgwJzgp84d8w348qb21ks5DH17gJ7poBDHyEWFTgEXW3suyRcI-6Fsznr5Y3yYjDi-FXtxsB7PC7fpRQ-IwDNiUdNHAYeih9PfcsuLs Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}] Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4d6b3911f0344bdb93d1eddf9d713730 Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 23de3496-097c-4008-b2e4-743499362de5 could not be found. Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '23de3496-097c-4008-b2e4-743499362de5'} Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23de3496-097c-4008-b2e4-743499362de5 could not be found. Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23de3496-097c-4008-b2e4-743499362de5 could not be found. Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:13:29.035426 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23de3496-097c-4008-b2e4-743499362de5 could not be found. Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Returning 404 to user: Instance 23de3496-097c-4008-b2e4-743499362de5 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-997d178e-966d-4996-b3ec-5bca82903dd9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5" status: 404 len: 111 microversion: 2.1 time: 0.032076 Oct 22 04:13:29.040344 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3666/7471] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:29 2022] GET /compute/v2.1/servers/23de3496-097c-4008-b2e4-743499362de5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:13:29.046101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45b407e2-da56-4a3c-a647-be2f5a95093e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '.version_select at 0x7f0d18c4ef70>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:29.066766 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45b407e2-da56-4a3c-a647-be2f5a95093e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2042400617" status: 202 len: 0 microversion: 2.1 time: 0.024361 Oct 22 04:13:29.067370 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3806/7472] 10.222.0.25 () {58 vars in 1278 bytes} [Sat Oct 22 04:13:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2042400617 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:13:29.084906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5bd07cf-4782-4ae1-bc72-9e9c45bf1455 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: .version_select at 0x7f0d1987b700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2079085889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWyoc+CxdI8N3YCwZioKpRa4qQfrxmKzHr3I3rGnvn/Gp8tVYdvkK/fsnQg2TcT4qgef+1iEcF654jFRrGrJ7Sft+9c5UbKI7zWx1VLJG6BsVF063r3+r/cNkJsLtMq4w=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:13:29.100988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a5bd07cf-4782-4ae1-bc72-9e9c45bf1455 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:13:29.106004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a5bd07cf-4782-4ae1-bc72-9e9c45bf1455 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for user 4d6b3911f0344bdb93d1eddf9d713730 and project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:13:29.128517 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a5bd07cf-4782-4ae1-bc72-9e9c45bf1455 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048146 Oct 22 04:13:29.129411 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3667/7473] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:13:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:29.179672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1942099175", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2079085889", "networks": [{"uuid": "6f8e8cc4-e903-40fe-b17a-8e804b91615b"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:13:29.232649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] validate_networks() for [('6f8e8cc4-e903-40fe-b17a-8e804b91615b', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:13:29.614105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:13:29.614569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:13:29.615085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:13:29.615506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:13:29.615958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:13:29.628031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:29.628556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:29.629518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:29.630347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:29.630816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:29.631250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:29.649191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:13:29.654395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Getting quotas for user 4d6b3911f0344bdb93d1eddf9d713730 and project 67041d5e8d2e4fe982741361ac7093f2. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:13:29.666635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:13:29.668976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:13:29.716836 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-65ca24b9-faea-4e93-99bb-d74967ebc639 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541642 Oct 22 04:13:29.717487 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3807/7474] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:13:29.728875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff2b3653-b225-433d-ac01-86d84a8b6786 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:29.729478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff2b3653-b225-433d-ac01-86d84a8b6786 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:29.788551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff2b3653-b225-433d-ac01-86d84a8b6786 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:29.796560 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff2b3653-b225-433d-ac01-86d84a8b6786 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1263 microversion: 2.1 time: 0.071479 Oct 22 04:13:29.797311 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3668/7475] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:29 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:30.821858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:30.822475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:30.829130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:30.829624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:30.830074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:30.830775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:30.831240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:30.831676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:30.897408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:30.905513 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7652dc73-4cd0-4bf5-b736-6711f10d5e86 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1321 microversion: 2.1 time: 0.089164 Oct 22 04:13:30.906186 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3808/7476] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:30 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1321 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:31.930283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:31.930873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:31.938402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:31.938882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:31.939345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:31.940045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:31.940524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:31.940948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:32.139009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:32.149312 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d6f9304c-511b-4855-a9ae-3ef7152de3ec tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1363 microversion: 2.1 time: 0.222486 Oct 22 04:13:32.156227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-117edfdf-f284-488c-840d-41d8f47b8c8f req-01eeeb48-f75c-4cda-aa53-94e968f97145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fd9906-160f-4708-96d9-3f4600f037f3", "tag": "e8ad8d9b-b959-4d6a-aec3-c5337504c609"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:13:32.164940 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3669/7477] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:31 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:32.170116 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-117edfdf-f284-488c-840d-41d8f47b8c8f req-01eeeb48-f75c-4cda-aa53-94e968f97145 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:32.170648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-117edfdf-f284-488c-840d-41d8f47b8c8f req-01eeeb48-f75c-4cda-aa53-94e968f97145 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:32.171071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-117edfdf-f284-488c-840d-41d8f47b8c8f req-01eeeb48-f75c-4cda-aa53-94e968f97145 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:32.184449 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-117edfdf-f284-488c-840d-41d8f47b8c8f req-01eeeb48-f75c-4cda-aa53-94e968f97145 service nova] Creating event network-changed:e8ad8d9b-b959-4d6a-aec3-c5337504c609 for instance 97fd9906-160f-4708-96d9-3f4600f037f3 on n-h2-862416-2 Oct 22 04:13:32.190187 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-117edfdf-f284-488c-840d-41d8f47b8c8f req-01eeeb48-f75c-4cda-aa53-94e968f97145 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037915 Oct 22 04:13:32.190983 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3809/7478] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:33.172776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:33.173385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:33.180361 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:33.180842 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:33.181282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:33.181971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:33.182452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:33.182875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:33.312480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:33.320543 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b4367197-f32f-4c37-b5b9-e348667c9a0e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1363 microversion: 2.1 time: 0.151670 Oct 22 04:13:33.321227 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3670/7479] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:33 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:34.344672 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:34.345378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:34.353009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:34.353495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:34.353941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:34.354637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:34.355096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:34.355529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:34.496189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:34.503880 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-48a84d67-97b3-4b2d-8efd-56c46fcb98e7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1363 microversion: 2.1 time: 0.163515 Oct 22 04:13:34.504496 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3810/7480] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:34 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:35.527635 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:35.528188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:35.535103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:35.535564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:35.536008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:35.536750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:35.537208 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:35.537636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:35.668108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:35.675664 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f2d08970-d9c2-4d5d-8827-f8f2b1ee3c24 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1363 microversion: 2.1 time: 0.152049 Oct 22 04:13:35.676258 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3671/7481] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:35 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:36.698956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:36.699581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:36.706394 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:36.707304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:36.707733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:36.708495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:36.708947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:36.709386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:36.841640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:36.849592 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f7128900-a35a-4550-8f19-260d7539a7ac tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1363 microversion: 2.1 time: 0.154602 Oct 22 04:13:36.850182 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3811/7482] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:36 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:37.873221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:37.873863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:37.880786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:37.881270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:37.881710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:37.882425 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:37.882867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:37.883297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:38.012954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:38.021158 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c2c06400-485a-4ede-b255-0c992e6edc09 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1363 microversion: 2.1 time: 0.151926 Oct 22 04:13:38.021774 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3672/7483] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:37 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:39.045210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:39.045834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:39.054009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:39.054613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:39.055348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:39.056071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:39.056563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:39.056991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:39.097089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c22e94b1-fea5-4f52-8b8d-134b8edeffef req-d572e203-5e94-40ca-8dc0-f2b388bf8ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fd9906-160f-4708-96d9-3f4600f037f3", "name": "network-vif-plugged", "status": "completed", "tag": "e8ad8d9b-b959-4d6a-aec3-c5337504c609"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:13:39.107224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c22e94b1-fea5-4f52-8b8d-134b8edeffef req-d572e203-5e94-40ca-8dc0-f2b388bf8ae8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:39.107720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c22e94b1-fea5-4f52-8b8d-134b8edeffef req-d572e203-5e94-40ca-8dc0-f2b388bf8ae8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:39.108167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c22e94b1-fea5-4f52-8b8d-134b8edeffef req-d572e203-5e94-40ca-8dc0-f2b388bf8ae8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:39.120384 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c22e94b1-fea5-4f52-8b8d-134b8edeffef req-d572e203-5e94-40ca-8dc0-f2b388bf8ae8 service nova] Creating event network-vif-plugged:e8ad8d9b-b959-4d6a-aec3-c5337504c609 for instance 97fd9906-160f-4708-96d9-3f4600f037f3 on n-h2-862416-2 Oct 22 04:13:39.125616 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c22e94b1-fea5-4f52-8b8d-134b8edeffef req-d572e203-5e94-40ca-8dc0-f2b388bf8ae8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098240 Oct 22 04:13:39.126233 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3812/7484] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:39.206349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:39.214501 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f69d6118-e591-4e3b-8486-b4daf051d9a9 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1363 microversion: 2.1 time: 0.173341 Oct 22 04:13:39.225092 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3673/7485] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:39 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:13:40.235781 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:40.236590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:40.242768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:40.243531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:40.250322 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:40.250819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:40.251269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:40.251969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:40.252464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:40.252907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:40.385972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:40.395650 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5db575c1-24ab-4694-b8f4-7c1b88bab6e2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1363 microversion: 2.1 time: 0.160616 Oct 22 04:13:40.396273 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3813/7486] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:40 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:41.419526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:41.420141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:41.422089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:41.427814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:41.428306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:41.428740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:41.429420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:41.429869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:41.430294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:41.564438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:41.572655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e6ed5faf-8bdd-43d6-9f63-fb3131c623c7 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1555 microversion: 2.1 time: 0.157166 Oct 22 04:13:41.573231 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3674/7487] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:41 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:41.595589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:41.596231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:41.603263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:41.603763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:41.604229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:41.604933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:41.605395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:41.605828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:41.736915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:13:41.745273 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3242a12e-60f4-41be-a95e-59176d632fae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1555 microversion: 2.1 time: 0.153517 Oct 22 04:13:41.745858 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3814/7488] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:13:41 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:13:43.236378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abdcf1f5-c14f-4a63-8df4-da2102f467d4"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:13:43.238857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:43.245691 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:43.246178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:43.246622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:43.247324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:43.247783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:43.248233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:43.485885 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c3a62d62-fbc1-4db1-b392-86061ef51ff3 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "POST /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252217 Oct 22 04:13:43.486812 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3675/7489] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 04:13:43 2022] POST /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:54.206539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:54.207087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:54.210432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:54.211102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:54.216962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:54.217459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:54.217906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:54.218604 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:54.219067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:54.219503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:54.303306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lazy-loading 'services' on Instance uuid 97fd9906-160f-4708-96d9-3f4600f037f3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:13:54.373168 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9e3ead64-77f2-4884-8703-5aff53626e4a tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments/abdcf1f5-c14f-4a63-8df4-da2102f467d4" status: 202 len: 0 microversion: 2.1 time: 0.170568 Oct 22 04:13:54.373754 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3815/7490] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:13:54 2022] DELETE /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments/abdcf1f5-c14f-4a63-8df4-da2102f467d4 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:13:54.384845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:54.387232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:54.390083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:54.391191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:13:54.400152 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:54.400674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:54.401121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:54.401834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:54.402907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:54.403534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:54.437690 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c4ff405d-33c4-4d96-abb9-38b27eb02bad tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059301 Oct 22 04:13:54.438264 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3676/7491] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:54 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:55.451965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:55.454362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:55.461364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:55.461860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:55.462308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:55.463017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:55.463483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:55.463922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:55.499541 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-221f0b09-4fa9-4edf-acda-215121f964ae tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052763 Oct 22 04:13:55.500119 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3816/7492] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:55 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:56.511270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:56.513498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:56.520582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:56.521092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:56.521658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:56.522461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:56.522951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:56.523385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:56.554565 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d529cbf5-b35e-463e-8f59-f7800d07b96f tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047389 Oct 22 04:13:56.555142 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3677/7493] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:56 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:57.567014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:57.569819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:57.576764 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:57.577258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:57.577711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:57.578414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:57.578888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:57.579325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:57.612044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72cba64f-327f-4f6d-8f82-dd96354194fd tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049039 Oct 22 04:13:57.612659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3817/7494] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:57 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:58.625154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:58.627336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:58.635259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:58.635686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:58.636130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:58.636869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:58.637329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:58.637790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:58.670953 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ea74f5c-666d-4552-b52f-459295ad4cff tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049850 Oct 22 04:13:58.671750 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3678/7495] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:58 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:13:59.684417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:59.686670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:59.693498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:59.693979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:59.694437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:59.695141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:59.695611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:59.696053 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:59.724919 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9fe5a497-96c3-4fdb-aafd-df2eb89779a2 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044223 Oct 22 04:13:59.725433 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3818/7496] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:13:59 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 04:13:59.736322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:13:59.736820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:13:59.745098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:59.745833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:59.746330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:59.747246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:13:59.747711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:13:59.748146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:13:59.824411 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] HTTP exception thrown: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 is not attached to volume abdcf1f5-c14f-4a63-8df4-da2102f467d4 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Request method failure captured: Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: request: DELETE /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments/abdcf1f5-c14f-4a63-8df4-da2102f467d4 HTTP/1.1 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU22bo5ummjMS0ghCLZFwqOXpYSYF0-sYNoSfyuemcgxR_bhak1hyoBSTCv-XkTi7zjjZWAYodgwJzgp84d8w348qb21ks5DH17gJ7poBDHyEWFTgEXW3suyRcI-6Fsznr5Y3yYjDi-FXtxsB7PC7fpRQ-IwDNiUdNHAYeih9PfcsuLs Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}] Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4d6b3911f0344bdb93d1eddf9d713730 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 is not attached to volume abdcf1f5-c14f-4a63-8df4-da2102f467d4 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'server_id': '97fd9906-160f-4708-96d9-3f4600f037f3', 'id': 'abdcf1f5-c14f-4a63-8df4-da2102f467d4'} Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id abdcf1f5-c14f-4a63-8df4-da2102f467d4. Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 is not attached to volume abdcf1f5-c14f-4a63-8df4-da2102f467d4 Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:13:59.826057 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:13:59.830579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:13:59.830579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:13:59.830579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 is not attached to volume abdcf1f5-c14f-4a63-8df4-da2102f467d4 Oct 22 04:13:59.830579 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:13:59.830579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Returning 404 to user: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 is not attached to volume abdcf1f5-c14f-4a63-8df4-da2102f467d4 {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:13:59.830579 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab3f17ba-8510-41cb-a32e-cffbc6c3b120 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments/abdcf1f5-c14f-4a63-8df4-da2102f467d4" status: 404 len: 154 microversion: 2.1 time: 0.095230 Oct 22 04:13:59.830579 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3679/7497] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:13:59 2022] DELETE /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3/os-volume_attachments/abdcf1f5-c14f-4a63-8df4-da2102f467d4 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:14:03.173082 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:03.173715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:03.181799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:03.182311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:03.182767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:03.183505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:03.183976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:03.184450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:03.212565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:14:03.293921 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d47991ef-c19d-4698-9012-dae9f6ac28ba tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 204 len: 0 microversion: 2.1 time: 0.124881 Oct 22 04:14:03.294589 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3819/7498] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:14:03 2022] DELETE /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:14:03.303928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:03.304505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:03.311295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:03.311793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:03.312280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:03.312994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:03.313453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:03.313886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:03.448331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:03.454478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20e32a7d-03c6-49ae-8730-3cb02dd4b02e tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1561 microversion: 2.1 time: 0.155107 Oct 22 04:14:03.455114 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3680/7499] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:03 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:04.479642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:04.480384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:04.487250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:04.487741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:04.488187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:04.488905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:04.489371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:04.489806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:04.620758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:04.628459 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d3f8679-d8f4-46a1-b368-747b1138e0cf tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1561 microversion: 2.1 time: 0.153136 Oct 22 04:14:04.629040 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3820/7500] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:04 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:05.378190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7795ab50-aae4-4d34-aa98-bbdfbabc5a89 req-0a3d3159-6698-4a7e-89c4-0f97a68012d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fd9906-160f-4708-96d9-3f4600f037f3", "name": "network-vif-deleted", "tag": "e8ad8d9b-b959-4d6a-aec3-c5337504c609"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:14:05.391585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7795ab50-aae4-4d34-aa98-bbdfbabc5a89 req-0a3d3159-6698-4a7e-89c4-0f97a68012d6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:05.393046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7795ab50-aae4-4d34-aa98-bbdfbabc5a89 req-0a3d3159-6698-4a7e-89c4-0f97a68012d6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:05.393748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7795ab50-aae4-4d34-aa98-bbdfbabc5a89 req-0a3d3159-6698-4a7e-89c4-0f97a68012d6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:05.408039 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7795ab50-aae4-4d34-aa98-bbdfbabc5a89 req-0a3d3159-6698-4a7e-89c4-0f97a68012d6 service nova] Creating event network-vif-deleted:e8ad8d9b-b959-4d6a-aec3-c5337504c609 for instance 97fd9906-160f-4708-96d9-3f4600f037f3 on n-h2-862416-2 Oct 22 04:14:05.413655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7795ab50-aae4-4d34-aa98-bbdfbabc5a89 req-0a3d3159-6698-4a7e-89c4-0f97a68012d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039199 Oct 22 04:14:05.414276 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3681/7501] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:14:05.653066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:05.653713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:05.662524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:05.663050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:05.663507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:05.664280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:05.664753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:05.665200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:05.701315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:05.701814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:05.702267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:05.702732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lazy-loading 'fault' on Instance uuid 97fd9906-160f-4708-96d9-3f4600f037f3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:14:05.749933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6b3911f0344bdb93d1eddf9d713730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67041d5e8d2e4fe982741361ac7093f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:05.760433 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-95339fa1-3891-4539-b440-8ff3bdbb9037 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 200 len: 1353 microversion: 2.1 time: 0.111485 Oct 22 04:14:05.761029 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3821/7502] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:05 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 1353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:06.786025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:06.787273 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] [instance: 97fd9906-160f-4708-96d9-3f4600f037f3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:06.793637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:06.794127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:06.794570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:06.795269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:06.795732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:06.796165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:06.809337 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] HTTP exception thrown: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 could not be found. Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Request method failure captured: Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 HTTP/1.1 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU22bo5ummjMS0ghCLZFwqOXpYSYF0-sYNoSfyuemcgxR_bhak1hyoBSTCv-XkTi7zjjZWAYodgwJzgp84d8w348qb21ks5DH17gJ7poBDHyEWFTgEXW3suyRcI-6Fsznr5Y3yYjDi-FXtxsB7PC7fpRQ-IwDNiUdNHAYeih9PfcsuLs Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/67041d5e8d2e4fe982741361ac7093f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/67041d5e8d2e4fe982741361ac7093f2"}]}] Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 67041d5e8d2e4fe982741361ac7093f2 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-942707795 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 4d6b3911f0344bdb93d1eddf9d713730 Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestEncryptedCinderVolumes-942707795-project Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 could not be found. Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '97fd9906-160f-4708-96d9-3f4600f037f3'} Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 could not be found. Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 could not be found. Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:14:06.810940 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 could not be found. Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Returning 404 to user: Instance 97fd9906-160f-4708-96d9-3f4600f037f3 could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d21f63c0-0cdc-4108-9920-204030e18cf0 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3" status: 404 len: 111 microversion: 2.1 time: 0.031483 Oct 22 04:14:06.816364 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3682/7503] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:06 2022] GET /compute/v2.1/servers/97fd9906-160f-4708-96d9-3f4600f037f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:14:06.821356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24edb3af-87b9-4c20-b58e-584b67e9e3f4 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] Calling method '.version_select at 0x7f0d18da3820>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:06.841561 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-24edb3af-87b9-4c20-b58e-584b67e9e3f4 tempest-TestEncryptedCinderVolumes-942707795 tempest-TestEncryptedCinderVolumes-942707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2079085889" status: 202 len: 0 microversion: 2.1 time: 0.024282 Oct 22 04:14:06.842156 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3822/7504] 10.222.0.25 () {58 vars in 1278 bytes} [Sat Oct 22 04:14:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2079085889 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 22 04:14:34.366111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e769f979-a941-4a27-91ef-4a5a0b65690d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'create', calling method: .version_select at 0x7f0d1e51e8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-245500517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQILFHNxGICsFs9MHMtfgHtn5WKN36qQ917C7DvubPOKNKhb/+iyOh6qhl6FQ4xCo7crACYfCFbJvo23q5d6glszpd+TXdFXN8Y63CD8EN03q5V7xZi9ROs1tr1JZbKQQ=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:14:34.372246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=14 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:14:34.372897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=34 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:14:34.384362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e769f979-a941-4a27-91ef-4a5a0b65690d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Getting quotas for project 5825d0ab593c4874a5f5ec4e8357c7fe. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:14:34.390261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e769f979-a941-4a27-91ef-4a5a0b65690d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Getting quotas for user 7b07367315da45a5943d45cba2b7a23f and project 5825d0ab593c4874a5f5ec4e8357c7fe. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:14:34.414161 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e769f979-a941-4a27-91ef-4a5a0b65690d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052035 Oct 22 04:14:34.414754 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3683/7505] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:14:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:14:34.465517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1398081316", "imageRef": "90c9e793-9915-416d-9cb4-a486c4d0c3eb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-245500517", "networks": [{"uuid": "c4dfd6c2-ee19-4197-9807-b4b72afcd90a"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:14:34.477316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:14:34.478046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:14:34.524699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] validate_networks() for [('c4dfd6c2-ee19-4197-9807-b4b72afcd90a', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:14:34.913036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:14:34.913470 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:14:34.913956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:14:34.914381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:14:34.914861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:14:34.923542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:34.924028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:34.924508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:34.925246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:34.925707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:34.926141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:34.943067 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Getting quotas for project 5825d0ab593c4874a5f5ec4e8357c7fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:14:34.948956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Getting quotas for user 7b07367315da45a5943d45cba2b7a23f and project 5825d0ab593c4874a5f5ec4e8357c7fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:14:34.961693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:14:34.963902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90c9e793-9915-416d-9cb4-a486c4d0c3eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:14:35.011341 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-348284a0-0e74-4120-92aa-9ca6e4163fe1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549709 Oct 22 04:14:35.012013 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3823/7506] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:14:35.024108 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c51db85c-df87-4f46-b50f-8f3259689868 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:35.024832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c51db85c-df87-4f46-b50f-8f3259689868 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:35.081563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c51db85c-df87-4f46-b50f-8f3259689868 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:35.088732 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c51db85c-df87-4f46-b50f-8f3259689868 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1258 microversion: 2.1 time: 0.069293 Oct 22 04:14:35.089312 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3684/7507] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:35 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:14:36.111866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:36.112900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:36.120477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:36.121286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:36.121797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:36.122575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:36.123366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:36.123892 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:36.197483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:36.207128 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-071968d2-fcd4-4138-bc1c-4c66c9cb8b32 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1318 microversion: 2.1 time: 0.100035 Oct 22 04:14:36.216546 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3824/7508] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:36 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:37.232279 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:37.233196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:37.241590 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:37.242405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:37.242784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:37.243530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:37.243984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:37.244447 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:37.401433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:37.419542 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-244273a8-63c9-4ce2-9036-bef769c4237e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.190304 Oct 22 04:14:37.436167 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3685/7509] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:37 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:38.452921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:38.453668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:38.462685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:38.463237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:38.463698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:38.464488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:38.465008 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:38.465640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:38.610916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:38.619206 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8a28daca-8756-41a1-87db-fa0fd40d33ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.179074 Oct 22 04:14:38.620083 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3825/7510] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:38 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:14:39.642587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:39.643451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:39.650822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:39.651302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:39.651740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:39.652468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:39.652929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:39.653360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:39.795940 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:39.804029 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9df493ba-d7a0-44d9-8c37-5f9882d7b6aa tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.165281 Oct 22 04:14:39.804635 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3686/7511] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:39 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:40.828535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:40.829271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:40.838178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:40.838707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:40.839194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:40.840038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:40.840928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:40.841389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:40.983379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:40.995380 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f7a5e023-2cfd-4108-8fe6-da2ba6a3d62b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.171838 Oct 22 04:14:40.996368 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3826/7512] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:40 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:42.019656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:42.020334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:42.027872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:42.028400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:42.028841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:42.029602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:42.030115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:42.030641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:42.182295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:42.190233 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-41792d4d-8bac-494e-a448-dfbc9c0d25d8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.174876 Oct 22 04:14:42.190823 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3687/7513] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:42 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:43.213694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:43.214373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:43.221117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:43.221614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:43.222066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:43.222768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:43.223239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:43.223712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:43.361614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:43.370596 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9f17d9ce-a5fd-481f-847c-0442a3816bbd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.161113 Oct 22 04:14:43.371180 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3827/7514] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:43 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:44.394076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:44.394721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:44.403987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:44.404676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:44.405171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:44.405824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:44.406283 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:44.406717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:44.537344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:44.545314 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f400ce0f-eb3e-44fd-bcaa-9276202df9e8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.155529 Oct 22 04:14:44.545883 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3688/7515] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:44 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:45.569114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:45.569807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:45.573190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:14:45.573867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:14:45.580330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:45.580831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:45.581279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:45.581989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:45.582450 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:45.582887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:45.691984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-90a094e8-61ad-4c30-aef8-69315039fffb req-e3893619-1b4a-43cc-b3d8-9cf5560e39b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e7c1b7-7c82-46b4-85d5-e76e1517a2ce", "tag": "3da34330-1b93-479f-b3eb-700929a92378"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:14:45.699315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:14:45.708759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-90a094e8-61ad-4c30-aef8-69315039fffb req-e3893619-1b4a-43cc-b3d8-9cf5560e39b3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:45.710443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-90a094e8-61ad-4c30-aef8-69315039fffb req-e3893619-1b4a-43cc-b3d8-9cf5560e39b3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:45.711346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-90a094e8-61ad-4c30-aef8-69315039fffb req-e3893619-1b4a-43cc-b3d8-9cf5560e39b3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:45.726675 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-90a094e8-61ad-4c30-aef8-69315039fffb req-e3893619-1b4a-43cc-b3d8-9cf5560e39b3 service nova] Creating event network-changed:3da34330-1b93-479f-b3eb-700929a92378 for instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce on n-h1-862416-2 Oct 22 04:14:45.727309 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:45.734271 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-90a094e8-61ad-4c30-aef8-69315039fffb req-e3893619-1b4a-43cc-b3d8-9cf5560e39b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047236 Oct 22 04:14:45.735487 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3689/7516] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:14:45.736996 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-732deb49-d57f-49b2-8fc6-e0ccea69461c tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.172056 Oct 22 04:14:45.737644 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3828/7517] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:45 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:46.762861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:46.763565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:46.771027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:46.771507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:46.772571 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:46.773359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:46.773893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:46.774323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:46.902710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:46.910453 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-19a6d183-1c09-4bff-97f7-a87795789755 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.151929 Oct 22 04:14:46.911035 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3690/7518] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:46 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:47.933882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:47.934518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:47.941898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:47.942439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:47.942902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:47.943883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:47.944621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:47.944758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:48.107163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:48.114994 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d243890d-2d0a-4915-a7ca-feed49d48d91 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.185202 Oct 22 04:14:48.127655 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3829/7519] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:47 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:49.140200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:49.140829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:49.147602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:49.148090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:49.148564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:49.149270 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:49.149728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:49.150191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:49.276557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:49.284262 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f588d84b-11a5-4d42-b0c4-a3e3edf27388 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.148152 Oct 22 04:14:49.284842 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3691/7520] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:49 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:50.307092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:50.307726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:50.314643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:50.315141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:50.315598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:50.316333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:50.316812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:50.317257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:50.448806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:50.456719 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d35352f0-aef7-4735-8840-ec191629f6e2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.153583 Oct 22 04:14:50.457313 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3830/7521] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:50 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:51.480450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:51.481057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:51.487870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:51.488388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:51.488825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:51.489507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:51.489956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:51.490379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:51.623655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:51.636472 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c7ca4713-f2fa-44ba-b91b-c3ba831f3999 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.159889 Oct 22 04:14:51.637055 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3692/7522] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:51 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:51.822531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0cc94b71-9dd2-4590-9172-d240f6444def req-2140b02a-e8dc-45e4-a8b1-68cd11312ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e7c1b7-7c82-46b4-85d5-e76e1517a2ce", "name": "network-vif-plugged", "status": "completed", "tag": "3da34330-1b93-479f-b3eb-700929a92378"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:14:51.833751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0cc94b71-9dd2-4590-9172-d240f6444def req-2140b02a-e8dc-45e4-a8b1-68cd11312ef2 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:51.834779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0cc94b71-9dd2-4590-9172-d240f6444def req-2140b02a-e8dc-45e4-a8b1-68cd11312ef2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:51.835231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0cc94b71-9dd2-4590-9172-d240f6444def req-2140b02a-e8dc-45e4-a8b1-68cd11312ef2 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:51.847961 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0cc94b71-9dd2-4590-9172-d240f6444def req-2140b02a-e8dc-45e4-a8b1-68cd11312ef2 service nova] Creating event network-vif-plugged:3da34330-1b93-479f-b3eb-700929a92378 for instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce on n-h1-862416-2 Oct 22 04:14:51.854131 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0cc94b71-9dd2-4590-9172-d240f6444def req-2140b02a-e8dc-45e4-a8b1-68cd11312ef2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035453 Oct 22 04:14:51.854742 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3831/7523] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:14:52.658858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:52.659476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:52.667008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:52.667496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:52.667935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:52.668669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:52.669131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:52.669564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:52.800285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:52.808934 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-56f10bb6-67b7-4971-80b4-d651b5509fa7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1358 microversion: 2.1 time: 0.154028 Oct 22 04:14:52.809505 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3693/7524] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:52 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:53.832767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:53.833411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:53.840260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:53.840767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:53.841228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:53.841941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:53.842420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:53.842866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:53.977566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:53.985479 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-77029acb-7ea9-4069-b5ae-81160c81d160 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1548 microversion: 2.1 time: 0.157998 Oct 22 04:14:53.986050 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3832/7525] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:53 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:54.007622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:54.008250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:54.015034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:54.015514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:54.015952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:54.016677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:54.017130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:54.017559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:54.150298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:54.158608 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3dcf139-1c45-4b22-b993-0933a4f04be6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1548 microversion: 2.1 time: 0.154987 Oct 22 04:14:54.159196 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3694/7526] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:54 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:54.181041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:54.185834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:54.186619 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Searching by: {'deleted': False, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 04:14:54.191899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:54.192432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:54.192888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:54.194147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:54.194743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:54.195223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:54.219218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 04:14:54.245764 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c68297e0-ad2c-41ac-aba2-50bebbc3125f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068612 Oct 22 04:14:54.246361 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3833/7527] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 04:14:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:14:54.258596 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:14:54.259207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:54.265145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:54.265622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:54.266073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:54.266899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:54.267351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:54.267775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:54.394846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:14:54.403122 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a82d880-e5fc-4ef1-8cbc-1425d2cb67f2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1548 microversion: 2.1 time: 0.148990 Oct 22 04:14:54.403695 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3695/7528] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:14:54 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:14:55.944017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96fb658d-2f49-4e4d-9e36-c691162c3529"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:14:55.946320 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:14:55.953235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:55.953740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:55.954193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:55.954899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:14:55.955368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:14:55.955810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:14:56.193923 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9d517bf5-5aa3-40ff-ae62-564fdaf78152 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253872 Oct 22 04:14:56.194719 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3834/7529] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 04:14:55 2022] POST /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:15:09.423009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:15:09.423622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:15:09.426549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:15:09.427211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=62 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:15:09.434350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:15:09.434843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:15:09.435284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:15:09.435984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:15:09.436550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:15:09.436983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:15:09.569714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:15:09.577977 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7fe9a69c-4289-4221-aeda-1db9e08b20b7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1594 microversion: 2.1 time: 0.158811 Oct 22 04:15:09.578550 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3696/7530] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:15:09 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:15:11.520878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:15:11.521757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:15:11.523107 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:15:11.532651 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f355b816-c1a8-49b7-8832-94ca6dd7f489 req-a95526fc-905f-4530-a264-3c459b482421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e7c1b7-7c82-46b4-85d5-e76e1517a2ce", "tag": "3da34330-1b93-479f-b3eb-700929a92378"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:15:11.546160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f355b816-c1a8-49b7-8832-94ca6dd7f489 req-a95526fc-905f-4530-a264-3c459b482421 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:15:11.546669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f355b816-c1a8-49b7-8832-94ca6dd7f489 req-a95526fc-905f-4530-a264-3c459b482421 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:15:11.547109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f355b816-c1a8-49b7-8832-94ca6dd7f489 req-a95526fc-905f-4530-a264-3c459b482421 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:15:11.561681 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f355b816-c1a8-49b7-8832-94ca6dd7f489 req-a95526fc-905f-4530-a264-3c459b482421 service nova] Creating event network-changed:3da34330-1b93-479f-b3eb-700929a92378 for instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce on n-h1-862416-2 Oct 22 04:15:11.566975 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f355b816-c1a8-49b7-8832-94ca6dd7f489 req-a95526fc-905f-4530-a264-3c459b482421 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047699 Oct 22 04:15:11.567467 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3835/7531] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:15:12.513921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1020122857"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:15:12.514458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:15:12.521183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:15:12.522295 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:15:12.522851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:15:12.523566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:15:12.524056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:15:12.524509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:15:12.658986 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.network.security_group_api [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Adding security group 818632e6-7623-4139-a83b-6e7f27755f0c to port 3da34330-1b93-479f-b3eb-700929a92378 Oct 22 04:15:12.986312 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff0f3579-a651-48ac-b839-a6f2543e3c52 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.476504 Oct 22 04:15:12.989028 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3697/7532] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:15:12 2022] POST /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:15:12.998223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:15:12.998862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:15:13.017367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:15:13.018501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:15:13.018960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:15:13.019678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:15:13.020143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:15:13.020765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:15:13.171639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:15:13.180663 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a089702-2a0b-4eb2-8349-95923d638a5f tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1760 microversion: 2.1 time: 0.187869 Oct 22 04:15:13.181269 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3836/7533] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:15:12 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1760 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:15:13.585659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-73205679-3e72-44f1-a5a4-13fdedaecac8 req-aff55be1-4a75-4c6e-a0df-525a5e3d2fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e7c1b7-7c82-46b4-85d5-e76e1517a2ce", "tag": "3da34330-1b93-479f-b3eb-700929a92378"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:15:13.595224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-73205679-3e72-44f1-a5a4-13fdedaecac8 req-aff55be1-4a75-4c6e-a0df-525a5e3d2fee service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:15:13.595696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-73205679-3e72-44f1-a5a4-13fdedaecac8 req-aff55be1-4a75-4c6e-a0df-525a5e3d2fee service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:15:13.596121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-73205679-3e72-44f1-a5a4-13fdedaecac8 req-aff55be1-4a75-4c6e-a0df-525a5e3d2fee service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:15:13.608028 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-73205679-3e72-44f1-a5a4-13fdedaecac8 req-aff55be1-4a75-4c6e-a0df-525a5e3d2fee service nova] Creating event network-changed:3da34330-1b93-479f-b3eb-700929a92378 for instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce on n-h1-862416-2 Oct 22 04:15:13.613082 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-73205679-3e72-44f1-a5a4-13fdedaecac8 req-aff55be1-4a75-4c6e-a0df-525a5e3d2fee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033140 Oct 22 04:15:13.613676 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3698/7534] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:16:52.331304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:16:52.332112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:16:52.333983 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 22 04:16:52.334912 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:16:52.335069 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:16:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/action (ip 10.222.0.25) !!! Oct 22 04:16:52.339291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:16:52.342521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:16:52.354724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:16:52.355218 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:16:52.355668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:16:52.356401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:16:52.357457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:16:52.358451 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:16:52.431380 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7b8a2da-c1b3-4479-a24b-be1340128774 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.101767 Oct 22 04:16:52.435117 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3837/7535] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:16:52 2022] POST /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:16:52.439207 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [699f8291-3d66-4313-98db-f3446285e6fa] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:16:52.439774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:16:52.440684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:16:52.441642 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 22 04:16:52.448807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:16:52.449502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:16:52.456476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:16:52.456965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:16:52.457401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:16:52.458160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:16:52.458637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:16:52.459068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:16:52.701188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:16:52.709649 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18f20e49-9a00-4d85-92f9-53ad8e1179f3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1762 microversion: 2.1 time: 0.272822 Oct 22 04:16:52.710228 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3699/7536] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:16:52 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1762 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:16:53.735178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:16:53.735800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:16:53.738420 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61cb36d1-88e4-4398-80a4-3c83b9903fa2] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:16:53.743632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:16:53.744124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:16:53.744631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:16:53.745333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:16:53.745793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:16:53.746228 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:16:53.893579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:16:53.902198 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eff0f838-64fb-49ee-a34c-19820ce63fd2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1760 microversion: 2.1 time: 0.172492 Oct 22 04:16:53.902780 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3838/7537] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:16:53 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:07.527148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:07.527934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:07.533412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1020122857"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:07.533953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:07.542408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:07.542891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:07.543329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:07.544051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:07.544534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:07.544962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:07.548412 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] [699f8291-3d66-4313-98db-f3446285e6fa] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36506. Oct 22 04:18:07.811961 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.network.security_group_api [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Removing security group 818632e6-7623-4139-a83b-6e7f27755f0c from port 3da34330-1b93-479f-b3eb-700929a92378 Oct 22 04:18:08.111620 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fd711762-14df-4982-9939-4fa117aa06ec tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.586410 Oct 22 04:18:08.115566 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3700/7538] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:18:07 2022] POST /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:18:08.119539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:08.121290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:08.131847 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] [61cb36d1-88e4-4398-80a4-3c83b9903fa2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36516. Oct 22 04:18:08.136817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d8184997-38a5-4538-ac58-c83c59a61322 req-da9bae9d-2938-40f9-83c2-b2c588b7062e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e7c1b7-7c82-46b4-85d5-e76e1517a2ce", "tag": "3da34330-1b93-479f-b3eb-700929a92378"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:08.148149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d8184997-38a5-4538-ac58-c83c59a61322 req-da9bae9d-2938-40f9-83c2-b2c588b7062e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:08.148776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d8184997-38a5-4538-ac58-c83c59a61322 req-da9bae9d-2938-40f9-83c2-b2c588b7062e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:08.149352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d8184997-38a5-4538-ac58-c83c59a61322 req-da9bae9d-2938-40f9-83c2-b2c588b7062e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:08.166712 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d8184997-38a5-4538-ac58-c83c59a61322 req-da9bae9d-2938-40f9-83c2-b2c588b7062e service nova] Creating event network-changed:3da34330-1b93-479f-b3eb-700929a92378 for instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce on n-h1-862416-2 Oct 22 04:18:08.173219 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d8184997-38a5-4538-ac58-c83c59a61322 req-da9bae9d-2938-40f9-83c2-b2c588b7062e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056943 Oct 22 04:18:08.174251 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3839/7539] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:09.569308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:09.569829 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:09.575880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:09.576410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:09.577033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:09.577738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:09.578200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:09.578634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:09.662368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lazy-loading 'services' on Instance uuid 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:18:09.737027 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [9c92a63e-087b-4550-ac5e-8c856b953126] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:18:10.189007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-51739daa-a460-42aa-b074-68942492e3c3 req-a616f17e-c2d0-4422-9e09-5794b77a35d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e7c1b7-7c82-46b4-85d5-e76e1517a2ce", "tag": "3da34330-1b93-479f-b3eb-700929a92378"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:10.200245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-51739daa-a460-42aa-b074-68942492e3c3 req-a616f17e-c2d0-4422-9e09-5794b77a35d6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:10.200731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-51739daa-a460-42aa-b074-68942492e3c3 req-a616f17e-c2d0-4422-9e09-5794b77a35d6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:10.201172 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-51739daa-a460-42aa-b074-68942492e3c3 req-a616f17e-c2d0-4422-9e09-5794b77a35d6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:10.212771 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-51739daa-a460-42aa-b074-68942492e3c3 req-a616f17e-c2d0-4422-9e09-5794b77a35d6 service nova] Creating event network-changed:3da34330-1b93-479f-b3eb-700929a92378 for instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce on n-h1-862416-2 Oct 22 04:18:10.218512 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-51739daa-a460-42aa-b074-68942492e3c3 req-a616f17e-c2d0-4422-9e09-5794b77a35d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032826 Oct 22 04:18:10.219728 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3840/7540] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:18:10.745900 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [9c92a63e-087b-4550-ac5e-8c856b953126] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36538. Oct 22 04:18:10.750538 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9dd03358-32d4-4771-b57c-ad4f6a21e500 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments/96fb658d-2f49-4e4d-9e36-c691162c3529" status: 202 len: 0 microversion: 2.1 time: 1.186536 Oct 22 04:18:10.751097 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3701/7541] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:18:09 2022] DELETE /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments/96fb658d-2f49-4e4d-9e36-c691162c3529 => generated 0 bytes in 1188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:18:10.761128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:10.765194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:10.774831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:10.775352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:10.775818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:10.776587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:10.777069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:10.777519 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:10.814962 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fbba2bad-3823-4e6d-93e3-a1d5f7b3eddd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059277 Oct 22 04:18:10.817916 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3841/7542] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:18:10 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:11.829016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:11.831271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:11.840799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:11.841280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:11.841715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:11.842515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:11.843302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:11.843735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:11.876404 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ae340fe8-5eb0-48dc-9c76-75a280c6af89 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053035 Oct 22 04:18:11.876988 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3702/7543] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:18:11 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:12.890495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:12.893386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:12.901748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:12.902250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:12.902696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:12.903410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:12.903885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:12.904345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:12.939290 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e12f2902-5269-4193-97e2-b37a49695bb9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054064 Oct 22 04:18:12.939886 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3842/7544] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:18:12 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:13.951186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:13.953558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:13.960462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:13.960942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:13.961388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:13.962126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:13.962583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:13.963013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:13.994049 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a5f767e5-1370-401f-a0af-dc19ac07782a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046928 Oct 22 04:18:13.994711 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3703/7545] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:18:13 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:15.009720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:15.011974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:15.019003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:15.019503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:15.020221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:15.021054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:15.021523 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:15.021958 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:15.052563 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-444d1064-80e2-40de-a138-7d2c26e8e107 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048380 Oct 22 04:18:15.053158 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3843/7546] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:18:15 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:16.065939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:16.067987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:16.074937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:16.075419 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:16.075859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:16.077250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:16.077708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:16.078135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:16.107513 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43c94d91-c7eb-4805-8380-96f55ddb4deb tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046188 Oct 22 04:18:16.108170 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3704/7547] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:18:16 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 04:18:16.119174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:16.119706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:16.127535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:16.128028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:16.128498 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:16.129282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:16.129743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:16.130176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:16.312765 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] HTTP exception thrown: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce is not attached to volume 96fb658d-2f49-4e4d-9e36-c691162c3529 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Request method failure captured: Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments/96fb658d-2f49-4e4d-9e36-c691162c3529 HTTP/1.1 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU24b95qidmiOTou939zBAXZYIEhAlnM7TD3UZgNG2fnyxhJpwB6O8i9KrlBSNWe3oY1vqE2B1UmAxk4iLWe_WMnSGyoy75rkT1Gys_1HCdsNmcnGXS1hWTQhoLx0b9QfAYLFUOTq4KgCZqE3noNwn80YTBzk3G-hERiPTX6ADPT4hWM Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5825d0ab593c4874a5f5ec4e8357c7fe Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5825d0ab593c4874a5f5ec4e8357c7fe"}]}] Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5825d0ab593c4874a5f5ec4e8357c7fe Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestMinimumBasicScenario-626796463-project Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7b07367315da45a5943d45cba2b7a23f Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestMinimumBasicScenario-626796463-project Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce is not attached to volume 96fb658d-2f49-4e4d-9e36-c691162c3529 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': '88e7c1b7-7c82-46b4-85d5-e76e1517a2ce', 'id': '96fb658d-2f49-4e4d-9e36-c691162c3529'} Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 96fb658d-2f49-4e4d-9e36-c691162c3529. Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce is not attached to volume 96fb658d-2f49-4e4d-9e36-c691162c3529 Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:18:16.314758 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:18:16.319064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:18:16.319064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:18:16.319064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce is not attached to volume 96fb658d-2f49-4e4d-9e36-c691162c3529 Oct 22 04:18:16.319064 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:16.319064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Returning 404 to user: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce is not attached to volume 96fb658d-2f49-4e4d-9e36-c691162c3529 {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:18:16.319064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-326deb15-6db3-4429-86e3-1bb5e5336225 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments/96fb658d-2f49-4e4d-9e36-c691162c3529" status: 404 len: 154 microversion: 2.1 time: 0.201186 Oct 22 04:18:16.319064 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3844/7548] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:18:16 2022] DELETE /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce/os-volume_attachments/96fb658d-2f49-4e4d-9e36-c691162c3529 => generated 154 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:18:19.570542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:19.571141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:19.578166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:19.578651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:19.579089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:19.579788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:19.580336 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:19.580801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:19.605856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:18:19.692956 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2596b05-0ace-4447-9d3a-d5f8cdc0ca35 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 204 len: 0 microversion: 2.1 time: 0.126063 Oct 22 04:18:19.694127 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3705/7549] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:18:19 2022] DELETE /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:18:19.702752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:19.703437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:19.711574 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:19.712085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:19.712583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:19.713510 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:19.714990 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:19.715440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:19.855189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:19.864702 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1a8f22d0-22cd-452f-b0d9-5e1598605a03 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1554 microversion: 2.1 time: 0.166295 Oct 22 04:18:19.865326 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3845/7550] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:19 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:20.889765 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:20.890463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:20.897517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:20.897997 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:20.898436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:20.899120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:20.899568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:20.899989 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:21.036445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:21.044157 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-81b30b81-3800-48bf-864e-1acc905f2122 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1554 microversion: 2.1 time: 0.159201 Oct 22 04:18:21.044758 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3706/7551] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:20 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:21.985060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b8e4de9b-df4a-42e0-8ec6-b1fa84f3ad0f req-893a3801-9c8f-4b32-acb0-4997a2af601b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e7c1b7-7c82-46b4-85d5-e76e1517a2ce", "name": "network-vif-deleted", "tag": "3da34330-1b93-479f-b3eb-700929a92378"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:22.000248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b8e4de9b-df4a-42e0-8ec6-b1fa84f3ad0f req-893a3801-9c8f-4b32-acb0-4997a2af601b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:22.000759 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b8e4de9b-df4a-42e0-8ec6-b1fa84f3ad0f req-893a3801-9c8f-4b32-acb0-4997a2af601b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:22.001205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b8e4de9b-df4a-42e0-8ec6-b1fa84f3ad0f req-893a3801-9c8f-4b32-acb0-4997a2af601b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:22.013612 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b8e4de9b-df4a-42e0-8ec6-b1fa84f3ad0f req-893a3801-9c8f-4b32-acb0-4997a2af601b service nova] Creating event network-vif-deleted:3da34330-1b93-479f-b3eb-700929a92378 for instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce on n-h1-862416-2 Oct 22 04:18:22.019476 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b8e4de9b-df4a-42e0-8ec6-b1fa84f3ad0f req-893a3801-9c8f-4b32-acb0-4997a2af601b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038781 Oct 22 04:18:22.020394 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3846/7552] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:22.068418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:22.069036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:22.075952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:22.077137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:22.077616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:22.078290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:22.078755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:22.079188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:22.110674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:22.111077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:22.111593 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:22.112050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lazy-loading 'fault' on Instance uuid 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:18:22.154913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:22.162743 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-22438332-fd1f-4dc0-ab55-fe87f93abd0a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 200 len: 1348 microversion: 2.1 time: 0.098420 Oct 22 04:18:22.163284 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3707/7553] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:22 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:23.190065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:23.190801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:23.196973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:23.197465 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:23.197912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:23.198616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:23.199081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:23.199520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:23.213931 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] HTTP exception thrown: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce could not be found. Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Request method failure captured: Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce HTTP/1.1 Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU24b95qidmiOTou939zBAXZYIEhAlnM7TD3UZgNG2fnyxhJpwB6O8i9KrlBSNWe3oY1vqE2B1UmAxk4iLWe_WMnSGyoy75rkT1Gys_1HCdsNmcnGXS1hWTQhoLx0b9QfAYLFUOTq4KgCZqE3noNwn80YTBzk3G-hERiPTX6ADPT4hWM Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5825d0ab593c4874a5f5ec4e8357c7fe Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5825d0ab593c4874a5f5ec4e8357c7fe"}]}] Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5825d0ab593c4874a5f5ec4e8357c7fe Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestMinimumBasicScenario-626796463-project Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7b07367315da45a5943d45cba2b7a23f Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestMinimumBasicScenario-626796463-project Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce could not be found. Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '88e7c1b7-7c82-46b4-85d5-e76e1517a2ce'} Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce could not be found. Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce could not be found. Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:18:23.215551 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce could not be found. Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Returning 404 to user: Instance 88e7c1b7-7c82-46b4-85d5-e76e1517a2ce could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7efed12-ea5b-43b9-84d8-713c56a94648 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce" status: 404 len: 111 microversion: 2.1 time: 0.032821 Oct 22 04:18:23.220342 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3847/7554] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:23 2022] GET /compute/v2.1/servers/88e7c1b7-7c82-46b4-85d5-e76e1517a2ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:18:23.225889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a4c4b42-1d05-4723-9172-a50903003dd8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '.version_select at 0x7f0d1e534ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:23.250667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a4c4b42-1d05-4723-9172-a50903003dd8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-245500517" status: 202 len: 0 microversion: 2.1 time: 0.028547 Oct 22 04:18:23.251240 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3708/7555] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Oct 22 04:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-245500517 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:18:32.507019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e789db65-e290-4faa-9b1a-f3f5277b3cf4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'create', calling method: .version_select at 0x7f0d18ab4e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1821459807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCFpC050gjzUSAsStMIHEHF7vXKKheg0LsdHnB/plxplHL3ajEHBMyHYAzJ/fjqVX8aRFvGN1Q69X88/IiGR4ZfZMX/hWe7L+Z/9EPX/b77/UNv8z+m/Uq+NytmJco6nA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:32.525823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-e789db65-e290-4faa-9b1a-f3f5277b3cf4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Getting quotas for project 5825d0ab593c4874a5f5ec4e8357c7fe. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:18:32.531024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-e789db65-e290-4faa-9b1a-f3f5277b3cf4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Getting quotas for user 7b07367315da45a5943d45cba2b7a23f and project 5825d0ab593c4874a5f5ec4e8357c7fe. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:18:32.556801 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e789db65-e290-4faa-9b1a-f3f5277b3cf4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053653 Oct 22 04:18:32.557385 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3848/7556] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:18:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:32.604557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:32.605580 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:18:32.605884 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:18:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 22 04:18:32.613457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1961424551", "imageRef": "a59a9934-36f0-465a-a136-b5f481465dfb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1821459807", "networks": [{"uuid": "c4dfd6c2-ee19-4197-9807-b4b72afcd90a"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:32.667656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] validate_networks() for [('c4dfd6c2-ee19-4197-9807-b4b72afcd90a', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:18:33.088423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:18:33.088890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:18:33.089360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:18:33.089762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:18:33.090171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:18:33.099834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:33.100705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:33.101482 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:33.102790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:33.103633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:33.104478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:33.124235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Getting quotas for project 5825d0ab593c4874a5f5ec4e8357c7fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:18:33.129359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Getting quotas for user 7b07367315da45a5943d45cba2b7a23f and project 5825d0ab593c4874a5f5ec4e8357c7fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:18:33.141560 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:18:33.143773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a59a9934-36f0-465a-a136-b5f481465dfb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:18:33.189564 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-159dc344-e032-4460-aa73-5f3d93bf2823 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586778 Oct 22 04:18:33.190215 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3709/7557] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:18:33.201231 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-08c3508e-47f5-4291-b81b-bcc1e8ea7163 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:33.201960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-08c3508e-47f5-4291-b81b-bcc1e8ea7163 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:33.206561 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=38 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:33.260348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-08c3508e-47f5-4291-b81b-bcc1e8ea7163 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:33.267408 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-08c3508e-47f5-4291-b81b-bcc1e8ea7163 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1259 microversion: 2.1 time: 0.070084 Oct 22 04:18:33.268162 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3849/7558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:33 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:34.293118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:34.293118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:34.303793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:34.304498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:34.304758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:34.305497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:34.305970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:34.306407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:34.383483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:34.392236 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff33b9f8-3a09-4670-9af6-5f51e2ed642d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1329 microversion: 2.1 time: 0.105014 Oct 22 04:18:34.402741 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3710/7559] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:34 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1329 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:35.417281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:35.417994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:35.425877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:35.426379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:35.426828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:35.427532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:35.427995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:35.428466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:35.583383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:35.591427 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8a3772f-efa7-4bb7-9c37-8b1addcaa4a2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.178045 Oct 22 04:18:35.592125 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3850/7560] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:35 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:36.615301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:36.617068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:36.625962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:36.626451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:36.626886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:36.627599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:36.628048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:36.628497 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:36.776424 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:36.784408 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-59c055ea-46a2-432d-b631-51153fe2cce6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.172999 Oct 22 04:18:36.784981 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3711/7561] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:36 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:37.808669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:37.809205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:37.817505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:37.818014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:37.818477 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:37.819204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:37.819679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:37.820155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:37.961449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:37.970051 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5d6df82a-5b87-4568-874c-b16ddced0935 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.165390 Oct 22 04:18:37.970948 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3851/7562] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:37 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:38.994956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:38.995589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:38.998655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:39.004171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:39.004688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:39.005127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:39.005841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:39.006298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:39.006728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:39.150275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:39.159698 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0173389-1f72-4980-a245-a688c0ac58e4 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.168801 Oct 22 04:18:39.161027 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3712/7563] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:38 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:40.183007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:40.183633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:40.186766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:40.192044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:40.192576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:40.193025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:40.193732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:40.194224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:40.194647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:40.336661 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:40.344816 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-902df638-94b5-4897-9600-bad674276a94 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.165696 Oct 22 04:18:40.345395 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3852/7564] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:40 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:41.377491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:41.378139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:41.385626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:41.386114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:41.386555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:41.387259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:41.387712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:41.388140 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:41.532956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:41.540640 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3bfc1c05-9a54-4e73-b12c-cdb9083a44ca tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.174492 Oct 22 04:18:41.541212 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3713/7565] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:41 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:42.564132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:42.564801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:42.571640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:42.572129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:42.572602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:42.573343 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:42.573758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:42.574191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:42.705671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:42.713371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ab534fd-4a0d-4607-99a2-b1ba2729b4a0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.153697 Oct 22 04:18:42.713969 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3853/7566] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:42 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:43.738861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:43.739477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:43.742189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:43.742902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:43.748470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:43.748960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:43.749400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:43.750099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:43.750553 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:43.750981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:43.883050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:43.891467 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-627ab69b-119c-4a29-b078-2604bb53bd69 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.156691 Oct 22 04:18:43.891974 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3714/7567] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:43 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:44.915339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:44.915878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:44.917763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:18:44.923727 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:44.924253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:44.924768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:44.925472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:44.925940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:44.926381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:45.333918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:45.341743 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ba09eab-7e6f-46ed-98ae-a724054680d1 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.430275 Oct 22 04:18:45.342321 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3854/7568] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:44 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:46.364762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:46.365444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:46.372422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:46.372953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:46.373395 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:46.374109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:46.374570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:46.374999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:46.572048 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:46.580478 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a658d1f6-e942-43c2-bfce-e66401753327 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.219608 Oct 22 04:18:46.581072 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3715/7569] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:46 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:46.772168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-668bbede-3a47-4ad5-997e-389d3a22ba63 req-21d66745-a6ea-4114-8286-d513ab893647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfb1d39-cb37-4943-be19-f84e7580301d", "tag": "ec01e3b1-4c16-449a-a216-ae29126c2e56"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:46.783638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-668bbede-3a47-4ad5-997e-389d3a22ba63 req-21d66745-a6ea-4114-8286-d513ab893647 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:46.784143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-668bbede-3a47-4ad5-997e-389d3a22ba63 req-21d66745-a6ea-4114-8286-d513ab893647 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:46.784623 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-668bbede-3a47-4ad5-997e-389d3a22ba63 req-21d66745-a6ea-4114-8286-d513ab893647 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:46.795766 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-668bbede-3a47-4ad5-997e-389d3a22ba63 req-21d66745-a6ea-4114-8286-d513ab893647 service nova] Creating event network-changed:ec01e3b1-4c16-449a-a216-ae29126c2e56 for instance 1dfb1d39-cb37-4943-be19-f84e7580301d on n-h2-862416-2 Oct 22 04:18:46.800735 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-668bbede-3a47-4ad5-997e-389d3a22ba63 req-21d66745-a6ea-4114-8286-d513ab893647 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100561 Oct 22 04:18:46.801331 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3855/7570] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:47.603326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:47.603936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:47.611465 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:47.611945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:47.612417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:47.613117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:47.613569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:47.613994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:47.745583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:47.753292 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-93a8554f-62e8-4f23-a0c9-23c84d0e73c6 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.153891 Oct 22 04:18:47.753907 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3716/7571] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:47 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:48.778540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:48.780226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:48.786330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:48.786821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:48.787266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:48.787962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:48.788454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:48.788888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:48.916589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:48.924751 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ae194a3-2ebe-4a89-b38d-bccc730680d0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.151396 Oct 22 04:18:48.925315 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3856/7572] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:48 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:49.947640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:49.948277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:49.955753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:49.956260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:49.956704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:49.957398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:49.957846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:49.958269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:50.088814 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:50.096661 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6776eaba-78ea-416c-aade-a565db27f709 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.152905 Oct 22 04:18:50.097245 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3717/7573] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:49 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:51.120608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:51.121148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:51.128685 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:51.129190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:51.129648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:51.130360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:51.130837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:51.131282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:51.265050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:51.273020 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-51e42acf-ab6e-46a0-9d6d-a9a45ad40243 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.156479 Oct 22 04:18:51.273597 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3857/7574] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:51 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:52.297722 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:52.298342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:52.306144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:52.306937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:52.307726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:52.308567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:52.309146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:52.309689 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:52.333625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-82437abb-b537-482a-aa95-afc9cc3cb63b req-4c14d0d6-4430-4466-b705-89171e11acc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfb1d39-cb37-4943-be19-f84e7580301d", "name": "network-vif-plugged", "status": "completed", "tag": "ec01e3b1-4c16-449a-a216-ae29126c2e56"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:52.344595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-82437abb-b537-482a-aa95-afc9cc3cb63b req-4c14d0d6-4430-4466-b705-89171e11acc4 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:52.345079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-82437abb-b537-482a-aa95-afc9cc3cb63b req-4c14d0d6-4430-4466-b705-89171e11acc4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:52.345509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-82437abb-b537-482a-aa95-afc9cc3cb63b req-4c14d0d6-4430-4466-b705-89171e11acc4 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:52.357636 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-82437abb-b537-482a-aa95-afc9cc3cb63b req-4c14d0d6-4430-4466-b705-89171e11acc4 service nova] Creating event network-vif-plugged:ec01e3b1-4c16-449a-a216-ae29126c2e56 for instance 1dfb1d39-cb37-4943-be19-f84e7580301d on n-h2-862416-2 Oct 22 04:18:52.362822 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-82437abb-b537-482a-aa95-afc9cc3cb63b req-4c14d0d6-4430-4466-b705-89171e11acc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100393 Oct 22 04:18:52.363426 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3718/7575] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:52.453991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:52.461912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03d30d90-c134-44b0-a447-ce66beb9ac4e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.169099 Oct 22 04:18:52.462971 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3858/7576] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:52 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:18:53.485982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:53.486684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:53.492840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:53.493320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:53.493766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:53.494455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:53.494908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:53.495334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:53.630092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:53.637890 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6af12b0-82ef-4009-920e-e34206f610c7 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1359 microversion: 2.1 time: 0.157174 Oct 22 04:18:53.639073 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3719/7577] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:53 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:54.661316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:54.661938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:54.668985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:54.669534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:54.669996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:54.670714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:54.671190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:54.671636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:54.803555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:54.811327 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30c6ca4e-7a0c-4638-bee6-d3fbf775d219 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1549 microversion: 2.1 time: 0.154045 Oct 22 04:18:54.811905 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3859/7578] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:54 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:54.834438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:54.835059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:54.842913 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:54.843404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:54.843878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:54.844625 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:54.845087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:54.845525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:54.972037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:54.979805 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-573bd54c-e91d-4c5b-be87-7282dc036439 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1549 microversion: 2.1 time: 0.149271 Oct 22 04:18:54.980415 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3720/7579] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:54 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:55.003200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:55.007886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:55.008696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Searching by: {'deleted': False, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe'} {{(pid=120581) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 22 04:18:55.014726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:55.015223 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:55.015681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:55.016457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:55.016930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:55.017379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:55.042986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.multi_cell_list [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 22 04:18:55.069735 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1b6e8a97-30f7-4941-aa9d-33c340bf6ada tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070472 Oct 22 04:18:55.070348 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3860/7580] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Oct 22 04:18:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:18:55.083319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:18:55.083919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:55.089978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:55.090458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:55.090895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:55.092175 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:55.092654 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:55.093087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:55.226244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:18:55.235085 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-eb438c49-294b-46d1-b3b0-c8b87e7a1357 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1549 microversion: 2.1 time: 0.155626 Oct 22 04:18:55.235668 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3721/7581] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:18:55 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:18:56.746315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f41c0eb-907c-4b95-b392-317fc457e78f"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:18:56.751266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:18:56.758177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:56.758669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:56.759118 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:56.759823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:18:56.760316 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:18:56.760896 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:18:56.995730 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c104317-671b-4a5c-af7e-d33dff19e86a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253225 Oct 22 04:18:56.996454 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3861/7582] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Oct 22 04:18:56 2022] POST /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:19:07.763572 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:19:07.764176 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:19:07.766816 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=19 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:19:07.768035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=70 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:19:07.775066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:19:07.775563 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:19:07.776036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:19:07.776806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:19:07.777269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:19:07.777703 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:19:07.906390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:19:07.914504 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9daac1c0-dc9d-42eb-8654-71423c4f81de tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1595 microversion: 2.1 time: 0.156075 Oct 22 04:19:07.915075 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3722/7583] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:19:07 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:19:09.501277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d689951a-5f19-4840-b5e0-e558c12f551e req-466e6c5c-77d0-4373-8a33-c17ec5a38e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfb1d39-cb37-4943-be19-f84e7580301d", "tag": "ec01e3b1-4c16-449a-a216-ae29126c2e56"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:19:09.512282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:19:09.513125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=19 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:19:09.513862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:19:09.516277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d689951a-5f19-4840-b5e0-e558c12f551e req-466e6c5c-77d0-4373-8a33-c17ec5a38e33 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:19:09.516977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d689951a-5f19-4840-b5e0-e558c12f551e req-466e6c5c-77d0-4373-8a33-c17ec5a38e33 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:19:09.517644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d689951a-5f19-4840-b5e0-e558c12f551e req-466e6c5c-77d0-4373-8a33-c17ec5a38e33 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:19:09.530559 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d689951a-5f19-4840-b5e0-e558c12f551e req-466e6c5c-77d0-4373-8a33-c17ec5a38e33 service nova] Creating event network-changed:ec01e3b1-4c16-449a-a216-ae29126c2e56 for instance 1dfb1d39-cb37-4943-be19-f84e7580301d on n-h2-862416-2 Oct 22 04:19:09.537054 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d689951a-5f19-4840-b5e0-e558c12f551e req-466e6c5c-77d0-4373-8a33-c17ec5a38e33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041057 Oct 22 04:19:09.538123 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3862/7584] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:19:10.511496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1406876003"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:19:10.512115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:19:10.519427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:19:10.520261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:19:10.520806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:19:10.521589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:19:10.522118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:19:10.522622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:19:10.662494 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.network.security_group_api [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Adding security group be9c902b-6cef-4b81-bc9f-2294a74f0ea3 to port ec01e3b1-4c16-449a-a216-ae29126c2e56 Oct 22 04:19:10.975964 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d5996680-4c23-42bb-a493-48809933b932 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/action" status: 202 len: 0 microversion: 2.1 time: 0.468371 Oct 22 04:19:10.976627 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3723/7585] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:19:10 2022] POST /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:19:10.987327 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:19:10.988187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:19:10.995567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:19:10.996073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:19:10.996740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:19:10.998092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:19:10.998678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:19:10.999061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:19:11.151649 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:19:11.160049 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-87c7d6a1-e5e7-4bff-9435-f99120bc58c3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1761 microversion: 2.1 time: 0.179017 Oct 22 04:19:11.160670 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3863/7586] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:19:10 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1761 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:19:11.553411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-8d640111-9e0c-4dbc-9076-cf475588b775 req-255022e5-810f-4b9a-a57d-9c29baca8122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfb1d39-cb37-4943-be19-f84e7580301d", "tag": "ec01e3b1-4c16-449a-a216-ae29126c2e56"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:19:11.563045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8d640111-9e0c-4dbc-9076-cf475588b775 req-255022e5-810f-4b9a-a57d-9c29baca8122 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:19:11.563519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8d640111-9e0c-4dbc-9076-cf475588b775 req-255022e5-810f-4b9a-a57d-9c29baca8122 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:19:11.563945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-8d640111-9e0c-4dbc-9076-cf475588b775 req-255022e5-810f-4b9a-a57d-9c29baca8122 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:19:11.575308 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-8d640111-9e0c-4dbc-9076-cf475588b775 req-255022e5-810f-4b9a-a57d-9c29baca8122 service nova] Creating event network-changed:ec01e3b1-4c16-449a-a216-ae29126c2e56 for instance 1dfb1d39-cb37-4943-be19-f84e7580301d on n-h2-862416-2 Oct 22 04:19:11.580235 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-8d640111-9e0c-4dbc-9076-cf475588b775 req-255022e5-810f-4b9a-a57d-9c29baca8122 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030938 Oct 22 04:19:11.580916 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3724/7587] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:20:05.327423 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:20:05.328123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:20:05.371200 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:20:05.374112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:05.380006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:05.380537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:05.380985 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:05.381681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:05.382147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:05.382584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:05.455494 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-186b331e-fa91-4303-beb9-df369d4f156e tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/action" status: 202 len: 0 microversion: 2.1 time: 0.134927 Oct 22 04:20:05.456225 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3864/7588] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:20:05 2022] POST /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:20:05.462708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:20:05.463445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:20:05.468707 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:05.469417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:05.476684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:05.477168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:05.477602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:05.478359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:05.478847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:05.479275 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:05.716806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:05.725226 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b6f627b2-64ef-45d1-bfde-41a0505129df tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1753 microversion: 2.1 time: 0.264509 Oct 22 04:20:05.725825 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3725/7589] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:05 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:06.752113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:06.752754 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:06.758931 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:06.759424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:06.759871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:06.760594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:06.761059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:06.761495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:06.908096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:06.916472 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-32b21035-33b1-41c6-af02-dbdf95df5b8a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.170668 Oct 22 04:20:06.917048 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3865/7590] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:06 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:07.941342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:07.941959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:07.948582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:07.949071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:07.949509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:07.950201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:07.950652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:07.951083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:08.098595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:08.106857 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b25246ed-0a97-4552-8f7d-913aefb337b2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.170090 Oct 22 04:20:08.107429 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3726/7591] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:07 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:09.130733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:09.131362 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:09.137796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:09.138293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:09.138746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:09.140299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:09.140772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:09.141216 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:09.286015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:09.294483 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0818abca-a669-428f-b54f-f880345a7e27 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.167742 Oct 22 04:20:09.295101 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3866/7592] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:09 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:20:10.317949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:10.318502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:10.325309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:10.325799 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:10.326237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:10.327564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:10.328029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:10.328499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:10.472522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:10.480852 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ad61e75b-93fd-479e-880e-eb8786d354ba tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.166922 Oct 22 04:20:10.481431 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3727/7593] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:10 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:11.505749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:11.506370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:11.513307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:11.513858 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:11.514532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:11.515168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:11.515640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:11.516089 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:11.669097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:11.678477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d6c0d72b-cb9e-44f2-9c81-44cb3df23db8 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.176688 Oct 22 04:20:11.679052 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3867/7594] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:11 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:12.701470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:12.702214 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:12.709791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:12.710272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:12.710708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:12.711407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:12.711858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:12.712314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:12.855749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:12.864331 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ff2a0bfc-ecad-4e71-8b88-8ec84e0e2a75 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.166739 Oct 22 04:20:12.864910 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3728/7595] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:12 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:13.888319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:13.889060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:13.892123 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:20:13.892289 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:20:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d (ip 10.222.0.25) !!! Oct 22 04:20:13.898996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:13.899520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:13.899972 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:13.900717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:13.901189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:13.901627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:14.044843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:14.053388 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-525c71da-476e-4bd8-9747-045fa8f40b06 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.169017 Oct 22 04:20:14.053965 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3868/7596] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:13 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:15.075936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:15.076722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:15.085720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:15.086206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:15.086641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:15.087344 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:15.087802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:15.088245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:15.267806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:15.277386 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d7ef27b1-6b8b-4485-a11a-b16a105dc230 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.205272 Oct 22 04:20:15.278184 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3729/7597] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:15 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:16.310084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:16.311334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:16.318408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:16.318912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:16.319373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:16.320088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:16.320597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:16.321046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:16.471349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:16.479826 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aff49ec7-3b29-42aa-9660-0c1d87343b36 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.173825 Oct 22 04:20:16.480428 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3869/7598] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:16 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:17.503902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:17.504526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:17.511389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:17.511862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:17.512321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:17.513012 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:17.513454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:17.515069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:17.657617 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:17.665975 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d7e26be1-7201-4bdf-8b5b-893803223e05 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.166036 Oct 22 04:20:17.666552 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3730/7599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:17 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:18.691254 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:18.691873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:18.698459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:18.698950 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:18.699396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:18.700092 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:18.700595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:18.701029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:18.842650 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:18.851198 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d8d9a023-0a9c-4322-9162-99f4437cb9d3 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.163907 Oct 22 04:20:18.851773 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3870/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:18 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:19.874918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:19.875530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:19.882228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:19.882697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:19.883124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:19.883801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:19.884269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:19.884693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:20.030755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:20.038852 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f15ecb1-7f5d-44cd-bf4b-c86a7e34b057 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.168155 Oct 22 04:20:20.039419 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3731/7601] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:19 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:20:21.063659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:21.064312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:21.071120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:21.071613 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:21.072059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:21.072793 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:21.073260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:21.073705 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:21.215359 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:21.223703 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2cac826c-6f12-4a83-b668-c1cbbd6f0cd9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1758 microversion: 2.1 time: 0.164552 Oct 22 04:20:21.224300 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3871/7602] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:21 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:20:22.246930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:20:22.247537 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:20:22.254550 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:22.255024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:22.255453 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:22.256137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:20:22.256626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:20:22.257033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:20:22.400609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:20:22.409638 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3cdfa436-9a0f-42b2-97f7-8ecdc4a20467 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1761 microversion: 2.1 time: 0.166618 Oct 22 04:20:22.410236 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3732/7603] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:20:22 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:17.996594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1406876003"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:21:17.997146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:17.999367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=16 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:18.000094 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:18.006542 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:18.007046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:18.007500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:18.008227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:18.008708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:18.009155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:18.145755 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.network.security_group_api [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Removing security group be9c902b-6cef-4b81-bc9f-2294a74f0ea3 from port ec01e3b1-4c16-449a-a216-ae29126c2e56 Oct 22 04:21:18.452884 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad293433-20a2-4e74-b621-3a601efcbf99 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "POST /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/action" status: 202 len: 0 microversion: 2.1 time: 0.461045 Oct 22 04:21:18.453754 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3872/7604] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:21:17 2022] POST /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:21:18.459179 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4937fa55-f991-417b-88b2-9cc53442bf17] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:21:18.463812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=16 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:18.464618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=48 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:18.540151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e3e19f2a-0e7b-43ef-9780-50d157549144 req-93ad03dd-1214-4748-830d-8b47c89aed8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfb1d39-cb37-4943-be19-f84e7580301d", "tag": "ec01e3b1-4c16-449a-a216-ae29126c2e56"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:21:18.550687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e3e19f2a-0e7b-43ef-9780-50d157549144 req-93ad03dd-1214-4748-830d-8b47c89aed8b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:18.551165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e3e19f2a-0e7b-43ef-9780-50d157549144 req-93ad03dd-1214-4748-830d-8b47c89aed8b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:18.551597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e3e19f2a-0e7b-43ef-9780-50d157549144 req-93ad03dd-1214-4748-830d-8b47c89aed8b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:18.563651 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e3e19f2a-0e7b-43ef-9780-50d157549144 req-93ad03dd-1214-4748-830d-8b47c89aed8b service nova] Creating event network-changed:ec01e3b1-4c16-449a-a216-ae29126c2e56 for instance 1dfb1d39-cb37-4943-be19-f84e7580301d on n-h2-862416-2 Oct 22 04:21:18.569397 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e3e19f2a-0e7b-43ef-9780-50d157549144 req-93ad03dd-1214-4748-830d-8b47c89aed8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111613 Oct 22 04:21:18.570115 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3733/7605] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:21:19.877045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:19.877634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:19.884175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:19.884706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:19.885164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:19.885891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:19.886363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:19.886804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:19.972988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lazy-loading 'services' on Instance uuid 1dfb1d39-cb37-4943-be19-f84e7580301d {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:21:20.046321 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b638e831-f2ce-4db6-a695-c5ac7ea2acf5 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments/9f41c0eb-907c-4b95-b392-317fc457e78f" status: 202 len: 0 microversion: 2.1 time: 0.174847 Oct 22 04:21:20.047102 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3873/7606] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:21:19 2022] DELETE /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments/9f41c0eb-907c-4b95-b392-317fc457e78f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:21:20.057710 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:20.060059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:20.069073 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:20.069606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:20.070064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:20.070766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:20.071226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:20.071680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:20.110734 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] [4937fa55-f991-417b-88b2-9cc53442bf17] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36948. Oct 22 04:21:20.125204 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e9c3aa0f-0dec-4645-b62a-023634ec079b tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073253 Oct 22 04:21:20.125798 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3734/7607] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:21:20 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:21:20.587486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-aee0b56f-8734-4e00-879c-113215093f05 req-c1fd567a-94d7-45e4-bd28-c1554e3cd4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfb1d39-cb37-4943-be19-f84e7580301d", "tag": "ec01e3b1-4c16-449a-a216-ae29126c2e56"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:21:20.598544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aee0b56f-8734-4e00-879c-113215093f05 req-c1fd567a-94d7-45e4-bd28-c1554e3cd4b6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:20.599040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aee0b56f-8734-4e00-879c-113215093f05 req-c1fd567a-94d7-45e4-bd28-c1554e3cd4b6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:20.599483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-aee0b56f-8734-4e00-879c-113215093f05 req-c1fd567a-94d7-45e4-bd28-c1554e3cd4b6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:20.612503 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-aee0b56f-8734-4e00-879c-113215093f05 req-c1fd567a-94d7-45e4-bd28-c1554e3cd4b6 service nova] Creating event network-changed:ec01e3b1-4c16-449a-a216-ae29126c2e56 for instance 1dfb1d39-cb37-4943-be19-f84e7580301d on n-h2-862416-2 Oct 22 04:21:20.617663 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-aee0b56f-8734-4e00-879c-113215093f05 req-c1fd567a-94d7-45e4-bd28-c1554e3cd4b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034331 Oct 22 04:21:20.618362 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3874/7608] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:21:21.139116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:21.143019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:21.150133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:21.150901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:21.151540 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:21.152526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:21.153174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:21.153824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:21.185747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-28780a11-f277-4539-9036-253564d6bd3a tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050575 Oct 22 04:21:21.186331 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3735/7609] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:21:21 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:21:22.200767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:22.203211 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:22.211313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:22.211821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:22.212298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:22.213032 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:22.213506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:22.213953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:22.244596 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-708ef68d-0b7d-4a5e-a0df-4fd119e7a964 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049064 Oct 22 04:21:22.245374 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3875/7610] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:21:22 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:21:23.257793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:23.259886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:23.267828 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:23.268337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:23.268773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:23.269468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:23.270197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:23.270624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:23.300407 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6a7603de-aca6-4b7e-970d-6831e03e9dcd tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Oct 22 04:21:23.300976 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3736/7611] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:21:23 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:21:24.313075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:24.315276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:24.322098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:24.322592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:24.323041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:24.323742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:24.324230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:24.324666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:24.354623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ab1d898-b1d3-4d59-9cc2-6548a9e7cba9 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045527 Oct 22 04:21:24.355130 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3876/7612] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:21:24 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:21:25.366738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:25.368937 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:25.376646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:25.377142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:25.377585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:25.378284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:25.378751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:25.379167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:25.407663 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-60abd30b-7ee4-4575-a572-f26e62a67ac2 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044871 Oct 22 04:21:25.408230 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3737/7613] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Oct 22 04:21:25 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 22 04:21:25.418907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:25.419410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:25.426904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:25.427404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:25.427862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:25.428605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:25.429090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:25.429541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:25.505681 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] HTTP exception thrown: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d is not attached to volume 9f41c0eb-907c-4b95-b392-317fc457e78f Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Request method failure captured: Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: request: DELETE /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments/9f41c0eb-907c-4b95-b392-317fc457e78f HTTP/1.1 Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU24b95qidmiOTou939zBAXZYIEhAlnM7TD3UZgNG2fnyxhJpwB6O8i9KrlBSNWe3oY1vqE2B1UmAxk4iLWe_WMnSGyoy75rkT1Gys_1HCdsNmcnGXS1hWTQhoLx0b9QfAYLFUOTq4KgCZqE3noNwn80YTBzk3G-hERiPTX6ADPT4hWM Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5825d0ab593c4874a5f5ec4e8357c7fe Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5825d0ab593c4874a5f5ec4e8357c7fe"}]}] Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5825d0ab593c4874a5f5ec4e8357c7fe Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestMinimumBasicScenario-626796463-project Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7b07367315da45a5943d45cba2b7a23f Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestMinimumBasicScenario-626796463-project Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d is not attached to volume 9f41c0eb-907c-4b95-b392-317fc457e78f Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'server_id': '1dfb1d39-cb37-4943-be19-f84e7580301d', 'id': '9f41c0eb-907c-4b95-b392-317fc457e78f'} Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9f41c0eb-907c-4b95-b392-317fc457e78f. Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d is not attached to volume 9f41c0eb-907c-4b95-b392-317fc457e78f Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:21:25.507341 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:21:25.512287 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:21:25.512287 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:21:25.512287 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d is not attached to volume 9f41c0eb-907c-4b95-b392-317fc457e78f Oct 22 04:21:25.512287 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:25.512287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Returning 404 to user: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d is not attached to volume 9f41c0eb-907c-4b95-b392-317fc457e78f {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:21:25.512287 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5feb52e7-ecb2-416d-a7aa-ae549149f0ac tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments/9f41c0eb-907c-4b95-b392-317fc457e78f" status: 404 len: 154 microversion: 2.1 time: 0.094075 Oct 22 04:21:25.512287 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3877/7614] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Oct 22 04:21:25 2022] DELETE /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d/os-volume_attachments/9f41c0eb-907c-4b95-b392-317fc457e78f => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:21:28.761912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:28.762436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:28.770452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:28.770950 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:28.771645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:28.772382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:28.772873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:28.773305 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:28.798869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:21:28.873522 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-03042b33-abda-43e0-914e-c7c45c1cc36d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 204 len: 0 microversion: 2.1 time: 0.115148 Oct 22 04:21:28.874124 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3738/7615] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:21:28 2022] DELETE /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:21:28.884573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:28.885240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:28.893528 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:28.894071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:28.894534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:28.895266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:28.895742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:28.896493 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:29.037085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:29.045076 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e30fcc1d-8a2d-4e19-83f4-90c6ce670bab tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1555 microversion: 2.1 time: 0.165341 Oct 22 04:21:29.045652 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3878/7616] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:28 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:30.069101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:30.069801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:30.077380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:30.077858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:30.078298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:30.079132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:30.079598 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:30.079930 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:30.207536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:30.215273 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-53fc1ea2-9e96-4617-8f5d-05920376a67d tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1555 microversion: 2.1 time: 0.150446 Oct 22 04:21:30.215840 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3739/7617] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:30 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:31.094579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-36da873f-5655-43e3-9b57-b9a3526050f4 req-4c42a0c6-850f-49d7-90e0-f6472d67e79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfb1d39-cb37-4943-be19-f84e7580301d", "name": "network-vif-deleted", "tag": "ec01e3b1-4c16-449a-a216-ae29126c2e56"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:21:31.108481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-36da873f-5655-43e3-9b57-b9a3526050f4 req-4c42a0c6-850f-49d7-90e0-f6472d67e79c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:31.109066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-36da873f-5655-43e3-9b57-b9a3526050f4 req-4c42a0c6-850f-49d7-90e0-f6472d67e79c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:31.110112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-36da873f-5655-43e3-9b57-b9a3526050f4 req-4c42a0c6-850f-49d7-90e0-f6472d67e79c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:31.122953 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-36da873f-5655-43e3-9b57-b9a3526050f4 req-4c42a0c6-850f-49d7-90e0-f6472d67e79c service nova] Creating event network-vif-deleted:ec01e3b1-4c16-449a-a216-ae29126c2e56 for instance 1dfb1d39-cb37-4943-be19-f84e7580301d on n-h2-862416-2 Oct 22 04:21:31.129477 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-36da873f-5655-43e3-9b57-b9a3526050f4 req-4c42a0c6-850f-49d7-90e0-f6472d67e79c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038785 Oct 22 04:21:31.130302 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3879/7618] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:21:31.239880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:31.240529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:31.247241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:31.247722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:31.248157 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:31.248949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:31.249385 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:31.249742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:31.285459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:31.285875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:31.286311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:31.286759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lazy-loading 'fault' on Instance uuid 1dfb1d39-cb37-4943-be19-f84e7580301d {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:21:31.330284 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b07367315da45a5943d45cba2b7a23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5825d0ab593c4874a5f5ec4e8357c7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:31.337905 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a92de2f-89dc-424c-8be9-be738f1b62ee tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 200 len: 1349 microversion: 2.1 time: 0.102461 Oct 22 04:21:31.338481 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3740/7619] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:31 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:32.360920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:32.361565 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] [instance: 1dfb1d39-cb37-4943-be19-f84e7580301d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:32.368596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:32.369088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:32.369538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:32.370238 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:32.370704 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:32.371145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:32.384720 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] HTTP exception thrown: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d could not be found. Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Request method failure captured: Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d HTTP/1.1 Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU24b95qidmiOTou939zBAXZYIEhAlnM7TD3UZgNG2fnyxhJpwB6O8i9KrlBSNWe3oY1vqE2B1UmAxk4iLWe_WMnSGyoy75rkT1Gys_1HCdsNmcnGXS1hWTQhoLx0b9QfAYLFUOTq4KgCZqE3noNwn80YTBzk3G-hERiPTX6ADPT4hWM Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 5825d0ab593c4874a5f5ec4e8357c7fe Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5825d0ab593c4874a5f5ec4e8357c7fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5825d0ab593c4874a5f5ec4e8357c7fe"}]}] Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 5825d0ab593c4874a5f5ec4e8357c7fe Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestMinimumBasicScenario-626796463 Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestMinimumBasicScenario-626796463-project Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 7b07367315da45a5943d45cba2b7a23f Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestMinimumBasicScenario-626796463-project Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d could not be found. Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1dfb1d39-cb37-4943-be19-f84e7580301d'} Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d could not be found. Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d could not be found. Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:21:32.386333 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d could not be found. Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Returning 404 to user: Instance 1dfb1d39-cb37-4943-be19-f84e7580301d could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3375a357-9a7b-45cf-bf2d-09c3ffbd7fce tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d" status: 404 len: 111 microversion: 2.1 time: 0.031249 Oct 22 04:21:32.391837 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3880/7620] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:32 2022] GET /compute/v2.1/servers/1dfb1d39-cb37-4943-be19-f84e7580301d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:21:32.397698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9e373c95-0d55-49df-8a04-bf5e8e417bb0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] Calling method '.version_select at 0x7f0d1e534ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:32.417600 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9e373c95-0d55-49df-8a04-bf5e8e417bb0 tempest-TestMinimumBasicScenario-626796463 tempest-TestMinimumBasicScenario-626796463-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1821459807" status: 202 len: 0 microversion: 2.1 time: 0.024003 Oct 22 04:21:32.418157 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3741/7621] 10.222.0.25 () {58 vars in 1272 bytes} [Sat Oct 22 04:21:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1821459807 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:21:41.713142 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-de694710-4626-4faa-8a4c-4633f7298d46 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: .version_select at 0x7f0d18256280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-394195163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGbww/UDe759PPYs3GOnS3muSRnA9aZK/qQjmjKf5gLA32uTMS+7QEFWsMpjuvti5zEkIEKYS7GVUsXgfO4NAg3p0vFdJeOfsP0RzQ2qaioG6M92GXDrUA9CDLkzrzTBw=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:21:41.729130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-de694710-4626-4faa-8a4c-4633f7298d46 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:21:41.737121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-de694710-4626-4faa-8a4c-4633f7298d46 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:21:41.750082 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [None req-de694710-4626-4faa-8a4c-4633f7298d46 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [a645337b-1e79-45c9-beee-538ed076e062] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:21:42.376323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:42.756438 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [None req-de694710-4626-4faa-8a4c-4633f7298d46 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [a645337b-1e79-45c9-beee-538ed076e062] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37126. Oct 22 04:21:42.772971 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-de694710-4626-4faa-8a4c-4633f7298d46 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.223170 Oct 22 04:21:42.773598 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3881/7622] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:21:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:21:48.403042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-176188519", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "83676705-8bd3-4cef-b132-ca5caa6e91e1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-394195163", "security_groups": [{"name": "tempest-secgroup-smoke-726262099"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:21:48.420893 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:48.422466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:48.574561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] validate_networks() for [('83676705-8bd3-4cef-b132-ca5caa6e91e1', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:21:49.016980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:21:49.017386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:21:49.018044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:21:49.018859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:21:49.020258 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:21:49.037365 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:49.038235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:49.038901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:49.039862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:49.040852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:49.041515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:49.071058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:21:49.083342 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:21:49.098749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:21:49.101689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:21:49.155262 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [6be31140-6fd0-468e-9e61-ee8df99b2160] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:21:50.164746 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [6be31140-6fd0-468e-9e61-ee8df99b2160] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37174. Oct 22 04:21:50.170785 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a2807656-c1b7-4d6f-bbee-7cf0be7bb417 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.775438 Oct 22 04:21:50.171701 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3742/7623] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:21:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:21:50.185321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-045927fa-3ffb-4429-8c9b-d892b5bbda2a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:50.186581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-045927fa-3ffb-4429-8c9b-d892b5bbda2a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:50.188979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:50.259031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-045927fa-3ffb-4429-8c9b-d892b5bbda2a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:50.268897 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-045927fa-3ffb-4429-8c9b-d892b5bbda2a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1265 microversion: 2.1 time: 0.088051 Oct 22 04:21:50.270265 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3882/7624] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:50 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:51.294194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:51.294805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:51.301685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:51.302169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:51.302604 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:51.303299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:51.303747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:51.304166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:51.373956 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:51.381789 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6dd41df8-b914-4fef-b0aa-987901eb6ae3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1317 microversion: 2.1 time: 0.092320 Oct 22 04:21:51.382373 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3743/7625] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:51 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1317 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:52.411959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:52.413111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:52.422155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:52.422804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:52.423387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:52.424246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:52.424837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:52.425395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:52.571310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:52.579375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-23edf5e6-6583-4478-90bc-418b67db5487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1390 microversion: 2.1 time: 0.172119 Oct 22 04:21:52.579967 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3883/7626] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:52 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:52.966547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2bcfa810-3e34-4071-aa76-63a9464bdffb req-fb59d998-7b94-407a-81ac-f4704aa20b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e90bb-e499-405a-bfd2-2aff155b503d", "tag": "e02404b0-d1fd-40f3-94ce-a889713ed422"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:21:52.980325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2bcfa810-3e34-4071-aa76-63a9464bdffb req-fb59d998-7b94-407a-81ac-f4704aa20b10 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:52.980812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2bcfa810-3e34-4071-aa76-63a9464bdffb req-fb59d998-7b94-407a-81ac-f4704aa20b10 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:52.981668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2bcfa810-3e34-4071-aa76-63a9464bdffb req-fb59d998-7b94-407a-81ac-f4704aa20b10 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:52.992680 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2bcfa810-3e34-4071-aa76-63a9464bdffb req-fb59d998-7b94-407a-81ac-f4704aa20b10 service nova] Creating event network-changed:e02404b0-d1fd-40f3-94ce-a889713ed422 for instance 562e90bb-e499-405a-bfd2-2aff155b503d on n-h1-862416-2 Oct 22 04:21:52.997490 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2bcfa810-3e34-4071-aa76-63a9464bdffb req-fb59d998-7b94-407a-81ac-f4704aa20b10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034729 Oct 22 04:21:52.998147 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3744/7627] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:21:53.602957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:53.603580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:53.611582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:53.612086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:53.612586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:53.613330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:53.613833 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:53.614306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:53.746679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:53.754402 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-697da1bb-65fd-4b9e-8dbf-1af239dbd19f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1390 microversion: 2.1 time: 0.155341 Oct 22 04:21:53.755204 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3884/7628] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:53 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:54.779980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:54.780826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:54.788643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:54.789120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:54.789552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:54.790250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:54.790696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:54.791118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:54.950976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:54.958908 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-677e70ac-c255-4461-8918-a2f204e172c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1390 microversion: 2.1 time: 0.184240 Oct 22 04:21:54.959478 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3745/7629] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:54 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1390 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:55.982051 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:55.982670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:55.991040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:55.991545 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:55.992350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:55.993605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:55.994467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:55.995286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:56.136418 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:56.144637 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-511a29cc-7a26-4a7c-9897-0e7f77d6fbc7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1390 microversion: 2.1 time: 0.166439 Oct 22 04:21:56.145316 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3885/7630] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:55 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:57.168164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:57.168819 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:57.176253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:57.176736 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:57.177178 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:57.177869 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:57.178322 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:57.178748 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:57.307197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:57.315029 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4c6807bc-818c-4453-b040-9cf5bc71c4a2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1390 microversion: 2.1 time: 0.150729 Oct 22 04:21:57.315599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3746/7631] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:57 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:57.965351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-fa397603-5db6-4668-a0a2-f8c7799448f3 req-3c38cafb-8723-4562-ae1b-29124fb6a307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e90bb-e499-405a-bfd2-2aff155b503d", "name": "network-vif-plugged", "status": "completed", "tag": "e02404b0-d1fd-40f3-94ce-a889713ed422"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:21:57.977546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fa397603-5db6-4668-a0a2-f8c7799448f3 req-3c38cafb-8723-4562-ae1b-29124fb6a307 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:57.978044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fa397603-5db6-4668-a0a2-f8c7799448f3 req-3c38cafb-8723-4562-ae1b-29124fb6a307 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:57.978488 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-fa397603-5db6-4668-a0a2-f8c7799448f3 req-3c38cafb-8723-4562-ae1b-29124fb6a307 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:57.989998 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-fa397603-5db6-4668-a0a2-f8c7799448f3 req-3c38cafb-8723-4562-ae1b-29124fb6a307 service nova] Creating event network-vif-plugged:e02404b0-d1fd-40f3-94ce-a889713ed422 for instance 562e90bb-e499-405a-bfd2-2aff155b503d on n-h1-862416-2 Oct 22 04:21:57.995058 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-fa397603-5db6-4668-a0a2-f8c7799448f3 req-3c38cafb-8723-4562-ae1b-29124fb6a307 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033704 Oct 22 04:21:57.995838 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3886/7632] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:21:58.337191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:58.337796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:58.344646 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:58.345122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:58.345556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:58.346241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:58.346690 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:58.347111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:58.482220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:58.491563 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1fc7932d-7327-47b9-89f6-3c22f9df8599 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1390 microversion: 2.1 time: 0.158197 Oct 22 04:21:58.492252 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3747/7633] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:58 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:59.515011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:59.515984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:59.523236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:59.523730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:59.524178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:59.524904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:59.525368 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:59.525808 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:59.663910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:59.672013 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bfd747a2-cd88-4a52-9928-ce25306c62dd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1562 microversion: 2.1 time: 0.161148 Oct 22 04:21:59.672744 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3887/7634] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:59 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:21:59.694873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:21:59.695485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:21:59.697462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:59.698135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:21:59.705693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:59.706179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:59.706624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:59.707315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:21:59.707770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:21:59.708197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:21:59.840575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:21:59.848916 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-22433980-6b6a-498b-8328-2c4557fc8859 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1562 microversion: 2.1 time: 0.157841 Oct 22 04:21:59.849496 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3748/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:21:59 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:01.681177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:01.681932 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:01.684094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-c516c0d6-6da6-4f53-a1cb-685323b33951 req-81ffde9a-ad30-4393-82e3-3e30975792df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e90bb-e499-405a-bfd2-2aff155b503d", "tag": "e02404b0-d1fd-40f3-94ce-a889713ed422"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:01.687190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:01.690909 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:01.691566 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:01.692062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:01.692841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:01.693312 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:01.693784 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:01.695952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c516c0d6-6da6-4f53-a1cb-685323b33951 req-81ffde9a-ad30-4393-82e3-3e30975792df service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:01.696500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c516c0d6-6da6-4f53-a1cb-685323b33951 req-81ffde9a-ad30-4393-82e3-3e30975792df service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:01.696953 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-c516c0d6-6da6-4f53-a1cb-685323b33951 req-81ffde9a-ad30-4393-82e3-3e30975792df service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:01.708589 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-c516c0d6-6da6-4f53-a1cb-685323b33951 req-81ffde9a-ad30-4393-82e3-3e30975792df service nova] Creating event network-changed:e02404b0-d1fd-40f3-94ce-a889713ed422 for instance 562e90bb-e499-405a-bfd2-2aff155b503d on n-h1-862416-2 Oct 22 04:22:01.713655 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-c516c0d6-6da6-4f53-a1cb-685323b33951 req-81ffde9a-ad30-4393-82e3-3e30975792df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034185 Oct 22 04:22:01.714367 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3749/7636] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:22:01.841723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:01.850484 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0fa33150-5b0c-4831-a60b-de391dc4f979 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1562 microversion: 2.1 time: 0.173506 Oct 22 04:22:01.851674 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3888/7637] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:01 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:25.111023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:25.111833 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=36 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:25.116724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:25.118963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:25.127649 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:25.128138 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:25.128611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:25.129314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:25.129768 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:25.130201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:25.180538 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d805f0c7-a743-4a9b-be62-68625894c213 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action" status: 200 len: 24554 microversion: 2.1 time: 0.071960 Oct 22 04:22:25.181190 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3750/7638] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:22:25 2022] POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action => generated 24554 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:22:36.092076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:36.092751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:36.095043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=15 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:36.095797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=32 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:36.101513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:36.102010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:36.102462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:36.103170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:36.103639 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:36.104080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:36.170162 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-869b7a30-6365-4f26-b0ec-237347a4b784 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action" status: 202 len: 0 microversion: 2.1 time: 0.081927 Oct 22 04:22:36.170797 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3889/7639] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:22:36 2022] POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:22:36.179781 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:36.180523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:36.184160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:36.185100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:36.194651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:36.195164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:36.195611 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:36.196356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:36.196838 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:36.197278 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:36.333234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:36.341201 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-583bec90-80db-4b66-ad9b-2d974a5e8549 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1685 microversion: 2.1 time: 0.165714 Oct 22 04:22:36.341775 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3751/7640] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:36 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:22:37.367562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:37.368334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:37.375232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:37.375732 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:37.376194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:37.376924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:37.377395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:37.377837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:37.510585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:37.518412 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f7cd7b7f-512b-4edc-8220-29a42f456451 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1665 microversion: 2.1 time: 0.156449 Oct 22 04:22:37.518988 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3890/7641] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:37 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:38.617653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:38.619922 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:38.627003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:38.627483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:38.627920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:38.628645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:38.629096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:38.629522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:38.689510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1ca49191-5657-4a4f-9f9b-06297a9613d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action" status: 200 len: 32623 microversion: 2.1 time: 0.075837 Oct 22 04:22:38.690381 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3752/7642] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:22:38 2022] POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action => generated 32623 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 22 04:22:38.702104 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:38.702659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:38.709536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:38.710041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:38.710499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:38.711462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:38.711967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:38.712458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:38.779878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f9ac6dd2-7dd6-4bbd-a4e6-ef6789280b71 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action" status: 202 len: 0 microversion: 2.1 time: 0.081552 Oct 22 04:22:38.783772 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3891/7643] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:22:38 2022] POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:22:38.790194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:38.790566 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:38.798544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:38.799033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:38.799489 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:38.800162 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:38.800685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:38.801060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:38.940299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:38.948151 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-04b5d0e7-1464-4312-9143-a91882480447 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1672 microversion: 2.1 time: 0.162925 Oct 22 04:22:38.948755 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3753/7644] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:38 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:39.974100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:39.974908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:39.981204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:39.981699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:39.982152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:39.982856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:39.983324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:39.984088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:40.118361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:40.127041 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b8681218-3c10-4870-b0f8-36a551797131 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1680 microversion: 2.1 time: 0.158160 Oct 22 04:22:40.127613 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3892/7645] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:39 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:40.225776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:40.227924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:40.236499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:40.236983 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:40.237423 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:40.238116 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:40.238576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:40.239001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:40.294036 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1cdf2b88-15e4-4d43-b57a-715181fbb25f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action" status: 200 len: 38372 microversion: 2.1 time: 0.072144 Oct 22 04:22:40.294672 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3754/7646] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:22:40 2022] POST /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d/action => generated 38372 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:22:41.275534 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:41.276749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:41.277884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d2cbd4d0-3080-4998-9e19-0c600893a4e0 req-282ed47b-1108-4d80-903d-bff7aeabaa43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e90bb-e499-405a-bfd2-2aff155b503d", "tag": "e02404b0-d1fd-40f3-94ce-a889713ed422"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:41.283517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:41.284124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:41.284680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:41.285476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:41.286056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:41.287048 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:41.290584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d2cbd4d0-3080-4998-9e19-0c600893a4e0 req-282ed47b-1108-4d80-903d-bff7aeabaa43 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:41.291062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d2cbd4d0-3080-4998-9e19-0c600893a4e0 req-282ed47b-1108-4d80-903d-bff7aeabaa43 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:41.291484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d2cbd4d0-3080-4998-9e19-0c600893a4e0 req-282ed47b-1108-4d80-903d-bff7aeabaa43 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:41.303824 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d2cbd4d0-3080-4998-9e19-0c600893a4e0 req-282ed47b-1108-4d80-903d-bff7aeabaa43 service nova] Creating event network-changed:e02404b0-d1fd-40f3-94ce-a889713ed422 for instance 562e90bb-e499-405a-bfd2-2aff155b503d on n-h1-862416-2 Oct 22 04:22:41.308715 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d2cbd4d0-3080-4998-9e19-0c600893a4e0 req-282ed47b-1108-4d80-903d-bff7aeabaa43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034930 Oct 22 04:22:41.309808 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3755/7647] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:22:41.316017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:22:41.406618 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-45d3035d-cdac-4c37-9951-4bac498f24e8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 204 len: 0 microversion: 2.1 time: 0.135339 Oct 22 04:22:41.408007 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3893/7648] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:22:41 2022] DELETE /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:22:41.416430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:41.417430 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:41.424755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:41.425637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:41.426298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:41.427227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:41.427885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:41.428549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:41.596804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:41.604451 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a9b57d3b-87ad-4d7e-aa56-616b7fa8469d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1686 microversion: 2.1 time: 0.192147 Oct 22 04:22:41.605043 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3756/7649] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:41 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1686 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:42.629810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:42.630538 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:42.637367 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:42.637873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:42.638332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:42.639056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:42.639535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:42.640614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:42.776567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:42.785686 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3e5a6232-dd56-4de4-a5e9-ada6aa096f4a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1686 microversion: 2.1 time: 0.160224 Oct 22 04:22:42.786381 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3894/7650] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:42 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:43.588921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-6f5252bf-de31-428a-a55c-dd018f647fb7 req-4176347a-aef8-4a5f-9ce7-42ced18e3bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e90bb-e499-405a-bfd2-2aff155b503d", "name": "network-vif-deleted", "tag": "e02404b0-d1fd-40f3-94ce-a889713ed422"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:43.599047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f5252bf-de31-428a-a55c-dd018f647fb7 req-4176347a-aef8-4a5f-9ce7-42ced18e3bf8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:43.599458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f5252bf-de31-428a-a55c-dd018f647fb7 req-4176347a-aef8-4a5f-9ce7-42ced18e3bf8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:43.599908 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-6f5252bf-de31-428a-a55c-dd018f647fb7 req-4176347a-aef8-4a5f-9ce7-42ced18e3bf8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:43.611700 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-6f5252bf-de31-428a-a55c-dd018f647fb7 req-4176347a-aef8-4a5f-9ce7-42ced18e3bf8 service nova] Creating event network-vif-deleted:e02404b0-d1fd-40f3-94ce-a889713ed422 for instance 562e90bb-e499-405a-bfd2-2aff155b503d on n-h1-862416-2 Oct 22 04:22:43.617121 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-6f5252bf-de31-428a-a55c-dd018f647fb7 req-4176347a-aef8-4a5f-9ce7-42ced18e3bf8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031818 Oct 22 04:22:43.617726 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3757/7651] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:22:43.810280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:43.810926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:43.818757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:43.819253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:43.819699 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:43.820441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:43.820912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:43.821351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:43.853188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:43.853633 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:43.854084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:43.854560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lazy-loading 'fault' on Instance uuid 562e90bb-e499-405a-bfd2-2aff155b503d {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:22:43.898397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:43.907451 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0dd8473f-8024-4c98-a7af-765771f032d6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 200 len: 1355 microversion: 2.1 time: 0.101102 Oct 22 04:22:43.908049 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3895/7652] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:43 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 1355 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:44.933614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:44.934319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 562e90bb-e499-405a-bfd2-2aff155b503d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:44.941124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:44.941615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:44.942057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:44.942757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:44.943217 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:44.943644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:44.957605 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] HTTP exception thrown: Instance 562e90bb-e499-405a-bfd2-2aff155b503d could not be found. Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Request method failure captured: Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d HTTP/1.1 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2_UTsBUIWZyXGmOotTOehe2PcQt0ZBev2MSefXLKMCQp6kCzGKE8pvC4joSsov1lMX2eRa7olF_lLcL7fIOV6Pj_TiXVmXzvg1kIbEB5ZcL6K2QZRsE-ekHFyy_LZVekh4qq-4BhRQ8CP3lNg-bnJV6S_GBJj60RE6KlOIyzUaRO2c Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}] Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: a215591a0f024864b910dab64fa74d03 Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 562e90bb-e499-405a-bfd2-2aff155b503d could not be found. Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '562e90bb-e499-405a-bfd2-2aff155b503d'} Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562e90bb-e499-405a-bfd2-2aff155b503d could not be found. Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562e90bb-e499-405a-bfd2-2aff155b503d could not be found. Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:22:44.959253 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562e90bb-e499-405a-bfd2-2aff155b503d could not be found. Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Returning 404 to user: Instance 562e90bb-e499-405a-bfd2-2aff155b503d could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a885dcad-daca-4ac7-a6b0-9a0c3af13e5b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d" status: 404 len: 111 microversion: 2.1 time: 0.032222 Oct 22 04:22:44.964053 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3758/7653] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:44 2022] GET /compute/v2.1/servers/562e90bb-e499-405a-bfd2-2aff155b503d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:22:48.232707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-671303a7-6fd4-462f-86bd-df878c22f76c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '.version_select at 0x7f0d18deb670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:48.270114 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-671303a7-6fd4-462f-86bd-df878c22f76c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-394195163" status: 202 len: 0 microversion: 2.1 time: 0.042173 Oct 22 04:22:48.271355 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3896/7654] 10.222.0.25 () {58 vars in 1281 bytes} [Sat Oct 22 04:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-394195163 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:22:48.304177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e982d477-5f70-40d5-aec1-8c1771bdcc64 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: .version_select at 0x7f0d19232e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1992003533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOjUbTmjDRW33UcpsIq1x5mfFEL4MGtIP26TsOQJUW4FWV8oPQsG1Ii4D9qMugpO2X8e4Wi8UAMbz8b+VjBA+VlormiYw9Jr+UHTw0i9PTI+nvUkpqBBuPpzdbeMMYQHw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:48.321771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e982d477-5f70-40d5-aec1-8c1771bdcc64 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:22:48.326859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-e982d477-5f70-40d5-aec1-8c1771bdcc64 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:22:48.350525 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e982d477-5f70-40d5-aec1-8c1771bdcc64 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050352 Oct 22 04:22:48.351161 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3759/7655] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:22:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:22:53.859248 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-877058287", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "b02979a7-849f-4e7b-8901-fdbcf4c4545e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1992003533", "security_groups": [{"name": "tempest-secgroup-smoke-1800532606"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:53.902618 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:53.980458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] validate_networks() for [('b02979a7-849f-4e7b-8901-fdbcf4c4545e', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:22:54.470345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:22:54.470790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:22:54.471286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:22:54.471712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:22:54.472149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:22:54.481899 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:54.482403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:54.482875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:54.483768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:54.484302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:54.484712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:54.502572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:22:54.508253 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:22:54.522249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:22:54.524917 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:22:54.575204 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6bb32fc9-001a-4ce5-8ce2-57aad2968f0b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721042 Oct 22 04:22:54.576093 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3897/7656] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:22:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:22:54.588752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cfcb1b08-a358-4732-b28d-7cfb4bf91e13 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:54.589378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cfcb1b08-a358-4732-b28d-7cfb4bf91e13 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:54.669933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cfcb1b08-a358-4732-b28d-7cfb4bf91e13 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:54.677361 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cfcb1b08-a358-4732-b28d-7cfb4bf91e13 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1266 microversion: 2.1 time: 0.093614 Oct 22 04:22:54.677943 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3760/7657] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:54 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:55.700485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:55.701185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:55.711713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:55.712627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:55.713269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:55.714350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:55.715052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:55.715507 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:55.793373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:55.822914 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0474c82e-b2d9-40d1-981c-dbc06a5bd93a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1324 microversion: 2.1 time: 0.126497 Oct 22 04:22:55.823537 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3898/7658] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:55 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1324 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:22:56.847980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:56.848628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:56.854112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=32 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:22:56.857039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:56.857533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:56.857976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:56.859225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:56.859758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:56.860193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:57.097063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:57.104995 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e7ba0a7-19e4-4bb3-b146-347410884cec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1392 microversion: 2.1 time: 0.261926 Oct 22 04:22:57.105617 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3761/7659] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:56 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:57.247105 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a39a96d3-75ed-4726-83c8-3bad4794914e req-30a1f72f-9315-43b2-aac9-985025488eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79dc6df5-bb4e-40e7-92b0-07359af74ccf", "tag": "9546592b-cb36-4969-b4a9-e12ce3ac164c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:22:57.260978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a39a96d3-75ed-4726-83c8-3bad4794914e req-30a1f72f-9315-43b2-aac9-985025488eda service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:57.261621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a39a96d3-75ed-4726-83c8-3bad4794914e req-30a1f72f-9315-43b2-aac9-985025488eda service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:57.262369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a39a96d3-75ed-4726-83c8-3bad4794914e req-30a1f72f-9315-43b2-aac9-985025488eda service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:57.274523 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a39a96d3-75ed-4726-83c8-3bad4794914e req-30a1f72f-9315-43b2-aac9-985025488eda service nova] Creating event network-changed:9546592b-cb36-4969-b4a9-e12ce3ac164c for instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf on n-h2-862416-2 Oct 22 04:22:57.279495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a39a96d3-75ed-4726-83c8-3bad4794914e req-30a1f72f-9315-43b2-aac9-985025488eda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036172 Oct 22 04:22:57.280742 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3899/7660] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:22:58.129868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:58.130535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:58.137621 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:58.137927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:58.138271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:58.138965 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:58.139413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:58.140520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:58.277086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:58.285901 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e224f734-f2a5-4ef1-b922-1aab094a1194 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1392 microversion: 2.1 time: 0.159897 Oct 22 04:22:58.286500 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3762/7661] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:58 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:22:59.310641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:22:59.311863 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:22:59.318301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:59.318804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:59.319267 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:59.319982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:22:59.320485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:22:59.320938 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:22:59.455027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:22:59.462711 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-609eff8e-0fd4-49d4-8891-17889ea6dcb0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1392 microversion: 2.1 time: 0.157253 Oct 22 04:22:59.463291 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3900/7662] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:22:59 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:23:00.485971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:23:00.486585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:23:00.493564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:00.494049 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:00.494483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:00.495177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:00.495632 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:00.496059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:00.629171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:23:00.637045 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-99d8f7bd-a229-47a6-b295-e04da444e729 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1392 microversion: 2.1 time: 0.155172 Oct 22 04:23:00.637647 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3763/7663] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:23:00 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:23:01.661485 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:23:01.662139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:23:01.668907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:01.669421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:01.669883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:01.670640 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:01.671770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:01.672233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:01.817454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:23:01.825466 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4d052796-fac7-4454-9dc4-e0f89e2707a5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1392 microversion: 2.1 time: 0.168155 Oct 22 04:23:01.826052 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3901/7664] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:23:01 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:23:02.849183 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:23:02.849806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:23:02.856605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:02.857088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:02.857527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:02.858741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:02.859291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:02.859791 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:02.995028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:23:03.002716 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0e87bd65-424f-4afe-8252-4e0c0ba2e85a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1392 microversion: 2.1 time: 0.157384 Oct 22 04:23:03.003282 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3764/7665] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:23:02 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:23:03.686109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-720ea12f-83f3-43e7-a36a-87835d085f99 req-72041bce-0cc6-4a29-aed0-ee9ec6feac2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79dc6df5-bb4e-40e7-92b0-07359af74ccf", "name": "network-vif-plugged", "status": "completed", "tag": "9546592b-cb36-4969-b4a9-e12ce3ac164c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:23:03.698518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-720ea12f-83f3-43e7-a36a-87835d085f99 req-72041bce-0cc6-4a29-aed0-ee9ec6feac2a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:03.699381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-720ea12f-83f3-43e7-a36a-87835d085f99 req-72041bce-0cc6-4a29-aed0-ee9ec6feac2a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:03.699834 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-720ea12f-83f3-43e7-a36a-87835d085f99 req-72041bce-0cc6-4a29-aed0-ee9ec6feac2a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:03.712079 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-720ea12f-83f3-43e7-a36a-87835d085f99 req-72041bce-0cc6-4a29-aed0-ee9ec6feac2a service nova] Creating event network-vif-plugged:9546592b-cb36-4969-b4a9-e12ce3ac164c for instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf on n-h2-862416-2 Oct 22 04:23:03.718781 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-720ea12f-83f3-43e7-a36a-87835d085f99 req-72041bce-0cc6-4a29-aed0-ee9ec6feac2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035553 Oct 22 04:23:03.719404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3902/7666] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:23:04.024976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:23:04.025600 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:23:04.033132 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:04.033618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:04.034083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:04.034783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:04.035244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:04.035675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:04.168682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:23:04.176412 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ae5c6a9-2e24-4554-b308-fc95a2138976 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1392 microversion: 2.1 time: 0.155588 Oct 22 04:23:04.176995 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3765/7667] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:23:04 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:23:05.276589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:23:05.277213 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:23:05.279198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:23:05.279876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:23:05.288146 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:05.288742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:05.289229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:05.289974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:05.290439 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:05.290955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:05.428802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:23:05.437186 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ccf2ed8c-cdd1-478f-8815-aa9d70899fc2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1564 microversion: 2.1 time: 0.164703 Oct 22 04:23:05.437775 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3903/7668] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:23:05 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:23:05.459867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:23:05.460503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:23:05.462346 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:23:05.469061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:05.469545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:05.469984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:05.470689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:05.471142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:05.471597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:05.603506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:23:05.611160 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86832800-cef0-4324-805a-7412c60b26a6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1564 microversion: 2.1 time: 0.155141 Oct 22 04:23:05.611736 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3766/7669] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:23:05 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:23:07.497547 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:23:07.503522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1c6fbebe-937e-4129-9e48-94389fa074b6 req-c168f5fb-9751-4fc4-b858-671707beb9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79dc6df5-bb4e-40e7-92b0-07359af74ccf", "tag": "9546592b-cb36-4969-b4a9-e12ce3ac164c"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:23:07.504554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:23:07.507128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:23:07.509686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:23:07.513219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:07.513729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:07.514139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:07.516191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:07.516698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:07.516836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1c6fbebe-937e-4129-9e48-94389fa074b6 req-c168f5fb-9751-4fc4-b858-671707beb9e5 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:07.517144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:07.517443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1c6fbebe-937e-4129-9e48-94389fa074b6 req-c168f5fb-9751-4fc4-b858-671707beb9e5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:07.517947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1c6fbebe-937e-4129-9e48-94389fa074b6 req-c168f5fb-9751-4fc4-b858-671707beb9e5 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:07.531667 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1c6fbebe-937e-4129-9e48-94389fa074b6 req-c168f5fb-9751-4fc4-b858-671707beb9e5 service nova] Creating event network-changed:9546592b-cb36-4969-b4a9-e12ce3ac164c for instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf on n-h2-862416-2 Oct 22 04:23:07.536715 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1c6fbebe-937e-4129-9e48-94389fa074b6 req-c168f5fb-9751-4fc4-b858-671707beb9e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037382 Oct 22 04:23:07.537318 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3767/7670] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:23:07.665838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:23:07.677188 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a98a7a4f-d182-42b4-8539-c4b5cc6e0180 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1564 microversion: 2.1 time: 0.183629 Oct 22 04:23:07.678095 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3904/7671] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:23:07 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:23:40.966878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=38 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:23:40.967758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:23:40.972744 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:23:40.975045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:23:40.982882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:40.984122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:40.984581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:40.985277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:23:40.985735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:23:40.986161 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:23:41.036566 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ae3c07e7-4e53-444b-89b6-66d8451c6701 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf/action" status: 200 len: 24569 microversion: 2.1 time: 0.071719 Oct 22 04:23:41.037228 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3768/7672] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:23:40 2022] POST /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf/action => generated 24569 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:24:11.239757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:24:11.240546 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=36 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:24:11.245578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:24:11.247817 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:11.255426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:11.255925 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:11.256406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:11.257110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:11.257578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:11.258017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:11.329940 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f610396f-92cf-43ce-b480-792686b9d867 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf/action" status: 202 len: 0 microversion: 2.1 time: 0.091987 Oct 22 04:24:11.330591 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3905/7673] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:24:11 2022] POST /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:24:11.340879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:11.341622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:11.344186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:24:11.344971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:24:11.351319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:11.351827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:11.352674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:11.353006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:11.353466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:11.353897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:11.637898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:11.645697 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8a0121c4-7329-4bf8-b08b-a46b3d87e5b5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1674 microversion: 2.1 time: 0.309507 Oct 22 04:24:11.646265 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3769/7674] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:11 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1674 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:12.671908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:12.672665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:12.679330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:12.679826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:12.680308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:12.681014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:12.681525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:12.682274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:12.871297 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:12.879833 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c7e3fe7-8d15-4cd0-937e-4b55258cf619 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.213166 Oct 22 04:24:12.880353 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3906/7675] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:12 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:13.904717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:13.905320 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:13.915895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:13.916413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:13.916851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:13.917546 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:13.917998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:13.918426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:14.053464 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:14.061228 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1288a2cf-c260-4e22-83cf-3fc43a108b2c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.160419 Oct 22 04:24:14.061817 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3770/7676] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:13 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:15.085736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:15.086365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:15.093550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:15.094137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:15.094595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:15.095347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:15.095818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:15.096284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:15.237285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:15.245710 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-367a9f1f-23dc-4a8b-90d0-e20e216547ad tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.164500 Oct 22 04:24:15.246286 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3907/7677] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:15 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:16.270907 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:16.271516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:16.278750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:16.279225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:16.279657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:16.280471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:16.280924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:16.281349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:16.419844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:16.428432 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8429a01f-6933-45a2-b5a5-4fab0f0e5fdf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.161905 Oct 22 04:24:16.429006 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3771/7678] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:16 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:17.452669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:17.453290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:17.460295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:17.460794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:17.461245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:17.461947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:17.462414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:17.462852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:17.594225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:17.602205 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fc371709-1c66-4b26-86bd-d6136b66c844 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.153772 Oct 22 04:24:17.602776 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3908/7679] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:17 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:18.626727 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:18.627337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:18.634844 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:18.635323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:18.635881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:18.636614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:18.637074 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:18.637504 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:18.774471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:18.782276 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0991af97-a759-4ce2-9790-289ace88039a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.159496 Oct 22 04:24:18.782842 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3772/7680] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:18 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:19.807024 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:19.807567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:19.814346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:19.814847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:19.815304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:19.816625 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:19.817222 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:19.817746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:19.952152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:19.959893 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e1ed1f2f-fce8-4217-8b65-cbba75e38efd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.156971 Oct 22 04:24:19.960513 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3909/7681] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:19 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:20.983256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:20.983998 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:20.991339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:20.991827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:20.992325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:20.993029 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:20.993488 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:20.993921 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:21.147063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:21.156004 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-86d2a803-0fe0-4091-a4db-2e210965caef tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.176899 Oct 22 04:24:21.156652 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3773/7682] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:20 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:22.181665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:22.182299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:22.189464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:22.189968 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:22.190431 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:22.191777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:22.192289 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:22.192744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:22.322544 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:22.330425 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-03e679b6-d644-4be8-9770-60e23a1a46be tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1679 microversion: 2.1 time: 0.152816 Oct 22 04:24:22.331013 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3910/7683] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:22 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:23.354008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:24:23.354631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:23.361545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:23.362032 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:23.362481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:23.363227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:23.363686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:23.364119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:23.494468 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:24:23.502248 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c7dfeb0-8cb5-43a6-ae1d-d60086fe24d8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1682 microversion: 2.1 time: 0.152172 Oct 22 04:24:23.502826 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3774/7684] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:24:23 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:24:55.725232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:24:55.727371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:24:55.729679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:24:55.730347 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:24:55.736637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:55.737134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:55.738098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:55.738818 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:24:55.739269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:24:55.739707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:24:55.797220 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5fcf0555-450e-43c3-8dc0-f6f0c200d564 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf/action" status: 200 len: 69158 microversion: 2.1 time: 0.075673 Oct 22 04:24:55.797903 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3911/7685] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:24:55 2022] POST /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf/action => generated 69158 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:25:20.002329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:20.002879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:20.004988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:20.005261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-453741a3-eeff-4872-9eb5-992fd1999913 req-1368f0f2-5d8f-4e42-bb24-c3f49fb1e23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79dc6df5-bb4e-40e7-92b0-07359af74ccf", "tag": "9546592b-cb36-4969-b4a9-e12ce3ac164c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:25:20.005914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=36 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:20.011650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:20.012147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:20.012412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:20.013119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:20.013241 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:20.014659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:20.016040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:20.016576 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:20.022260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-453741a3-eeff-4872-9eb5-992fd1999913 req-1368f0f2-5d8f-4e42-bb24-c3f49fb1e23c service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:20.022755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-453741a3-eeff-4872-9eb5-992fd1999913 req-1368f0f2-5d8f-4e42-bb24-c3f49fb1e23c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:20.023257 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-453741a3-eeff-4872-9eb5-992fd1999913 req-1368f0f2-5d8f-4e42-bb24-c3f49fb1e23c service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:20.036485 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-453741a3-eeff-4872-9eb5-992fd1999913 req-1368f0f2-5d8f-4e42-bb24-c3f49fb1e23c service nova] Creating event network-changed:9546592b-cb36-4969-b4a9-e12ce3ac164c for instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf on n-h2-862416-2 Oct 22 04:25:20.041694 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-453741a3-eeff-4872-9eb5-992fd1999913 req-1368f0f2-5d8f-4e42-bb24-c3f49fb1e23c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040425 Oct 22 04:25:20.042508 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3912/7686] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:25:20.043531 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:25:20.128628 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-43a94cbe-a7ae-4160-8c73-d3410fd5629e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 204 len: 0 microversion: 2.1 time: 0.130711 Oct 22 04:25:20.129531 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3775/7687] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:25:19 2022] DELETE /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:25:20.140779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:20.141572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:20.148112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:20.148728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:20.149247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:20.150474 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:20.151046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:20.151575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:20.303942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:20.311914 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d74d6a96-2256-419f-aa46-36799bf65bb1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1688 microversion: 2.1 time: 0.177730 Oct 22 04:25:20.312618 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3913/7688] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:20 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:21.336821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:21.337547 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:21.339736 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:25:21.339988 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:25:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf (ip 10.222.0.25) !!! Oct 22 04:25:21.351093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:21.351581 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:21.352020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:21.352754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:21.353212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:21.353644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:21.564350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:21.572094 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9fc637d7-dfc5-47c8-a635-e1391b63dbd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1688 microversion: 2.1 time: 0.239612 Oct 22 04:25:21.572700 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3776/7689] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:21 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:22.277627 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-93322983-f51e-4134-b2d9-e52185749fb8 req-7db5fb16-b959-4401-b7c9-e42d65f58ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79dc6df5-bb4e-40e7-92b0-07359af74ccf", "name": "network-vif-deleted", "tag": "9546592b-cb36-4969-b4a9-e12ce3ac164c"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:25:22.290073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-93322983-f51e-4134-b2d9-e52185749fb8 req-7db5fb16-b959-4401-b7c9-e42d65f58ac6 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:22.290569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-93322983-f51e-4134-b2d9-e52185749fb8 req-7db5fb16-b959-4401-b7c9-e42d65f58ac6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:22.291023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-93322983-f51e-4134-b2d9-e52185749fb8 req-7db5fb16-b959-4401-b7c9-e42d65f58ac6 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:22.304010 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-93322983-f51e-4134-b2d9-e52185749fb8 req-7db5fb16-b959-4401-b7c9-e42d65f58ac6 service nova] Creating event network-vif-deleted:9546592b-cb36-4969-b4a9-e12ce3ac164c for instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf on n-h2-862416-2 Oct 22 04:25:22.309833 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-93322983-f51e-4134-b2d9-e52185749fb8 req-7db5fb16-b959-4401-b7c9-e42d65f58ac6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122472 Oct 22 04:25:22.310446 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3914/7690] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:25:22.599851 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:22.606686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:22.615470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:22.616126 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:22.616733 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:22.617944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:22.618734 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:22.619486 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:22.661156 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:22.661559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:22.661999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:22.662448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lazy-loading 'fault' on Instance uuid 79dc6df5-bb4e-40e7-92b0-07359af74ccf {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:25:22.712730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:22.721633 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5508b86b-6395-4ab7-8622-d116a6315fd2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 200 len: 1356 microversion: 2.1 time: 0.125709 Oct 22 04:25:22.722232 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3777/7691] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:22 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 1356 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:23.752444 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:23.753191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 79dc6df5-bb4e-40e7-92b0-07359af74ccf] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:23.759360 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:23.759861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:23.760354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:23.761066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:23.761539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:23.761984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:23.778138 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] HTTP exception thrown: Instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf could not be found. Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Request method failure captured: Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf HTTP/1.1 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2_UTsBUIWZyXGmOotTOehe2PcQt0ZBev2MSefXLKMCQp6kCzGKE8pvC4joSsov1lMX2eRa7olF_lLcL7fIOV6Pj_TiXVmXzvg1kIbEB5ZcL6K2QZRsE-ekHFyy_LZVekh4qq-4BhRQ8CP3lNg-bnJV6S_GBJj60RE6KlOIyzUaRO2c Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}] Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: a215591a0f024864b910dab64fa74d03 Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf could not be found. Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '79dc6df5-bb4e-40e7-92b0-07359af74ccf'} Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf could not be found. Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf could not be found. Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:25:23.779807 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf could not be found. Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Returning 404 to user: Instance 79dc6df5-bb4e-40e7-92b0-07359af74ccf could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-3bed14c4-9abb-483a-b763-9a3cab30948d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf" status: 404 len: 111 microversion: 2.1 time: 0.034958 Oct 22 04:25:23.785151 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3915/7692] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:23 2022] GET /compute/v2.1/servers/79dc6df5-bb4e-40e7-92b0-07359af74ccf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:25:27.257944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c884f305-2bd5-4739-abcb-70b3e56efe5c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '.version_select at 0x7f0d1a77d4c0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:27.289982 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c884f305-2bd5-4739-abcb-70b3e56efe5c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1992003533" status: 202 len: 0 microversion: 2.1 time: 0.036843 Oct 22 04:25:27.290590 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3778/7693] 10.222.0.25 () {58 vars in 1284 bytes} [Sat Oct 22 04:25:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1992003533 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:25:27.319597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-151b6562-65b1-4772-8756-99f10458f908 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: .version_select at 0x7f0d182561f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1479368901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYs90sXCTJZ8SCUctXs1LgK0Pm1rYZ+lL9GmuA4XzN+IjU9NZvC+oqdxCYUb+m2I17AiRnHselkIPdsI4gFxkVXARbe24t8QJwEFBt49Khmn6UwxceMJNhCpedjVaUkHA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:25:27.337702 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-151b6562-65b1-4772-8756-99f10458f908 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:25:27.345319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-151b6562-65b1-4772-8756-99f10458f908 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:25:27.372371 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-151b6562-65b1-4772-8756-99f10458f908 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056643 Oct 22 04:25:27.373024 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3916/7694] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:25:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:25:32.863182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:32.868053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-26885678", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "682890f7-6349-41d9-bf72-33b13d627527"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1479368901", "security_groups": [{"name": "tempest-secgroup-smoke-932503100"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:25:32.989865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] validate_networks() for [('682890f7-6349-41d9-bf72-33b13d627527', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:25:33.455916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:25:33.456401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:25:33.456879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:25:33.457290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:25:33.457711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:25:33.467700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:33.468263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:33.468685 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:33.469415 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:33.469867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:33.470291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:33.490679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:25:33.496306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:25:33.511192 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:25:33.513564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:25:33.574329 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8194de04-97a0-4eda-8a70-9fd8b57174fc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710470 Oct 22 04:25:33.575314 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3779/7695] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:25:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:25:33.587632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5688be94-7347-41a5-aa91-3696ba5d9ff4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:33.588668 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5688be94-7347-41a5-aa91-3696ba5d9ff4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:33.658922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5688be94-7347-41a5-aa91-3696ba5d9ff4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:33.667579 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5688be94-7347-41a5-aa91-3696ba5d9ff4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1265 microversion: 2.1 time: 0.084221 Oct 22 04:25:33.669226 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3917/7696] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:33 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:34.692313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:34.693577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:34.700355 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:34.701091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:34.701535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:34.702406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:34.702861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:34.703542 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:34.782933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:34.794722 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4dafde6d-b37e-4cc5-87c3-1b3f1d1c5ec4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1317 microversion: 2.1 time: 0.107308 Oct 22 04:25:34.796739 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3780/7697] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:34 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:35.820854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:35.823728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:35.830026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:35.832895 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:35.833664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:35.834370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:35.835332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:35.836028 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:35.836803 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:36.063039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:36.072985 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d58e0966-d768-4756-8e19-3be5abe2d842 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1390 microversion: 2.1 time: 0.256191 Oct 22 04:25:36.073856 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3918/7698] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:35 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1390 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:36.500124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-29787fcd-1c73-4a4b-8ae4-890d5fc69145 req-997a3ce4-39db-4367-a056-65df484f1bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3561eb5-3c7a-461c-98b3-8d6e966c5f0d", "tag": "839473ef-ebe2-44a3-9199-ff3fbf7e06cc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:25:36.515303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-29787fcd-1c73-4a4b-8ae4-890d5fc69145 req-997a3ce4-39db-4367-a056-65df484f1bc0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:36.516028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-29787fcd-1c73-4a4b-8ae4-890d5fc69145 req-997a3ce4-39db-4367-a056-65df484f1bc0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:36.516769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-29787fcd-1c73-4a4b-8ae4-890d5fc69145 req-997a3ce4-39db-4367-a056-65df484f1bc0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:36.528781 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-29787fcd-1c73-4a4b-8ae4-890d5fc69145 req-997a3ce4-39db-4367-a056-65df484f1bc0 service nova] Creating event network-changed:839473ef-ebe2-44a3-9199-ff3fbf7e06cc for instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d on n-h1-862416-2 Oct 22 04:25:36.534590 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-29787fcd-1c73-4a4b-8ae4-890d5fc69145 req-997a3ce4-39db-4367-a056-65df484f1bc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039549 Oct 22 04:25:36.535203 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3781/7699] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:25:37.096629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:37.097259 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:37.104268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:37.104779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:37.105240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:37.105960 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:37.106435 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:37.106907 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:37.314848 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:37.323071 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5f223b80-a7ed-410e-9014-9a327a3e4ee4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1390 microversion: 2.1 time: 0.230436 Oct 22 04:25:37.323660 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3919/7700] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:37 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1390 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:38.347775 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:38.349106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:38.355370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:38.355866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:38.356341 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:38.357061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:38.357517 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:38.357952 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:38.495179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:38.503726 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a8bb784-b8ea-47ff-8d0e-39c81f5e6676 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1390 microversion: 2.1 time: 0.161112 Oct 22 04:25:38.504329 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3782/7701] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:38 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:39.527461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:39.528084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:39.535469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:39.535995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:39.536473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:39.537184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:39.537655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:39.538098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:39.670524 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:39.678481 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a26fcd48-e649-4f61-ae4c-9050f892770c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1390 microversion: 2.1 time: 0.155429 Oct 22 04:25:39.679060 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3920/7702] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:39 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:40.702047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:40.702698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:40.709539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:40.710028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:40.710463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:40.711159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:40.711613 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:40.712040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:40.850927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:40.858921 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d6f73741-6043-4349-a82f-a2758decc8c5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1390 microversion: 2.1 time: 0.160805 Oct 22 04:25:40.859509 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3783/7703] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:40 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:41.882280 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:41.882912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:41.889922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:41.890427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:41.890888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:41.891606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:41.892083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:41.892573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:42.023877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:42.032135 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ad0d6aac-33dd-4153-b01e-e9ca3ebdcbdc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1390 microversion: 2.1 time: 0.153814 Oct 22 04:25:42.032743 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3921/7704] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:41 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:42.683433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-bc960e8e-fa0a-4f95-8a5b-3ee081de1f0d req-9276179f-f58f-467a-8bda-44a3e80cdd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3561eb5-3c7a-461c-98b3-8d6e966c5f0d", "name": "network-vif-plugged", "status": "completed", "tag": "839473ef-ebe2-44a3-9199-ff3fbf7e06cc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:25:42.693034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bc960e8e-fa0a-4f95-8a5b-3ee081de1f0d req-9276179f-f58f-467a-8bda-44a3e80cdd63 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:42.693508 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bc960e8e-fa0a-4f95-8a5b-3ee081de1f0d req-9276179f-f58f-467a-8bda-44a3e80cdd63 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:42.693942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-bc960e8e-fa0a-4f95-8a5b-3ee081de1f0d req-9276179f-f58f-467a-8bda-44a3e80cdd63 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:42.704811 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-bc960e8e-fa0a-4f95-8a5b-3ee081de1f0d req-9276179f-f58f-467a-8bda-44a3e80cdd63 service nova] Creating event network-vif-plugged:839473ef-ebe2-44a3-9199-ff3fbf7e06cc for instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d on n-h1-862416-2 Oct 22 04:25:42.709717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-bc960e8e-fa0a-4f95-8a5b-3ee081de1f0d req-9276179f-f58f-467a-8bda-44a3e80cdd63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091606 Oct 22 04:25:42.710299 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3784/7705] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:25:43.054687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:43.055305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:43.062227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:43.062720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:43.063177 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:43.063914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:43.064412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:43.064910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:43.195464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:43.204097 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5b1e3ded-663e-4d92-a7a4-b33c57bb59c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1390 microversion: 2.1 time: 0.153360 Oct 22 04:25:43.204721 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3922/7706] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:43 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:44.225720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:44.226677 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:44.232345 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:44.233091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:44.240923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:44.241422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:44.241857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:44.242558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:44.243019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:44.243450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:44.379264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:44.387048 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d9471eab-722c-4876-a7ab-f085da5316b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1562 microversion: 2.1 time: 0.162269 Oct 22 04:25:44.387599 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3785/7707] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:44 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:44.410210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:44.410835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:44.412762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:25:44.419977 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:44.420562 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:44.421013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:44.421715 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:44.422210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:44.422648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:44.562948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:44.570702 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-93034cb3-7f28-4f82-b7bb-9985a0c70957 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1562 microversion: 2.1 time: 0.165118 Oct 22 04:25:44.571286 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3923/7708] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:44 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:25:46.166865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:25:46.167527 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f189c6dd-b8e1-49ff-9bdb-2ab2e1a480d3 req-6c6b0f33-3737-4a1a-96ad-2b7c916c2d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3561eb5-3c7a-461c-98b3-8d6e966c5f0d", "tag": "839473ef-ebe2-44a3-9199-ff3fbf7e06cc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:25:46.167968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:25:46.177314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:46.178307 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:46.178859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:46.180446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f189c6dd-b8e1-49ff-9bdb-2ab2e1a480d3 req-6c6b0f33-3737-4a1a-96ad-2b7c916c2d95 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:46.181126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f189c6dd-b8e1-49ff-9bdb-2ab2e1a480d3 req-6c6b0f33-3737-4a1a-96ad-2b7c916c2d95 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:46.181669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:25:46.181946 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f189c6dd-b8e1-49ff-9bdb-2ab2e1a480d3 req-6c6b0f33-3737-4a1a-96ad-2b7c916c2d95 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:46.182338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:25:46.183022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:25:46.195926 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f189c6dd-b8e1-49ff-9bdb-2ab2e1a480d3 req-6c6b0f33-3737-4a1a-96ad-2b7c916c2d95 service nova] Creating event network-changed:839473ef-ebe2-44a3-9199-ff3fbf7e06cc for instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d on n-h1-862416-2 Oct 22 04:25:46.201680 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f189c6dd-b8e1-49ff-9bdb-2ab2e1a480d3 req-6c6b0f33-3737-4a1a-96ad-2b7c916c2d95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038020 Oct 22 04:25:46.202380 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3924/7709] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:25:46.332435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:25:46.342747 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-167f7bd7-8cf3-4cc5-bdac-9aec22b3d919 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1562 microversion: 2.1 time: 0.181150 Oct 22 04:25:46.343619 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3786/7710] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:25:46 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1562 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:09.596867 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:26:09.597455 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:26:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action (ip 10.222.0.25) !!! Oct 22 04:26:09.598203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:26:09.598982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=38 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:26:09.603657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:26:09.606030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:09.616553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:09.617055 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:09.617514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:09.618230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:09.618708 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:09.619156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:09.677405 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7b39310d-6b39-44fd-bf26-7bc1cb660b40 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action" status: 200 len: 24561 microversion: 2.1 time: 0.082632 Oct 22 04:26:09.678063 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3925/7711] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:26:09 2022] POST /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action => generated 24561 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:26:20.793196 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:26:20.795358 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:20.797442 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:26:20.798081 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=36 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:26:20.804304 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:20.804693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:20.805128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:20.805822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:20.806269 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:20.806687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:20.848187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:20.854263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120582) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 22 04:26:20.861011 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:26:20.861435 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:26:20.861931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:26:20.862337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:26:20.863500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:26:20.928758 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-10a2755c-ad2f-476d-9278-55cd1af0d538 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action" status: 202 len: 0 microversion: 2.1 time: 0.139634 Oct 22 04:26:20.929543 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3787/7712] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:26:20 2022] POST /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:26:20.938395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:20.939114 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:20.942195 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:26:20.943194 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:26:20.949147 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:20.949658 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:20.950143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:20.951127 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:20.951599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:20.952321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:21.106747 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:21.115376 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73e799ee-7a0e-4ccc-9016-d9e1995809aa tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1690 microversion: 2.1 time: 0.181322 Oct 22 04:26:21.116044 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3926/7713] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:20 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:22.142321 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:22.142875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:22.152347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:22.152840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:22.153271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:22.153966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:22.154420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:22.154841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:22.292857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:22.300712 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f1e3f211-8687-48db-9c5e-a4c44219747c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1690 microversion: 2.1 time: 0.162643 Oct 22 04:26:22.301256 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3788/7714] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:22 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:23.324103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:23.325095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:23.333255 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:23.333869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:23.334226 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:23.334954 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:23.335430 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:23.336778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:23.497038 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:23.505710 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e3035e28-2127-44ae-8635-286c6edf6755 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.185645 Oct 22 04:26:23.506301 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3927/7715] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:23 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:24.534375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:24.535580 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:24.542689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:24.543170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:24.543608 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:24.544326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:24.544782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:24.545209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:24.678755 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:24.686439 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e8f62e14-a7e9-4f67-930c-8fa2cd595b7e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.156022 Oct 22 04:26:24.687009 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3789/7716] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:24 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:25.711508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:25.712138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:25.719487 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:25.719993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:25.720475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:25.721198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:25.721669 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:25.722738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:25.932849 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:25.940536 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-79028686-0c02-4f21-9413-a3f59c4039c4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.232948 Oct 22 04:26:25.941785 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3928/7717] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:25 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:26.965565 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:26.966171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:26.973587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:26.974071 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:26.974516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:26.975211 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:26.975661 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:26.976089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:27.109672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:27.117984 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d49a2f1b-d0cb-46df-b9b3-6b298a79c485 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.156318 Oct 22 04:26:27.118559 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3790/7718] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:26 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:28.142102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:28.142796 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:28.149638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:28.150145 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:28.150878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:28.151570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:28.152042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:28.152516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:28.290726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:28.298499 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2b78327b-ac0e-401d-85fd-280d896803ba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.160405 Oct 22 04:26:28.299074 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3929/7719] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:28 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:29.322377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:29.323019 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:29.329941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:29.330426 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:29.330866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:29.332313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:29.332801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:29.333215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:29.463522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:29.471492 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-dc65cafc-1b8b-4cde-b90a-9820a451cfde tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.153057 Oct 22 04:26:29.472171 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3791/7720] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:29 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:30.496696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:30.497262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:30.504295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:30.504792 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:30.505242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:30.505943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:30.506408 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:30.506846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:30.637138 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:30.645201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39cf3cbd-7dd3-45f9-be74-e7319f8561a4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.152559 Oct 22 04:26:30.645783 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3930/7721] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:30 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:31.670008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:31.670008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:31.677223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:31.677741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:31.678184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:31.678918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:31.679375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:31.679813 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:31.815125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:31.823529 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9ceb52d5-deec-450e-a821-1de0884aba50 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.158022 Oct 22 04:26:31.824098 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3792/7722] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:31 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:32.847873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:32.848663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:32.855655 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:32.856151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:32.856632 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:32.857328 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:32.857794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:32.858232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:32.993178 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:33.001002 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-19d70339-6c08-432c-af59-294e7bde9461 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.157819 Oct 22 04:26:33.001590 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3931/7723] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:32 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:34.024505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:34.025123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:34.032154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:34.032660 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:34.033095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:34.033789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:34.034248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:34.034669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:34.164428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:34.172064 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1cbee21e-83f2-4952-8868-1707a767f834 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.151506 Oct 22 04:26:34.172669 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3793/7724] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:34 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:35.195631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:35.196314 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:35.203308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:35.203809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:35.204295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:35.205004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:35.205475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:35.205920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:35.337352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:35.345164 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5eda7c02-5cef-4054-a926-5e72f6ce672f tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.153527 Oct 22 04:26:35.345743 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3932/7725] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:35 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:36.369529 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:36.370174 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:36.377473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:36.378009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:36.379348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:36.379911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:36.380402 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:36.380832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:36.513041 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:36.520775 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-086f5a8d-36e7-4e7d-8b55-441e05a39ee8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.155167 Oct 22 04:26:36.521357 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3794/7726] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:36 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:37.544396 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:37.545044 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:37.553109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:37.553600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:37.554057 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:37.554757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:37.555224 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:37.555666 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:37.697791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:37.705463 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-13cc566b-48a3-42f3-a65e-715f274c3e82 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.165071 Oct 22 04:26:37.706051 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3933/7727] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:37 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:38.730912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:38.731521 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:38.739422 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:38.739903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:38.740375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:38.741099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:38.741551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:38.741976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:38.881811 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:38.889723 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-cdde0e42-a03d-4fb6-8722-d75b3f58ea0a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.162678 Oct 22 04:26:38.890303 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3795/7728] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:38 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:39.916099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:39.916757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:39.923275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:39.923765 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:39.924235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:39.924989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:39.925583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:39.926025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:40.098017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:40.106765 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-20e4bd8a-9dff-420f-9de0-66ae12b45503 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1695 microversion: 2.1 time: 0.194854 Oct 22 04:26:40.107564 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3934/7729] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:39 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:40.666693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-e54eb670-72e4-4987-b265-22b8677327ba req-3045aa3c-7b6e-4252-a244-c66035a3a844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3561eb5-3c7a-461c-98b3-8d6e966c5f0d", "name": "network-vif-unplugged", "status": "completed", "tag": "839473ef-ebe2-44a3-9199-ff3fbf7e06cc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:26:40.677057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e54eb670-72e4-4987-b265-22b8677327ba req-3045aa3c-7b6e-4252-a244-c66035a3a844 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:40.677528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e54eb670-72e4-4987-b265-22b8677327ba req-3045aa3c-7b6e-4252-a244-c66035a3a844 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:40.677962 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-e54eb670-72e4-4987-b265-22b8677327ba req-3045aa3c-7b6e-4252-a244-c66035a3a844 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:40.690288 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-e54eb670-72e4-4987-b265-22b8677327ba req-3045aa3c-7b6e-4252-a244-c66035a3a844 service nova] Creating event network-vif-unplugged:839473ef-ebe2-44a3-9199-ff3fbf7e06cc for instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d on n-h2-862416-2 Oct 22 04:26:40.696253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-e54eb670-72e4-4987-b265-22b8677327ba req-3045aa3c-7b6e-4252-a244-c66035a3a844 service nova] Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:26:40.707702 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-e54eb670-72e4-4987-b265-22b8677327ba req-3045aa3c-7b6e-4252-a244-c66035a3a844 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044846 Oct 22 04:26:40.708468 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3796/7730] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:26:41.131364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:41.132074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:41.139184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:41.139694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:41.140150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:41.140906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:41.141386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:41.141830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:41.291217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:41.299288 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-99c8ef99-3d5f-40cc-8dd3-1c22d2bb20ae tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1694 microversion: 2.1 time: 0.172066 Oct 22 04:26:41.300453 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3935/7731] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:41 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:42.370408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:42.371096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:42.377216 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:42.377695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:42.378880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:42.379589 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:42.380142 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:42.380591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:42.516375 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:42.524373 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f5e2f0a-fdaf-4151-b09d-329c3f3aa101 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1692 microversion: 2.1 time: 0.204406 Oct 22 04:26:42.524945 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3797/7732] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:42 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:42.747842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-4b1a50c0-2273-404c-aa3d-86c2dea04f56 req-f4bd51f8-311e-4ca1-859d-107c0543aa11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3561eb5-3c7a-461c-98b3-8d6e966c5f0d", "tag": "839473ef-ebe2-44a3-9199-ff3fbf7e06cc"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:26:42.758101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b1a50c0-2273-404c-aa3d-86c2dea04f56 req-f4bd51f8-311e-4ca1-859d-107c0543aa11 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:42.758589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b1a50c0-2273-404c-aa3d-86c2dea04f56 req-f4bd51f8-311e-4ca1-859d-107c0543aa11 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:42.759040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-4b1a50c0-2273-404c-aa3d-86c2dea04f56 req-f4bd51f8-311e-4ca1-859d-107c0543aa11 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:42.770656 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-4b1a50c0-2273-404c-aa3d-86c2dea04f56 req-f4bd51f8-311e-4ca1-859d-107c0543aa11 service nova] Creating event network-changed:839473ef-ebe2-44a3-9199-ff3fbf7e06cc for instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d on n-h2-862416-2 Oct 22 04:26:42.776108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [req-4b1a50c0-2273-404c-aa3d-86c2dea04f56 req-f4bd51f8-311e-4ca1-859d-107c0543aa11 service nova] Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:26:42.787643 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-4b1a50c0-2273-404c-aa3d-86c2dea04f56 req-f4bd51f8-311e-4ca1-859d-107c0543aa11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043556 Oct 22 04:26:42.788264 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3936/7733] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:26:43.548737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:43.549343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:43.556511 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:43.557005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:43.557432 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:43.558127 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:43.558584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:43.559010 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:43.692619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:43.700419 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c917a818-40e5-4430-85eb-308e17d7ec0e tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1692 microversion: 2.1 time: 0.155591 Oct 22 04:26:43.701161 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3798/7734] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:43 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:44.726814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:44.727634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:44.733926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:44.734452 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:44.735076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:44.735621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:44.736093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:44.736564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:44.884188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:44.892448 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bc8e9e0c-4ef4-4a09-a24d-6fa9be389994 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1692 microversion: 2.1 time: 0.172039 Oct 22 04:26:44.893033 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3937/7735] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:44 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:45.918101 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:45.918714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:45.925890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:45.926380 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:45.926818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:45.927514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:45.927969 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:45.928429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:46.065133 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:46.073625 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7571eedb-45d0-4864-9c19-901b1bb78481 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1689 microversion: 2.1 time: 0.159764 Oct 22 04:26:46.074204 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3799/7736] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:45 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:46.096496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:26:46.097179 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:46.104168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:46.104707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:46.105169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:46.105919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:46.106399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:46.106852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:46.165411 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c0a8ca2e-ac61-40cc-b3fa-bed5cc9b9774 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action" status: 204 len: 0 microversion: 2.1 time: 0.072788 Oct 22 04:26:46.165977 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3938/7737] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:26:46 2022] POST /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:26:46.175362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:46.176163 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:46.182536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:46.183057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:46.183501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:46.184272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:46.184737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:46.185167 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:46.325672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:46.334458 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1d64645e-8ecf-4865-bccb-72da8e090452 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1689 microversion: 2.1 time: 0.164273 Oct 22 04:26:46.335051 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3800/7738] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:46 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:46.358160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:46.358870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:46.366389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:46.366886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:46.367346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:46.368046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:46.368537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:46.368994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:46.555319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:46.563156 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5aa8fa7f-e1a1-445c-9bef-f1e829a15e2d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1689 microversion: 2.1 time: 0.209363 Oct 22 04:26:46.563734 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3939/7739] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:46 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:26:46.996905 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-27e518f7-b020-4a56-a385-7e80ea0df43f req-81fac3b3-bdee-4f89-afec-88915ab6e5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3561eb5-3c7a-461c-98b3-8d6e966c5f0d", "name": "network-vif-plugged", "status": "completed", "tag": "839473ef-ebe2-44a3-9199-ff3fbf7e06cc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:26:47.008189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-27e518f7-b020-4a56-a385-7e80ea0df43f req-81fac3b3-bdee-4f89-afec-88915ab6e5af service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:47.009008 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-27e518f7-b020-4a56-a385-7e80ea0df43f req-81fac3b3-bdee-4f89-afec-88915ab6e5af service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:47.009443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-27e518f7-b020-4a56-a385-7e80ea0df43f req-81fac3b3-bdee-4f89-afec-88915ab6e5af service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:47.024447 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-27e518f7-b020-4a56-a385-7e80ea0df43f req-81fac3b3-bdee-4f89-afec-88915ab6e5af service nova] Creating event network-vif-plugged:839473ef-ebe2-44a3-9199-ff3fbf7e06cc for instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d on n-h2-862416-2 Oct 22 04:26:47.031036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [req-27e518f7-b020-4a56-a385-7e80ea0df43f req-81fac3b3-bdee-4f89-afec-88915ab6e5af service nova] Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862416-2', 'n-h2-862416-2'} {{(pid=120582) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 22 04:26:47.043308 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-27e518f7-b020-4a56-a385-7e80ea0df43f req-81fac3b3-bdee-4f89-afec-88915ab6e5af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050229 Oct 22 04:26:47.043934 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3801/7740] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:26:47.586885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:26:47.587504 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:26:47.594266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:47.594777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:47.595237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:47.595956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:26:47.596514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:26:47.596947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:26:47.739608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:26:47.747465 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-317d8659-d979-4d19-af62-9f63866dcf54 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1681 microversion: 2.1 time: 0.164465 Oct 22 04:26:47.748043 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3940/7741] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:26:47 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:27:17.965124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=34 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:27:17.965877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:27:17.971263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:27:17.974298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:17.982729 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:17.983199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:17.983689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:17.984409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:17.984860 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:17.985281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:18.040510 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-84455eea-488e-46f3-8902-d1439426d384 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action" status: 200 len: 24579 microversion: 2.1 time: 0.077224 Oct 22 04:27:18.041146 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3802/7742] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:27:17 2022] POST /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d/action => generated 24579 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:27:41.713180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:41.713850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:41.716379 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-91b0d1de-7b73-47cf-a9ae-48d203342130 req-d002da19-0b45-4dfb-9633-af487501b857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3561eb5-3c7a-461c-98b3-8d6e966c5f0d", "tag": "839473ef-ebe2-44a3-9199-ff3fbf7e06cc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:27:41.716837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=30 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:27:41.717420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:27:41.723594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:27:41.724673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:41.724815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:27:41.725097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:41.725480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:41.726191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:41.726865 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:41.727249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:41.732125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-91b0d1de-7b73-47cf-a9ae-48d203342130 req-d002da19-0b45-4dfb-9633-af487501b857 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:41.732702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-91b0d1de-7b73-47cf-a9ae-48d203342130 req-d002da19-0b45-4dfb-9633-af487501b857 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:41.733456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-91b0d1de-7b73-47cf-a9ae-48d203342130 req-d002da19-0b45-4dfb-9633-af487501b857 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:41.749647 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-91b0d1de-7b73-47cf-a9ae-48d203342130 req-d002da19-0b45-4dfb-9633-af487501b857 service nova] Creating event network-changed:839473ef-ebe2-44a3-9199-ff3fbf7e06cc for instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d on n-h2-862416-2 Oct 22 04:27:41.755270 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-91b0d1de-7b73-47cf-a9ae-48d203342130 req-d002da19-0b45-4dfb-9633-af487501b857 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043516 Oct 22 04:27:41.756302 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3803/7743] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:27:41.757806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:27:41.848870 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8c675640-9253-4367-b4ea-14e0a0331ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 204 len: 0 microversion: 2.1 time: 0.139401 Oct 22 04:27:41.849478 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3941/7744] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:27:41 2022] DELETE /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:27:41.858939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:41.859730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:41.867058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:41.867640 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:41.868235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:41.869026 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:41.869558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:41.870059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:42.025502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:27:42.034771 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-50fd5f3f-e1f7-48cd-b788-9a85aecb98cf tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1687 microversion: 2.1 time: 0.180557 Oct 22 04:27:42.035341 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3804/7745] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:27:41 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:27:43.060878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:43.061621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:43.068880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:43.069378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:43.069821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:43.070525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:43.070993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:43.071434 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:43.210109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:27:43.218470 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-64623f87-b608-416e-b770-6cb5e5414956 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1687 microversion: 2.1 time: 0.163137 Oct 22 04:27:43.219063 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3942/7746] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:27:43 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:27:43.771382 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-7d6726d9-9836-4d9b-b570-86be39507ddd req-be278648-dc91-4ae5-bef8-21fb9584e340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3561eb5-3c7a-461c-98b3-8d6e966c5f0d", "name": "network-vif-deleted", "tag": "839473ef-ebe2-44a3-9199-ff3fbf7e06cc"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:27:43.782650 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7d6726d9-9836-4d9b-b570-86be39507ddd req-be278648-dc91-4ae5-bef8-21fb9584e340 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:43.783154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7d6726d9-9836-4d9b-b570-86be39507ddd req-be278648-dc91-4ae5-bef8-21fb9584e340 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:43.783619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-7d6726d9-9836-4d9b-b570-86be39507ddd req-be278648-dc91-4ae5-bef8-21fb9584e340 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:43.797492 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-7d6726d9-9836-4d9b-b570-86be39507ddd req-be278648-dc91-4ae5-bef8-21fb9584e340 service nova] Creating event network-vif-deleted:839473ef-ebe2-44a3-9199-ff3fbf7e06cc for instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d on n-h2-862416-2 Oct 22 04:27:43.802320 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-7d6726d9-9836-4d9b-b570-86be39507ddd req-be278648-dc91-4ae5-bef8-21fb9584e340 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034557 Oct 22 04:27:43.803185 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3805/7747] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:27:44.243100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:44.243829 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:44.251294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:44.251854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:44.252349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:44.253185 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:44.253804 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:44.254401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:44.292571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:44.293101 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:44.293481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:44.293971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lazy-loading 'fault' on Instance uuid a3561eb5-3c7a-461c-98b3-8d6e966c5f0d {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:27:44.341085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:27:44.348103 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-82de15f3-3ad3-4ef7-b5b1-9e84e64a2152 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 200 len: 1355 microversion: 2.1 time: 0.109336 Oct 22 04:27:44.348804 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3943/7748] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:27:44 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 1355 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:27:45.374462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:45.375164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: a3561eb5-3c7a-461c-98b3-8d6e966c5f0d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:45.381366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:45.381852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:45.382296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:45.382991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:45.383451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:45.383884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:45.397115 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] HTTP exception thrown: Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d could not be found. Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Request method failure captured: Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d HTTP/1.1 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU2_UTsBUIWZyXGmOotTOehe2PcQt0ZBev2MSefXLKMCQp6kCzGKE8pvC4joSsov1lMX2eRa7olF_lLcL7fIOV6Pj_TiXVmXzvg1kIbEB5ZcL6K2QZRsE-ekHFyy_LZVekh4qq-4BhRQ8CP3lNg-bnJV6S_GBJj60RE6KlOIyzUaRO2c Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}] Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: a215591a0f024864b910dab64fa74d03 Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d could not be found. Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': 'a3561eb5-3c7a-461c-98b3-8d6e966c5f0d'} Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d could not be found. Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d could not be found. Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:27:45.398713 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d could not be found. Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Returning 404 to user: Instance a3561eb5-3c7a-461c-98b3-8d6e966c5f0d could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d19cf576-422d-4bfb-915e-740971e484cd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d" status: 404 len: 111 microversion: 2.1 time: 0.030812 Oct 22 04:27:45.404941 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3806/7749] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:27:45 2022] GET /compute/v2.1/servers/a3561eb5-3c7a-461c-98b3-8d6e966c5f0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:27:48.919093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7111a69-6733-42ae-b400-2daaeb0f3062 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '.version_select at 0x7f0d1a2d5670>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:48.925623 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7111a69-6733-42ae-b400-2daaeb0f3062 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [a645337b-1e79-45c9-beee-538ed076e062] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:27:49.933484 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7111a69-6733-42ae-b400-2daaeb0f3062 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [a645337b-1e79-45c9-beee-538ed076e062] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37756. Oct 22 04:27:49.952313 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7111a69-6733-42ae-b400-2daaeb0f3062 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1479368901" status: 202 len: 0 microversion: 2.1 time: 1.037242 Oct 22 04:27:49.952912 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3944/7750] 10.222.0.25 () {58 vars in 1284 bytes} [Sat Oct 22 04:27:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1479368901 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:27:49.981260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-640a5b25-072b-43fb-a966-8890962345e0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: .version_select at 0x7f0d18fdb940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1621697758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFGopw+e3IUT6qPuImLWcUva0vvoGBoluMjRsdszsEqEujBuv9djLEGf2YD6zYweNP6pGtM/qvTYonEqL2tARNvFJcvCo4KbuF3iyBGlFnsqNLHlEEu338DytFi1STKvw=="}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:27:49.997128 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-640a5b25-072b-43fb-a966-8890962345e0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:27:50.002848 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-640a5b25-072b-43fb-a966-8890962345e0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:27:50.026818 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-640a5b25-072b-43fb-a966-8890962345e0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.048687 Oct 22 04:27:50.027407 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3807/7751] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:27:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:27:55.811411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:27:55.816876 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1158967154", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "a2711246-3f74-4957-b125-f5a370b14fd5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1621697758", "security_groups": [{"name": "tempest-secgroup-smoke-951913643"}]}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:27:55.946856 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.network.neutron [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] validate_networks() for [('a2711246-3f74-4957-b125-f5a370b14fd5', None, None, None, None, None)] {{(pid=120581) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:27:56.438078 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:27:56.438559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image limits 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:27:56.439062 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:27:56.439494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image pref 0:0:0 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:27:56.439934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.virt.hardware [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:27:56.450486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:56.451520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:56.451987 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:56.453050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:56.453585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:56.454066 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:56.471815 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:27:56.477440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:27:56.491176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Going to run 1 instances... {{(pid=120581) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:27:56.493592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:27:56.546741 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2944ba8a-bf28-43ac-99fa-982ef584fdab tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737503 Oct 22 04:27:56.547319 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3945/7752] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:27:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:27:56.560277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ba81d077-7e53-4912-8272-999bc6a32a3b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:56.560902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ba81d077-7e53-4912-8272-999bc6a32a3b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:56.564044 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=12 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:27:56.627120 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ba81d077-7e53-4912-8272-999bc6a32a3b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:27:56.634234 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ba81d077-7e53-4912-8272-999bc6a32a3b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1267 microversion: 2.1 time: 0.079226 Oct 22 04:27:56.635011 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3808/7753] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:27:56 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:27:57.659828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ee0b9c45-7f95-41de-bebe-0fbc9d93e8b1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:57.660548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ee0b9c45-7f95-41de-bebe-0fbc9d93e8b1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:57.724551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ee0b9c45-7f95-41de-bebe-0fbc9d93e8b1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:27:57.734486 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ee0b9c45-7f95-41de-bebe-0fbc9d93e8b1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1267 microversion: 2.1 time: 0.079476 Oct 22 04:27:57.735935 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3946/7754] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:27:57 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:27:58.759292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:58.759927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:58.768021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:58.768549 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:58.768999 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:58.769715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:58.770177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:58.770609 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:58.862087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:27:58.873184 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a9c61d2-c94b-4c67-811a-e0e21c066487 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1327 microversion: 2.1 time: 0.117273 Oct 22 04:27:58.875011 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3809/7755] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:27:58 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:27:59.897971 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:27:59.898583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:27:59.905926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:59.906432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:59.906891 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:27:59.907610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:27:59.908084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:27:59.908555 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:00.147770 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:00.157878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7ec3178e-5b8d-4c87-bae9-7575491c38c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1392 microversion: 2.1 time: 0.263834 Oct 22 04:28:00.158864 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3947/7756] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:27:59 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:00.428722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d152f1e6-3768-4145-a66d-163dd3f24f01 req-7a71d8c5-de12-45e7-8cea-27fce08e62c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1407d986-b08d-4578-8272-f2da00edb06a", "tag": "b531dec1-0465-4767-b791-61e3ff12ca4e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:28:00.440519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d152f1e6-3768-4145-a66d-163dd3f24f01 req-7a71d8c5-de12-45e7-8cea-27fce08e62c8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:00.442409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d152f1e6-3768-4145-a66d-163dd3f24f01 req-7a71d8c5-de12-45e7-8cea-27fce08e62c8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:00.442866 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d152f1e6-3768-4145-a66d-163dd3f24f01 req-7a71d8c5-de12-45e7-8cea-27fce08e62c8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:00.463184 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d152f1e6-3768-4145-a66d-163dd3f24f01 req-7a71d8c5-de12-45e7-8cea-27fce08e62c8 service nova] Creating event network-changed:b531dec1-0465-4767-b791-61e3ff12ca4e for instance 1407d986-b08d-4578-8272-f2da00edb06a on n-h1-862416-2 Oct 22 04:28:00.468743 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d152f1e6-3768-4145-a66d-163dd3f24f01 req-7a71d8c5-de12-45e7-8cea-27fce08e62c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118038 Oct 22 04:28:00.469737 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3810/7757] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:28:01.182076 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:01.182757 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:01.189714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:01.190212 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:01.190663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:01.191369 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:01.191835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:01.192301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:01.325576 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:01.333396 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1fd55684-3dfc-4e6e-b85e-60d2b2b6edd7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1392 microversion: 2.1 time: 0.155313 Oct 22 04:28:01.333974 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3948/7758] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:01 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:02.359219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:02.359892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:02.366057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:02.366534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:02.366970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:02.367659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:02.368111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:02.368567 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:02.503303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:02.512117 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-2e71ccd6-89c8-45e4-a9f5-aa6aa5eea2e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1392 microversion: 2.1 time: 0.158764 Oct 22 04:28:02.512716 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3811/7759] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:02 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:03.535121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:03.535748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:03.543693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:03.544130 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:03.544612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:03.545331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:03.545800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:03.546241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:03.684906 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:03.692793 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa5b8731-7f91-4795-9081-933a266f25c7 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1392 microversion: 2.1 time: 0.161675 Oct 22 04:28:03.693388 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3949/7760] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:03 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:04.716226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:04.716858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:04.723706 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:04.724123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:04.724584 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:04.725267 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:04.725716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:04.726141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:04.861481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:04.869185 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5b6b1a36-623d-47b6-aa08-01f7298a1cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1392 microversion: 2.1 time: 0.157019 Oct 22 04:28:04.870313 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3812/7761] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:04 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:05.187059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-40374692-2c1f-453b-a936-89b60ebca7d2 req-48396622-1842-4c75-9d20-9a374f54e87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1407d986-b08d-4578-8272-f2da00edb06a", "name": "network-vif-plugged", "status": "completed", "tag": "b531dec1-0465-4767-b791-61e3ff12ca4e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:28:05.199276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-40374692-2c1f-453b-a936-89b60ebca7d2 req-48396622-1842-4c75-9d20-9a374f54e87e service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:05.199774 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-40374692-2c1f-453b-a936-89b60ebca7d2 req-48396622-1842-4c75-9d20-9a374f54e87e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:05.200258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-40374692-2c1f-453b-a936-89b60ebca7d2 req-48396622-1842-4c75-9d20-9a374f54e87e service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:05.211632 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-40374692-2c1f-453b-a936-89b60ebca7d2 req-48396622-1842-4c75-9d20-9a374f54e87e service nova] Creating event network-vif-plugged:b531dec1-0465-4767-b791-61e3ff12ca4e for instance 1407d986-b08d-4578-8272-f2da00edb06a on n-h1-862416-2 Oct 22 04:28:05.217308 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-40374692-2c1f-453b-a936-89b60ebca7d2 req-48396622-1842-4c75-9d20-9a374f54e87e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Oct 22 04:28:05.218246 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3950/7762] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:28:05.892822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:05.893443 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:05.900261 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:05.901514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:05.902310 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:05.903018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:05.903478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:05.903923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:06.037459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:06.045489 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0654e9e9-58a5-4377-8979-57fba6b1954c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1392 microversion: 2.1 time: 0.156605 Oct 22 04:28:06.046064 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3813/7763] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:05 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:07.067473 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:07.071840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:07.072703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:07.079124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:07.079629 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:07.080086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:07.080828 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:07.081308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:07.081755 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:07.214102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:07.221977 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a81508c4-dd7b-46bc-9734-d6bfe2d2a306 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1564 microversion: 2.1 time: 0.156379 Oct 22 04:28:07.222566 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3951/7764] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:07 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:28:07.244559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:07.245177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:07.247185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:07.253319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:07.253806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:07.254245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:07.254942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:07.255401 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:07.255834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:07.386776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:07.394529 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-edf4a9b1-591e-44a3-b696-ffe24f5fb7bc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1564 microversion: 2.1 time: 0.153892 Oct 22 04:28:07.395106 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3814/7765] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:07 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:09.262865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-afe78709-eea5-4a4e-9a4f-218a72a79e22 req-2f6747f7-6b5a-4931-b0ef-1fbeed70f67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1407d986-b08d-4578-8272-f2da00edb06a", "tag": "b531dec1-0465-4767-b791-61e3ff12ca4e"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:28:09.266287 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:09.266926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:09.268861 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=8 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:09.280582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afe78709-eea5-4a4e-9a4f-218a72a79e22 req-2f6747f7-6b5a-4931-b0ef-1fbeed70f67d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:09.281153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afe78709-eea5-4a4e-9a4f-218a72a79e22 req-2f6747f7-6b5a-4931-b0ef-1fbeed70f67d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:09.281421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:09.281728 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-afe78709-eea5-4a4e-9a4f-218a72a79e22 req-2f6747f7-6b5a-4931-b0ef-1fbeed70f67d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:09.281939 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:09.282413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:09.283129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:09.283608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:09.284060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:09.293860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-afe78709-eea5-4a4e-9a4f-218a72a79e22 req-2f6747f7-6b5a-4931-b0ef-1fbeed70f67d service nova] Creating event network-changed:b531dec1-0465-4767-b791-61e3ff12ca4e for instance 1407d986-b08d-4578-8272-f2da00edb06a on n-h1-862416-2 Oct 22 04:28:09.299483 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-afe78709-eea5-4a4e-9a4f-218a72a79e22 req-2f6747f7-6b5a-4931-b0ef-1fbeed70f67d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041259 Oct 22 04:28:09.300516 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3815/7766] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:28:09.502910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:09.511429 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f8a9f334-3cc2-44ca-9146-21791599815d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1564 microversion: 2.1 time: 0.256378 Oct 22 04:28:09.512292 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3952/7767] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:09 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1564 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:32.754751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:32.755500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=34 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:32.759823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:28:32.762148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:32.769383 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:32.769865 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:32.770302 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:32.771004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:32.771458 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:32.771882 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:32.823476 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8cb49a3b-6a5c-4313-86b4-c613b05682c3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action" status: 200 len: 24568 microversion: 2.1 time: 0.070556 Oct 22 04:28:32.824268 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3816/7768] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:28:32 2022] POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action => generated 24568 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:28:43.880427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d85f1dca-f2b2-49ff-a0ab-bd9f3364652a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:28:43.882518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:43.883286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=34 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:43.890407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d85f1dca-f2b2-49ff-a0ab-bd9f3364652a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:43.890913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d85f1dca-f2b2-49ff-a0ab-bd9f3364652a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:43.891370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d85f1dca-f2b2-49ff-a0ab-bd9f3364652a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:43.915425 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d85f1dca-f2b2-49ff-a0ab-bd9f3364652a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Going to try to stop instance {{(pid=120581) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 22 04:28:43.957147 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d85f1dca-f2b2-49ff-a0ab-bd9f3364652a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action" status: 202 len: 0 microversion: 2.1 time: 0.080891 Oct 22 04:28:43.957753 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3953/7769] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:28:43 2022] POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:28:43.968202 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:43.968929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:43.971633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:43.972793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=4 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:28:43.981861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:43.982353 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:43.982796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:43.983514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:43.983973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:43.984444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:44.119942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:44.127852 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-25672df4-abb4-4ce6-ae3b-5433396c1336 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.164861 Oct 22 04:28:44.128577 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3817/7770] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:43 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:45.155556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:45.156307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:45.162441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:45.162936 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:45.163385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:45.164084 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:45.164581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:45.165025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:45.296726 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:45.304458 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-efcfcf79-1c52-4e7c-ab3c-3fab1e035f69 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.155018 Oct 22 04:28:45.305037 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3954/7771] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:45 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:46.328806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:46.329451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:46.336558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:46.337045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:46.337525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:46.338215 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:46.338668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:46.340033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:46.476348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:46.484391 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5c452fba-46a0-4880-9522-1f3ef8d297a0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.159428 Oct 22 04:28:46.484964 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3818/7772] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:46 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:47.508930 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:47.509560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:47.516106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:47.516638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:47.517098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:47.517812 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:47.518286 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:47.518731 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:47.648992 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:47.657832 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-268f3728-5155-4c00-8999-31950dbeb03c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.153013 Oct 22 04:28:47.658416 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3955/7773] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:47 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:48.681711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:48.682325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:48.689730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:48.690210 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:48.690643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:48.691335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:48.691786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:48.692236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:48.830994 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:48.839335 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-073f0a31-aa54-4df6-8936-02a6b4a30473 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.160977 Oct 22 04:28:48.840092 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3819/7774] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:48 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:49.863608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:49.864173 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:49.871579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:49.872075 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:49.872551 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:49.873249 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:49.873713 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:49.874150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:50.012921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:50.020785 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cf7b0436-af75-42b7-b8c4-6ca6e8b278d2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.161209 Oct 22 04:28:50.021373 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3956/7775] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:49 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:51.044787 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:51.045407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:51.052199 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:51.052714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:51.053159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:51.053854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:51.054312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:51.054740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:51.186655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:51.194444 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d51c35e1-68e3-4690-af1a-a3b340a25014 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.153650 Oct 22 04:28:51.195031 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3820/7776] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:51 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:52.218854 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:52.219590 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:52.226503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:52.227005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:52.227463 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:52.228170 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:52.228682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:52.229126 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:52.360013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:52.367822 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9843e6fb-a4da-4075-8451-f5575261f3a8 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.152937 Oct 22 04:28:52.368454 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3957/7777] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:52 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:53.391412 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:53.392062 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:53.398901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:53.399387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:53.399843 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:53.400541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:53.401015 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:53.402509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:53.538143 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:53.546146 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d3eebdee-57e0-44cf-a451-a6c4b28a263a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.158866 Oct 22 04:28:53.546721 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3821/7778] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:53 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:28:54.571087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:54.571664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:54.579344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:54.579839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:54.580319 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:54.581016 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:54.581483 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:54.581920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:54.720458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:54.728262 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7a3116c5-99f4-4d50-bfc2-ddbe8284e22a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.161247 Oct 22 04:28:54.728851 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3958/7779] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:54 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:55.752643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:55.753194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:55.762388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:55.762871 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:55.763308 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:55.764004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:55.764494 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:55.764916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:55.896177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:55.904494 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-32ae0993-93b5-4049-9c90-02f1fb7d8ba6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.155873 Oct 22 04:28:55.905072 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3822/7780] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:55 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:56.928548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:56.929461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:56.936749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:56.937250 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:56.937700 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:56.938402 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:56.938868 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:56.939306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:57.070188 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:57.078623 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5478cbbc-e6fa-458e-9fcc-5a0831cbc6df tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.154053 Oct 22 04:28:57.079215 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3959/7781] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:56 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:58.102483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:58.103105 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:58.106876 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:28:58.107119 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:28:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a (ip 10.222.0.25) !!! Oct 22 04:28:58.113616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:58.114106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:58.114548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:58.115271 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:58.115725 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:58.116154 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:58.256627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:58.265102 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-272f1301-8e94-4dde-bd3f-71a25f3c637c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.166653 Oct 22 04:28:58.265685 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3823/7782] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:58 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:28:59.289870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:28:59.290484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:28:59.298009 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:59.298516 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:59.298976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:59.299696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:28:59.300167 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:28:59.300647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:28:59.436554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:28:59.444337 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ec68b76c-6943-4727-93d1-effdc8ce7fba tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.158495 Oct 22 04:28:59.444922 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3960/7783] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:28:59 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:00.469452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:00.470063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:00.477052 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:00.477530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:00.477963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:00.478658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:00.479149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:00.479577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:00.608179 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:00.615897 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-38b081ae-68d4-4613-83b1-d10f70791db2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.150395 Oct 22 04:29:00.616500 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3824/7784] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:00 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:01.639515 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:01.640176 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:01.647121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:01.647616 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:01.648072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:01.648798 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:01.649268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:01.649709 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:01.782404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:01.790990 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa984ccd-dfc7-488a-adf6-b6a481496a86 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.155426 Oct 22 04:29:01.791593 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3961/7785] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:01 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:02.814979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:02.815681 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:02.823474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:02.823974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:02.824509 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:02.825301 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:02.825759 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:02.826190 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:02.959017 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:02.967536 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-207cce4b-bad2-4129-9828-a43525494e85 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.156482 Oct 22 04:29:02.968134 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3825/7786] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:02 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:03.991710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:03.992357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:03.999824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:04.000352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:04.000806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:04.001508 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:04.001976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:04.002417 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:04.149644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:04.158860 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6ba98e28-438c-4658-9c0e-3c7112213679 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1693 microversion: 2.1 time: 0.171055 Oct 22 04:29:04.159449 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3962/7787] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:03 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:05.183201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:05.183807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:05.190639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:05.191119 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:05.191557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:05.192274 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:05.192735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:05.193168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:05.327038 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:05.334868 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d0d0296e-e9e1-4363-96d1-a75e848172bb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1670 microversion: 2.1 time: 0.156233 Oct 22 04:29:05.335443 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3826/7788] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:05 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:06.429298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:29:06.431539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:06.439571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:06.440068 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:06.440585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:06.441285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:06.441751 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:06.442187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:06.502067 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e7897f1b-d62f-435e-8ba3-742a1d0fbef9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action" status: 200 len: 38348 microversion: 2.1 time: 0.076532 Oct 22 04:29:06.502729 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3963/7789] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:29:06 2022] POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action => generated 38348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:29:06.514979 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b337469f-1c58-407c-94ea-d3d87052d1c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:29:06.522095 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b337469f-1c58-407c-94ea-d3d87052d1c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:06.522578 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b337469f-1c58-407c-94ea-d3d87052d1c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:06.523021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b337469f-1c58-407c-94ea-d3d87052d1c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:06.546051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b337469f-1c58-407c-94ea-d3d87052d1c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Going to try to start instance {{(pid=120582) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 22 04:29:06.588798 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b337469f-1c58-407c-94ea-d3d87052d1c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action" status: 202 len: 0 microversion: 2.1 time: 0.077339 Oct 22 04:29:06.589418 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3827/7790] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:29:06 2022] POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:29:06.598484 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:06.599201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:06.606797 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:06.607388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:06.608088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:06.608869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:06.609599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:06.610043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:06.834614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:06.843023 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7882847b-95e9-4b4d-a087-b9c62b9a7fd3 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1679 microversion: 2.1 time: 0.248835 Oct 22 04:29:06.843538 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3964/7791] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:06 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:07.867801 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:07.868541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:07.875515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:07.875996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:07.876459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:07.877148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:07.877597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:07.878020 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:08.016557 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:08.024151 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a7b4a7c8-7ae0-4ac2-a064-22d8e1aa9ee5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1683 microversion: 2.1 time: 0.160958 Oct 22 04:29:08.024752 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3828/7792] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:07 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:34.221559 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:29:34.223819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:34.226441 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=24 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:29:34.227119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:29:34.236100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:34.236664 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:34.237093 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:34.237819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:34.238292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:34.238738 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:34.293215 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fa47bd55-098d-4e69-8c57-8649e3a96bfc tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action" status: 200 len: 62915 microversion: 2.1 time: 0.076288 Oct 22 04:29:34.294290 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3965/7793] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:29:34 2022] POST /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a/action => generated 62915 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:29:41.315612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:41.316149 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:41.318689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=24 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:29:41.318840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3e64b6ce-bd75-4cc3-9c3f-333c9b86560f req-6a56409f-ce9d-481d-a8fe-6c1aeec34dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1407d986-b08d-4578-8272-f2da00edb06a", "tag": "b531dec1-0465-4767-b791-61e3ff12ca4e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:29:41.319431 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:29:41.327327 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:41.327935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:41.328481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:41.329266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:41.329795 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:41.330292 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:41.330922 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e64b6ce-bd75-4cc3-9c3f-333c9b86560f req-6a56409f-ce9d-481d-a8fe-6c1aeec34dc0 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:41.331420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e64b6ce-bd75-4cc3-9c3f-333c9b86560f req-6a56409f-ce9d-481d-a8fe-6c1aeec34dc0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:41.331867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3e64b6ce-bd75-4cc3-9c3f-333c9b86560f req-6a56409f-ce9d-481d-a8fe-6c1aeec34dc0 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:41.344650 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3e64b6ce-bd75-4cc3-9c3f-333c9b86560f req-6a56409f-ce9d-481d-a8fe-6c1aeec34dc0 service nova] Creating event network-changed:b531dec1-0465-4767-b791-61e3ff12ca4e for instance 1407d986-b08d-4578-8272-f2da00edb06a on n-h1-862416-2 Oct 22 04:29:41.349761 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3e64b6ce-bd75-4cc3-9c3f-333c9b86560f req-6a56409f-ce9d-481d-a8fe-6c1aeec34dc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035381 Oct 22 04:29:41.350733 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3966/7794] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:29:41.366988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:29:41.462809 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-20fb8ad1-4a27-4b30-a8af-b7b2f61a656a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 204 len: 0 microversion: 2.1 time: 0.150203 Oct 22 04:29:41.470445 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3829/7795] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:29:41 2022] DELETE /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:29:41.480268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:41.481381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:41.488941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:41.489529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:41.490419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:41.491406 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:41.492099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:41.492641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:41.677080 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:41.684905 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-49f81a08-3f3c-4d54-bfba-30153e54d3da tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1689 microversion: 2.1 time: 0.214509 Oct 22 04:29:41.685483 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3967/7796] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:41 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1689 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:42.710403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:42.711110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:42.719147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:42.719626 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:42.720065 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:42.720783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:42.721232 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:42.721651 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:42.901698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:42.910385 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a51d3b44-2df5-4a62-8fea-80af83e6a215 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1689 microversion: 2.1 time: 0.204230 Oct 22 04:29:42.910972 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3830/7797] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:42 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:43.567112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-90b90d9e-bc3f-4450-a725-933225170110 req-950a9789-cfb3-4f60-9c32-96872b1a3424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1407d986-b08d-4578-8272-f2da00edb06a", "name": "network-vif-deleted", "tag": "b531dec1-0465-4767-b791-61e3ff12ca4e"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:29:43.581325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-90b90d9e-bc3f-4450-a725-933225170110 req-950a9789-cfb3-4f60-9c32-96872b1a3424 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:43.581816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-90b90d9e-bc3f-4450-a725-933225170110 req-950a9789-cfb3-4f60-9c32-96872b1a3424 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:43.582263 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-90b90d9e-bc3f-4450-a725-933225170110 req-950a9789-cfb3-4f60-9c32-96872b1a3424 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:43.596722 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-90b90d9e-bc3f-4450-a725-933225170110 req-950a9789-cfb3-4f60-9c32-96872b1a3424 service nova] Creating event network-vif-deleted:b531dec1-0465-4767-b791-61e3ff12ca4e for instance 1407d986-b08d-4578-8272-f2da00edb06a on n-h1-862416-2 Oct 22 04:29:43.602132 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-90b90d9e-bc3f-4450-a725-933225170110 req-950a9789-cfb3-4f60-9c32-96872b1a3424 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038786 Oct 22 04:29:43.602738 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3968/7798] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:29:43.934817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:43.936066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:43.943209 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:43.943700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:43.944141 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:43.944876 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:43.945331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:43.945758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:43.982825 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:43.983312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:43.983752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:43.984231 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lazy-loading 'fault' on Instance uuid 1407d986-b08d-4578-8272-f2da00edb06a {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:29:44.030459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:44.038362 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8d6e0519-716a-4323-a03e-ca440807b7e5 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 200 len: 1357 microversion: 2.1 time: 0.107709 Oct 22 04:29:44.039022 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3831/7799] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:43 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:45.062459 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:45.063168 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 1407d986-b08d-4578-8272-f2da00edb06a] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:45.070294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:45.070788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:45.071236 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:45.071933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:45.072438 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:45.072877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:45.087241 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] HTTP exception thrown: Instance 1407d986-b08d-4578-8272-f2da00edb06a could not be found. Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Request method failure captured: Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a HTTP/1.1 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2_UTsBUIWZyXGmOotTOehe2PcQt0ZBev2MSefXLKMCQp6kCzGKE8pvC4joSsov1lMX2eRa7olF_lLcL7fIOV6Pj_TiXVmXzvg1kIbEB5ZcL6K2QZRsE-ekHFyy_LZVekh4qq-4BhRQ8CP3lNg-bnJV6S_GBJj60RE6KlOIyzUaRO2c Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}] Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: a215591a0f024864b910dab64fa74d03 Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 1407d986-b08d-4578-8272-f2da00edb06a could not be found. Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '1407d986-b08d-4578-8272-f2da00edb06a'} Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1407d986-b08d-4578-8272-f2da00edb06a could not be found. Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1407d986-b08d-4578-8272-f2da00edb06a could not be found. Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:29:45.088943 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1407d986-b08d-4578-8272-f2da00edb06a could not be found. Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Returning 404 to user: Instance 1407d986-b08d-4578-8272-f2da00edb06a could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-97d938d0-910b-4aa9-8699-46276cb48916 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a" status: 404 len: 111 microversion: 2.1 time: 0.032757 Oct 22 04:29:45.095077 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3969/7800] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:45 2022] GET /compute/v2.1/servers/1407d986-b08d-4578-8272-f2da00edb06a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 22 04:29:48.429463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fdd6d6cd-aa11-46dd-8db1-047a8047aae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '.version_select at 0x7f0d1a9299d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:48.450541 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fdd6d6cd-aa11-46dd-8db1-047a8047aae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1621697758" status: 202 len: 0 microversion: 2.1 time: 0.024851 Oct 22 04:29:48.452670 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3832/7801] 10.222.0.25 () {58 vars in 1284 bytes} [Sat Oct 22 04:29:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1621697758 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:29:48.488026 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ddc3fa62-5b47-475f-88f6-766d273e2cbd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: .version_select at 0x7f0d198705e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1851352364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmvSTFMLlLa2M8MjScetT9kSpcf4M1rqrXmrJUSAaloiuqL5GOC5zQ+HCTcJ/UsSzfPM6uvDyaUWg2+iS1S+3p4/tWFIVqFuVhwQWwWZEuHqIBmfAZxf6NutfruNfB/bw=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:29:48.514589 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ddc3fa62-5b47-475f-88f6-766d273e2cbd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:29:48.520505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-ddc3fa62-5b47-475f-88f6-766d273e2cbd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:29:48.554302 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ddc3fa62-5b47-475f-88f6-766d273e2cbd tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.070314 Oct 22 04:29:48.555236 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3970/7802] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:29:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:29:54.274895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:29:54.279262 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1121306652", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "networks": [{"uuid": "d642b841-a4e6-4839-9804-ab6fe7abf1b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1851352364", "security_groups": [{"name": "tempest-secgroup-smoke-1861438691"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:29:54.418500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] validate_networks() for [('d642b841-a4e6-4839-9804-ab6fe7abf1b5', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:29:54.897004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:29:54.897438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:29:54.897906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:29:54.898591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:29:54.899219 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:29:54.910722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:54.911351 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:54.911902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:54.912762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:54.913311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:54.913834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:54.934063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:29:54.940927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Getting quotas for user a215591a0f024864b910dab64fa74d03 and project 4b9654a5d6a84389b209c9a00dcf26e2. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:29:54.959168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:29:54.962872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:29:55.024451 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a4930d98-3ad5-4937-9f44-08c258a20cf6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751392 Oct 22 04:29:55.025117 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3833/7803] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:29:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:29:55.038304 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6d4da58a-5142-4962-b4ac-78ee99920354 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:55.039579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6d4da58a-5142-4962-b4ac-78ee99920354 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:55.079332 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=16 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:29:55.132969 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6d4da58a-5142-4962-b4ac-78ee99920354 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:55.151235 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6d4da58a-5142-4962-b4ac-78ee99920354 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1267 microversion: 2.1 time: 0.116923 Oct 22 04:29:55.152493 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3971/7804] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:55 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1267 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:56.181206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:56.182481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:56.194146 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:56.195050 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:56.195885 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:56.197131 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:56.197687 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:56.198311 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:56.291411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:56.299389 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3e0d6792-80ac-4b16-84ed-7c73234bd3c6 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1337 microversion: 2.1 time: 0.123106 Oct 22 04:29:56.299964 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3834/7805] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:56 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1337 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:57.323521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:57.324151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:57.332599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:57.333282 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:57.333735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:57.334462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:57.334935 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:57.335381 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:57.509340 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:57.519075 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34d99c34-a111-40ff-a002-da7b8e61bcd1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1393 microversion: 2.1 time: 0.199900 Oct 22 04:29:57.520323 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3972/7806] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:57 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1393 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:57.758974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-41d4715d-c744-4dd4-a52f-c6a97b4e8774 req-fed7fd40-6f18-42c7-9960-3d3c3b490943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225de3c7-f20a-4e32-8897-8c5a12c9f0f0", "tag": "dd0e0ea9-7568-4a2d-a152-57c702519303"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:29:57.770949 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-41d4715d-c744-4dd4-a52f-c6a97b4e8774 req-fed7fd40-6f18-42c7-9960-3d3c3b490943 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:57.771436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-41d4715d-c744-4dd4-a52f-c6a97b4e8774 req-fed7fd40-6f18-42c7-9960-3d3c3b490943 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:57.771867 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-41d4715d-c744-4dd4-a52f-c6a97b4e8774 req-fed7fd40-6f18-42c7-9960-3d3c3b490943 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:57.784005 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-41d4715d-c744-4dd4-a52f-c6a97b4e8774 req-fed7fd40-6f18-42c7-9960-3d3c3b490943 service nova] Creating event network-changed:dd0e0ea9-7568-4a2d-a152-57c702519303 for instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 on n-h2-862416-2 Oct 22 04:29:57.788888 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-41d4715d-c744-4dd4-a52f-c6a97b4e8774 req-fed7fd40-6f18-42c7-9960-3d3c3b490943 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034295 Oct 22 04:29:57.789502 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3835/7807] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:29:58.544794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:58.545567 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:58.553018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:58.553536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:58.553995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:58.554762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:58.555242 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:58.555694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:58.697621 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:58.706162 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b7644985-f9af-48b5-a9c2-7f3855c7f15b tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1393 microversion: 2.1 time: 0.166478 Oct 22 04:29:58.706747 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3973/7808] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:58 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:29:59.730473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:29:59.731086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:29:59.737890 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:59.738364 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:59.738798 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:59.739483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:29:59.739928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:29:59.740376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:29:59.872124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:29:59.879933 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-18bcdfbc-9fff-43bd-955a-6c8595858777 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1393 microversion: 2.1 time: 0.154585 Oct 22 04:29:59.880531 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3836/7809] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:29:59 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:30:00.903614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:30:00.904383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:30:00.911335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:00.911837 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:00.912324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:00.913040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:00.913517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:00.913966 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:01.049225 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:30:01.056878 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-571ce129-b051-4045-8230-c4e41866c6e9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1393 microversion: 2.1 time: 0.157815 Oct 22 04:30:01.057459 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3974/7810] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:30:00 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:30:02.080533 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:30:02.081084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:30:02.087932 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:02.088455 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:02.088897 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:02.089594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:02.090043 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:02.090467 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:02.222645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:30:02.230378 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ebb2cc5f-86eb-46a1-8bfc-533860832be4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1393 microversion: 2.1 time: 0.154592 Oct 22 04:30:02.230953 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3837/7811] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:30:02 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:30:03.253836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:30:03.254462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:30:03.262570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:03.262570 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:03.262824 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:03.263940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:03.264437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:03.264878 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:03.399141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:30:03.408064 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f938b17f-ef56-4ab3-b16c-1f15f3c0dfec tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1393 microversion: 2.1 time: 0.158210 Oct 22 04:30:03.408675 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3975/7812] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:30:03 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:30:03.946169 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-2d4ecdda-4da6-45c7-8bde-746749ef3432 req-bd2184dd-5a37-44a1-85d1-28112b982003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225de3c7-f20a-4e32-8897-8c5a12c9f0f0", "name": "network-vif-plugged", "status": "completed", "tag": "dd0e0ea9-7568-4a2d-a152-57c702519303"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:30:03.957272 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d4ecdda-4da6-45c7-8bde-746749ef3432 req-bd2184dd-5a37-44a1-85d1-28112b982003 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:03.957741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d4ecdda-4da6-45c7-8bde-746749ef3432 req-bd2184dd-5a37-44a1-85d1-28112b982003 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:03.958237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-2d4ecdda-4da6-45c7-8bde-746749ef3432 req-bd2184dd-5a37-44a1-85d1-28112b982003 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:03.970394 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-2d4ecdda-4da6-45c7-8bde-746749ef3432 req-bd2184dd-5a37-44a1-85d1-28112b982003 service nova] Creating event network-vif-plugged:dd0e0ea9-7568-4a2d-a152-57c702519303 for instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 on n-h2-862416-2 Oct 22 04:30:03.975373 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-2d4ecdda-4da6-45c7-8bde-746749ef3432 req-bd2184dd-5a37-44a1-85d1-28112b982003 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Oct 22 04:30:03.975980 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3838/7813] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:30:04.430964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:30:04.431588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:30:04.434357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:30:04.440330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:04.440831 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:04.441285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:04.441999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:04.442472 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:04.442916 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:04.577233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:30:04.585114 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e8d2f682-5ea3-4b21-9307-b7ea99506e63 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1393 microversion: 2.1 time: 0.158080 Oct 22 04:30:04.585692 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3976/7814] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:30:04 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:30:05.605642 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:30:05.607004 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:30:05.611951 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:30:05.612679 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:30:05.619751 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:05.620263 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:05.620715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:05.621410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:05.621868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:05.622297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:05.758018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:30:05.766453 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-351418a6-dae4-4ac1-9c7b-150db595b1b4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1564 microversion: 2.1 time: 0.161791 Oct 22 04:30:05.767044 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3839/7815] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:30:05 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:30:05.789475 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:30:05.790108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:30:05.791941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:30:05.798361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:05.798864 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:05.799324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:05.800034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:05.800533 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:05.800981 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:05.941910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:30:05.949683 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-90e99658-d666-48f6-b169-b2d569035c08 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1564 microversion: 2.1 time: 0.164287 Oct 22 04:30:05.950281 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3977/7816] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:30:05 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:30:07.803806 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:30:07.804698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:30:07.807364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-99745c2c-9751-43a2-8a01-3dca2c3d06ef req-7e254439-876e-4bb6-a47c-d9ad1dafb6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225de3c7-f20a-4e32-8897-8c5a12c9f0f0", "tag": "dd0e0ea9-7568-4a2d-a152-57c702519303"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:30:07.812429 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:07.813168 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:07.813615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:07.814328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:07.814991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:07.815428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:07.819220 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-99745c2c-9751-43a2-8a01-3dca2c3d06ef req-7e254439-876e-4bb6-a47c-d9ad1dafb6f3 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:07.820056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-99745c2c-9751-43a2-8a01-3dca2c3d06ef req-7e254439-876e-4bb6-a47c-d9ad1dafb6f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:07.820585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-99745c2c-9751-43a2-8a01-3dca2c3d06ef req-7e254439-876e-4bb6-a47c-d9ad1dafb6f3 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:07.833518 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-99745c2c-9751-43a2-8a01-3dca2c3d06ef req-7e254439-876e-4bb6-a47c-d9ad1dafb6f3 service nova] Creating event network-changed:dd0e0ea9-7568-4a2d-a152-57c702519303 for instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 on n-h2-862416-2 Oct 22 04:30:07.839073 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-99745c2c-9751-43a2-8a01-3dca2c3d06ef req-7e254439-876e-4bb6-a47c-d9ad1dafb6f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036098 Oct 22 04:30:07.840100 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3978/7817] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:30:08.049066 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:30:08.057119 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0088f705-38b0-4171-9a8c-68b7e0a68ae4 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1564 microversion: 2.1 time: 0.257618 Oct 22 04:30:08.057845 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3840/7818] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:30:07 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1564 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:30:39.336740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=5 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:30:39.337494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=38 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:30:39.341915 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:30:39.344847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:30:39.352069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:39.352602 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:39.353056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:39.353768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:30:39.354237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:30:39.354679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:30:39.404591 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f4d6855a-79e4-43a7-a37a-ed62ab54fa3d tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action" status: 200 len: 24575 microversion: 2.1 time: 0.069811 Oct 22 04:30:39.405221 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3979/7819] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:30:39 2022] POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action => generated 24575 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:31:09.837700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:09.838491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=36 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:09.844428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:09.844961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:09.852306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:09.852786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:09.853218 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:09.853902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:09.854348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:09.854770 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:09.879476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lazy-loading 'flavor' on Instance uuid 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:31:09.943812 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-14f1c8a8-29ab-4938-b1f5-26bea48adfe2 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.108276 Oct 22 04:31:09.944489 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3841/7820] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:31:09 2022] POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:31:09.954735 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:09.955541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:09.958305 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:09.959210 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:09.968021 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:09.968550 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:09.969006 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:09.969729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:09.970201 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:09.970646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:10.107152 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:10.116090 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4ac2861d-5650-4c11-947f-50286768ba5a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1690 microversion: 2.1 time: 0.167034 Oct 22 04:31:10.116711 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3980/7821] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:09 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:11.141638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:11.142246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:11.148730 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:11.149226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:11.149669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:11.150397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:11.150853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:11.151282 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:11.289628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:11.298065 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-07103b06-6375-43c8-8b21-ccff49cb839c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1690 microversion: 2.1 time: 0.162370 Oct 22 04:31:11.298640 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3842/7822] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:11 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:12.322952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:12.323568 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:12.331027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:12.331520 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:12.331967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:12.332695 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:12.333164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:12.333600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:12.465486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:12.474063 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-39d6d10a-4d7e-4600-8cea-7d5511d2f5d1 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1673 microversion: 2.1 time: 0.155010 Oct 22 04:31:12.474821 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3981/7823] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:12 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:13.572420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:13.574682 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:13.581569 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:13.582056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:13.582500 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:13.583197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:13.583653 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:13.584079 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:13.635352 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5a7bbdfd-fa7b-4b83-a846-ea23e1bc4a37 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action" status: 200 len: 37924 microversion: 2.1 time: 0.066791 Oct 22 04:31:13.635993 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3843/7824] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:31:13 2022] POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action => generated 37924 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:31:13.648388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:13.648982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:13.656720 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:13.657227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:13.657686 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:13.658399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:13.658875 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:13.659324 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:13.724747 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-35bf27ab-5081-466d-9b78-89d07da2a404 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.080061 Oct 22 04:31:13.725339 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3982/7825] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:31:13 2022] POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:31:13.735021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:13.735731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:13.744564 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:13.745056 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:13.745496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:13.746313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:13.746758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:13.747188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:13.969818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:13.977924 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3729ca12-2cf8-45b8-9fdf-ea58053d95b0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1679 microversion: 2.1 time: 0.247687 Oct 22 04:31:13.978656 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3844/7826] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:13 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:15.001430 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:31:15.002036 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:31:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 (ip 10.222.0.25) !!! Oct 22 04:31:15.007015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:15.007730 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:15.015758 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:15.016285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:15.016748 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:15.017478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:15.017933 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:15.018377 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:15.150301 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:15.158340 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e26a40d5-425b-4c1b-9b19-e0d0038c2370 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1679 microversion: 2.1 time: 0.159526 Oct 22 04:31:15.158917 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3983/7827] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:14 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:16.182864 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:16.183491 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:16.190551 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:16.191037 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:16.191479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:16.192233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:16.192686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:16.193117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:16.333974 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:16.342829 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f113f16a-1ebb-458b-9ba5-d6d32652a320 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1682 microversion: 2.1 time: 0.163232 Oct 22 04:31:16.343663 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3845/7828] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:16 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:16.453099 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:16.456034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:16.463160 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:16.463657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:16.464110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:16.464847 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:16.465315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:16.465772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:16.510171 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb5f8e84-14da-4e27-8d81-ad0569b03085 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action" status: 200 len: 37924 microversion: 2.1 time: 0.062268 Oct 22 04:31:16.510861 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3984/7829] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:31:16 2022] POST /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0/action => generated 37924 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 22 04:31:17.517316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:17.517857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:17.525159 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:17.525774 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:17.526087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:17.527155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:17.527616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:17.528047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:17.575339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c4a96d15-b44e-4c5f-93a9-09d84f21ca58 req-6ae0ecff-372e-4147-9347-1c0e50de9e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225de3c7-f20a-4e32-8897-8c5a12c9f0f0", "tag": "dd0e0ea9-7568-4a2d-a152-57c702519303"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:17.588111 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4a96d15-b44e-4c5f-93a9-09d84f21ca58 req-6ae0ecff-372e-4147-9347-1c0e50de9e88 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:17.588641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4a96d15-b44e-4c5f-93a9-09d84f21ca58 req-6ae0ecff-372e-4147-9347-1c0e50de9e88 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:17.589102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c4a96d15-b44e-4c5f-93a9-09d84f21ca58 req-6ae0ecff-372e-4147-9347-1c0e50de9e88 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:17.601458 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-c4a96d15-b44e-4c5f-93a9-09d84f21ca58 req-6ae0ecff-372e-4147-9347-1c0e50de9e88 service nova] Creating event network-changed:dd0e0ea9-7568-4a2d-a152-57c702519303 for instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 on n-h2-862416-2 Oct 22 04:31:17.606909 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c4a96d15-b44e-4c5f-93a9-09d84f21ca58 req-6ae0ecff-372e-4147-9347-1c0e50de9e88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091397 Oct 22 04:31:17.607721 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3985/7830] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:31:17.834717 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:31:17.960638 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a89fcb86-c993-4e6d-a94f-188149c85bfb tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 204 len: 0 microversion: 2.1 time: 0.447260 Oct 22 04:31:17.962386 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3846/7831] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:31:17 2022] DELETE /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:31:17.973221 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:17.973942 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:17.981233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:17.981976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:17.982642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:17.984448 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:17.984928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:17.985543 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:18.130800 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:18.138906 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-090bdc6d-9870-4b2b-8213-6afae58cace0 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1688 microversion: 2.1 time: 0.171898 Oct 22 04:31:18.140044 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3986/7832] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:17 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:19.166285 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:19.166977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:19.174575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:19.175063 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:19.175503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:19.176201 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:19.177086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:19.177086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:19.388434 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:19.397006 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4ccd8efe-ba6b-4d45-bfdc-a2368e97987a tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1688 microversion: 2.1 time: 0.234979 Oct 22 04:31:19.397808 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3847/7833] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:19 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1688 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:20.150298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-368ce37e-1750-42d0-a5f2-9cf56e01c24c req-2c8d81b2-69f8-433f-a4e0-78dcdc1d1a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225de3c7-f20a-4e32-8897-8c5a12c9f0f0", "name": "network-vif-deleted", "tag": "dd0e0ea9-7568-4a2d-a152-57c702519303"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:20.164161 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-368ce37e-1750-42d0-a5f2-9cf56e01c24c req-2c8d81b2-69f8-433f-a4e0-78dcdc1d1a6b service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:20.164678 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-368ce37e-1750-42d0-a5f2-9cf56e01c24c req-2c8d81b2-69f8-433f-a4e0-78dcdc1d1a6b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:20.165123 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-368ce37e-1750-42d0-a5f2-9cf56e01c24c req-2c8d81b2-69f8-433f-a4e0-78dcdc1d1a6b service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:20.178051 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-368ce37e-1750-42d0-a5f2-9cf56e01c24c req-2c8d81b2-69f8-433f-a4e0-78dcdc1d1a6b service nova] Creating event network-vif-deleted:dd0e0ea9-7568-4a2d-a152-57c702519303 for instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 on n-h2-862416-2 Oct 22 04:31:20.182943 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-368ce37e-1750-42d0-a5f2-9cf56e01c24c req-2c8d81b2-69f8-433f-a4e0-78dcdc1d1a6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036725 Oct 22 04:31:20.183535 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3987/7834] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:31:20.421335 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:20.422002 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:20.428899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:20.429398 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:20.429943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:20.430543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:20.431009 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:20.431450 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:20.464802 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:20.465018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:20.465469 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:20.465929 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lazy-loading 'fault' on Instance uuid 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:31:20.513135 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a215591a0f024864b910dab64fa74d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9654a5d6a84389b209c9a00dcf26e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:20.521369 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97eb99bc-86b3-400d-a73b-4652e86d589c tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 200 len: 1357 microversion: 2.1 time: 0.104373 Oct 22 04:31:20.521959 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3848/7835] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:20 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:21.547679 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:21.548413 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] [instance: 225de3c7-f20a-4e32-8897-8c5a12c9f0f0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:21.554603 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:21.555096 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:21.555548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:21.556279 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:21.556752 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:21.557189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:21.571075 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] HTTP exception thrown: Instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 could not be found. Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Request method failure captured: Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 HTTP/1.1 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU2_UTsBUIWZyXGmOotTOehe2PcQt0ZBev2MSefXLKMCQp6kCzGKE8pvC4joSsov1lMX2eRa7olF_lLcL7fIOV6Pj_TiXVmXzvg1kIbEB5ZcL6K2QZRsE-ekHFyy_LZVekh4qq-4BhRQ8CP3lNg-bnJV6S_GBJj60RE6KlOIyzUaRO2c Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b9654a5d6a84389b209c9a00dcf26e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b9654a5d6a84389b209c9a00dcf26e2"}]}] Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 4b9654a5d6a84389b209c9a00dcf26e2 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1306278403 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: a215591a0f024864b910dab64fa74d03 Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1306278403-project Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 could not be found. Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '225de3c7-f20a-4e32-8897-8c5a12c9f0f0'} Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 could not be found. Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 could not be found. Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:31:21.572744 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 could not be found. Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Returning 404 to user: Instance 225de3c7-f20a-4e32-8897-8c5a12c9f0f0 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-768dcb22-afe6-4f43-a5d8-fcf11f455104 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0" status: 404 len: 111 microversion: 2.1 time: 0.032719 Oct 22 04:31:21.577806 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3988/7836] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:21 2022] GET /compute/v2.1/servers/225de3c7-f20a-4e32-8897-8c5a12c9f0f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:31:24.929014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f3671cff-522d-4039-b0aa-ba75276589d9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] Calling method '.version_select at 0x7f0d191a2ca0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:24.955519 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f3671cff-522d-4039-b0aa-ba75276589d9 tempest-TestNetworkAdvancedServerOps-1306278403 tempest-TestNetworkAdvancedServerOps-1306278403-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1851352364" status: 202 len: 0 microversion: 2.1 time: 0.030265 Oct 22 04:31:24.955979 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3849/7837] 10.222.0.25 () {58 vars in 1284 bytes} [Sat Oct 22 04:31:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1851352364 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:31:36.361853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=18 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:36.362805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:36.607583 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-c96be319-9807-4267-be2b-35cade70c90f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Action: 'create', calling method: .version_select at 0x7f0d1a998310>, body: {"keypair": {"name": "tempest-TestShelveInstance-324916065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5XXQ23u1EzwzvLbKUGuK1FOcH71+0/o97VajEq7CcfViKW/Tna3sntIIqZHNgSUoVTgWbBHsUHqu7stvyN7Ps2lElPvu6/n1NljkVIBBcfAbgRF/Jjbaffui87YOxlgA=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:36.631656 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-c96be319-9807-4267-be2b-35cade70c90f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Getting quotas for project 335d7a25ce5146cea6836550cded735a. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:31:36.638635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-c96be319-9807-4267-be2b-35cade70c90f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Getting quotas for user 336d5f2120bf44cf8a2b21026ec7873d and project 335d7a25ce5146cea6836550cded735a. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:31:36.672130 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-c96be319-9807-4267-be2b-35cade70c90f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.317217 Oct 22 04:31:36.672861 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3989/7838] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:31:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:31:37.674136 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:37.674898 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:37.679060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1445959169", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-324916065", "security_groups": [{"name": "tempest-secgroup-smoke-1147870616"}], "networks": [{"uuid": "0cea762a-a544-467c-b6a0-2a0f78d50700"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:37.790920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] validate_networks() for [('0cea762a-a544-467c-b6a0-2a0f78d50700', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:31:38.277470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:31:38.277903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:31:38.278387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:31:38.278835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:31:38.279652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:31:38.288763 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:38.289245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:38.289683 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:38.290418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:38.290881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:38.291315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:38.310451 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Getting quotas for project 335d7a25ce5146cea6836550cded735a. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:31:38.316388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Getting quotas for user 336d5f2120bf44cf8a2b21026ec7873d and project 335d7a25ce5146cea6836550cded735a. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:31:38.329255 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:31:38.331583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:31:38.379973 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f9363e2f-5ab3-4018-9ca8-d89ac067f004 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707645 Oct 22 04:31:38.387211 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3850/7839] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:31:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:31:38.393898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-285adae3-c741-44ff-bfa4-d6b81470e02e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:38.394526 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-285adae3-c741-44ff-bfa4-d6b81470e02e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:38.499552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-285adae3-c741-44ff-bfa4-d6b81470e02e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:38.510247 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-285adae3-c741-44ff-bfa4-d6b81470e02e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1246 microversion: 2.1 time: 0.119626 Oct 22 04:31:38.511697 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3990/7840] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:38 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:39.536562 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:39.537298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:39.544530 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:39.545213 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:39.545880 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:39.546676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:39.547239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:39.547735 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:39.657886 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:39.666819 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-deec4e79-978f-49dc-b218-35439fbbedcd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1306 microversion: 2.1 time: 0.135940 Oct 22 04:31:39.667469 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3851/7841] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:39 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1306 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:40.693153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:40.694466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:40.712097 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:40.712691 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:40.713154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:40.713902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:40.714365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:40.715333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:40.910073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:40.920464 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-33c5572c-5043-4381-b89f-f613953ca100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1372 microversion: 2.1 time: 0.232304 Oct 22 04:31:40.921303 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3991/7842] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:40 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:41.209025 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d0d6024f-0b51-4c7e-bed0-b8b9b1d5b92d req-474c5731-1f93-4f84-98d0-0081db8d0a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:41.220655 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d0d6024f-0b51-4c7e-bed0-b8b9b1d5b92d req-474c5731-1f93-4f84-98d0-0081db8d0a43 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:41.221137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d0d6024f-0b51-4c7e-bed0-b8b9b1d5b92d req-474c5731-1f93-4f84-98d0-0081db8d0a43 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:41.221582 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d0d6024f-0b51-4c7e-bed0-b8b9b1d5b92d req-474c5731-1f93-4f84-98d0-0081db8d0a43 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:41.240800 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d0d6024f-0b51-4c7e-bed0-b8b9b1d5b92d req-474c5731-1f93-4f84-98d0-0081db8d0a43 service nova] Creating event network-changed:72378aa6-3c34-4908-8dbd-a4e0a00af897 for instance 96755dbc-325d-4081-bff7-31010492c6b5 on n-h1-862416-2 Oct 22 04:31:41.245923 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d0d6024f-0b51-4c7e-bed0-b8b9b1d5b92d req-474c5731-1f93-4f84-98d0-0081db8d0a43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040852 Oct 22 04:31:41.246531 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3852/7843] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:31:41.945967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:41.946612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:41.954843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:41.955352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:41.955805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:41.956553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:41.957030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:41.957469 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:42.096149 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:42.104044 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-28ce0382-4c6f-42c4-9acb-31b690ace04e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1372 microversion: 2.1 time: 0.162000 Oct 22 04:31:42.104804 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3992/7844] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:41 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:43.129445 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:43.130110 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:43.136656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:43.137145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:43.137587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:43.138291 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:43.138852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:43.139466 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:43.271657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:43.280133 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1a7055ef-b456-4170-9e0a-e701c92c1df1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1372 microversion: 2.1 time: 0.156124 Oct 22 04:31:43.280737 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3853/7845] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:43 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:44.303799 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:44.304467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:44.311412 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:44.311978 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:44.312453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:44.313401 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:44.313886 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:44.314335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:44.456007 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:44.463962 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e46a2200-8465-455a-aaac-30f82ce4c1c5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1372 microversion: 2.1 time: 0.164217 Oct 22 04:31:44.464597 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3993/7846] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:44 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:45.487033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:45.487574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:45.494316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:45.494796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:45.495228 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:45.495911 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:45.496407 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:45.496831 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:45.629968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:45.637657 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7975f157-ac7a-4c00-87c6-6c96890546d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1372 microversion: 2.1 time: 0.154576 Oct 22 04:31:45.638225 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3854/7847] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:45 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:46.259652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-e72b3b4d-7916-4969-9f26-fa50bc226490 req-5a56de10-7137-490e-aedd-e66493fc0915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "name": "network-vif-plugged", "status": "completed", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:46.270162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e72b3b4d-7916-4969-9f26-fa50bc226490 req-5a56de10-7137-490e-aedd-e66493fc0915 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:46.270646 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e72b3b4d-7916-4969-9f26-fa50bc226490 req-5a56de10-7137-490e-aedd-e66493fc0915 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:46.271088 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-e72b3b4d-7916-4969-9f26-fa50bc226490 req-5a56de10-7137-490e-aedd-e66493fc0915 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:46.282191 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-e72b3b4d-7916-4969-9f26-fa50bc226490 req-5a56de10-7137-490e-aedd-e66493fc0915 service nova] Creating event network-vif-plugged:72378aa6-3c34-4908-8dbd-a4e0a00af897 for instance 96755dbc-325d-4081-bff7-31010492c6b5 on n-h1-862416-2 Oct 22 04:31:46.287312 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-e72b3b4d-7916-4969-9f26-fa50bc226490 req-5a56de10-7137-490e-aedd-e66493fc0915 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096946 Oct 22 04:31:46.287899 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3994/7848] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:31:46.661772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:46.662337 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:46.669233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:46.669723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:46.670996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:46.671575 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:46.672039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:46.672502 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:46.803680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:46.811635 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-933a5058-0ca4-4464-ab48-b25fcaf2f3d3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1372 microversion: 2.1 time: 0.153858 Oct 22 04:31:46.812234 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3855/7849] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:46 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:47.835912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:47.836654 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:47.844522 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:47.845031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:47.845486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:47.846203 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:47.846676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:47.847121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:47.979592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:47.988324 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8121ebd1-5d76-42c0-ace7-bd5c1b4ce28d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1556 microversion: 2.1 time: 0.156830 Oct 22 04:31:47.988901 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3995/7850] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:47 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:48.011359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:31:48.011980 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:31:48.019296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:48.019788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:48.020280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:48.021001 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:48.021460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:48.021891 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:48.156827 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:31:48.164481 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-802a3769-bb93-45d0-8bf6-4029472d85fa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1556 microversion: 2.1 time: 0.157060 Oct 22 04:31:48.165056 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3856/7851] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:31:48 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:31:50.140783 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-f56f7895-7862-4c08-8e3e-f24660454ebb req-9a805e6f-f6a6-46a3-8b3b-784c37463989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:31:50.146086 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:31:50.152742 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f56f7895-7862-4c08-8e3e-f24660454ebb req-9a805e6f-f6a6-46a3-8b3b-784c37463989 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:31:50.153244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f56f7895-7862-4c08-8e3e-f24660454ebb req-9a805e6f-f6a6-46a3-8b3b-784c37463989 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:31:50.153694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-f56f7895-7862-4c08-8e3e-f24660454ebb req-9a805e6f-f6a6-46a3-8b3b-784c37463989 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:31:50.165773 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-f56f7895-7862-4c08-8e3e-f24660454ebb req-9a805e6f-f6a6-46a3-8b3b-784c37463989 service nova] Creating event network-changed:72378aa6-3c34-4908-8dbd-a4e0a00af897 for instance 96755dbc-325d-4081-bff7-31010492c6b5 on n-h1-862416-2 Oct 22 04:31:50.170959 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-f56f7895-7862-4c08-8e3e-f24660454ebb req-9a805e6f-f6a6-46a3-8b3b-784c37463989 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034593 Oct 22 04:31:50.171568 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3996/7852] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:33:46.448246 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4937fa55-f991-417b-88b2-9cc53442bf17] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:33:46.448815 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:33:46.449339 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:33:46.450689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:33:46.451386 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=34 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:33:46.456151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:33:46.456731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:46.465750 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:46.466714 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:46.467188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:46.467944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:46.468389 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:46.468823 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:46.493378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lazy-loading 'flavor' on Instance uuid 96755dbc-325d-4081-bff7-31010492c6b5 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:33:46.686954 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-fee5612e-4886-4c5d-a697-da5a786cb74a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "POST /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5/action" status: 202 len: 0 microversion: 2.1 time: 0.240757 Oct 22 04:33:46.687562 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3857/7853] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:33:46 2022] POST /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:33:46.696650 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61cb36d1-88e4-4398-80a4-3c83b9903fa2] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 22 04:33:46.697233 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:33:46.698163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=28 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:33:46.703805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:46.704557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:46.712313 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:46.712809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:46.713354 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:46.714098 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:46.714579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:46.715025 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:46.854505 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:46.862429 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-54e96c1b-0a9d-46c2-8e1b-a9eb40b891fd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.169502 Oct 22 04:33:46.863012 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3997/7854] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:46 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:33:47.888067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:47.889324 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:47.897121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:47.897605 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:47.898042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:47.898747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:47.899206 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:47.899636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:47.905137 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] [4937fa55-f991-417b-88b2-9cc53442bf17] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38378. Oct 22 04:33:48.038433 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:48.046972 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-aef7ad75-2843-4f61-9c55-cb69d7978a89 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.164733 Oct 22 04:33:48.047760 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3858/7855] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:47 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:33:49.071346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:49.071961 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:49.080624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:49.081122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:49.081578 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:49.082291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:49.082761 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:49.083205 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:49.088641 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] [61cb36d1-88e4-4398-80a4-3c83b9903fa2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38382. Oct 22 04:33:49.216584 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:49.224847 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cb47bfcb-f907-4ac0-a1cf-a343655a8532 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.157509 Oct 22 04:33:49.225426 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3998/7856] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:49 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:33:50.249481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:50.250093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:50.256832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:50.257319 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:50.257760 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:50.258461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:50.258918 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:50.259350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:50.393538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:50.401349 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-084c85b8-16a6-43fc-94da-46f1b23bca9e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.156643 Oct 22 04:33:50.401930 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3859/7857] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:50 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:33:51.425154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:51.425775 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:51.432548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:51.433043 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:51.433496 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:51.434716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:51.435184 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:51.435624 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:51.566670 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:51.574403 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-9525e940-c574-49eb-8ed1-087706ce023a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.153196 Oct 22 04:33:51.575529 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 3999/7858] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:51 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:33:52.597644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:52.598257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:52.605075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:52.605561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:52.606003 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:52.606731 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:52.607191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:52.607622 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:52.736906 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:52.744664 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d75dc943-f565-4091-acab-68d440dc2569 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.150870 Oct 22 04:33:52.745238 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3860/7859] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:52 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:33:53.768349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:53.768913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:53.775703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:53.776196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:53.776674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:53.777379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:53.778814 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:53.779258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:53.917302 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:53.925821 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-07399474-bf46-49d8-ac21-0550b0dcdd68 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.161532 Oct 22 04:33:53.926404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4000/7860] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:53 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:33:54.949448 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:54.950053 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:54.956846 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:54.957323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:54.957756 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:54.958449 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:54.958902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:54.959329 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:55.094418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:55.102154 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-acc96119-c2ee-4ad3-8a21-4e1ac6dc87f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.156676 Oct 22 04:33:55.102722 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3861/7861] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:54 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:33:56.126945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:56.127564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:56.135054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:56.135564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:56.136020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:56.136767 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:56.137247 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:56.137697 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:56.268122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:56.275861 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5d9d4ba8-d06a-4910-9769-7c8c654d8e2c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.152931 Oct 22 04:33:56.276471 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4001/7862] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:56 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:33:57.300853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:57.301479 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:57.308378 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:57.309538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:57.309975 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:57.310665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:57.311117 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:57.311538 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:57.440747 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:57.448762 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d0110ac0-4e28-498b-980f-8a5a25fe4ff7 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1701 microversion: 2.1 time: 0.152190 Oct 22 04:33:57.449383 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3862/7863] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:57 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:33:58.472454 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:58.473081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:58.480052 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:58.480588 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:58.481281 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:58.481994 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:58.482461 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:58.482908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:58.890112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:33:58.897960 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8f932818-cdc7-4691-8444-ed3466713ce1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1701 microversion: 2.1 time: 0.429528 Oct 22 04:33:58.898538 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4002/7864] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:58 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1701 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:33:59.922618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:33:59.923248 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:33:59.930237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:59.931013 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:59.931647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:33:59.932697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:33:59.933233 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:33:59.934164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:00.088786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:00.098565 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-837b9ad6-cd3f-4b94-aa7f-a75b781f8e09 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1696 microversion: 2.1 time: 0.180218 Oct 22 04:34:00.099162 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3863/7865] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:33:59 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:01.124050 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:01.125648 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:01.133787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:01.134537 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:01.135323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:01.136047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:01.136714 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:01.137819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:01.299845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:01.313696 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-36317bc5-b8a4-4367-805a-445bbddd3369 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1696 microversion: 2.1 time: 0.194431 Oct 22 04:34:01.314285 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4003/7866] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:01 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:02.339376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:02.340088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:02.347356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:02.347857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:02.348499 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:02.349936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:02.351028 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:02.351535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:02.516118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:02.525838 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17dcc7ed-0017-4e2a-aa8d-649bfafa946f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1696 microversion: 2.1 time: 0.190707 Oct 22 04:34:02.526687 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3864/7867] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:02 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:02.896060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-86ba2605-0200-4c2e-b606-8933605d20cc req-f6bb2e0c-a1de-4bdf-9a06-ce9387b57e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "name": "network-vif-plugged", "status": "completed", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:34:02.907636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86ba2605-0200-4c2e-b606-8933605d20cc req-f6bb2e0c-a1de-4bdf-9a06-ce9387b57e0f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:02.908440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86ba2605-0200-4c2e-b606-8933605d20cc req-f6bb2e0c-a1de-4bdf-9a06-ce9387b57e0f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:02.908979 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86ba2605-0200-4c2e-b606-8933605d20cc req-f6bb2e0c-a1de-4bdf-9a06-ce9387b57e0f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:02.922504 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-86ba2605-0200-4c2e-b606-8933605d20cc req-f6bb2e0c-a1de-4bdf-9a06-ce9387b57e0f service nova] Creating event network-vif-plugged:72378aa6-3c34-4908-8dbd-a4e0a00af897 for instance 96755dbc-325d-4081-bff7-31010492c6b5 on n-h1-862416-2 Oct 22 04:34:02.928087 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-86ba2605-0200-4c2e-b606-8933605d20cc req-f6bb2e0c-a1de-4bdf-9a06-ce9387b57e0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035759 Oct 22 04:34:02.928754 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4004/7868] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:34:03.551069 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:03.551669 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:03.560276 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:03.561083 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:03.561705 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:03.562708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:03.563166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:03.563624 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:03.705948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:03.716931 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5aa4377-e4d1-4338-8cda-492768727545 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1696 microversion: 2.1 time: 0.169650 Oct 22 04:34:03.717714 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3865/7869] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:03 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:04.742163 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:04.742810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:04.750169 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:04.750674 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:04.751124 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:04.751845 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:04.752336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:04.752779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:04.910258 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:04.918781 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67c24059-c2fa-4cde-8867-3bcb10fed16b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1696 microversion: 2.1 time: 0.181318 Oct 22 04:34:04.919364 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4005/7870] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:04 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:05.943106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:05.944492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:05.952879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:05.953461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:05.953982 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:05.954766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:05.955223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:05.955668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:06.100061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:06.109909 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b5bd57fe-51fc-44fb-b5ae-93637fea919f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1696 microversion: 2.1 time: 0.170901 Oct 22 04:34:06.111049 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3866/7871] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:05 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:07.133948 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:07.135284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:07.143264 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:07.143914 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:07.144499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:07.145284 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:07.145953 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:07.146599 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:07.293766 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:07.302370 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f95c6678-4479-42f8-9556-9607bc045676 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1696 microversion: 2.1 time: 0.172477 Oct 22 04:34:07.308278 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4006/7872] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:07 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:08.327698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:08.328516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:08.335594 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:08.336084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:08.336919 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:08.337643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:08.338111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:08.338680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:08.487306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:08.495609 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-717e2d6b-b4a4-4639-ab59-6be17c0e1cd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1696 microversion: 2.1 time: 0.172493 Oct 22 04:34:08.496884 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3867/7873] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:08 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:34:09.519027 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:09.519749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:09.526794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:09.527342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:09.527860 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:09.528586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:09.529065 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:09.529512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:09.673232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:09.681382 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7addf81a-70f8-4e0c-a007-0d20d79892c8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1678 microversion: 2.1 time: 0.166230 Oct 22 04:34:09.682032 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4007/7874] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:09 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:10.705665 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:10.706287 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:10.713599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:10.714086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:10.714522 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:10.715841 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:10.716330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:10.716804 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:10.850643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:10.858822 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-635cc120-9fc4-4c42-8a21-ede3f9e36b3f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1678 microversion: 2.1 time: 0.157117 Oct 22 04:34:10.859392 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3868/7875] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:10 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:11.882991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:11.883615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:11.891325 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:11.891823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:11.892315 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:11.893036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:11.893549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:11.893996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:12.029339 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:12.037363 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-aa3c3e8a-6ecc-45bc-bbb9-281f4577533b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1621 microversion: 2.1 time: 0.158404 Oct 22 04:34:12.037980 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4008/7876] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:11 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1621 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:12.061260 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:34:12.061862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:12.068579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:12.069088 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:12.069528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:12.070244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:12.070697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:12.071121 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:12.111928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120582) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 04:34:12.178460 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [6be31140-6fd0-468e-9e61-ee8df99b2160] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:34:12.875294 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-c58fa84d-75b9-4c2f-a759-983a1f377d22 req-8fe6adf9-0341-482d-ae6c-2afaa94df8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "name": "network-vif-unplugged", "status": "completed", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:34:12.885015 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c58fa84d-75b9-4c2f-a759-983a1f377d22 req-8fe6adf9-0341-482d-ae6c-2afaa94df8e7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:12.885647 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c58fa84d-75b9-4c2f-a759-983a1f377d22 req-8fe6adf9-0341-482d-ae6c-2afaa94df8e7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:12.885956 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-c58fa84d-75b9-4c2f-a759-983a1f377d22 req-8fe6adf9-0341-482d-ae6c-2afaa94df8e7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:12.898180 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.compute.server_external_events [req-c58fa84d-75b9-4c2f-a759-983a1f377d22 req-8fe6adf9-0341-482d-ae6c-2afaa94df8e7 service nova] Unable to find a host for instance 96755dbc-325d-4081-bff7-31010492c6b5. Dropping event network-vif-unplugged {{(pid=120581) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 04:34:12.899089 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-c58fa84d-75b9-4c2f-a759-983a1f377d22 req-8fe6adf9-0341-482d-ae6c-2afaa94df8e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027778 Oct 22 04:34:12.899684 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4009/7877] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 22 04:34:13.186058 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [6be31140-6fd0-468e-9e61-ee8df99b2160] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38478. Oct 22 04:34:13.189326 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8005204b-826b-4933-af0e-61e3a6b9ab91 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "POST /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5/action" status: 202 len: 0 microversion: 2.1 time: 1.133012 Oct 22 04:34:13.189951 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3869/7878] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:34:12 2022] POST /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:34:13.198303 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:13.198965 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:13.206870 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:13.207378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:13.207838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:13.208591 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:13.209069 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:13.209563 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:13.345046 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:13.354106 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ee935831-a02a-4be1-8ee9-ac72f9fd7031 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1629 microversion: 2.1 time: 0.159814 Oct 22 04:34:13.354691 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4010/7879] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:13 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1629 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:14.378688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:14.379299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:14.386122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:14.386672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:14.387125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:14.387800 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:14.388294 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:14.388722 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:14.410535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:34:14.525303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:14.533535 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6ce3826f-4ab5-4b6b-9827-29f653ba03be tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.159470 Oct 22 04:34:14.534170 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3870/7880] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:14 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:15.350881 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d05e29ba-b984-406d-87e2-c8be20dd1295 req-a9e6dd07-7fbf-45de-a0f9-f8688a02dfcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:34:15.363903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d05e29ba-b984-406d-87e2-c8be20dd1295 req-a9e6dd07-7fbf-45de-a0f9-f8688a02dfcc service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:15.364716 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d05e29ba-b984-406d-87e2-c8be20dd1295 req-a9e6dd07-7fbf-45de-a0f9-f8688a02dfcc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:15.365275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d05e29ba-b984-406d-87e2-c8be20dd1295 req-a9e6dd07-7fbf-45de-a0f9-f8688a02dfcc service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:15.378729 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d05e29ba-b984-406d-87e2-c8be20dd1295 req-a9e6dd07-7fbf-45de-a0f9-f8688a02dfcc service nova] Creating event network-changed:72378aa6-3c34-4908-8dbd-a4e0a00af897 for instance 96755dbc-325d-4081-bff7-31010492c6b5 on n-h2-862416-2 Oct 22 04:34:15.384783 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d05e29ba-b984-406d-87e2-c8be20dd1295 req-a9e6dd07-7fbf-45de-a0f9-f8688a02dfcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039097 Oct 22 04:34:15.385125 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4011/7881] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:34:15.558312 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:15.559786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:15.567034 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:15.567637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:15.568165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:15.569148 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:15.569702 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:15.570264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:15.816014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:15.825802 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d4f04f42-1533-4f85-926d-4f4ced12f0ac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.270868 Oct 22 04:34:15.836454 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3871/7882] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:15 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:16.850789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:16.856723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:16.859209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=31 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:34:16.865335 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:16.866217 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:16.866918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:16.868370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:16.869110 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:16.869862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:16.896706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=79 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:34:17.021921 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:17.030513 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d5ee089d-f811-47cd-aaab-64a32cf5c012 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.184826 Oct 22 04:34:17.031420 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4012/7883] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:16 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:18.055971 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:18.056619 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:18.060057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:34:18.065268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:18.065753 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:18.066191 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:18.066884 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:18.067338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:18.067764 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:18.215792 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:18.223604 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9c2297cb-d922-42a9-b093-4ae9875cb55a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.171771 Oct 22 04:34:18.224185 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3872/7884] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:18 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:19.252125 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:19.257636 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:19.275982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:19.276531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:19.276974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:19.277717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:19.279137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:19.282443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:19.441684 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:19.449575 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e70e04b7-adec-42f2-97e2-01ebdba1284d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.203822 Oct 22 04:34:19.450200 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4013/7885] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:19 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:20.475516 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:20.476286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:20.486444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:20.486939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:20.487377 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:20.488094 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:20.488574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:20.489005 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:20.635561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:20.644073 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-79c30403-6efd-4260-8ac6-5d475151475e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.172945 Oct 22 04:34:20.644692 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3873/7886] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:20 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:21.669586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:21.670349 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:21.677571 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:21.678073 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:21.678531 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:21.679245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:21.679717 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:21.680162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:21.818342 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:21.827201 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-24a82594-ebd7-4105-b3e1-76b7ee5a7ce4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.162201 Oct 22 04:34:21.827789 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4014/7887] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:21 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:22.851151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:22.851742 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:22.859254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:22.859741 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:22.860193 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:22.860925 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:22.861388 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:22.861824 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:23.000902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:23.009036 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-daaf883b-090d-4aa7-8683-7a414d500586 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.161847 Oct 22 04:34:23.009627 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3874/7888] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:22 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:24.040535 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:24.041386 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:24.048596 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:24.049108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:24.049552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:24.050306 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:24.050838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:24.051192 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:24.201887 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:24.209644 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d466096a-cdb0-4d92-b574-72d2d371ec70 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.179704 Oct 22 04:34:24.210228 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4015/7889] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:24 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:25.235221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:25.235809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:25.242686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:25.243171 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:25.243615 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:25.244417 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:25.244879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:25.245309 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:25.413180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:25.421811 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-62f2ddf0-0a04-40fd-b602-1301544fb3db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.191160 Oct 22 04:34:25.422393 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3875/7890] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:25 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:26.445087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:26.445719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:26.453687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:26.454404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:26.454866 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:26.455600 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:26.456072 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:26.456552 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:26.592106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:26.599907 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cc529a62-7139-4b81-8e4d-953274310629 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.158769 Oct 22 04:34:26.600517 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4016/7891] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:26 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:27.623360 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:27.623977 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:27.630863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:27.631350 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:27.631793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:27.632519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:27.632981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:27.633410 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:27.771970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:27.781204 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-469dc206-60ef-426d-b06c-7802e661fa49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.161717 Oct 22 04:34:27.782068 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3876/7892] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:27 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:28.805334 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:28.805967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:28.813331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:28.813842 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:28.814298 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:28.815031 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:28.815503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:28.815951 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:28.959912 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:28.970242 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2e162bfd-ab78-47f1-a90b-b3c11e7c273d tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.168576 Oct 22 04:34:28.970843 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4017/7893] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:28 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:29.994852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:29.995495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:30.003235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:30.003712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:30.004147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:30.004861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:30.005315 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:30.005738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:30.137078 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:30.144959 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-90b2391b-e6d8-4ac6-89d8-107124218879 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.153994 Oct 22 04:34:30.145526 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3877/7894] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:29 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:31.168867 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:31.169634 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:31.177189 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:31.178108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:31.178963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:31.180299 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:31.181199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:31.182029 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:31.322763 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:31.331550 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7d564a8e-9143-4c19-87c2-a005c6020c10 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.166892 Oct 22 04:34:31.332238 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4018/7895] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:31 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:32.354874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:32.355478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:32.362507 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:32.362990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:32.363428 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:32.364118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:32.364601 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:32.365036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:32.499554 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:32.507315 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ea382bf2-2aec-4c7a-8d27-49c1e24d5b22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.156340 Oct 22 04:34:32.507866 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3878/7896] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:32 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:33.465805 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-361f680e-43e2-41c3-a01e-7591f59037df req-68198b8d-4a65-403d-aef2-89039d790266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "name": "network-vif-plugged", "status": "completed", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:34:33.478295 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-361f680e-43e2-41c3-a01e-7591f59037df req-68198b8d-4a65-403d-aef2-89039d790266 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:33.478843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-361f680e-43e2-41c3-a01e-7591f59037df req-68198b8d-4a65-403d-aef2-89039d790266 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:33.479357 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-361f680e-43e2-41c3-a01e-7591f59037df req-68198b8d-4a65-403d-aef2-89039d790266 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:33.495859 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-361f680e-43e2-41c3-a01e-7591f59037df req-68198b8d-4a65-403d-aef2-89039d790266 service nova] Creating event network-vif-plugged:72378aa6-3c34-4908-8dbd-a4e0a00af897 for instance 96755dbc-325d-4081-bff7-31010492c6b5 on n-h2-862416-2 Oct 22 04:34:33.502956 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-361f680e-43e2-41c3-a01e-7591f59037df req-68198b8d-4a65-403d-aef2-89039d790266 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042513 Oct 22 04:34:33.503840 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4019/7897] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:34:33.533835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:33.534854 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:33.553928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:33.554418 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:33.555027 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:33.556035 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:33.556527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:33.557016 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:33.765636 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:33.773733 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0a1b07e5-094a-46c3-b3c0-8590af6debac tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.246340 Oct 22 04:34:33.774329 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3879/7898] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:33 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:34.800156 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:34.800822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:34.807772 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:34.808296 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:34.808743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:34.810601 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:34.811074 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:34.811518 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:34.951943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:34.959792 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a3e5c14c-5ca5-4a47-9e4f-67e96fd30d49 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1687 microversion: 2.1 time: 0.163975 Oct 22 04:34:34.960410 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4020/7899] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:34 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:34:35.985068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:34:35.985696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:34:35.992616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:35.993097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:35.993535 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:35.994223 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:34:35.994674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:34:35.995096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:34:36.128303 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:34:36.136048 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01533ebe-691d-44a8-97c5-c44a649c1486 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1674 microversion: 2.1 time: 0.155059 Oct 22 04:34:36.136661 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3880/7900] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:34:35 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:21.904724 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [487d215f-f51f-4b17-90c4-baae2d45644a] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:36:21.905696 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=17 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:21.906581 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=49 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:21.908228 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:36:21.908422 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 (ip 10.222.0.25) !!! Oct 22 04:36:21.910933 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:36:21.911061 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 (ip 10.222.0.25) !!! Oct 22 04:36:21.912025 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [699f8291-3d66-4313-98db-f3446285e6fa] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:36:21.912695 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=17 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:21.914099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=62 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:21.915403 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 04:36:21.915540 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 22 04:36:21.916448 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:36:21.916571 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 22 04:36:21.931344 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:21.932113 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:21.945293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:21.946351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:21.946351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:21.947277 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:21.948462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:21.949036 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:21.980659 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Going to try to terminate instance {{(pid=120581) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:36:21.990288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-d74c79cc-ca5e-43ae-8c9c-33bf8e0e7c82 req-4cf33fc3-a26f-4958-bcfd-abe6334495f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:36:22.002323 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d74c79cc-ca5e-43ae-8c9c-33bf8e0e7c82 req-4cf33fc3-a26f-4958-bcfd-abe6334495f7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:22.002933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d74c79cc-ca5e-43ae-8c9c-33bf8e0e7c82 req-4cf33fc3-a26f-4958-bcfd-abe6334495f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:22.003250 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-d74c79cc-ca5e-43ae-8c9c-33bf8e0e7c82 req-4cf33fc3-a26f-4958-bcfd-abe6334495f7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:22.015860 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-d74c79cc-ca5e-43ae-8c9c-33bf8e0e7c82 req-4cf33fc3-a26f-4958-bcfd-abe6334495f7 service nova] Creating event network-changed:72378aa6-3c34-4908-8dbd-a4e0a00af897 for instance 96755dbc-325d-4081-bff7-31010492c6b5 on n-h2-862416-2 Oct 22 04:36:22.024344 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-d74c79cc-ca5e-43ae-8c9c-33bf8e0e7c82 req-4cf33fc3-a26f-4958-bcfd-abe6334495f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118711 Oct 22 04:36:22.025535 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3881/7901] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:36:22.072937 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-1ef036d2-336b-499f-85ca-7bc45a3854f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "DELETE /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 204 len: 0 microversion: 2.1 time: 0.171255 Oct 22 04:36:22.078476 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4021/7902] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:36:21 2022] DELETE /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:36:22.084195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:22.085087 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:22.092359 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:22.093155 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:22.093680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:22.094404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:22.094872 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:22.095306 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:22.288852 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:22.297307 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-46d8fad9-6e9a-47b7-b484-839b6e725a25 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.217594 Oct 22 04:36:22.297987 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3882/7903] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:22 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:23.327378 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:23.328234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:23.339270 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] [487d215f-f51f-4b17-90c4-baae2d45644a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38666. Oct 22 04:36:23.345641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:23.346144 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:23.346594 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:23.347311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:23.347778 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:23.348276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:23.539393 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:23.547531 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-60d263f7-b982-4d4d-b41d-6ec106f4afb9 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 200 len: 1680 microversion: 2.1 time: 0.225479 Oct 22 04:36:23.548318 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4022/7904] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:23 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:24.071382 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] [699f8291-3d66-4313-98db-f3446285e6fa] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38674. Oct 22 04:36:24.116235 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-1cca7786-880b-48b2-b438-3a5b73444169 req-0cd6d6a0-40c4-4284-aed1-b1f67b9a31f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96755dbc-325d-4081-bff7-31010492c6b5", "name": "network-vif-deleted", "tag": "72378aa6-3c34-4908-8dbd-a4e0a00af897"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:36:24.126757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1cca7786-880b-48b2-b438-3a5b73444169 req-0cd6d6a0-40c4-4284-aed1-b1f67b9a31f9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:24.127236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1cca7786-880b-48b2-b438-3a5b73444169 req-0cd6d6a0-40c4-4284-aed1-b1f67b9a31f9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:24.127686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-1cca7786-880b-48b2-b438-3a5b73444169 req-0cd6d6a0-40c4-4284-aed1-b1f67b9a31f9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:24.142498 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-1cca7786-880b-48b2-b438-3a5b73444169 req-0cd6d6a0-40c4-4284-aed1-b1f67b9a31f9 service nova] Creating event network-vif-deleted:72378aa6-3c34-4908-8dbd-a4e0a00af897 for instance 96755dbc-325d-4081-bff7-31010492c6b5 on n-h2-862416-2 Oct 22 04:36:24.147417 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-1cca7786-880b-48b2-b438-3a5b73444169 req-0cd6d6a0-40c4-4284-aed1-b1f67b9a31f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092157 Oct 22 04:36:24.147987 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3883/7905] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:36:24.573275 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:24.573838 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: 96755dbc-325d-4081-bff7-31010492c6b5] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:24.580740 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:24.581244 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:24.581703 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:24.582420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:24.582898 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:24.583346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:24.597415 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] HTTP exception thrown: Instance 96755dbc-325d-4081-bff7-31010492c6b5 could not be found. Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Request method failure captured: Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 HTTP/1.1 Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU3IjbQ05Klfm6kLLc_IMo2zAaUoPk22jzhS4mG-CrhvNwLnwdL96RWeq1f5K4jPrh2Zci6sdd0c01FD6DNNFuGqP6DWbLUAMsXcx2hwd-OVaDJhkGKX4f2pzeI6N9SEm-jtO9R6SpKpUoj0lOemg7WuzfybEI3c2oCTkkohW1osr6nU Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 335d7a25ce5146cea6836550cded735a Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestShelveInstance-1105288113 Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_335d7a25ce5146cea6836550cded735a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/335d7a25ce5146cea6836550cded735a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/335d7a25ce5146cea6836550cded735a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/335d7a25ce5146cea6836550cded735a"}]}] Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestShelveInstance-1105288113 Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 335d7a25ce5146cea6836550cded735a Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestShelveInstance-1105288113 Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestShelveInstance-1105288113-project Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 336d5f2120bf44cf8a2b21026ec7873d Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestShelveInstance-1105288113-project Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 96755dbc-325d-4081-bff7-31010492c6b5 could not be found. Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '96755dbc-325d-4081-bff7-31010492c6b5'} Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96755dbc-325d-4081-bff7-31010492c6b5 could not be found. Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96755dbc-325d-4081-bff7-31010492c6b5 could not be found. Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:36:24.599085 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96755dbc-325d-4081-bff7-31010492c6b5 could not be found. Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Returning 404 to user: Instance 96755dbc-325d-4081-bff7-31010492c6b5 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-032d5ccf-0d59-45f6-a052-cc9b14814951 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5" status: 404 len: 111 microversion: 2.1 time: 0.031399 Oct 22 04:36:24.604811 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4023/7906] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:24 2022] GET /compute/v2.1/servers/96755dbc-325d-4081-bff7-31010492c6b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:36:24.760995 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4db38f0e-4ad5-4acd-b4ea-25caa34dbee8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '.version_select at 0x7f0d1929d9d0>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:24.790615 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4db38f0e-4ad5-4acd-b4ea-25caa34dbee8 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-324916065" status: 202 len: 0 microversion: 2.1 time: 0.034270 Oct 22 04:36:24.791354 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3884/7907] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Oct 22 04:36:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-324916065 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:36:24.813996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-73ceae27-b6bc-49fb-b3c3-4e33da524fe4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Action: 'create', calling method: .version_select at 0x7f0d19591af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1722236225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwP9jYZM+hQp1T/1AbZoWuOGxqRZzJM0ALKH3NJDylvSwZ0/9G0x0P6HWs41yN110iBmiopEbo57lFO1iQKLEHLAWtLTZY3cCNInLZ6N5bRVfWm6Me4NRNeo4qJdewpxQ=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:36:24.830117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-73ceae27-b6bc-49fb-b3c3-4e33da524fe4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Getting quotas for project 335d7a25ce5146cea6836550cded735a. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:36:24.835204 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-73ceae27-b6bc-49fb-b3c3-4e33da524fe4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Getting quotas for user 336d5f2120bf44cf8a2b21026ec7873d and project 335d7a25ce5146cea6836550cded735a. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:36:24.863056 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-73ceae27-b6bc-49fb-b3c3-4e33da524fe4 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053076 Oct 22 04:36:24.863697 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4024/7908] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:36:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:36:41.058444 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2051151874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1722236225", "security_groups": [{"name": "tempest-secgroup-smoke-414708885"}], "networks": [{"uuid": "0cea762a-a544-467c-b6a0-2a0f78d50700"}], "block_device_mapping_v2": [{"uuid": "e726e6b7-fc8f-4967-8e75-38ae2d69d6da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:36:41.070721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=10 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:41.071376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:41.174036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] validate_networks() for [('0cea762a-a544-467c-b6a0-2a0f78d50700', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:36:41.591526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:36:41.591966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:36:41.592475 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:36:41.592899 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:36:41.593348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:36:41.602109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:41.602541 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:41.602985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:41.603720 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:41.604180 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:41.604648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:41.622266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Getting quotas for project 335d7a25ce5146cea6836550cded735a. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:36:41.627498 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Getting quotas for user 336d5f2120bf44cf8a2b21026ec7873d and project 335d7a25ce5146cea6836550cded735a. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:36:41.685587 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:36:41.687857 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e726e6b7-fc8f-4967-8e75-38ae2d69d6da',volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:36:41.814636 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8c388be9-45bb-46ba-a5ee-43b742e3a5a6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760254 Oct 22 04:36:41.815373 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3885/7909] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:36:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:36:41.826937 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-ee9f3fc5-326c-47f4-b4e1-19e982a2c033 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:41.827667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-ee9f3fc5-326c-47f4-b4e1-19e982a2c033 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:41.830608 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:41.831380 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=4 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:41.833455 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:41.891592 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-ee9f3fc5-326c-47f4-b4e1-19e982a2c033 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:41.898987 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-ee9f3fc5-326c-47f4-b4e1-19e982a2c033 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1089 microversion: 2.1 time: 0.076390 Oct 22 04:36:41.899653 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4025/7910] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:41 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:36:42.924144 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:42.924990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:42.931328 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:42.931821 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:42.932293 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:42.933024 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:42.933552 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:42.933988 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:43.005227 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:43.013956 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e22773fc-dd94-400e-bbca-4b216ca4b3f3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1187 microversion: 2.1 time: 0.094450 Oct 22 04:36:43.019139 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3886/7911] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:42 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:44.038809 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:44.039569 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:44.047395 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:44.047900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:44.048404 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:44.049164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:44.049641 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:44.050085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:44.194420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:44.203662 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb2f5af2-e1b6-43b9-92de-de38a0a0452e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1272 microversion: 2.1 time: 0.168571 Oct 22 04:36:44.205195 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4026/7912] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:44 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:44.458234 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-b95ae12c-d2c2-43a9-824c-c82f878d35f5 req-bd0faade-cce5-426b-8e14-beae13af7391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f015cfb9-f171-4508-b108-b96d355813e3", "tag": "7acf11d6-6c08-40f8-9c25-741421f2fb04"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:36:44.479104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b95ae12c-d2c2-43a9-824c-c82f878d35f5 req-bd0faade-cce5-426b-8e14-beae13af7391 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:44.479788 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b95ae12c-d2c2-43a9-824c-c82f878d35f5 req-bd0faade-cce5-426b-8e14-beae13af7391 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:44.480256 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-b95ae12c-d2c2-43a9-824c-c82f878d35f5 req-bd0faade-cce5-426b-8e14-beae13af7391 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:44.495251 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-b95ae12c-d2c2-43a9-824c-c82f878d35f5 req-bd0faade-cce5-426b-8e14-beae13af7391 service nova] Creating event network-changed:7acf11d6-6c08-40f8-9c25-741421f2fb04 for instance f015cfb9-f171-4508-b108-b96d355813e3 on n-h1-862416-2 Oct 22 04:36:44.501495 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-b95ae12c-d2c2-43a9-824c-c82f878d35f5 req-bd0faade-cce5-426b-8e14-beae13af7391 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046981 Oct 22 04:36:44.502554 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3887/7913] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:36:45.227011 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:45.229196 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:45.237230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:45.237910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:45.238995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:45.239853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:45.240657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:45.242108 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:45.398557 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:45.408375 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-63c1f71c-134a-4320-91ee-a2ad946cd3df tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1272 microversion: 2.1 time: 0.185130 Oct 22 04:36:45.409077 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4027/7914] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:45 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:46.434643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:46.435456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:46.441656 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:46.442164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:46.442597 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:46.443326 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:46.443757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:46.444182 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:46.587870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:46.596898 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-67aa56b5-18b8-4a46-a6c5-a6f9e3cb741e tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1272 microversion: 2.1 time: 0.167937 Oct 22 04:36:46.597480 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3888/7915] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:46 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:47.619059 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:47.619690 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:47.627063 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:47.627564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:47.628017 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:47.628762 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:47.629237 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:47.629681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:47.779509 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:47.788407 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-18e2e997-f2cf-44ff-aac5-d54288fdff6f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1272 microversion: 2.1 time: 0.173180 Oct 22 04:36:47.789119 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4028/7916] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:47 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:48.812561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:48.813130 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:48.819595 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:48.820075 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:48.820548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:48.821245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:48.821697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:48.822125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:48.954996 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:48.963008 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9523cc76-3b17-41f7-a75f-b8ed585bf76a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.155291 Oct 22 04:36:48.963586 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3889/7917] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:48 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:49.986598 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:49.987271 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:49.993943 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:49.994443 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:49.994902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:49.995617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:49.996617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:49.997070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:50.130789 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:50.139139 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-7096ecef-b0a1-4a7e-80fd-1ec3ca47fb59 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.156500 Oct 22 04:36:50.139708 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4029/7918] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:49 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:51.161680 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:51.162268 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:51.169186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:51.169662 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:51.170097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:51.170784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:51.171266 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:51.171688 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:51.304103 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:51.312785 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-96d6aa31-f944-4520-b18e-0b0122de0100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.155437 Oct 22 04:36:51.313348 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3890/7919] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:51 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:52.336338 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:52.336963 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:52.340039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:52.345293 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:52.345806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:52.346403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:52.347141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:52.347615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:52.348058 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:52.484962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:52.492682 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-72094682-3377-4367-9263-2e47e9fffff3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.160321 Oct 22 04:36:52.493265 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4030/7920] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:52 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:53.517225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:53.517835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:53.519808 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:53.520476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:36:53.528129 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:53.528645 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:53.529086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:53.529785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:53.530246 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:53.530673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:53.664737 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:53.672437 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-140b1a83-1c45-4747-801d-845e7474c531 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.159166 Oct 22 04:36:53.673040 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3891/7921] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:53 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:54.696117 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:54.696777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:54.704070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:54.704606 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:54.705064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:54.705786 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:54.706260 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:54.706710 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:54.838331 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:54.846694 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e71c4965-f2d7-4195-8ce4-6c18a60d19e5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.154593 Oct 22 04:36:54.847283 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4031/7922] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:54 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:55.870084 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:55.870616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:55.877332 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:55.877963 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:55.878602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:55.879818 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:55.880644 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:55.881092 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:56.017237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:56.024935 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3ed55bee-64a4-4490-b753-24199a5b7937 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.158806 Oct 22 04:36:56.025510 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3892/7923] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:55 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:57.049753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:57.050375 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:57.057245 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:57.057736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:57.058187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:57.059457 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:57.059919 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:57.060398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:57.193240 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:57.201127 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-64b2351e-9ae9-4e4e-a4da-10e0f85a1f34 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.155471 Oct 22 04:36:57.201703 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4032/7924] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:57 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:58.223290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:58.223912 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:58.230845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:58.231334 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:58.231783 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:58.232525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:58.232985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:58.233427 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:58.364697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:58.374009 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ab4cbe22-4d2e-405a-90e4-309ec6af791b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.154676 Oct 22 04:36:58.374591 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3893/7925] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:58 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:59.397500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:36:59.398134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:36:59.405346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:59.405850 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:59.406307 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:59.407023 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:59.407756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:59.408219 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:59.538841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:36:59.547161 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-44108cd6-c7a7-4bba-b049-c50f762874f5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.153728 Oct 22 04:36:59.547740 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4033/7926] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:36:59 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:36:59.770438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-9c70b754-2242-47e9-808c-db3e6ce62e46 req-7e80f8dc-adc1-48d7-99ef-8bca958f38ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f015cfb9-f171-4508-b108-b96d355813e3", "name": "network-vif-plugged", "status": "completed", "tag": "7acf11d6-6c08-40f8-9c25-741421f2fb04"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:36:59.780602 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9c70b754-2242-47e9-808c-db3e6ce62e46 req-7e80f8dc-adc1-48d7-99ef-8bca958f38ee service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:36:59.781076 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9c70b754-2242-47e9-808c-db3e6ce62e46 req-7e80f8dc-adc1-48d7-99ef-8bca958f38ee service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:36:59.781505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-9c70b754-2242-47e9-808c-db3e6ce62e46 req-7e80f8dc-adc1-48d7-99ef-8bca958f38ee service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:36:59.793457 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-9c70b754-2242-47e9-808c-db3e6ce62e46 req-7e80f8dc-adc1-48d7-99ef-8bca958f38ee service nova] Creating event network-vif-plugged:7acf11d6-6c08-40f8-9c25-741421f2fb04 for instance f015cfb9-f171-4508-b108-b96d355813e3 on n-h1-862416-2 Oct 22 04:36:59.798751 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-9c70b754-2242-47e9-808c-db3e6ce62e46 req-7e80f8dc-adc1-48d7-99ef-8bca958f38ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082824 Oct 22 04:36:59.799364 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3894/7927] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:37:00.570995 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:37:00.571665 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:37:00.580054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:37:00.580597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:37:00.581083 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:37:00.581801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:37:00.582273 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:37:00.582719 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:37:00.719388 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:37:00.727264 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-783decbb-8f05-4c67-8377-49d6f09f6c54 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1260 microversion: 2.1 time: 0.160104 Oct 22 04:37:00.727779 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4034/7928] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:37:00 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:37:01.753187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:37:01.753817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:37:01.759990 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:37:01.760503 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:37:01.760947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:37:01.761641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:37:01.762100 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:37:01.763090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:37:01.899068 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:37:01.907881 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8f69e19b-cc65-4050-8b1f-c11a43919419 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1444 microversion: 2.1 time: 0.160351 Oct 22 04:37:01.908494 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3895/7929] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:37:01 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:37:01.931187 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:37:01.932134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:37:01.939004 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:37:01.939500 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:37:01.939955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:37:01.940682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:37:01.941157 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:37:01.941597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:37:02.071611 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:37:02.080053 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6a8e619a-7b07-438e-9a02-385533ab2fcb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1444 microversion: 2.1 time: 0.153084 Oct 22 04:37:02.080659 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4035/7930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:37:01 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:37:04.011657 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-5807af8c-9065-4a01-a7f5-3f6c3b704009 req-cb52f58f-4a1e-4162-88c2-e88dded1d0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f015cfb9-f171-4508-b108-b96d355813e3", "tag": "7acf11d6-6c08-40f8-9c25-741421f2fb04"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:37:04.022340 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5807af8c-9065-4a01-a7f5-3f6c3b704009 req-cb52f58f-4a1e-4162-88c2-e88dded1d0f8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:37:04.022910 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5807af8c-9065-4a01-a7f5-3f6c3b704009 req-cb52f58f-4a1e-4162-88c2-e88dded1d0f8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:37:04.023438 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-5807af8c-9065-4a01-a7f5-3f6c3b704009 req-cb52f58f-4a1e-4162-88c2-e88dded1d0f8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:37:04.035683 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-5807af8c-9065-4a01-a7f5-3f6c3b704009 req-cb52f58f-4a1e-4162-88c2-e88dded1d0f8 service nova] Creating event network-changed:7acf11d6-6c08-40f8-9c25-741421f2fb04 for instance f015cfb9-f171-4508-b108-b96d355813e3 on n-h1-862416-2 Oct 22 04:37:04.041060 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-5807af8c-9065-4a01-a7f5-3f6c3b704009 req-cb52f58f-4a1e-4162-88c2-e88dded1d0f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033670 Oct 22 04:37:04.042030 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3896/7931] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:39:01.317433 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61cb36d1-88e4-4398-80a4-3c83b9903fa2] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:39:01.318003 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=24 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:39:01.318671 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=60 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:39:01.319976 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 04:39:01.320129 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:39:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3/action (ip 10.222.0.25) !!! Oct 22 04:39:01.326175 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:39:01.326711 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:01.334903 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:01.335398 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:01.335846 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:01.336607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:01.337090 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:01.337529 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:01.361122 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.objects.instance [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lazy-loading 'flavor' on Instance uuid f015cfb9-f171-4508-b108-b96d355813e3 {{(pid=120581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:39:01.435312 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0e72a3d2-69a2-4275-a254-b2b69b912761 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "POST /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3/action" status: 202 len: 0 microversion: 2.1 time: 0.120101 Oct 22 04:39:01.435916 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4036/7932] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:39:01 2022] POST /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:39:01.446857 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [699f8291-3d66-4313-98db-f3446285e6fa] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 22 04:39:01.447790 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4937fa55-f991-417b-88b2-9cc53442bf17] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 22 04:39:01.448436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:39:01.449313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=56 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:39:01.461077 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:01.461807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:01.471777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:01.472338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:01.472784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:01.473501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:01.473961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:01.474606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:01.613577 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:01.621985 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-63b98589-07c5-4745-9fc7-659bcce5c5a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.180841 Oct 22 04:39:01.622563 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3897/7933] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:01 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:02.647844 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:02.648587 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:02.655836 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:02.656366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:02.656821 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:02.657560 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:02.658030 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:02.658724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:02.665084 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] [61cb36d1-88e4-4398-80a4-3c83b9903fa2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38940. Oct 22 04:39:02.791337 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:02.799739 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-edc7f3c0-3bba-4c6a-aa23-454e42877d97 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.157359 Oct 22 04:39:02.800345 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4037/7934] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:02 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:03.823850 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:03.824461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:03.833528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:03.834515 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:03.834948 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:03.835639 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:03.836089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:03.836543 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:03.842037 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] [699f8291-3d66-4313-98db-f3446285e6fa] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38946. Oct 22 04:39:03.844229 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] [4937fa55-f991-417b-88b2-9cc53442bf17] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38948. Oct 22 04:39:03.974637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:03.983704 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b3432f11-8f2f-4eeb-87cd-d8bf2cb9d3ab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.162802 Oct 22 04:39:03.984442 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3898/7935] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:03 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:05.007047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:05.007676 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:05.014873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:05.015371 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:05.015830 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:05.016582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:05.017056 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:05.017499 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:05.152100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:05.160952 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a12d3799-a937-472d-959e-2ac2672a7792 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.157912 Oct 22 04:39:05.161540 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4038/7936] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:05 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:06.184954 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:06.186086 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:06.192873 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:06.193356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:06.193793 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:06.194487 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:06.194944 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:06.195368 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:06.331463 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:06.339230 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c48a4f00-d841-4a56-9b66-b60fb671bb08 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.158292 Oct 22 04:39:06.339802 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3899/7937] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:06 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:07.363241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:07.363857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:07.370777 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:07.371274 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:07.371729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:07.372467 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:07.372999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:07.373693 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:07.506788 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:07.515194 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-df9de0e1-1002-41c5-831d-3d2b1c127cdd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.155926 Oct 22 04:39:07.515776 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4039/7938] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:07 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:08.538040 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:08.538658 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:08.545441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:08.545968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:08.546408 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:08.547089 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:08.547539 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:08.547964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:08.683758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:08.692095 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-600dad3d-2b76-45a0-9702-6cdd85fd1803 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.157981 Oct 22 04:39:08.692688 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3900/7939] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:08 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:09.716230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:09.716872 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:09.724165 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:09.724694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:09.725132 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:09.725827 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:09.726291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:09.726729 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:09.863841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:09.871608 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-5881933e-031c-4a24-95ff-10cdd0236699 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.159320 Oct 22 04:39:09.872194 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4040/7940] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:09 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:10.895570 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:10.896114 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:10.902836 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:10.903316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:10.903746 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:10.904470 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:10.904926 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:10.905376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:11.037123 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:11.044954 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d2499e6e-74c5-4a0e-b57f-8730f20daa76 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.153410 Oct 22 04:39:11.046010 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3901/7941] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:10 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:12.069071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:12.069667 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:12.076638 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:12.077174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:12.077630 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:12.078407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:12.078806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:12.079262 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:12.213350 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:12.221923 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-98391051-a01e-4f31-8b8d-1fcc5597557a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.156930 Oct 22 04:39:12.222507 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4041/7942] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:12 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:13.246039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:13.246675 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:13.253870 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:13.254349 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:13.254782 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:13.255478 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:13.255927 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:13.256390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:13.393973 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:13.401714 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9a4d81cc-08ca-4ae6-b059-68cee61699b5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.159667 Oct 22 04:39:13.402285 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3902/7943] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:13 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:14.425232 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:14.425871 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:14.432973 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:14.433506 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:14.433967 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:14.434712 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:14.435193 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:14.435643 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:14.574119 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:14.582276 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6f158c54-e345-49d7-949b-ffc3dedc4433 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.161104 Oct 22 04:39:14.582853 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4042/7944] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:14 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:15.606164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:15.606771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:15.615883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:15.616591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:15.617042 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:15.617859 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:15.618316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:15.618740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:15.758374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:15.768357 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-d238d1c6-85d2-4342-800c-5829938a2dfd tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.165934 Oct 22 04:39:15.772318 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3903/7945] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:15 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:16.197134 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-1093ad9f-0b09-4b93-b524-d7fedcb9255d req-a2057a56-a058-4c64-98ae-9c74f4bae530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f015cfb9-f171-4508-b108-b96d355813e3", "name": "network-vif-unplugged", "status": "completed", "tag": "7acf11d6-6c08-40f8-9c25-741421f2fb04"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:39:16.214148 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1093ad9f-0b09-4b93-b524-d7fedcb9255d req-a2057a56-a058-4c64-98ae-9c74f4bae530 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:16.219947 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1093ad9f-0b09-4b93-b524-d7fedcb9255d req-a2057a56-a058-4c64-98ae-9c74f4bae530 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:16.220806 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-1093ad9f-0b09-4b93-b524-d7fedcb9255d req-a2057a56-a058-4c64-98ae-9c74f4bae530 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:16.233387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.compute.server_external_events [req-1093ad9f-0b09-4b93-b524-d7fedcb9255d req-a2057a56-a058-4c64-98ae-9c74f4bae530 service nova] Unable to find a host for instance f015cfb9-f171-4508-b108-b96d355813e3. Dropping event network-vif-unplugged {{(pid=120581) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 22 04:39:16.234301 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-1093ad9f-0b09-4b93-b524-d7fedcb9255d req-a2057a56-a058-4c64-98ae-9c74f4bae530 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042008 Oct 22 04:39:16.235104 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4043/7946] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 22 04:39:16.792623 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:16.793257 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:16.800972 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:16.801456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:16.801892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:16.802585 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:16.803039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:16.803461 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:16.938606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:16.946329 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-01968bf6-74a4-4a27-8b1b-d70ef1a3e40a tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1510 microversion: 2.1 time: 0.157616 Oct 22 04:39:16.946910 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3904/7947] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:16 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:16.969976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:39:16.970597 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:16.976631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:16.977131 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:16.977586 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:16.978292 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:16.978768 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:16.979208 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:17.062363 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120581) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 22 04:39:17.130035 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-647cd1ca-7e56-4bd1-92a3-26e7250db912 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "POST /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3/action" status: 202 len: 0 microversion: 2.1 time: 0.164657 Oct 22 04:39:17.131280 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4044/7948] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:39:16 2022] POST /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:39:17.139058 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:17.139673 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:17.145561 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:17.146045 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:17.146485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:17.147188 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:17.147641 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:17.148070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:17.283357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:17.291438 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-6953057c-1c40-43c3-846b-e12478e717b1 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1518 microversion: 2.1 time: 0.156328 Oct 22 04:39:17.292016 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3905/7949] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:17 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:18.315819 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:18.316481 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:18.322675 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:18.323121 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:18.323580 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:18.324330 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:18.324810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:18.325265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:18.476536 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:18.485194 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-4b790c5b-ca5b-43e4-b6b5-a198cdc96626 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1518 microversion: 2.1 time: 0.174242 Oct 22 04:39:18.485780 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4045/7950] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:18 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:19.510935 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:19.512109 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:19.519826 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:19.520343 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:19.520784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:19.521493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:19.521947 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:19.522506 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:19.664348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:19.673632 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-607ae6ec-d909-4872-bfa2-c9a93286d823 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1518 microversion: 2.1 time: 0.166626 Oct 22 04:39:19.674208 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3906/7951] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:19 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:20.696862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:20.697494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:20.704365 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:20.704869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:20.705326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:20.706042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:20.706512 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:20.706959 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:20.841414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:20.849541 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-2ee2d93b-8f8a-42de-a661-51ff1f870639 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1518 microversion: 2.1 time: 0.156618 Oct 22 04:39:20.850129 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4046/7952] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:20 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:21.874405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:21.875723 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:21.882712 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:21.883205 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:21.883647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:21.884381 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:21.884835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:21.885265 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:22.023454 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:22.031861 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0d3d20ef-6829-4b95-b5ee-b6246c38b3f6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1520 microversion: 2.1 time: 0.161967 Oct 22 04:39:22.032484 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3907/7953] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:21 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:23.056070 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:23.056840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:23.064540 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:23.065039 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:23.065491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:23.066285 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:23.066750 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:23.067191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:23.205478 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:23.213410 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-0d87b242-4751-441c-b926-6f81ecfeac60 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1520 microversion: 2.1 time: 0.161284 Oct 22 04:39:23.214004 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4047/7954] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:23 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:24.237628 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:24.238245 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:24.245390 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:24.245874 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:24.246318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:24.247298 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:24.247762 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:24.248194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:24.384039 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:24.392587 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7b503a6f-c75c-493d-a606-6139030736d0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1520 microversion: 2.1 time: 0.159690 Oct 22 04:39:24.393162 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3908/7955] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:24 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:39:25.416687 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:25.417424 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:25.424490 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:25.424989 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:25.425437 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:25.426143 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:25.426612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:25.427054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:25.560605 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:25.569192 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b53c6efa-2a80-4bac-aa47-d2bed6a92a56 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1520 microversion: 2.1 time: 0.156396 Oct 22 04:39:25.569763 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4048/7956] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:25 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:26.592485 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:26.594222 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:26.601225 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:26.601711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:26.602147 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:26.602845 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:26.603299 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:26.603721 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:26.741868 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:26.749885 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5f07bbd8-f38e-48bf-ae6f-f4ad6d12f100 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1520 microversion: 2.1 time: 0.161582 Oct 22 04:39:26.750473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3909/7957] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:26 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:27.773756 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:27.774326 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:27.782071 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:27.782564 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:27.783014 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:27.783982 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:27.784476 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:27.784918 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:27.921986 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:27.929883 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-34a24f0c-2906-4286-ad2d-d149ffcd4aec tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.160260 Oct 22 04:39:27.930467 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4049/7958] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:27 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:28.955709 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:28.956527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:28.963145 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:28.963627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:28.964064 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:28.964784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:28.965243 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:28.965672 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:29.101460 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:29.110064 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e5b7a208-88ff-4172-974c-ebc9a496bc8f tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.158280 Oct 22 04:39:29.110646 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3910/7959] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:28 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:30.133374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:30.134005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:30.141556 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:30.142061 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:30.142517 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:30.143230 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:30.143707 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:30.144155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:30.148137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:39:30.276432 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:30.284912 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6c4bde73-dbce-4e46-9073-aac57699fa22 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.155544 Oct 22 04:39:30.285494 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4050/7960] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:30 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:31.308749 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:31.309288 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:31.316172 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:31.316693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:31.317134 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:31.317830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:31.318286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:31.318715 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:31.449647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:31.458556 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-8cb14d6e-6380-453e-aac4-727a56956290 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.153867 Oct 22 04:39:31.459127 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3911/7961] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:31 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:32.481513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:32.482137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:32.485934 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:39:32.491361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:32.491853 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:32.492336 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:32.493037 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:32.493501 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:32.493940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:32.632612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:32.640624 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e4094a88-ca26-46f5-8e59-21c191243dd5 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.162872 Oct 22 04:39:32.641135 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4051/7962] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:32 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:33.663879 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:33.664555 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:33.667253 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=31 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:39:33.673698 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:33.674184 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:33.674627 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:33.675330 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:33.675789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:33.676230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:33.680197 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=91 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:39:33.804786 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:33.812607 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-695c9ac8-1f83-4339-9008-59a47769e573 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.152504 Oct 22 04:39:33.813186 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3912/7963] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:33 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:34.836348 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:34.837045 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:34.843734 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:34.844361 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:34.844582 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:34.845288 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:34.845753 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:34.846190 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:34.977366 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:34.985977 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-d90f9498-3e52-47d0-ae92-35426a00bef6 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.153584 Oct 22 04:39:34.986577 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4052/7964] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:34 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:36.010347 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:36.011096 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:36.018221 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:36.018711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:36.019151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:36.019855 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:36.020356 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:36.020790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:36.229796 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:36.239027 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0c8cc15d-f3ef-4888-8748-e129c5ad6b3c tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.232898 Oct 22 04:39:36.239808 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3913/7965] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:36 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:36.348385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-a50dd211-59d8-4b29-ac42-279a3c7f066a req-5e11c828-170a-401e-8186-cdd7a3011d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f015cfb9-f171-4508-b108-b96d355813e3", "name": "network-vif-plugged", "status": "completed", "tag": "7acf11d6-6c08-40f8-9c25-741421f2fb04"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:39:36.363151 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a50dd211-59d8-4b29-ac42-279a3c7f066a req-5e11c828-170a-401e-8186-cdd7a3011d81 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:36.363873 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a50dd211-59d8-4b29-ac42-279a3c7f066a req-5e11c828-170a-401e-8186-cdd7a3011d81 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:36.364355 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-a50dd211-59d8-4b29-ac42-279a3c7f066a req-5e11c828-170a-401e-8186-cdd7a3011d81 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:36.379188 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-a50dd211-59d8-4b29-ac42-279a3c7f066a req-5e11c828-170a-401e-8186-cdd7a3011d81 service nova] Creating event network-vif-plugged:7acf11d6-6c08-40f8-9c25-741421f2fb04 for instance f015cfb9-f171-4508-b108-b96d355813e3 on n-h1-862416-2 Oct 22 04:39:36.384462 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-a50dd211-59d8-4b29-ac42-279a3c7f066a req-5e11c828-170a-401e-8186-cdd7a3011d81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040310 Oct 22 04:39:36.385227 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4053/7966] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:39:37.263200 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:37.263809 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:37.273007 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:37.273495 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:37.273924 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:37.275317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:37.275889 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:37.276789 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:37.438900 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:37.447341 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-0f8aa461-7992-486a-a29f-e460f0348b06 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1576 microversion: 2.1 time: 0.187989 Oct 22 04:39:37.447936 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3914/7967] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:37 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:39:38.473261 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:39:38.474042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:39:38.480345 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:38.480852 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:38.481308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:38.482018 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:39:38.482494 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:39:38.482941 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:39:38.622234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:39:38.630834 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-e0f202dc-cd9c-4f21-b96e-d0d41c6f6138 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1563 microversion: 2.1 time: 0.163556 Oct 22 04:39:38.631420 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4054/7968] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:39:38 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:40:55.031777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=5 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:40:55.032711 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=17 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:40:55.033522 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:40:55.033677 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:40:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 (ip 10.222.0.25) !!! Oct 22 04:40:55.035079 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:40:55.035206 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:40:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 (ip 10.222.0.25) !!! Oct 22 04:40:55.036123 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:40:55.036416 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:40:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 (ip 10.222.0.25) !!! Oct 22 04:40:55.040198 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=7 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:40:55.042150 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=24 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:40:55.043908 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:40:55.043908 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:40:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 22 04:40:55.045314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:40:55.045820 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:40:55.056387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-3c30e8c6-652f-4b9e-8f34-f6903384b21f req-e0e65c28-3419-423b-a846-0f03dde96dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f015cfb9-f171-4508-b108-b96d355813e3", "tag": "7acf11d6-6c08-40f8-9c25-741421f2fb04"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:40:55.063242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:55.064244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:55.064244 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:55.064961 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:55.065436 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:55.065840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:55.074426 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c30e8c6-652f-4b9e-8f34-f6903384b21f req-e0e65c28-3419-423b-a846-0f03dde96dc8 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:55.074924 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c30e8c6-652f-4b9e-8f34-f6903384b21f req-e0e65c28-3419-423b-a846-0f03dde96dc8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:55.075372 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-3c30e8c6-652f-4b9e-8f34-f6903384b21f req-e0e65c28-3419-423b-a846-0f03dde96dc8 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:55.087353 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-3c30e8c6-652f-4b9e-8f34-f6903384b21f req-e0e65c28-3419-423b-a846-0f03dde96dc8 service nova] Creating event network-changed:7acf11d6-6c08-40f8-9c25-741421f2fb04 for instance f015cfb9-f171-4508-b108-b96d355813e3 on n-h1-862416-2 Oct 22 04:40:55.092651 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-3c30e8c6-652f-4b9e-8f34-f6903384b21f req-e0e65c28-3419-423b-a846-0f03dde96dc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058757 Oct 22 04:40:55.093437 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4055/7969] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:40:55.095370 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:40:55.186717 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f8bdaa8d-693a-4a10-8b37-8a61ef02e7a3 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 204 len: 0 microversion: 2.1 time: 0.156768 Oct 22 04:40:55.188049 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3915/7970] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:40:55 2022] DELETE /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:40:55.202905 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:40:55.204392 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:40:55.214154 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:55.214794 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:55.215495 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:55.216513 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:55.217085 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:55.217635 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:55.365419 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:40:55.373735 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-91a1f126-58a2-48bd-861e-c8e9c7ccbeab tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.178303 Oct 22 04:40:55.374549 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4056/7971] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:40:55 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:40:56.398862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:40:56.399558 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:40:56.406830 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:56.407314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:56.407758 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:56.408483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:56.408939 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:56.409618 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:56.579524 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:40:56.587866 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0236799-471e-4c82-b3f5-4546b7bd61db tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1569 microversion: 2.1 time: 0.193841 Oct 22 04:40:56.588473 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3916/7972] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:40:56 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:40:57.392251 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b5c8200e-b6ac-48ef-903a-b737ba10e413 req-cc785dfb-4276-4cf4-9686-8a89d09f7d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f015cfb9-f171-4508-b108-b96d355813e3", "name": "network-vif-deleted", "tag": "7acf11d6-6c08-40f8-9c25-741421f2fb04"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:40:57.404410 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b5c8200e-b6ac-48ef-903a-b737ba10e413 req-cc785dfb-4276-4cf4-9686-8a89d09f7d7d service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:57.404913 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b5c8200e-b6ac-48ef-903a-b737ba10e413 req-cc785dfb-4276-4cf4-9686-8a89d09f7d7d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:57.405397 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b5c8200e-b6ac-48ef-903a-b737ba10e413 req-cc785dfb-4276-4cf4-9686-8a89d09f7d7d service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:57.418814 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b5c8200e-b6ac-48ef-903a-b737ba10e413 req-cc785dfb-4276-4cf4-9686-8a89d09f7d7d service nova] Creating event network-vif-deleted:7acf11d6-6c08-40f8-9c25-741421f2fb04 for instance f015cfb9-f171-4508-b108-b96d355813e3 on n-h1-862416-2 Oct 22 04:40:57.423777 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b5c8200e-b6ac-48ef-903a-b737ba10e413 req-cc785dfb-4276-4cf4-9686-8a89d09f7d7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035362 Oct 22 04:40:57.424417 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4057/7973] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:40:57.612634 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:40:57.613189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:40:57.620697 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:57.621177 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:57.621633 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:57.622338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:57.622797 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:57.623230 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:57.688790 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:40:57.697500 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-972a1f87-1d6a-415b-98d6-733f0ebab520 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1220 microversion: 2.1 time: 0.088892 Oct 22 04:40:57.705019 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3917/7974] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:40:57 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:40:58.722723 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:40:58.723449 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:40:58.730776 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:58.731272 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:58.731739 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:58.732491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:58.732964 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:58.733642 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:58.799385 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:40:58.807827 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a4bcaf94-2b7d-4f4b-b9f0-361a485c77cb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1220 microversion: 2.1 time: 0.090211 Oct 22 04:40:58.808484 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4058/7975] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:40:58 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:40:59.836187 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:40:59.836861 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:40:59.843960 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:59.844483 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:59.844933 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:59.845716 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:40:59.846527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:40:59.846527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:40:59.908881 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:40:59.917633 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c0d9826d-137f-4529-a9b8-c781d723c1eb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1220 microversion: 2.1 time: 0.086232 Oct 22 04:40:59.918202 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3918/7976] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:40:59 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:00.941103 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:00.941835 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:00.948945 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:00.949445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:00.949902 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:00.950617 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:00.951087 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:00.951532 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:01.018631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:01.027113 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-eb097479-9d15-4e11-9ba2-4811e4301c7b tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1220 microversion: 2.1 time: 0.089914 Oct 22 04:41:01.028075 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4059/7977] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:00 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:41:02.053331 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:02.053959 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:02.062387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:02.062964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:02.063397 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:02.064333 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:02.064785 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:02.065411 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:02.103047 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:02.103663 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:02.105090 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:02.105606 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lazy-loading 'fault' on Instance uuid f015cfb9-f171-4508-b108-b96d355813e3 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:41:02.151057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336d5f2120bf44cf8a2b21026ec7873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d7a25ce5146cea6836550cded735a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:02.158218 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9bdccc80-833f-41b8-b056-8de2a2a9f4aa tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 200 len: 1179 microversion: 2.1 time: 0.110392 Oct 22 04:41:02.158802 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3919/7978] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:02 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 1179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:03.183120 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:03.183908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] [instance: f015cfb9-f171-4508-b108-b96d355813e3] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:03.190741 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:03.191246 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:03.191706 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:03.193112 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:03.193595 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:03.194047 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:03.207763 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] HTTP exception thrown: Instance f015cfb9-f171-4508-b108-b96d355813e3 could not be found. Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Request method failure captured: Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 HTTP/1.1 Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU3IjbQ05Klfm6kLLc_IMo2zAaUoPk22jzhS4mG-CrhvNwLnwdL96RWeq1f5K4jPrh2Zci6sdd0c01FD6DNNFuGqP6DWbLUAMsXcx2hwd-OVaDJhkGKX4f2pzeI6N9SEm-jtO9R6SpKpUoj0lOemg7WuzfybEI3c2oCTkkohW1osr6nU Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 335d7a25ce5146cea6836550cded735a Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestShelveInstance-1105288113 Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_335d7a25ce5146cea6836550cded735a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/335d7a25ce5146cea6836550cded735a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/335d7a25ce5146cea6836550cded735a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/335d7a25ce5146cea6836550cded735a"}]}] Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestShelveInstance-1105288113 Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 335d7a25ce5146cea6836550cded735a Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestShelveInstance-1105288113 Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestShelveInstance-1105288113-project Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 336d5f2120bf44cf8a2b21026ec7873d Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestShelveInstance-1105288113-project Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance f015cfb9-f171-4508-b108-b96d355813e3 could not be found. Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': 'f015cfb9-f171-4508-b108-b96d355813e3'} Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f015cfb9-f171-4508-b108-b96d355813e3 could not be found. Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f015cfb9-f171-4508-b108-b96d355813e3 could not be found. Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:41:03.209728 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f015cfb9-f171-4508-b108-b96d355813e3 could not be found. Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Returning 404 to user: Instance f015cfb9-f171-4508-b108-b96d355813e3 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-521c7ac0-58e8-4a1a-9407-af5a51c6dde0 tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3" status: 404 len: 111 microversion: 2.1 time: 0.032042 Oct 22 04:41:03.214486 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4060/7979] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:03 2022] GET /compute/v2.1/servers/f015cfb9-f171-4508-b108-b96d355813e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:41:03.374181 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-1dcdf487-384c-417f-8be1-d715a1fe0afb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] Calling method '.version_select at 0x7f0d1987ba60>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:03.402606 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-1dcdf487-384c-417f-8be1-d715a1fe0afb tempest-TestShelveInstance-1105288113 tempest-TestShelveInstance-1105288113-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1722236225" status: 202 len: 0 microversion: 2.1 time: 0.032263 Oct 22 04:41:03.403537 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3920/7980] 10.222.0.25 () {58 vars in 1254 bytes} [Sat Oct 22 04:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1722236225 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 22 04:41:21.391040 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=12 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:41:21.392549 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=24 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:41:21.596480 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-412b00a6-d7cd-46c4-b7e0-7f2c48e65332 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Action: 'create', calling method: .version_select at 0x7f0d1a3b0310>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1265109935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLd03OaROWwvEL1B6bTwgjQebONZkVmsF2h7K0fJe1N3q4/fF/D4ABW3+xZZEoJn+lNAFDh+64YgtAzLvRqQkxm6M8f5HTvFRqnXGe8AY0pX/ypm1Zk5VGeX9Jo+K8kzMg=="}} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:41:21.616883 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-412b00a6-d7cd-46c4-b7e0-7f2c48e65332 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Getting quotas for project 535bb84d95a84c6c89797ea499716f44. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:41:21.622109 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.quota [None req-412b00a6-d7cd-46c4-b7e0-7f2c48e65332 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Getting quotas for user 535f38558f2444dc978982fe007d273d and project 535bb84d95a84c6c89797ea499716f44. Resources: {'key_pairs'} {{(pid=120581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:41:21.652647 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-412b00a6-d7cd-46c4-b7e0-7f2c48e65332 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.267205 Oct 22 04:41:21.653274 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4061/7981] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Oct 22 04:41:21 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:41:22.629856 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:41:22.630616 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:41:22.635473 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1717664423", "imageRef": "78462069-c4b0-4a1c-b064-2d19ad600046", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1265109935", "security_groups": [{"name": "tempest-secgroup-smoke-1366890786"}], "networks": [{"uuid": "481410e8-435e-43c7-9174-7b0d9bfc2338"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:41:22.873574 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] validate_networks() for [('481410e8-435e-43c7-9174-7b0d9bfc2338', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:41:23.256931 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:41:23.257366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:41:23.257847 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:41:23.258259 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:41:23.258766 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:41:23.267701 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:23.268456 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:23.268901 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:23.269637 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:23.270164 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:23.271093 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:23.289556 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Getting quotas for project 535bb84d95a84c6c89797ea499716f44. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:41:23.294835 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Getting quotas for user 535f38558f2444dc978982fe007d273d and project 535bb84d95a84c6c89797ea499716f44. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:41:23.307519 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:41:23.309887 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='78462069-c4b0-4a1c-b064-2d19ad600046',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:41:23.359508 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-4b5da4db-f27d-4e6c-90aa-d52e26603271 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731717 Oct 22 04:41:23.360387 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3921/7982] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:41:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:41:23.372346 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb37eda0-c725-4442-b3c4-49484cb85301 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:23.372976 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb37eda0-c725-4442-b3c4-49484cb85301 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:23.555900 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb37eda0-c725-4442-b3c4-49484cb85301 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:23.563399 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb37eda0-c725-4442-b3c4-49484cb85301 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1249 microversion: 2.1 time: 0.194919 Oct 22 04:41:23.564056 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4062/7983] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:23 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1249 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:24.590249 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:24.591501 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:24.601754 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:24.602700 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:24.603325 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:24.604242 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:24.604875 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:24.605474 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:24.701878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:24.711017 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-9fed0f42-700c-4d68-b71b-50a85b28ce49 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1319 microversion: 2.1 time: 0.125597 Oct 22 04:41:24.712191 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3922/7984] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:24 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1319 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:25.736554 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:25.737427 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:25.746291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:25.746882 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:25.747379 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:25.748100 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:25.748607 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:25.749054 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:25.887880 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:25.897677 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-111047bc-d03e-49f3-b7ef-d33a46d6fdff tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1375 microversion: 2.1 time: 0.165000 Oct 22 04:41:25.898277 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4063/7985] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:25 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:26.082158 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-fc320000-e1c0-4fe3-8582-ee7ded519a36 req-d4bde84c-1e49-410d-b6ff-4bf51aea6904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b5a038-3918-47a8-91e7-35e073f6700d", "tag": "c76a68d3-1355-40ba-9ffd-1ad09972bc73"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:41:26.093023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fc320000-e1c0-4fe3-8582-ee7ded519a36 req-d4bde84c-1e49-410d-b6ff-4bf51aea6904 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:26.093023 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fc320000-e1c0-4fe3-8582-ee7ded519a36 req-d4bde84c-1e49-410d-b6ff-4bf51aea6904 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:26.093525 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-fc320000-e1c0-4fe3-8582-ee7ded519a36 req-d4bde84c-1e49-410d-b6ff-4bf51aea6904 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:26.105733 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-fc320000-e1c0-4fe3-8582-ee7ded519a36 req-d4bde84c-1e49-410d-b6ff-4bf51aea6904 service nova] Creating event network-changed:c76a68d3-1355-40ba-9ffd-1ad09972bc73 for instance 20b5a038-3918-47a8-91e7-35e073f6700d on n-h1-862416-2 Oct 22 04:41:26.110735 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-fc320000-e1c0-4fe3-8582-ee7ded519a36 req-d4bde84c-1e49-410d-b6ff-4bf51aea6904 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099937 Oct 22 04:41:26.111319 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3923/7986] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:41:26.922920 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:26.923553 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:26.931743 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:26.932352 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:26.932890 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:26.933680 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:26.934229 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:26.934737 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:27.079787 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:27.088189 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-fcd32fb2-6813-4753-a3d5-bee780a4fff6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1375 microversion: 2.1 time: 0.169201 Oct 22 04:41:27.088793 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4064/7987] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:26 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:28.113046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:28.113834 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:28.119966 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:28.120490 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:28.120928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:28.121693 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:28.122151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:28.122579 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:28.258150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:28.265858 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-db6127f1-1e1a-4c2e-897b-4e5b66b1f2f3 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1375 microversion: 2.1 time: 0.157923 Oct 22 04:41:28.266464 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3924/7988] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:28 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:29.291060 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:29.291825 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:29.299614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:29.300129 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:29.300610 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:29.302822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:29.303440 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:29.303885 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:29.451746 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:29.459909 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-afb153f1-1b78-4a1d-a7b9-560731d7bcef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1375 microversion: 2.1 time: 0.173773 Oct 22 04:41:29.460531 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4065/7989] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:29 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:30.483139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:30.483752 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:30.491822 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:30.492400 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:30.492840 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:30.493534 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:30.493984 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:30.494404 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:30.625941 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:30.633947 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bebc2b7f-ac96-442d-951f-a8bf113075a8 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1375 microversion: 2.1 time: 0.154779 Oct 22 04:41:30.634520 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3925/7990] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:30 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:30.961698 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-89c74ef4-78f2-4aa9-93e2-e4045a79606f req-53cf01d4-e9f8-417f-a014-bb1748993aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b5a038-3918-47a8-91e7-35e073f6700d", "name": "network-vif-plugged", "status": "completed", "tag": "c76a68d3-1355-40ba-9ffd-1ad09972bc73"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:41:30.972503 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-89c74ef4-78f2-4aa9-93e2-e4045a79606f req-53cf01d4-e9f8-417f-a014-bb1748993aef service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:30.973034 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-89c74ef4-78f2-4aa9-93e2-e4045a79606f req-53cf01d4-e9f8-417f-a014-bb1748993aef service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:30.974199 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-89c74ef4-78f2-4aa9-93e2-e4045a79606f req-53cf01d4-e9f8-417f-a014-bb1748993aef service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:30.986349 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-89c74ef4-78f2-4aa9-93e2-e4045a79606f req-53cf01d4-e9f8-417f-a014-bb1748993aef service nova] Creating event network-vif-plugged:c76a68d3-1355-40ba-9ffd-1ad09972bc73 for instance 20b5a038-3918-47a8-91e7-35e073f6700d on n-h1-862416-2 Oct 22 04:41:30.991441 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-89c74ef4-78f2-4aa9-93e2-e4045a79606f req-53cf01d4-e9f8-417f-a014-bb1748993aef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034115 Oct 22 04:41:30.992055 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4066/7991] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:41:31.657104 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:31.657732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:31.665481 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:31.665936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:31.666374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:31.667070 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:31.667527 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:31.667964 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:31.797740 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:31.805401 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-ae698c41-0449-4e8f-a112-fb1d95c0e21d tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1375 microversion: 2.1 time: 0.152288 Oct 22 04:41:31.805978 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3926/7992] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:31 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:32.830091 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:32.830810 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:32.837191 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:32.837681 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:32.838128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:32.838826 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:32.839290 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:32.839724 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:32.972733 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:32.981011 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-59abb70f-4baf-4268-9fb3-0012ec829a24 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1560 microversion: 2.1 time: 0.156258 Oct 22 04:41:32.981587 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4067/7993] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:32 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:33.003014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:41:33.003631 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:41:33.010991 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:33.011476 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:33.011923 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:33.012689 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:33.013150 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:33.013583 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:33.151568 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:41:33.159347 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-17b0f658-3e6d-4aa7-995f-c35f7f50ef14 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1560 microversion: 2.1 time: 0.160241 Oct 22 04:41:33.160184 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3927/7994] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:41:32 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:41:35.124692 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-ea8176e0-52c8-4fa2-99a3-039ab0a8ec1c req-89a20ac0-3eab-4f06-8413-b88f0d05faf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b5a038-3918-47a8-91e7-35e073f6700d", "tag": "c76a68d3-1355-40ba-9ffd-1ad09972bc73"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:41:35.129984 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=6 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:41:35.137308 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ea8176e0-52c8-4fa2-99a3-039ab0a8ec1c req-89a20ac0-3eab-4f06-8413-b88f0d05faf7 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:41:35.137795 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ea8176e0-52c8-4fa2-99a3-039ab0a8ec1c req-89a20ac0-3eab-4f06-8413-b88f0d05faf7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:41:35.138235 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-ea8176e0-52c8-4fa2-99a3-039ab0a8ec1c req-89a20ac0-3eab-4f06-8413-b88f0d05faf7 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:41:35.149570 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-ea8176e0-52c8-4fa2-99a3-039ab0a8ec1c req-89a20ac0-3eab-4f06-8413-b88f0d05faf7 service nova] Creating event network-changed:c76a68d3-1355-40ba-9ffd-1ad09972bc73 for instance 20b5a038-3918-47a8-91e7-35e073f6700d on n-h1-862416-2 Oct 22 04:41:35.154813 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-ea8176e0-52c8-4fa2-99a3-039ab0a8ec1c req-89a20ac0-3eab-4f06-8413-b88f0d05faf7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Oct 22 04:41:35.155410 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4068/7995] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:43:32.591974 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [699f8291-3d66-4313-98db-f3446285e6fa] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:43:32.592919 n-d-862416-2 devstack@n-api.service[120582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4937fa55-f991-417b-88b2-9cc53442bf17] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:43:32.593528 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:32.594277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:32.595125 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:32.595877 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=34 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:32.602212 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-865185718"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:43:32.604536 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:32.613194 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:32.614316 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:32.614757 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:32.615459 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:32.615916 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:32.616376 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:32.816182 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-bb1265a3-4ec7-49da-843f-4ee7cf117f01 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "POST /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d/action" status: 202 len: 0 microversion: 2.1 time: 0.225865 Oct 22 04:43:32.817128 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3928/7996] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:43:32 2022] POST /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 04:43:39.502582 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [487d215f-f51f-4b17-90c4-baae2d45644a] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:43:39.509970 n-d-862416-2 devstack@n-api.service[120581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61cb36d1-88e4-4398-80a4-3c83b9903fa2] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 22 04:43:39.510682 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:39.511612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=28 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:39.513366 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:43:39.514196 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:43:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 22 04:43:39.622374 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-6198359f-8f79-47e1-b44b-c12db5f22b74 req-91b3ca7e-c7f3-4acf-9ecb-cc244df46b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b5a038-3918-47a8-91e7-35e073f6700d", "name": "network-vif-plugged", "status": "completed", "tag": "c76a68d3-1355-40ba-9ffd-1ad09972bc73"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:43:39.643816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6198359f-8f79-47e1-b44b-c12db5f22b74 req-91b3ca7e-c7f3-4acf-9ecb-cc244df46b84 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:39.643816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6198359f-8f79-47e1-b44b-c12db5f22b74 req-91b3ca7e-c7f3-4acf-9ecb-cc244df46b84 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:39.643816 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-6198359f-8f79-47e1-b44b-c12db5f22b74 req-91b3ca7e-c7f3-4acf-9ecb-cc244df46b84 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:39.652161 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-6198359f-8f79-47e1-b44b-c12db5f22b74 req-91b3ca7e-c7f3-4acf-9ecb-cc244df46b84 service nova] Creating event network-vif-plugged:c76a68d3-1355-40ba-9ffd-1ad09972bc73 for instance 20b5a038-3918-47a8-91e7-35e073f6700d on n-h1-862416-2 Oct 22 04:43:39.657538 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-6198359f-8f79-47e1-b44b-c12db5f22b74 req-91b3ca7e-c7f3-4acf-9ecb-cc244df46b84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157733 Oct 22 04:43:39.658158 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4069/7997] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:43:46.374638 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-339156958", "imageRef": "6c049f87-b23e-411a-971e-30a13c336ba0", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1265109935", "security_groups": [{"name": "tempest-secgroup-smoke-1366890786"}], "networks": [{"uuid": "481410e8-435e-43c7-9174-7b0d9bfc2338"}]}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:43:46.389226 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:46.389903 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:46.411361 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] [4937fa55-f991-417b-88b2-9cc53442bf17] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39462. Oct 22 04:43:46.412017 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] [699f8291-3d66-4313-98db-f3446285e6fa] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39460. Oct 22 04:43:46.495776 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.network.neutron [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] validate_networks() for [('481410e8-435e-43c7-9174-7b0d9bfc2338', None, None, None, None, None)] {{(pid=120582) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 22 04:43:46.920018 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Flavor limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 22 04:43:46.920496 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Image limits 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 22 04:43:46.920987 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Flavor pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 22 04:43:46.921409 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Image pref 0:0:0 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 22 04:43:46.921832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.virt.hardware [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 22 04:43:46.930586 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:46.931014 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:46.931457 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:46.932195 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:46.932686 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:46.933151 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:46.949895 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Getting quotas for project 535bb84d95a84c6c89797ea499716f44. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 22 04:43:46.955111 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.quota [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Getting quotas for user 535f38558f2444dc978982fe007d273d and project 535bb84d95a84c6c89797ea499716f44. Resources: {'cores', 'instances', 'ram'} {{(pid=120582) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 22 04:43:46.967853 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Going to run 1 instances... {{(pid=120582) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 22 04:43:46.970374 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6c049f87-b23e-411a-971e-30a13c336ba0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 22 04:43:47.023139 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-835eee7a-ca02-4e3f-99ff-a336432beccb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.654088 Oct 22 04:43:47.023785 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3929/7998] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Oct 22 04:43:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 22 04:43:47.037673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b66286ce-98f3-4c0d-aa9e-152922692c23 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:47.038390 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b66286ce-98f3-4c0d-aa9e-152922692c23 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:47.065037 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] [487d215f-f51f-4b17-90c4-baae2d45644a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39476. Oct 22 04:43:47.065785 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] [61cb36d1-88e4-4398-80a4-3c83b9903fa2] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39478. Oct 22 04:43:47.100266 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b66286ce-98f3-4c0d-aa9e-152922692c23 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:47.111048 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b66286ce-98f3-4c0d-aa9e-152922692c23 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1248 microversion: 2.1 time: 0.079725 Oct 22 04:43:47.111725 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4070/7999] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:47 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:48.138652 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:48.139406 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:48.148317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:48.148803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:48.149236 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:48.149981 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:48.150441 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:48.150862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:48.226942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:48.236255 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-3eaee78d-7d30-4e1c-aac1-3ee815ba3c48 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1306 microversion: 2.1 time: 0.103970 Oct 22 04:43:48.236255 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3930/8000] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:48 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:49.260005 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:49.261387 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:49.268949 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:49.269453 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:49.269940 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:49.270663 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:49.271137 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:49.271585 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:49.417736 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:49.428167 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-a49bcf46-918f-4ef3-a32a-e43728935e36 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.171721 Oct 22 04:43:49.429131 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4071/8001] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:49 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:49.529462 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-68e97738-971a-4a7f-ae3f-67318a9a480d req-56ad41ab-4db5-49fb-a6e6-60cf93757630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b5a038-3918-47a8-91e7-35e073f6700d", "name": "network-vif-unplugged", "status": "completed", "tag": "c76a68d3-1355-40ba-9ffd-1ad09972bc73"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:43:49.545237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-68e97738-971a-4a7f-ae3f-67318a9a480d req-56ad41ab-4db5-49fb-a6e6-60cf93757630 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:49.545724 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-68e97738-971a-4a7f-ae3f-67318a9a480d req-56ad41ab-4db5-49fb-a6e6-60cf93757630 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:49.546160 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-68e97738-971a-4a7f-ae3f-67318a9a480d req-56ad41ab-4db5-49fb-a6e6-60cf93757630 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:49.558896 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-68e97738-971a-4a7f-ae3f-67318a9a480d req-56ad41ab-4db5-49fb-a6e6-60cf93757630 service nova] Creating event network-vif-unplugged:c76a68d3-1355-40ba-9ffd-1ad09972bc73 for instance 20b5a038-3918-47a8-91e7-35e073f6700d on n-h1-862416-2 Oct 22 04:43:49.563879 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-68e97738-971a-4a7f-ae3f-67318a9a480d req-56ad41ab-4db5-49fb-a6e6-60cf93757630 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038890 Oct 22 04:43:49.564514 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3931/8002] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:43:50.453579 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:50.454209 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:50.461321 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:50.461822 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:50.462278 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:50.462993 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:50.463466 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:50.463908 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:50.604514 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:50.612534 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-47f822ba-d951-42db-bbc8-a630bb2df882 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.163029 Oct 22 04:43:50.613151 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4072/8003] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:50 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:51.638357 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:51.639165 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:51.645484 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:51.645928 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:51.646371 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:51.647207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:51.647668 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:51.648099 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:51.791139 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:51.799581 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-29c6b6d7-e1fa-40b2-a741-205228ceab46 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.166358 Oct 22 04:43:51.803824 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3932/8004] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:51 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:52.824265 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:52.825276 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:52.833888 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:52.834511 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:52.835383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:52.836241 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:52.836974 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:52.837644 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:52.985626 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:52.995292 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-edb422d9-5df9-4e6f-a034-51e8aef39482 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.174791 Oct 22 04:43:52.998404 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4073/8005] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:52 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:54.019006 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:54.020510 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:54.027769 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:54.028290 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:54.028732 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:54.029440 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:54.029896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:54.030348 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:54.174599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:54.183988 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7bac2ec5-081a-4bfa-b7e8-dff6f8188caa tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.168879 Oct 22 04:43:54.184613 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3933/8006] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:54 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:55.207095 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:55.208389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:55.215615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:55.216128 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:55.216615 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:55.217333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:55.217802 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:55.218239 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:55.363904 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:55.372011 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-6bc342b5-0d9c-4976-b656-678dcbab4ce5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.168862 Oct 22 04:43:55.372735 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4074/8007] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:55 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:56.396403 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:56.396970 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:56.404559 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:56.405046 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:56.405492 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:56.406204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:56.406743 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:56.407091 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:56.575862 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:56.584840 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-990a8933-11a9-4365-bbec-c7bcc867ebef tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.193264 Oct 22 04:43:56.585423 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3934/8008] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:56 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 22 04:43:57.607923 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:57.608575 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:57.611234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell0:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:57.617446 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:57.617955 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:57.618414 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:57.619139 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:57.619614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:57.620064 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:57.760351 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:57.768003 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-b9c81fc3-7c69-43b2-98e9-7fdee74e87f2 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.164058 Oct 22 04:43:57.768599 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4075/8009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:57 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:58.791643 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:43:58.792413 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:43:58.794251 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:58.795061 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell0:SELECT=6 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:43:58.802612 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:58.803106 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:58.808067 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:58.808976 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:58.809446 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:58.809902 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:59.000773 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:43:59.008670 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-5e4e42ab-ea08-4bcf-992e-4ea6dc77c17b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.221090 Oct 22 04:43:59.009250 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3935/8010] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:43:58 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:43:59.521791 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-61d139b4-e487-4318-8100-69726b650cb4 req-7034b35f-392d-4f2c-b923-e3792ed0ea90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec88af2-2762-42e6-8940-b20ba5b4fad0", "tag": "e7281f16-2d93-4f19-90cc-aa144a2bdcc5"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:43:59.535162 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-61d139b4-e487-4318-8100-69726b650cb4 req-7034b35f-392d-4f2c-b923-e3792ed0ea90 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:43:59.536270 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-61d139b4-e487-4318-8100-69726b650cb4 req-7034b35f-392d-4f2c-b923-e3792ed0ea90 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:43:59.537333 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-61d139b4-e487-4318-8100-69726b650cb4 req-7034b35f-392d-4f2c-b923-e3792ed0ea90 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:43:59.550394 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-61d139b4-e487-4318-8100-69726b650cb4 req-7034b35f-392d-4f2c-b923-e3792ed0ea90 service nova] Creating event network-changed:e7281f16-2d93-4f19-90cc-aa144a2bdcc5 for instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 on n-h2-862416-2 Oct 22 04:43:59.556317 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-61d139b4-e487-4318-8100-69726b650cb4 req-7034b35f-392d-4f2c-b923-e3792ed0ea90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039412 Oct 22 04:43:59.556941 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4076/8011] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:44:00.032518 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:00.033186 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:00.041036 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:00.041520 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:00.041955 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:00.042648 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:00.043098 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:00.043523 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:00.181858 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:00.189487 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a99c0615-70bb-40e8-9001-5689252f6ae5 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.160952 Oct 22 04:44:00.190075 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3936/8012] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:00 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:01.212631 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:01.213364 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:01.220492 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:01.220991 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:01.221445 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:01.222153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:01.222652 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:01.223102 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:01.361996 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:01.370596 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-bb61739e-9dbc-47c8-83b1-c195cce4b6c0 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.162452 Oct 22 04:44:01.371196 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4077/8013] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:01 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:02.394254 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:02.394803 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:02.402207 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:02.402684 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:02.403115 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:02.403807 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:02.404280 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:02.404704 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:02.580784 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:02.588566 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-a05a37d5-fd05-45d6-b0ff-77ae92d64b94 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.198303 Oct 22 04:44:02.589146 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3937/8014] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:02 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:03.612155 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:03.612877 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:03.620462 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:03.620957 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:03.621403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:03.622106 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:03.622572 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:03.623010 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:03.755141 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:03.763347 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-da2106b1-5a40-4af8-a4e2-183935b421fb tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.155214 Oct 22 04:44:03.763918 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4078/8015] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:03 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:04.787185 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:04.787794 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:04.794674 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:04.795153 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:04.795591 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:04.796313 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:04.796777 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:04.797204 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:04.930022 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:04.937674 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-e4770a10-ace0-49ac-b741-b9941e7e58de tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.154904 Oct 22 04:44:04.938252 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3938/8016] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:04 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:05.961269 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:05.961926 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:05.968823 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:05.969323 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:05.969779 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:05.970491 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:05.970962 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:05.971411 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:06.032112 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [req-003bfaae-2cf1-4278-867f-03a5bd4f8291 req-b4624b34-bf0d-41c5-855d-50e0ec0417a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec88af2-2762-42e6-8940-b20ba5b4fad0", "name": "network-vif-plugged", "status": "completed", "tag": "e7281f16-2d93-4f19-90cc-aa144a2bdcc5"}]} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:44:06.043936 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-003bfaae-2cf1-4278-867f-03a5bd4f8291 req-b4624b34-bf0d-41c5-855d-50e0ec0417a9 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:06.044545 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-003bfaae-2cf1-4278-867f-03a5bd4f8291 req-b4624b34-bf0d-41c5-855d-50e0ec0417a9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:06.045051 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [req-003bfaae-2cf1-4278-867f-03a5bd4f8291 req-b4624b34-bf0d-41c5-855d-50e0ec0417a9 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:06.057689 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.compute.server_external_events [req-003bfaae-2cf1-4278-867f-03a5bd4f8291 req-b4624b34-bf0d-41c5-855d-50e0ec0417a9 service nova] Creating event network-vif-plugged:e7281f16-2d93-4f19-90cc-aa144a2bdcc5 for instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 on n-h2-862416-2 Oct 22 04:44:06.063106 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [req-003bfaae-2cf1-4278-867f-03a5bd4f8291 req-b4624b34-bf0d-41c5-855d-50e0ec0417a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Oct 22 04:44:06.064117 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3939/8017] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 22 04:44:06.120694 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:06.129083 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-f39e200f-1676-4886-9697-ee4c72b8170f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.172463 Oct 22 04:44:06.131429 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4079/8018] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:05 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:07.155548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:07.156220 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:07.164033 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:07.164544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:07.164978 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:07.165664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:07.166113 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:07.166544 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:07.298548 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:07.306722 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-44332bb4-159f-4849-ab07-c6646e385926 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1374 microversion: 2.1 time: 0.155496 Oct 22 04:44:07.307324 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3940/8019] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:07 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:08.329227 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:08.329839 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:08.337022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:08.337521 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:08.337970 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:08.338673 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:08.339174 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:08.339614 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:08.475268 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:08.483608 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-cd44052d-66e2-4af9-9044-318e08b47636 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1559 microversion: 2.1 time: 0.158314 Oct 22 04:44:08.484400 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4080/8020] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:08 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:08.507883 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:44:08.508526 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:44:08.515297 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:08.515780 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:08.516237 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:08.516945 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:08.517405 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:08.517832 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:08.651920 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:44:08.659640 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-7594c0d9-cd37-4e2f-90b4-7253af81487f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1559 microversion: 2.1 time: 0.155809 Oct 22 04:44:08.660228 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3941/8021] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:44:08 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:44:10.561637 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-624037c8-0199-43e6-a3f7-c03ce29400f2 req-0104a29d-fcf2-4a9d-9975-74de71667acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec88af2-2762-42e6-8940-b20ba5b4fad0", "tag": "e7281f16-2d93-4f19-90cc-aa144a2bdcc5"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:44:10.567433 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=27 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:44:10.574421 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-624037c8-0199-43e6-a3f7-c03ce29400f2 req-0104a29d-fcf2-4a9d-9975-74de71667acd service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:44:10.574910 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-624037c8-0199-43e6-a3f7-c03ce29400f2 req-0104a29d-fcf2-4a9d-9975-74de71667acd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:44:10.575356 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-624037c8-0199-43e6-a3f7-c03ce29400f2 req-0104a29d-fcf2-4a9d-9975-74de71667acd service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:44:10.578234 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=59 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:44:10.588981 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-624037c8-0199-43e6-a3f7-c03ce29400f2 req-0104a29d-fcf2-4a9d-9975-74de71667acd service nova] Creating event network-changed:e7281f16-2d93-4f19-90cc-aa144a2bdcc5 for instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 on n-h2-862416-2 Oct 22 04:44:10.594128 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-624037c8-0199-43e6-a3f7-c03ce29400f2 req-0104a29d-fcf2-4a9d-9975-74de71667acd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036300 Oct 22 04:44:10.594731 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4081/8022] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:46:09.808659 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:46:09.809471 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=66 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:46:09.810272 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:46:09.810470 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0/action (ip 10.222.0.25) !!! Oct 22 04:46:09.812051 n-d-862416-2 devstack@n-api.service[120582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 22 04:46:09.812248 n-d-862416-2 devstack@n-api.service[120582]: Sat Oct 22 04:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0/action (ip 10.222.0.25) !!! Oct 22 04:46:09.817452 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-604011581"}} {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:46:09.819739 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:09.830805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:09.831296 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:09.831772 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:09.832505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:09.832968 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:09.833399 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:10.038219 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-c2f65433-12ea-442f-837c-604d43417a0f tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "POST /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0/action" status: 202 len: 0 microversion: 2.1 time: 0.231505 Oct 22 04:46:10.038904 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3942/8023] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Oct 22 04:46:09 2022] POST /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 22 04:46:16.784577 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:46:16.785420 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=1 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:46:16.786478 n-d-862416-2 devstack@n-api.service[120581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 22 04:46:16.787830 n-d-862416-2 devstack@n-api.service[120581]: Sat Oct 22 04:46:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 22 04:46:16.803999 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-0d25e39b-a767-40e4-85db-0754b5835c74 req-cc822608-8101-462c-8845-a157715d941f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec88af2-2762-42e6-8940-b20ba5b4fad0", "name": "network-vif-plugged", "status": "completed", "tag": "e7281f16-2d93-4f19-90cc-aa144a2bdcc5"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:46:16.814893 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0d25e39b-a767-40e4-85db-0754b5835c74 req-cc822608-8101-462c-8845-a157715d941f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:16.815389 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0d25e39b-a767-40e4-85db-0754b5835c74 req-cc822608-8101-462c-8845-a157715d941f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:16.815841 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-0d25e39b-a767-40e4-85db-0754b5835c74 req-cc822608-8101-462c-8845-a157715d941f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:16.829287 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-0d25e39b-a767-40e4-85db-0754b5835c74 req-cc822608-8101-462c-8845-a157715d941f service nova] Creating event network-vif-plugged:e7281f16-2d93-4f19-90cc-aa144a2bdcc5 for instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 on n-h2-862416-2 Oct 22 04:46:16.835322 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-0d25e39b-a767-40e4-85db-0754b5835c74 req-cc822608-8101-462c-8845-a157715d941f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053103 Oct 22 04:46:16.836501 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4082/8024] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:46:27.895286 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_api:SELECT=2 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:46:27.896059 n-d-862416-2 devstack@n-api.service[120582]: DEBUG dbcounter [-] [120582] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:46:27.901137 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:27.901840 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_api:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:46:27.902896 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:27.903399 n-d-862416-2 devstack@n-api.service[120581]: DEBUG dbcounter [-] [120581] Writing DB stats nova_cell1:SELECT=2 {{(pid=120581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 04:46:27.910318 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:27.910805 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:27.911239 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:27.911942 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:27.912676 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:27.913097 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:27.945021 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:46:27.961384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-d1c99a82-91a1-4643-afa7-3d7ec2d1fde7 req-916ea85b-9573-456c-bfc8-97112e33a801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec88af2-2762-42e6-8940-b20ba5b4fad0", "tag": "e7281f16-2d93-4f19-90cc-aa144a2bdcc5"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:46:27.971541 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1c99a82-91a1-4643-afa7-3d7ec2d1fde7 req-916ea85b-9573-456c-bfc8-97112e33a801 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:27.972042 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1c99a82-91a1-4643-afa7-3d7ec2d1fde7 req-916ea85b-9573-456c-bfc8-97112e33a801 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:27.972573 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-d1c99a82-91a1-4643-afa7-3d7ec2d1fde7 req-916ea85b-9573-456c-bfc8-97112e33a801 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:27.984657 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-d1c99a82-91a1-4643-afa7-3d7ec2d1fde7 req-916ea85b-9573-456c-bfc8-97112e33a801 service nova] Creating event network-changed:e7281f16-2d93-4f19-90cc-aa144a2bdcc5 for instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 on n-h2-862416-2 Oct 22 04:46:27.994521 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-d1c99a82-91a1-4643-afa7-3d7ec2d1fde7 req-916ea85b-9573-456c-bfc8-97112e33a801 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098739 Oct 22 04:46:27.995625 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4083/8025] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:46:28.034399 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-f3ab8731-5c4c-4238-bd30-abf9b1bed9cc tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 204 len: 0 microversion: 2.1 time: 0.140979 Oct 22 04:46:28.035053 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3943/8026] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:46:27 2022] DELETE /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:46:28.044988 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:28.046081 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:28.052657 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:28.053164 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:28.053612 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:28.054548 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:28.055022 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:28.055464 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:28.244077 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:46:28.252328 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-30cb8ebf-0452-4873-9115-c76c8ca0f001 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1683 microversion: 2.1 time: 0.212350 Oct 22 04:46:28.252928 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4084/8027] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:46:28 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1683 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:46:29.276985 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:29.277696 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:29.285122 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:29.285614 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:29.286057 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:29.286761 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:29.287477 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:29.287909 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:29.530934 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:46:29.539050 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-734f17b0-00ef-4664-91d3-95e02726d634 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1683 microversion: 2.1 time: 0.266533 Oct 22 04:46:29.539633 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3944/8028] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:46:29 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:46:30.225020 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-81fcc558-4a21-4e88-9df4-d9d5851bd633 req-1a24f93a-7d30-4e3d-838e-9a20f4be0056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec88af2-2762-42e6-8940-b20ba5b4fad0", "name": "network-vif-deleted", "tag": "e7281f16-2d93-4f19-90cc-aa144a2bdcc5"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:46:30.236373 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-81fcc558-4a21-4e88-9df4-d9d5851bd633 req-1a24f93a-7d30-4e3d-838e-9a20f4be0056 service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:30.236862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-81fcc558-4a21-4e88-9df4-d9d5851bd633 req-1a24f93a-7d30-4e3d-838e-9a20f4be0056 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:30.237310 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-81fcc558-4a21-4e88-9df4-d9d5851bd633 req-1a24f93a-7d30-4e3d-838e-9a20f4be0056 service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:30.249496 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-81fcc558-4a21-4e88-9df4-d9d5851bd633 req-1a24f93a-7d30-4e3d-838e-9a20f4be0056 service nova] Creating event network-vif-deleted:e7281f16-2d93-4f19-90cc-aa144a2bdcc5 for instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 on n-h2-862416-2 Oct 22 04:46:30.254271 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-81fcc558-4a21-4e88-9df4-d9d5851bd633 req-1a24f93a-7d30-4e3d-838e-9a20f4be0056 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033035 Oct 22 04:46:30.254872 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4085/8029] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:46:30.563505 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:30.564118 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:30.571277 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:30.571771 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:30.572229 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:30.573166 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:30.573812 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:30.574247 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:30.610943 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:30.611480 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:30.612030 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:30.612708 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.objects.instance [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lazy-loading 'fault' on Instance uuid 8ec88af2-2762-42e6-8940-b20ba5b4fad0 {{(pid=120582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 22 04:46:30.662892 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:46:30.671290 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-b18bdc22-c954-412a-b783-7d12ad9634e1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 200 len: 1338 microversion: 2.1 time: 0.112228 Oct 22 04:46:30.671881 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3945/8030] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:46:30 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:46:31.696952 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:31.697801 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 8ec88af2-2762-42e6-8940-b20ba5b4fad0] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:31.704790 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:31.705291 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:31.705749 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:31.706458 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:31.706928 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:31.707403 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:31.721721 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.wsgi [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] HTTP exception thrown: Instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 could not be found. Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Request method failure captured: Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: request: GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 HTTP/1.1 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: Accept: application/json Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: Accept-Encoding: identity Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: Connection: close Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: Content-Length: 0 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: Content-Type: application/json Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: Host: 10.222.0.25 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: Openstack-System-Scope: None Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: User-Agent: python-urllib3/1.26.12 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Auth-Token: gAAAAABjU3RrhGV1jba_9veTNWTr_vucdiBTxfY6PZldQEdEOuOHsyW8IzX6ZVhgDnRm9j68nU5D-GMc_DK-FfnCLmad1KzG-Th7g4TyQhDlheuR6PbrhjzFqE1iyzqmwTCYM_5_tBU_Rt92CdmTzyzJHLuuHjIK3nN7tcAJtc1AAHv_-zCwQVg Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Id: None Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Domain-Name: None Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Identity-Status: Confirmed Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Is-Admin-Project: True Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Id: default Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Domain-Name: Default Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Id: 535bb84d95a84c6c89797ea499716f44 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Project-Name: tempest-TestSnapshotPattern-686107919 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Role: member,reader Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Roles: member,reader Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_535bb84d95a84c6c89797ea499716f44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/535bb84d95a84c6c89797ea499716f44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/535bb84d95a84c6c89797ea499716f44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/535bb84d95a84c6c89797ea499716f44"}]}] Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant: tempest-TestSnapshotPattern-686107919 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Id: 535bb84d95a84c6c89797ea499716f44 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-Tenant-Name: tempest-TestSnapshotPattern-686107919 Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-User: tempest-TestSnapshotPattern-686107919-project Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Id: default Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-User-Domain-Name: Default Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-User-Id: 535f38558f2444dc978982fe007d273d Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: X-User-Name: tempest-TestSnapshotPattern-686107919-project Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: method: > Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: exception: Instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 could not be found. Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: action_args: {'id': '8ec88af2-2762-42e6-8940-b20ba5b4fad0'} Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 could not be found. Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 could not be found. Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:46:31.723384 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 could not be found. Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: ERROR nova.api.openstack.wsgi Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Returning 404 to user: Instance 8ec88af2-2762-42e6-8940-b20ba5b4fad0 could not be found. {{(pid=120581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-8dd997ef-9677-4f47-9769-61af2f8869fd tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0" status: 404 len: 111 microversion: 2.1 time: 0.033148 Oct 22 04:46:31.729353 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4086/8031] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:46:31 2022] GET /compute/v2.1/servers/8ec88af2-2762-42e6-8940-b20ba5b4fad0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:46:33.334362 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:33.334863 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:33.337862 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-86b55a97-8d99-41a6-809e-6866500f069a req-1253b0fb-84c6-425b-a3e1-9be9a756427a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b5a038-3918-47a8-91e7-35e073f6700d", "tag": "c76a68d3-1355-40ba-9ffd-1ad09972bc73"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:46:33.342514 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:33.343189 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:33.343629 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:33.344366 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:33.344817 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:33.345493 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:33.348857 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86b55a97-8d99-41a6-809e-6866500f069a req-1253b0fb-84c6-425b-a3e1-9be9a756427a service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:33.349391 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86b55a97-8d99-41a6-809e-6866500f069a req-1253b0fb-84c6-425b-a3e1-9be9a756427a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:33.349843 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-86b55a97-8d99-41a6-809e-6866500f069a req-1253b0fb-84c6-425b-a3e1-9be9a756427a service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:33.362495 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-86b55a97-8d99-41a6-809e-6866500f069a req-1253b0fb-84c6-425b-a3e1-9be9a756427a service nova] Creating event network-changed:c76a68d3-1355-40ba-9ffd-1ad09972bc73 for instance 20b5a038-3918-47a8-91e7-35e073f6700d on n-h1-862416-2 Oct 22 04:46:33.367893 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-86b55a97-8d99-41a6-809e-6866500f069a req-1253b0fb-84c6-425b-a3e1-9be9a756427a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033789 Oct 22 04:46:33.368838 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4087/8032] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:46:33.375338 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Going to try to terminate instance {{(pid=120582) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 22 04:46:33.468476 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-97f19297-6d1c-4ac6-822c-53d214f7a032 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 204 len: 0 microversion: 2.1 time: 0.136759 Oct 22 04:46:33.472305 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3946/8033] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Oct 22 04:46:33 2022] DELETE /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 22 04:46:33.480407 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:33.481153 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.compute.api [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120581) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:33.490019 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:33.490539 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:33.491001 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:33.492013 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:33.492525 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:33.492980 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:33.650771 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.policy [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120581) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:46:33.660421 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-67864928-b34c-45d2-a69f-8e8cb2c49398 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1685 microversion: 2.1 time: 0.185874 Oct 22 04:46:33.676446 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4088/8034] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:46:33 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1685 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:46:34.684599 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:34.685317 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:34.692420 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:34.692914 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:34.693387 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:34.694170 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:34.694630 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:34.695060 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:34.766314 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.policy [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535f38558f2444dc978982fe007d273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535bb84d95a84c6c89797ea499716f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120582) authorize /opt/stack/nova/nova/policy.py:199}} Oct 22 04:46:34.775228 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-094f90bb-dd5b-4cdd-8763-dfe973204fa6 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 200 len: 1334 microversion: 2.1 time: 0.094881 Oct 22 04:46:34.775839 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3947/8035] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:46:34 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 22 04:46:35.384041 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [req-b584e17e-d642-40b8-ae04-df17c337b811 req-86878043-4cdc-454c-b137-8c3400f76d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b5a038-3918-47a8-91e7-35e073f6700d", "name": "network-vif-deleted", "tag": "c76a68d3-1355-40ba-9ffd-1ad09972bc73"}]} {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 22 04:46:35.394383 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b584e17e-d642-40b8-ae04-df17c337b811 req-86878043-4cdc-454c-b137-8c3400f76d1f service nova] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:35.394869 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b584e17e-d642-40b8-ae04-df17c337b811 req-86878043-4cdc-454c-b137-8c3400f76d1f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:35.395311 n-d-862416-2 devstack@n-api.service[120581]: DEBUG oslo_concurrency.lockutils [req-b584e17e-d642-40b8-ae04-df17c337b811 req-86878043-4cdc-454c-b137-8c3400f76d1f service nova] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:35.406616 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.compute.server_external_events [req-b584e17e-d642-40b8-ae04-df17c337b811 req-86878043-4cdc-454c-b137-8c3400f76d1f service nova] Creating event network-vif-deleted:c76a68d3-1355-40ba-9ffd-1ad09972bc73 for instance 20b5a038-3918-47a8-91e7-35e073f6700d on n-h1-862416-2 Oct 22 04:46:35.411358 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [req-b584e17e-d642-40b8-ae04-df17c337b811 req-86878043-4cdc-454c-b137-8c3400f76d1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031040 Oct 22 04:46:35.412340 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4089/8036] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Oct 22 04:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 22 04:46:35.799264 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '>' {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:35.799878 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.compute.api [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] [instance: 20b5a038-3918-47a8-91e7-35e073f6700d] Fetching instance by UUID {{(pid=120582) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 22 04:46:35.806738 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:35.807224 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:35.807664 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:35.808391 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Acquiring lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 22 04:46:35.808849 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 22 04:46:35.809281 n-d-862416-2 devstack@n-api.service[120582]: DEBUG oslo_concurrency.lockutils [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Lock "8445e6fb-6264-4dcd-8d49-6689c2f27048" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 22 04:46:35.822486 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.wsgi [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] HTTP exception thrown: Instance 20b5a038-3918-47a8-91e7-35e073f6700d could not be found. Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Request method failure captured: Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: request: GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d HTTP/1.1 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: Accept: application/json Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: Accept-Encoding: identity Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: Connection: close Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: Content-Length: 0 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: Content-Type: application/json Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: Host: 10.222.0.25 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: Openstack-System-Scope: None Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: User-Agent: python-urllib3/1.26.12 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Auth-Token: gAAAAABjU3RrhGV1jba_9veTNWTr_vucdiBTxfY6PZldQEdEOuOHsyW8IzX6ZVhgDnRm9j68nU5D-GMc_DK-FfnCLmad1KzG-Th7g4TyQhDlheuR6PbrhjzFqE1iyzqmwTCYM_5_tBU_Rt92CdmTzyzJHLuuHjIK3nN7tcAJtc1AAHv_-zCwQVg Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Id: None Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Domain-Name: None Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Identity-Status: Confirmed Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Is-Admin-Project: True Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Id: default Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Domain-Name: Default Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Id: 535bb84d95a84c6c89797ea499716f44 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Project-Name: tempest-TestSnapshotPattern-686107919 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Role: member,reader Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Roles: member,reader Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_535bb84d95a84c6c89797ea499716f44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/535bb84d95a84c6c89797ea499716f44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/535bb84d95a84c6c89797ea499716f44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/535bb84d95a84c6c89797ea499716f44"}]}] Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant: tempest-TestSnapshotPattern-686107919 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Id: 535bb84d95a84c6c89797ea499716f44 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-Tenant-Name: tempest-TestSnapshotPattern-686107919 Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-User: tempest-TestSnapshotPattern-686107919-project Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Id: default Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-User-Domain-Name: Default Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-User-Id: 535f38558f2444dc978982fe007d273d Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: X-User-Name: tempest-TestSnapshotPattern-686107919-project Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: method: > Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: exception: Instance 20b5a038-3918-47a8-91e7-35e073f6700d could not be found. Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: action_args: {'id': '20b5a038-3918-47a8-91e7-35e073f6700d'} Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: {{(pid=120582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b5a038-3918-47a8-91e7-35e073f6700d could not be found. Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b5a038-3918-47a8-91e7-35e073f6700d could not be found. Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 22 04:46:35.824124 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b5a038-3918-47a8-91e7-35e073f6700d could not be found. Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: ERROR nova.api.openstack.wsgi Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: DEBUG nova.api.openstack.wsgi [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Returning 404 to user: Instance 20b5a038-3918-47a8-91e7-35e073f6700d could not be found. {{(pid=120582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: INFO nova.api.openstack.requestlog [None req-91f9732e-eb03-4252-b8d1-d21c8824cff1 tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d" status: 404 len: 111 microversion: 2.1 time: 0.030265 Oct 22 04:46:35.830647 n-d-862416-2 devstack@n-api.service[120582]: [pid: 120582|app: 0|req: 3948/8037] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Oct 22 04:46:35 2022] GET /compute/v2.1/servers/20b5a038-3918-47a8-91e7-35e073f6700d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 22 04:46:35.984370 n-d-862416-2 devstack@n-api.service[120581]: DEBUG nova.api.openstack.wsgi [None req-087fe13c-427f-43cb-b595-0940f8964e1b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] Calling method '.version_select at 0x7f0d1a23d160>' {{(pid=120581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 22 04:46:36.010163 n-d-862416-2 devstack@n-api.service[120581]: INFO nova.api.openstack.requestlog [None req-087fe13c-427f-43cb-b595-0940f8964e1b tempest-TestSnapshotPattern-686107919 tempest-TestSnapshotPattern-686107919-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1265109935" status: 202 len: 0 microversion: 2.1 time: 0.030082 Oct 22 04:46:36.010771 n-d-862416-2 devstack@n-api.service[120581]: [pid: 120581|app: 0|req: 4090/8038] 10.222.0.25 () {58 vars in 1257 bytes} [Sat Oct 22 04:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1265109935 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)